JP4992931B2 - Information processing apparatus and method, program, and recording medium - Google Patents

Description

  The present invention relates to an information processing apparatus and method, a program, and a recording medium for recording and reproducing a sub-picture such as a video and accompanying subtitles and graphics.

  When recording a video material such as a movie on a package medium such as a disk medium, a stream in which a video stream and accompanying audio, subtitles, and graphics are multiplexed is recorded. For example, in a DVD (Digital Versatile Disc or Digital Video Disc), a video stream encoded with MPEG2 and accompanying audio and sub-picture (meaning video information other than the main video such as subtitles, graphics, and still images) MPEG2 program stream is recorded.

  On a DVD program stream, the data address of a certain video frame and the data address of a sub-picture unit displayed in synchronization with the video are often not adjacent. One sub-picture unit is divided into packs having a length of 2048 bytes, and each pack is discretely arranged on the stream.

  First, when an audio video stream (hereinafter referred to as an AV stream) is recorded on a disc, an address table in which the position of an I picture in the stream is recorded to enable special playback such as high-speed playback. Has been proposed by the present applicant (see, for example, Patent Document 1).

When a multiplexed AV stream (for example, an MPEG2 program stream file of a DVD video) in which video, audio, and subpicture are multiplexed is recorded on a disk medium, random access reproduction is performed as shown in FIG. First, the address of a pack at which a sub-picture to be reproduced in synchronization with an I picture of a reproduction time PTS (Presentation Time Stamp; reproduction output time management information) to be randomly accessed is obtained. FIG. 1 shows a pack in which an I picture of playback time PTS that Pm1 wants to access starts.

  Data reading is started from the obtained sub-picture address. FIG. 1 shows a pack in which a sub-picture that is played back in synchronization with an I-picture of playback time PTS that Ps1 wants to access is started. The read operation is continued until all the data of the sub picture is read. In FIG. 1, Ps1, Ps2,..., Psn indicate n packs containing all data of the sub-picture. In this read operation, pack data other than sub-pictures existing between sub-picture packs must also be read.

  When this read is completed, the jump is made to the address of the pack Pm1 where the I picture of the reproduction time to be randomly accessed starts. Then, reading is resumed from that address. As a result, it is possible to reproduce the randomly accessed video and the sub-picture synchronized therewith.

  In addition to a method for recording video and its associated encoded audio and encoded sub-pictures into one multiplexed stream and recording this multiplexed stream, the video stream and its associated sub-pictures are separated into separate streams. There is a way to record as. In this case, the player needs to simultaneously read a plurality of streams from the recording medium and decode them simultaneously.

  FIG. 2 shows that a main AV stream (a stream in which audio packets and video packets are multiplexed) and a sub stream (a stream in which sub-picture packets other than the main stream audio and video are multiplexed) are separately recorded on a recording medium. The reproduction method when it is done is shown. On the disc, each stream is recorded in a continuous recording area.

  The player starts reading the main AV stream, and when the substream data is needed, jumps to the substream (jump 1), reproduces the substream, and finishes reading the data in the necessary substream. Then, a jump is made to return to reading of the main AV stream (jump 2). Data read from each stream is supplied to a decoder so that it can be continuously reproduced. As described above, two jump operations are required after the main AV stream stops being read and then restarted.

JP 2002-158972 A

  As shown in FIG. 1, when video and accompanying audio, subtitles, and graphics are recorded as one multiplexed stream, it is not easy to extract sub-picture data from the stream during random access reproduction. That is, since it is necessary to read data other than the sub-picture, there is a problem that the amount of data that needs to be read increases.

  As shown in FIG. 2, in the method of recording the video stream and the accompanying subtitles and graphics as separate streams, a jump is necessary when switching between readings because the player reads the two streams alternately from the disc. It is. Furthermore, in order to supply each stream to the decoder so that each read stream can be continuously reproduced, it is necessary to keep the bit rate of the stream low. Therefore, since the encoding bit rate of the video stream has to be lowered, there is a problem that the encoded image quality of video or the like is lowered.

  Accordingly, an object of the present invention is to enable a player to easily read a substream when a subtitle associated with a main stream such as audio video or a substream of a subpicture such as graphics is recorded on a recording medium. It is also possible to provide an information processing apparatus and method, a program, and a recording medium that can reduce the bit rate of the main stream.

To solve the problems described above, the present invention is synchronized with the main multiplex stream multiplexed by a unit of packet and the audio and video streams with reference to the time reference signal, and an audio stream and video stream playback re recording medium interleaved one stream is recorded so that the multiplexed sub multiplexed stream alternately positioned in 1GOP units with reference to a packet unit image stream time reference signal an information processing apparatus that eggplant,
Packet ID values representing packet attributes of all the elementary streams in the main multiplexed stream and sub-multiplexed stream are not duplicated,
The packet ID of the packet transmitting the time reference signal is the same between the main multiplexed stream and the sub-multiplexed stream,
A table for describing the identification number of the program, a list of packet IDs of transport packets in which each stream of video, audio, etc. constituting the program is transmitted, and a table for describing the auxiliary information, of the main multiplexed stream and the sub multiplexed stream Each is to have,
Reproduced data is supplied to the buffer memory, the output data of the buffer memory is supplied, based on the packet ID, a packet for transmitting the time reference signal from the playback data, video stream, audio stream, and image stream Separating means for separating each of
Time reference standard value of a packet for transmitting the time reference signal separated by the separating means from the playback stream is set, the time reference generating means for generating a time reference signal,
Video packets and audio packets separated by the separation means is supplied, a first decoding means for Gosuru restore the video and audio streams to ignore the decode time stamp,
Image packets separated by the separation means is supplied, a second decoding means for Gosuru restore the image stream, ignoring the decode time stamp,
The video signal output from the first decoding unit and the image signal output from the second decoding unit are combined to generate a display video signal. Based on the time reference signal generated by the time reference generation unit Thus, the information processing apparatus includes a display video signal and a means for outputting the audio signal output from the first decoding means in synchronization .

The present invention includes a main multiplexed streams multiplexed in packets and the audio and video streams with reference to the time reference signal, the image stream is a time reference signal to be reproduced in synchronism with audio and video streams a reference to multiplexed sub multiplexed stream and is that re-forms a recording medium interleaved one stream are recorded so as to be positioned alternately 1GOP unit information processing method in packet units ,
Packet ID values representing packet attributes of all the elementary streams in the main multiplexed stream and sub-multiplexed stream are not duplicated,
The packet ID of the packet transmitting the time reference signal is the same between the main multiplexed stream and the sub-multiplexed stream,
A table for describing the identification number of the program, a list of packet IDs of transport packets in which each stream of video, audio, etc. constituting the program is transmitted, and a table for describing the auxiliary information, of the main multiplexed stream and the sub multiplexed stream Each is to have,
Reproduced data is supplied to the buffer memory, the output data of the buffer memory is supplied, based on the packet ID, a packet for transmitting the time reference signal from the playback data, video stream, audio stream, and image stream Separating steps to separate each;
Time reference standard value of a packet for transmitting the time reference signal separated by the separation step from play stream is set, the time reference generating step of generating a time reference signal,
Video packets and audio packets separated by the separation step is supplied, a first decoding step of decrypt the video and audio streams to ignore the decode time stamp,
A second decoding step, wherein the image packet separated by the separation step is supplied and the image stream is decoded ignoring the decoding time stamp;
A video signal for display is generated by synthesizing the video signal obtained in the first decoding step and the image signal obtained in the second decoding step, and based on the time reference signal generated in the time reference generation step, Outputting the display video signal and the audio signal output from the first decoding step in synchronization ;
Is an information processing method.

The present invention includes a main multiplexed streams multiplexed in packets and the audio and video streams with reference to the time reference signal, the image stream is a time reference signal to be reproduced in synchronism with audio and video streams in reference to multiplexed sub multiplexed stream and a program interleaved re eggplant that information processing method of one of the recording media stream is recorded so as to be positioned alternately 1GOP units in packets There,
Packet ID values representing packet attributes of all the elementary streams in the main multiplexed stream and sub-multiplexed stream are not duplicated,
The packet ID of the packet transmitting the time reference signal is the same between the main multiplexed stream and the sub-multiplexed stream,
A table for describing the identification number of the program, a list of packet IDs of transport packets in which each stream of video, audio, etc. constituting the program is transmitted, and a table for describing the auxiliary information, of the main multiplexed stream and the sub multiplexed stream Each is to have,
Reproduced data is supplied to the buffer memory, the output data of the buffer memory is supplied, based on the packet ID, a packet for transmitting the time reference signal from the playback data, video stream, audio stream, and image stream Separating steps to separate each;
Time reference standard value of a packet for transmitting the time reference signal separated by the separation step from play stream is set, the time reference generating step of generating a time reference signal,
Video packets and audio packets separated by the separation step is supplied, a first decoding step of decrypt the video and audio streams to ignore the decode time stamp,
A second decoding step, wherein the image packet separated by the separation step is supplied and the image stream is decoded ignoring the decoding time stamp;
A video signal for display is generated by synthesizing the video signal obtained in the first decoding step and the image signal obtained in the second decoding step, and based on the time reference signal generated in the time reference generation step, Outputting the display video signal and the audio signal output from the first decoding step in synchronization ;
Is a program of an information processing method .

The present invention includes a main multiplexed streams multiplexed in packets and the audio and video streams with reference to the time reference signal, the image stream is a time reference signal to be reproduced in synchronism with audio and video streams in reference to multiplexed sub multiplexed stream and a program interleaved re eggplant that information processing method of one of the recording media stream is recorded so as to be positioned alternately 1GOP units in packets There,
Packet ID values representing packet attributes of all the elementary streams in the main multiplexed stream and sub-multiplexed stream are not duplicated,
The packet ID of the packet transmitting the time reference signal is the same between the main multiplexed stream and the sub-multiplexed stream,
A table for describing the identification number of the program, a list of packet IDs of transport packets in which each stream of video, audio, etc. constituting the program is transmitted, and a table for describing the auxiliary information, of the main multiplexed stream and the sub multiplexed stream Each is to have,
Reproduced data is supplied to the buffer memory, the output data of the buffer memory is supplied, based on the packet ID, a packet for transmitting the time reference signal from the playback data, video stream, audio stream, and image stream Separating steps to separate each;
Time reference standard value of a packet for transmitting the time reference signal separated by the separation step from play stream is set, the time reference generating step of generating a time reference signal,
Video packets and audio packets separated by the separation step is supplied, a first decoding step of decrypt the video and audio streams to ignore the decode time stamp,
A second decoding step, wherein the image packet separated by the separation step is supplied and the image stream is decoded ignoring the decoding time stamp;
A video signal for display is generated by synthesizing the video signal obtained in the first decoding step and the image signal obtained in the second decoding step, and based on the time reference signal generated in the time reference generation step, Outputting the display video signal and the audio signal output from the first decoding step in synchronization ;
A recording medium having a program of the information processing method is recorded readably by a computer having a.

  In the present invention, the main stream such as audio video and the substreams such as subtitles and graphics accompanying the main stream are continuously recorded by interleaving, so that jumping can be performed by switching between reading of the main stream and substream. It is unnecessary. Therefore, it is not necessary to lower the encoding bit rate of the stream in order to ensure that the stream is supplied to the decoder so that each stream can be continuously reproduced, and there is no problem that the image quality of video or the like deteriorates.

  In the present invention, since the stream is encoded so that the main stream and the substream refer to a common time reference signal (STC), synchronous reproduction of the main stream and the substream can be facilitated.

  Since the streams are encoded so that the packet ID values of all the elementary streams in the main stream and the substream do not overlap, demultiplexing (separation) of each elementary stream can be facilitated.

FIG. 10 is a schematic diagram for explaining a conventional method for randomly accessing and reproducing a stream in which main AV data and sub-pictures are multiplexed. It is a basic diagram for demonstrating the conventional reproduction | regeneration method at the time of recording the conventional AV stream and a substream as a separate stream. It is a basic diagram for demonstrating the recording method of the main stream and substream by this invention. It is a basic diagram for demonstrating the recording method by this invention in the case of a transport stream. It is a block diagram which shows the structure of an example of the recorder system by this invention. It is a flowchart which shows the flow of a process of the recording method by this invention. It is a block diagram which shows the structure of an example of the player system by this invention. It is a block diagram which shows the structure of the other example of the player system by this invention. It is a flowchart which shows the flow of a process of the reproducing method of the other example of the player system by this invention. It is a basic diagram for demonstrating the method of carrying out the random access reproduction | regeneration of the two transport streams recorded by interleaving by this invention.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 3 shows an example of a recording data generation method according to the present invention. A main multiplexed audio video stream file such as audio video (hereinafter referred to as a main AV stream as appropriate) and a sub-multiplexed stream file such as subtitles and graphics (hereinafter referred to as a sub stream as appropriate) are separately provided. Generate. These streams are in the format of MPEG2 program streams, for example. These streams are interleaved and recorded on the recording medium as shown in FIG.

In FIG. 3, the main AV stream is divided into data units 1a, 1b, 1c,... For each predetermined time, for example, 1 GOP (Group Of Picture), and the substreams are similarly data units for every predetermined time such as 1 GOP. It is divided into 2a, 2b, 2c,. For example, the sub-stream data unit 2a is reproduced in synchronization with the data unit 1a of the main AV stream. Then, the data units are interleaved so that data units are alternately selected from the main AV stream and the sub-stream to form one stream, and this stream is recorded on the disc. The substream data unit may be recorded before the main stream data unit. The main stream and the substream are encoded with reference to a common time reference signal such as a system time clock STC (System Time Clock). This is to facilitate synchronized playback of the main stream and substream.

  FIG. 4 shows an example in which the main stream and the substream are respectively transport streams. In FIG. 4, one rectangular area represents a transport stream packet. The transport stream packet has a fixed length of 188 bytes and includes a packet ID (PID: Packet Identification) in the header portion. PID is identification information of a stream and indicates an attribute of the stream including the packet.

In addition, a PCR (Program Clock Reference) is inserted in an adaptation field that can be optionally inserted in the header portion of the packet. Each stream PCR refers to a common STC. The STC value serving as the time reference in the decoder is set to the value indicated by the PCR.

  The main stream and substream of the transport stream are interleaved. As described above, the data unit for 1 GOP in the main stream and the data unit for 1 GOP in the substream are interleaved into one stream. It is defined so that PIDs do not overlap in all streams of the main stream and substream. Thereby, as will be described later, the number of demultiplexers can be one in the player system.

  An example of a recorder system according to the present invention will be described with reference to FIG. The video input and the audio input are input to the AV encoder 11 and subjected to encoding and packetization processing. For example, video data is encoded by MPEG2, and audio data is encoded by AC-3. The video elementary stream V to which the time stamp is added from the AV encoder 11 and the audio elementary stream A to which the time stamp is added are input to the multiplexer 12 (denoted as MUX in FIG. 5). The multiplexer 12 encodes the main transport stream. Then, the main transport stream is input to the buffer memory 16.

  Graphics input data and subtitle input data are input to the graphics and subtitle encoder 13 and subjected to encoding and packetization processing. The graphics elementary stream G and the subtitle elementary stream S from the encoder 13 are input to the multiplexer 14. The multiplexer 14 encodes the sub transport stream. Then, the sub transport stream is input to the buffer memory 17.

Each of the multiplexers 12 and 14 performs the following encoding process. That is,
The main stream and the substream are encoded with reference to the common system clock STC from the STC generation unit 15,
Packet IDs (PIDs) of all elementary streams in the main stream and substream are not duplicated,
Preferably, the packet ID (PID) of the packet (PCR packet) transmitting the STC is set to the same value in the main stream and the substream, and the program map table (PMT) is set in the main stream and the substream. Are the same.

  The outputs of the buffer memories 16 and 17 are selected by the switch unit 18 every predetermined time, for example, every 1 GOP, and a stream interleaved with the output of the switch unit 18 is taken out. The buffer memories 16 and 17 and the switch unit 18 constitute an interleave device. The interleaved stream is supplied to the drive unit 19 and recorded on the medium 20. Although not shown, normally, an ECC encoder that performs error correction encoding processing and a digital modulator that performs digital modulation are provided between the switch unit 18 and the drive unit 19.

  The drive unit 19 is configured to rotate a medium (for example, a recordable optical disk) 20 and record recording data at a predetermined writing position by an optical head. The drive unit 19 includes a servo unit for rotation servo of the medium 20, tracking servo for the optical head, and focus servo. The interleaved stream is recorded on the medium 20 by an optical head.

  FIG. 6 is a flowchart showing the flow of processing of the recording method. Although omitted in FIG. 6, in the stage before step S101, the input video data and audio data are encoded, and the graphics data and subtitle data are encoded. .

  In step S101, the PID values of all the elementary streams of the main transport stream (shown as TS in the figure) composed of AV data and the sub transport stream composed of graphics and subtitle data are not duplicated. Determined by value.

  In step S102, the main transport stream and the sub-transport stream are encoded with reference to the common system time clock STC. Preferably, the packet ID (PID) of the packet (PCR packet) transmitting the STC is set to the same value in the main stream and the substream, and the program map table (PMT) is set in the main stream and the substream. Are the same.

  In step S103, the main transport stream and the sub-transport stream are interleaved, and the interleaved stream is recorded on the recording medium.

  FIG. 7 shows a player system that reproduces the main stream and the substream recorded by interleaving as described above. Since the main stream and the substream are interleaved and continuously recorded on the medium, the jump operation of the reading position is not necessary when switching between the reading of the main stream and the substream.

  Data read from a medium such as an optical disk is supplied to the input terminal 31, and the read data is stored in the buffer memory 32. At the output of the buffer memory 32, a deinterleave switch unit 33 is provided. The switch unit 33 inputs the main stream data to the buffer memory 34 and the substream data to the buffer memory 35.

  The main stream data output from the buffer memory 34 is input to a demultiplexer (denoted as DE-MUX in the figure) 36. The demultiplexer 36 determines the attribute of each packet in the main stream based on the PID, and separates the packet data for each attribute based on the determination result. The PCR packet extracted by the demultiplexer 36 is supplied to an STC (system time clock) generator 38.

  The STC generation unit 38 generates a 27 MHz clock and STC based on the PCR value of the PCR packet. For example, the STC generation unit 38 generates a 27 MHz clock by comparing a comparator that compares the output of the PCR with the output of the counter, a low-pass filter to which the output of the comparator is supplied, and an output of the low-pass filter as a control voltage. A VCO (Voltage Controlled Oscillator) and a counter that receives the output of the VCO and outputs the output to the comparator. The value of PCR is set for the counter.

  The demultiplexer 36 separates the audio stream and video stream in the main stream and inputs each stream to the AV decoder 39. The AV decoder 39 decodes each video stream in the audio stream, and the decoded video data and audio data are input to the video composer and the sync controller 41.

  On the other hand, the substream data output from the buffer memory 35 is input to the demultiplexer 37. The demultiplexer 37 separates the graphics stream and the subtitle stream from the substream. The graphics stream and subtitle stream are supplied to the decoder 40. The decoder 40 decodes the graphics stream and the subtitle stream, respectively. The decoded graphics data and subtitle data are input to the video composer and sync controller 41.

  The controller 41 combines the video data and the graphics subtitle data to generate a display video signal. In addition, the controller 41 refers to the presentation time stamps (PTS) of the audio data, video data, and graphics subtitle data, and based on the reference clock STC generated by the STC generation unit 38, the controller 41 converts the audio and video. Output in synchronization.

  Next, another example of the player system to which the present invention is applied will be described. Another example is to simplify the player system by reducing the number of demultiplexers by encoding the main stream and sub-stream recorded on the media as follows.

  The streams are encoded so that the packet ID (PID) values of all elementary streams in the main stream and the substream do not overlap. Thereby, each elementary stream can be demultiplexed (separated) by one demultiplexer.

  In this case, it is preferable that the packet ID (PID) of the packet (PCR packet) transmitting the STC in the main stream and the substream has the same value. In addition, it is preferable that the contents of the program map table (PMT) are the same in the main stream and the substream. That is, substream information is also described in the main stream PMT, and main stream information is also described in the substream PMT. In the MPEG2 transport stream, the program map table describes a program identification number, a list of PIDs of transport packets in which each stream such as video and audio constituting the program is transmitted, and additional information. Is.

  FIG. 8 shows a configuration of another example of a player system that reproduces a main stream and a substream recorded by interleaving. Since the main stream and the substream are interleaved and continuously recorded on the medium, a jump is not necessary when switching between reading of the main stream and the substream.

  Data read from the medium is input from the input terminal 51 and stored in the buffer medium 52. The stream data read from the buffer 52 is input to the demultiplexer 53. The demultiplexer 53 extracts the first PCR packet and sets it as a STC initial value in a counter in the STC (system time clock) generation unit 54. The counter in the STC generation unit 54 functions as a frequency divider circuit having a PLL configuration, and the counter counts a 27 MHz clock from the VCO and outputs an STC.

  The demultiplexer 53 separates audio packets and video packets from the audio video stream, and inputs each packet to the AV decoder 55. The AV decoder 55 decodes the audio stream and the video stream, respectively, and inputs the decoded audio data and video data to the video composer and the sync controller 57.

  Further, the demultiplexer 53 separates the graphics packet and the subtitle packet from the substream, and inputs each packet to the graphics and subtitle decoder 56. The graphics and subtitle decoder 56 decodes the graphics and subtitle data, and inputs the decoded data to the video composer and sync controller 57.

  If there is data in the buffer memory 52, the AV decoder 55 and the graphics and subtitle decoder 56 decode the data, and stop decoding when the buffer memory 52 becomes empty. That is, the AV decoder 55 and the decoder 56 ignore the decoding time stamp (DTS) in the multiplexed stream and decode the stream. The DTS is provided because the decoding order and the reproduction order are different in MPEG. That is, the I picture and the P picture are output to the stream before the B picture.

  The video composer and sync controller 57 synthesizes the video data and graphics subtitle data to generate a display video signal. The controller 57 refers to the presentation time stamps (PTS) of the audio data, video data, and graphics subtitle data, and synchronizes the audio and video based on the reference clock STC from the STC generation unit 54. Output.

  FIG. 9 is a flowchart showing the flow of playback processing in the player system of FIG. In step S201, two transport streams that are interleaved and recorded on the medium are read in the order of data arrangement.

  In step S202, the read data is input to the demultiplexer 53.

  In step S203, the demultiplexer 53 separates the elementary stream from the input data and inputs it to the decoder. That is, the demultiplexer 53 separates the audio stream and the video stream and inputs them to the AV decoder 55. Further, the demultiplexer 53 separates the graphics stream and the subtitle stream from the substream and inputs them to the graphics and subtitle decoder 56.

  In step S204, each decoder ignores the DTS and performs decoding. That is, the AV decoder 55 decodes audio data and video data, and the graphics and subtitle decoder 56 decodes graphics data and subtitle data.

  In step S205, the decoded audio data and video data are input to the video composer and sync controller 57, and the video data and graphics data are combined to generate a display video signal. Also, the audio video is synchronously output with reference to the PTS.

  Next, an example of random access reproduction when the main stream and the substream are recorded on the disc medium by interleaving will be described. Random access reproduction can be facilitated by interleaving and recording data corresponding to a predetermined reproduction time of the main stream and substreams corresponding to the time of synchronous reproduction corresponding thereto.

  FIG. 10 illustrates a random access playback operation. Reference numeral AD1 indicates the address of a packet from which subtitles and graphics are played back in synchronization with an I picture of playback time (PTS) to be randomly accessed. Reference symbol AD2 indicates an address of a packet at which an I picture having a reproduction time (PTS) to be randomly accessed starts.

  Data reading is started from the address AD1 of the packet at which the substream that is played back in synchronization with the I picture of the playback time (PTS) to be randomly accessed starts. Since the main stream and the substream are recorded continuously, a jump operation is not required when switching between reading of the main stream and the substream. As a result, it is possible to play back a video of a location where random access is desired and a substream synchronized therewith.

  The present invention is not limited to the above-described embodiment of the present invention, and various modifications and applications are possible without departing from the spirit of the present invention. For example, the present invention can be applied to communication in which a main stream and a sub stream are transmitted via a network. In the case of the transmission device, the drive unit 19 and the medium 20 in FIG. 5 are changed to the transmission unit. In the case of the receiving device, the received data is supplied to the input terminal 31 in FIG. 7 and the input terminal 51 in FIG.

12, 14 ... multiplexer, 15 ... STC generator, 18 ... interleave switch, 33 ... deinterleave switch, 36, 37 ... demultiplexer, 38 ... STC generator 39: AV decoder, 40 ... Graphics and subtitle decoder, 41 ... Video composer and sync controller

Claims (4)

A main multiplexed streams multiplexed in packet units and the audio and video streams with reference to the time reference signal, an image stream to be reproduced in synchronization with the audio stream and video stream with reference to the time reference signal a sub multiplexed streams multiplexed in packet units Te is a re-forms that the information processing apparatus recording medium interleaved one stream are recorded so as to be positioned alternately 1GOP units,
Packet ID values representing packet attributes of all the elementary streams in the main multiplexed stream and the sub-multiplexed stream are not duplicated,
The packet ID of the packet transmitting the time reference signal is the same between the main multiplexed stream and the sub multiplexed stream,
A table for describing the identification number of the program, the list of packet IDs of the transport packets in which each stream of video, audio, etc. constituting the program is transmitted and the auxiliary information are shown in the main multiplexed stream and the sub multiplexed Each of the stream will have
Reproduced data is supplied to the buffer memory, the output data of the buffer memory is supplied, based on the packet ID, playback packet for transmitting the time reference signal from the data, a video stream, an audio stream, And separating means for separating the image streams,
Time reference standard value of a packet for transmitting the time reference signal separated by said separating means from said playback stream is set, the time reference generating means for generating a time reference signal,
Video packets and audio packets separated by said separating means is supplied, a first decoding means for Gosuru restore the video and audio streams to ignore the decode time stamp,
Image packets separated by said separating means is supplied, a second decoding means for Gosuru restore the image stream, ignoring the decode time stamp,
The video signal output from the first decoding unit and the image signal output from the second decoding unit are combined to generate a display video signal, and the time generated by the time reference generation unit An information processing apparatus comprising: means for synchronously outputting the display video signal and the audio signal output from the first decoding means based on a reference signal . A main multiplexed streams multiplexed in packet units and the audio and video streams with reference to the time reference signal, an image stream to be reproduced in synchronization with the audio stream and video stream with reference to the time reference signal and a sub-multiplexed streams multiplexed in packet units a interleaved one re eggplant that information processing method of the recording medium in which a stream is recorded so as to be positioned alternately 1GOP units Te,
Packet ID values representing packet attributes of all the elementary streams in the main multiplexed stream and the sub-multiplexed stream are not duplicated,
The packet ID of the packet transmitting the time reference signal is the same between the main multiplexed stream and the sub multiplexed stream,
A table for describing the identification number of the program, the list of packet IDs of the transport packets in which each stream of video, audio, etc. constituting the program is transmitted and the auxiliary information are shown in the main multiplexed stream and the sub multiplexed Each of the stream will have
Reproduced data is supplied to the buffer memory, the output data of the buffer memory is supplied, based on the packet ID, playback packet for transmitting the time reference signal from the data, a video stream, an audio stream, And a separation step for separating each of the image streams,
Time reference standard value of a packet for transmitting the time reference signal separated by the separating step from the playback stream is set, the time reference generating step of generating a time reference signal,
Said video packets and audio packets separated by the separation step is supplied, a first decoding step of decrypt the video and audio streams to ignore the decode time stamp,
A second decoding step in which the image packet separated by the separation step is supplied and the image stream is decoded ignoring the decoding time stamp;
The video signal obtained in the first decoding step and the image signal obtained in the second decoding step are combined to generate a display video signal, and the time reference signal generated in the time reference generation step And outputting the display video signal and the audio signal output from the first decoding step in synchronization with each other, and
An information processing method comprising: A main multiplexed streams multiplexed in packet units and the audio and video streams with reference to the time reference signal, an image stream to be reproduced in synchronization with the audio stream and video stream with reference to the time reference signal and a sub-multiplexed streams multiplexed with a program of interleaved one stream recorded by the recording medium again eggplant that an information processing method to be positioned alternately 1GOP units Te packet units ,
Packet ID values representing packet attributes of all the elementary streams in the main multiplexed stream and the sub-multiplexed stream are not duplicated,
The packet ID of the packet transmitting the time reference signal is the same between the main multiplexed stream and the sub multiplexed stream,
A table for describing the identification number of the program, the list of packet IDs of the transport packets in which each stream of video, audio, etc. constituting the program is transmitted and the auxiliary information are shown in the main multiplexed stream and the sub multiplexed Each of the stream will have
Reproduced data is supplied to the buffer memory, the output data of the buffer memory is supplied, based on the packet ID, playback packet for transmitting the time reference signal from the data, a video stream, an audio stream, And a separation step for separating each of the image streams,
Time reference standard value of a packet for transmitting the time reference signal separated by the separating step from the playback stream is set, the time reference generating step of generating a time reference signal,
Said video packets and audio packets separated by the separation step is supplied, a first decoding step of decrypt the video and audio streams to ignore the decode time stamp,
A second decoding step in which the image packet separated by the separation step is supplied and the image stream is decoded ignoring the decoding time stamp;
The video signal obtained in the first decoding step and the image signal obtained in the second decoding step are combined to generate a display video signal, and the time reference signal generated in the time reference generation step And outputting the display video signal and the audio signal output from the first decoding step in synchronization with each other, and
An information processing method program comprising: A main multiplexed streams multiplexed in packet units and the audio and video streams with reference to the time reference signal, an image stream to be reproduced in synchronization with the audio stream and video stream with reference to the time reference signal and a sub-multiplexed streams multiplexed with a program of interleaved one stream recorded by the recording medium again eggplant that an information processing method to be positioned alternately 1GOP units Te packet units ,
Packet ID values representing packet attributes of all the elementary streams in the main multiplexed stream and the sub-multiplexed stream are not duplicated,
The packet ID of the packet transmitting the time reference signal is the same between the main multiplexed stream and the sub multiplexed stream,
A table for describing the identification number of the program, the list of packet IDs of the transport packets in which each stream of video, audio, etc. constituting the program is transmitted and the auxiliary information are shown in the main multiplexed stream and the sub multiplexed Each of the stream will have
Reproduced data is supplied to the buffer memory, the output data of the buffer memory is supplied, based on the packet ID, playback packet for transmitting the time reference signal from the data, a video stream, an audio stream, And a separation step for separating each of the image streams,
Time reference standard value of a packet for transmitting the time reference signal separated by the separating step from the playback stream is set, the time reference generating step of generating a time reference signal,
Said video packets and audio packets separated by the separation step is supplied, a first decoding step of decrypt the video and audio streams to ignore the decode time stamp,
A second decoding step in which the image packet separated by the separation step is supplied and the image stream is decoded ignoring the decoding time stamp;
The video signal obtained in the first decoding step and the image signal obtained in the second decoding step are combined to generate a display video signal, and the time reference signal generated in the time reference generation step And outputting the display video signal and the audio signal output from the first decoding step in synchronization with each other, and
A recording medium on which a program for an information processing method is recorded so as to be readable by a computer.

Images