KR101169488B1 - Data processing device, data processing method, program, program recording medium, data recording medium, and data structure - Google Patents

Abstract

The present invention relates to a data processing apparatus and a data processing method, a program and a program recording medium, a data recording medium and a data structure that enable reading of encoded video data in units of an access unit without analyzing encoded video data. . In step S211, the packet of private_stream_2 used for decoding of coded video data, which is disposed immediately before each of one or more decode start points in the coded video data in units of access units, is searched for. In step S216, the encoded video data is provided in units of access units based on the AU_length indicating the size of each of the access units arranged in the packet of private_stream_2 from the packet of private_stream_2 to the packet of the next private_stream_2. It is read. The present invention can be applied to, for example, a game device using a DVD.

Disc driver, drive interface, video decoder, video output interface, audio decoder, memory, player control module, disc device

Description

Data processing apparatus, data processing method, program recording medium and data recording medium {DATA PROCESSING DEVICE, DATA PROCESSING METHOD, PROGRAM, PROGRAM RECORDING MEDIUM, DATA RECORDING MEDIUM, AND DATA STRUCTURE}

The present invention relates to a data processing apparatus and a data processing method, a program and a program recording medium, a data recording medium and a data structure, and in particular, a data processing apparatus and data enabling high data processing such as, for example, convenience. A processing method, a program and a program recording medium, a data recording medium and a data structure.

In recent years, for example, a DVD (Digital Versatile Disc) has become widespread as a recording medium capable of random access with a large capacity, and a DVD device that performs various processes using a DVD has also become widespread.

As a DVD device, for example, a DVD recorder for recording and reproducing data of a television broadcast program, a car navigation system for recording map information and the like on a DVD, and displaying the map information, and a game on a DVD, for example. And a game device that records the program and executes the program.

In addition, about the DVD, the detail is described in the nonpatent literature 1, for example.

[Non-Patent Document 1] DVD Specifications for Read-Only Disc Part 3; Version 1.1 December 1997

<Start of invention>

Problems to be Solved by the Invention

Like a DVD, a recording medium capable of recording a large amount of data, a DVD device that performs various processing using the same, and the like are requested to perform a high data processing such as convenience for such a large amount of data.

This invention is made | formed in view of such a situation, and is made to be able to perform high data processing, such as convenience.

MEANS FOR SOLVING THE PROBLEMS [

The data processing apparatus of the present invention uses the usage information used for decoding encoded video data disposed immediately before each of the one or more decode start points in the encoded video data in the access unit and in the encoded video data in the access unit. Based on the size information included in the use information, the search means for searching for use information from the encoded data to be included and the video decoder control means for controlling the video decoder for decoding the encoded video data. And supply means for reading encoded video data in units of access units and supplying the same to a video decoder.

According to the data processing method of the present invention, usage information used for decoding encoded video data arranged immediately before each of one or more decode start points in encoded video data in an access unit and encoded video data in an access unit is used. On the basis of the size information included in the usage information, the encoded data is stored in accordance with a search step for searching for use information from the encoded data to be included and a request from the video decoder control means for controlling the video decoder for decoding the encoded video data. And a supply step of reading encoded video data in units of an access unit and supplying the same to a video decoder.

The program of the present invention includes encoded video data in units of an access unit and usage information used for decoding of encoded video data, which is disposed immediately before each of one or more decode start points in the encoded video data in units of an access unit. The access unit from the encoded data, based on the size information included in the usage information, in accordance with a search step for searching for use information from the encoded data and a request from the video decoder control means for controlling the video decoder for decoding the encoded video data. And a supply step of reading encoded video data in units and supplying the same to a video decoder.

The program recorded in the program recording medium of the present invention is decoded in the encoded video data arranged immediately before each of the one or more decode start points in the encoded video data in the access unit and in the encoded video data in the access unit. On the basis of the size information included in the usage information in accordance with a request from a video decoder control means for controlling a video decoder for decoding the encoded video data and a search step for searching for the usage information from the encoded data including the usage information to be used. And a supply step of reading encoded video data in units of an access unit from the encoded data and supplying the same to a video decoder.

The data recording medium and the data structure of the present invention provide one or more decoding start points in encoded video data in an access unit unit and encoded video data in an access unit unit, in which encoded data is obtained by encoding video data in a predetermined unit. A size indicating the size of each of the one or more access units including usage information used for decoding the encoded video data disposed immediately before each, and the usage information disposed between the usage information and the next usage information. It is characterized by including the information.

In the data processing apparatus and data processing method of the present invention, and a program recorded in a program and a program recording medium, usage information is searched for from the encoded data. Then, in response to a request from the video decoder control means for controlling the video decoder for decoding the encoded video data, the encoded video data is read out from the encoded data in units of access units based on the size information included in the usage information, and the video is read. Supplied to the decoder.

Further, in the encoded data and the data structure of the encoded data recorded on the data recording medium of the present invention, the encoded video data in the unit of access unit and the encoded video in the unit of access unit are obtained by encoding video data in a predetermined unit. One or more access units including usage information used for decoding encoded video data, which is disposed immediately before each of the one or more decoding start possible points in the data, and arranged between the usage information and the next usage information. Contains size information indicating each size.

EFFECTS OF THE INVENTION [

According to the present invention, high data processing such as convenience and the like becomes possible. In particular, it is possible to read encoded video data in units of an access unit without analyzing encoded video data.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram showing a hardware configuration example of one embodiment of a disk apparatus to which the present invention is applied.

2 is a block diagram illustrating a configuration example of a software module group executed by the CPU 112.

3 is a block diagram illustrating a configuration example of a buffer control module 215.

4 is a diagram showing an example of the directory structure of the disc 101;

5 is a diagram illustrating syntax of a "PLAYLIST.DAT" file.

Fig. 6 is a diagram illustrating syntax of PlayItem ().

Fig. 7 is a diagram illustrating syntax of PlayListMark ().

Fig. 8 is a diagram showing a relationship between the value of mark_type and the type of Mark ();

Fig. 9 is a diagram showing a relationship between a PlayList (), a PlayItem (), a clip, and a program stream stored in a clip stream file.

10 is a diagram illustrating syntax of a clip information file Clip ().

Fig. 11 is a diagram showing a relationship between stream_id and private_stream_id identifying elementary streams and elementary streams.

Fig. 12 is a diagram illustrating syntax of StaticInfo ().

Fig. 13 is a diagram illustrating syntax of DynamicInfo ().

FIG. 14 is a diagram illustrating syntax of EP_map (). FIG.

FIG. 15 is a diagram illustrating syntax of a program stream, a program stream pack, and a program stream pack header of the MPEG-2 System. FIG.

16 is a diagram illustrating syntax of a PES packet of the MPEG-2 System.

17 is a diagram illustrating syntax of a PES packet of an MPEG-2 System.

18 is a diagram illustrating syntax of a PES packet of an MPEG-2 System.

Fig. 19 is a diagram showing a relationship between a value described in stream_id of PES_packet () and an attribute (type) of an elementary stream in the MPEG-2 System.

20 is a diagram showing a stream_id adopted by a disk device.

Fig. 21 is a diagram showing syntax of private_stream1_PES_payload ().

Fig. 22 is a diagram showing a relationship between a value of private_stream_id and an attribute of an elementary stream stored in private_payload ().

Fig. 23 is a diagram showing syntax of private_stream2_PES_payload ().

FIG. 24 is a diagram illustrating syntax of au_information (). FIG.

25 is a diagram showing a specific example of a "PLAYLIST.DAT" file.

Fig. 26 is a diagram showing specific examples of clip information files "00001.CLP", "00002.CLP", and "00003.CLP".

Fig. 27 is a diagram showing a specific example of EP_map () in the clip information file "00001.CLP".

Fig. 28 is a diagram showing a specific example of PlayListMark () in PlayList # 0 and PlayList # 1.

29 is a flowchart for describing reproduction preprocessing.

30 is a flowchart for describing reproduction processing.

Fig. 31 is a flowchart for explaining a PlayItem change process.

32 is a flowchart for describing time code display processing.

33 is a flowchart for describing stream switching processing.

34 is a flowchart for describing processing of the buffer control module 215.

35 is a flowchart for describing processing of the buffer control module 215.

Fig. 36 is a flowchart for explaining processing of reading a video stream.

Fig. 37 is a flowchart for explaining a process of reading an audio stream.

Fig. 38 is a flowchart for explaining processing of reading a subtitle stream.

39 is a flowchart for explaining resynchronization processing.

40 is a flowchart for explaining mark processing.

Fig. 41 is a flowchart for describing control processing of output attributes.

Fig. 42 is a diagram showing a specific example of a set of pts_change_point and DynamicInfo () described in the clip information file "00003.CLP".

43 is a flowchart for explaining caption display control processing.

44 is a flowchart for explaining capture control processing and background / screen saver processing.

Fig. 45 is a diagram illustrating another syntax of private_stream2_PES_payload ().

Fig. 46 is a diagram illustrating another syntax of au_information ().

<Explanation of symbols for the main parts of the drawings>

101: disk

102: disk drive

111: bus

112: CPU

113: memory

114: drive interface

115: input interface

116: video decoder

117: Audio Decoder

118: video output interface

119: audio output interface

120: video output terminal

121: audio output terminal

201: operating system

210: video content playback program

211: script control module

212 player control module

213: Content Data Supply Module

214: Decode Control Module

214A: Timepiece

215: Buffer Control Module

215A: Buffer

216: video decoder control module

217: audio decoder control module

218: subtitle decoder control module

219 graphics processing module

220: video output module

220A: FIFO

221: audio output module

221A: FIFO

231: Data head pointer storage

232: data write pointer storage unit

233: Video reading function

234: audio reading function

235: subtitle reading function

241: Video read pointer storage

242: stream_id register

243: au_information () register

251: Audio read pointer storage

252: stream_id register

253: private_stream_id register

261: subtitle reading function flag storage unit

262: subtitle reading pointer storage unit

263 stream_id register

264: private_stream_id register

BEST MODE FOR CARRYING OUT THE INVENTION [

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[Hardware Configuration]

1 is a block diagram showing a configuration example of hardware of one embodiment of a disk apparatus to which the present invention is applied.

The disk apparatus of FIG. 1 can be applied to, for example, a disk player, a game apparatus, or a car navigation system.

In the disk apparatus of FIG. 1, the disk 101 is, for example, an optical disk such as a DVD, a magneto-optical disk, a magnetic disk, or the like, and includes content data such as video data, audio data, subtitle data, and the like, Data necessary for reproducing the content data is recorded.

The data (recorded data) recorded on the disk 101 also includes a program executable by a computer as necessary. In addition, in this embodiment, although the disk 101 which is a disk-shaped recording medium is employ | adopted as a recording medium, as a recording medium, a semiconductor memory and a tape-shaped recording medium may be sufficient, for example. In addition, in the disk apparatus of FIG. 1, data that is read from and transmitted to the disk 101 at a distance can be input. In other words, reading of data from the disk 101 is performed by another device connected to the disk device, and the data read by the other device can be received and processed by the disk device. In the disk apparatus, it is also possible to receive and process data delivery from a server or the like which stores the same data as the data recorded on the disk 101 in a storage via a network such as the Internet. The disk device may also receive data from a server or other device, record the data on the disk 101 and then process the data recorded on the disk 101.

The disk 101 is detachably attached to the disk drive 102. The disk drive 102 incorporates an interface (not shown) and is connected to the drive interface 114 through the interface. The disk drive 102 drives the disk 101 mounted therein, reads data from the disk 101 according to a command such as reading from the drive interface 114, and writes the data to the drive interface 114. Processing such as supplying.

The bus 111 includes a central processing unit (CPU) 112, a memory 113, a drive interface 114, an input interface 115, a video decoder 116, an audio decoder 117, and a video output interface 118. ), An audio output interface 119 is connected.

The CPU 112 and the memory 113 form a computer system. That is, the CPU 112 executes a group of software modules described later, which are programs stored in the memory 113, controls the entire disk device, and performs various processes described later. The memory 113 stores a group of software modules executed by the CPU 112. The memory 113 temporarily stores data necessary for the operation of the CPU 112. In addition, the memory 113 can be configured only of the nonvolatile memory or a combination of the volatile memory and the nonvolatile memory. In addition, in the case where a hard disk is installed in the disk device of FIG. 1 and the software module group executed by the CPU 112 is recorded (installed) on the hard disk, the memory 113 is constituted only of volatile memory. It is possible to do

Here, the program (software module group) executed by the CPU 112 can be previously recorded (memorized) in the memory 113 as a recording medium built in the disk device.

Alternatively, the program may be a disk 101, or a remover such as a flexible disk other than the disk 101, a compact disc read only memory (CD-ROM), a magneto optical (MO) disk, a magnetic disk, a memory card, or the like. It can be stored (recorded) temporarily or permanently in a double recording medium. Such a removable recording medium can be provided as so-called package software.

The program can be stored in the memory 113 in advance, or can be installed in the disk device from the above-described removable recording medium. Further, the program is wirelessly transmitted from the download site to the disk device via a satellite for digital satellite broadcasting, or wired to the disk device via a network such as a LAN (Local Area Network) or the Internet, and the disk device. In this way, the program transmitted in this manner can be received by the input interface 115 and installed in the built-in memory 113.

The program may be processed by one CPU or may be distributed by a plurality of CPUs.

The drive interface 114 controls the disk drive 102 under the control of the CPU 112, whereby the data read from the disk 101 by the disk drive 102 via the bus 111, It is supplied to the CPU 112, the memory 113, the video decoder 116, the audio decoder 117, and the like.

The input interface 115 receives a key (button) (not shown) or a signal supplied by a remote controller (remote controller) being operated by a user, and supplies it to the CPU 112 via the bus 111. In addition, the input interface 115 also functions as a communication interface such as a modem (including an ASL (Asymmetric Digital Subscriber Line) modem) or a network interface card (NIC).

The video decoder 116 decodes encoded data (encoded audio data) of video data, which is read from the disc 101 by the disc drive 102 and supplied via the drive interface 114 and the bus 111. The resulting video data is supplied to the CPU 112 or the video output interface 118 via the bus 111.

The audio decoder 117 decodes encoded data (encoded audio data) of audio data, which is read out from the disk 101 by the disk drive 102 and supplied via the drive interface 114 and the bus 111. The resulting audio data is supplied to the CPU 112 or the audio output interface 119 via the bus 111.

The video output interface 118 performs processing necessary for video data supplied via the bus 111 and outputs it from the video output terminal 120. The audio output interface 119 performs processing necessary for audio data supplied through the bus 111 and outputs it from the audio output terminal 121.

The video output terminal 120 is connected to a video output device such as a cathode ray tube (CRT) or a liquid crystal panel (not shown), so that the video data output from the video output terminal 120 is connected to the video output device. Supplied and displayed. The audio output terminal 121 is connected to an audio output device such as a speaker or an amplifier (not shown). Therefore, audio data output from the audio output terminal 121 is supplied to and output from the audio output device.

In addition, the supply of video data and audio data from the disk apparatus to the video output apparatus and the audio output apparatus can be performed by either wired or wireless.

 [Configuration of Software Module Group]

Next, FIG. 2 shows a configuration example of a software module group executed by the CPU 112 of FIG.

The software module group executed by the CPU 112 is roughly divided into an operating system (OS) 201 and a video content reproduction program 210 as an application program.

`` Operating System 201 ''

The operating system 201 starts up for the first time when the power supply of the disk apparatus is turned on (the CPU 112 executes the operating system 201), performs necessary processing such as initial setting, and the like. Call 210).

The operating system 201 provides an infrastructure (infrastructure) service, such as reading a file, to the video content reproduction program 210. That is, the operating system 201, for example, regarding the reading of the file, the disk drive 102 via the drive interface 114 with respect to the request for reading the file from the video content playback program 210. ) To read the data on the disc 101 and to pass it to the video content playback program 210. The operating system 201 also analyzes the file system and the like.

In addition, the operating system 201 has a function of a multitasking process, and can operate a plurality of software modules simultaneously (in terms of appearance) by time division. That is, although the video content reproduction program 210 is composed of several software modules, each software module can operate in parallel.

"Video content player" (210)

The video content playback program 210 includes a script control module 211, a player control module 212, a content data supply module 213, a decode control module 214, a buffer control module 215, and a video decoder control module ( 216, an audio decoder control module 217, a subtitle decoder control module 218, a graphics processing module 219, a video output module 220, and an audio output module 221.

The video content reproducing program 210 is software which plays a central role in the reproduction of the disc 101. When the disc 101 is mounted (inserted) in the disc drive 102, the disc 101 is stored in the content. Is a disc of a format described later that is recorded. In addition, the video content reproducing program 210 reads and executes a script file to be described later from the disc 101, and furthermore, is required for reproducing the content recorded on the disc 101 from the disc 101. The file of the metadata (database information) is read out, and the reproduction of the content is controlled based on the metadata.

Hereinafter, a software module constituting the video content reproduction program 210 of FIG. 2 will be described. In addition, in FIG. 2, the solid line arrow shows the data of a content, and the dotted line arrow shows the control data in principle.

Script Control Module 211

The script control module 211 analyzes and executes a script program (script) described in the script file recorded on the disk 101. In the script program, for example, "the graphics processing module 219 is operated to create and display an image such as a menu", and "the display of the menu is changed in accordance with a signal from a UI (User Interface) such as a remote control. (For example, moving a cursor on a menu), &quot; controlling the player control module 212 &quot;

Player Control Module 212

The player control module 212 refers to metadata (database information) or the like recorded on the disc 101 and performs control related to reproduction of the content. That is, the player control module 212 analyzes, for example, PlayList () and Clip (), which will be described later, recorded on the disc 101, and according to the analysis result, the content data supply module 213 or the like. The decode control module 214 and the buffer control module 215 are controlled. In addition, the player control module 212 controls, for example, stream switching, which will be described later, for switching the stream to be played back in accordance with the instructions from the script control module 211 or the input interface 115. In addition, the player control module 214 acquires the time from the decode control module 214 and performs time display, processing of the mark (Mark) described later, and the like.

`` Content data supply module 213 ''

The content data supply module 213 is based on the control of the player control module 212 or based on the amount of data stored in the buffer control module 215, and the data and metadata of the content from the disk 101. The operating system 201 is requested to read.

The metadata read from the disk 101 by the operating system 201 in response to a request from the content data supply module 213 is supplied to a required module. In addition, the data of the content read from the disk 101 by the operating system 201 in response to a request from the content data supply module 213 is supplied to the buffer control module 215.

"Decode Control Module 214"

The decode control module 214 controls the operations of the video decoder control module 216, the audio decoder control module 217, and the subtitle decoder control module 218 according to the control from the player control module 212. The decode control module 214 also includes a time unit 214A which clocks time, and outputs video data output by the control of the video decoder control module 216 and data to be output in synchronization with the video data. The output of the (output data), that is, the synchronization with the output of the audio data output by the control of the audio decoder control module 217 is managed here.

Buffer control module 215

The buffer control module 215 has a built-in buffer 215A which is a part of the storage area of the memory 113 of FIG. 1, and the content data supply module 213 has an operating system 201 in the buffer 215A. A request is made to temporarily store the data of the content read from the disc 101.

In addition, the buffer control module 215 stores the data stored in the buffer 215A in response to a request of the video decoder control module 216, the audio decoder control module 217, or the subtitle decoder control module 218. The decoder is supplied to the decoder control module 216, the audio decoder control module 217, or the subtitle decoder control module 218.

That is, the buffer control module 215 has a video reading function unit 233, an audio reading function unit 234, and a subtitle reading function unit 235 described in FIG. 3 described later. Then, the buffer control module 215 processes the request for data from the video decoder control module 216 in the video read function unit 233 to process the data stored in the buffer 215A by the video decoder control module. Supply to 216. Similarly, the buffer control module 215 processes the data request in the audio decoder control module 217 by the audio read function unit 234 to process the data stored in the buffer 215A. The subtitle decoder control module 218 processes the data stored in the buffer 215A by supplying the data to the buffer 217 and processing the request for data from the subtitle decoder control module 218 in the subtitle reading function unit 235. Supplies).

`` Video Decoder Control Module 216 ''

The video decoder control module 216 operates the video read function unit 233 (FIG. 3) in the buffer control module 215 to convert data (video coded data) obtained by encoding video data into video access unit units. Therefore, it reads from the buffer 215A of the buffer control module 215 and supplies it to the video decoder 116 of FIG. In addition, the video decoder control module 216 controls the video decoder 116 to decode data in units of a video access unit. In addition, the video decoder control module 216 supplies the video data obtained as a result of the decoding in the video decoder 116 to the graphics processing module 219.

Here, the video access unit is, for example, one picture (one frame or one field) of video data.

Audio Decoder Control Module 217

The audio decoder control module 217 operates the audio read function unit 234 (FIG. 3) in the buffer control module 215 to convert data (audio encoded data) in which audio data is encoded in audio access unit units. The data is read from the buffer 215A of the buffer control module 215 and supplied to the audio decoder 117 of FIG. The audio decoder control module 217 also controls the audio decoder 117 to decode data in units of an audio access unit. In addition, the audio decoder control module 217 supplies the audio data obtained as a result of the decoding in the audio decoder 117 to the audio output module 221.

Here, the audio access unit is a predetermined data amount of audio data (for example, one output in synchronization with one picture). In this embodiment, the audio access unit is, for example, a known fixed length.

"Subtitle decoder control module 218"

The caption decoder control module 218 operates the caption reading function unit 235 (FIG. 3) in the buffer control module 215 to convert the data (caption encoded data) in which caption data is encoded in caption access unit units. The data is read from the buffer 215A of the buffer control module 215. The caption decoder control module 218 also includes caption decode software (not shown) inside to decode the data read from the buffer 215A. The caption decoder control module 218 also supplies the caption data (subtitle image data) obtained as a result of the decoding to the graphics processing module 219.

Here, the caption access unit is a predetermined amount of data of the caption data (for example, one to be output in synchronization with one picture). In this embodiment, the size of the caption access unit is described at the head of the caption access unit, for example.

`` Graphics Processing Module 219 ''

The graphics processing module 219 enlarges or reduces the caption data from the caption decoder control module 218 according to the control (instruction) of the player control module 212, and the video from the video decoder control module 216. Add to the data (overlay). In addition, the graphics processing module 219 enlarges or reduces the size (picture frame) of the video data after addition with the caption data to match the display screen of the video output device connected to the video output terminal 120 of FIG. 1. And the like, and the resulting video data is output to the video output module 220.

In addition, the graphics processing module 219 generates a menu or a message and overlays the output video data according to the instructions (control) of the script control module 211 or the player control module 212.

Further, the graphics processing module 219 is based on the aspect ratio of the video output device connected to the video output terminal 120 of FIG. 1, the information indicating the aspect ratio of the video data recorded on the disc 101, and the like. The aspect ratio of the video data output to the video output module 220 is converted.

That is, for example, when the aspect ratio of the video output device is 16: 9, when the information indicating the aspect ratio of the video data indicates the aspect ratio of 4: 3, the graphics processing module 219 Squeezes (reduces) the video data output to the video output module 220 in the horizontal direction (horizontal direction), and outputs black light left and right. For example, when the aspect ratio of the video output device is 4: 3, when the information indicating the aspect ratio of the video data indicates the aspect ratio of 16: 9, the graphics processing module 219 Squeezes (reduces) the video data output to the video output module 220 in the vertical direction (vertical direction), and puts black light up and down to output it.

In addition, when the aspect ratio of the video output device and the aspect ratio indicated by the information indicating the aspect ratio of the video data are both 4: 3 and 16: 9, the graphics processing module 219 is a video. The video data output to the output module 220 is output as it is without squeeze processing.

In addition, the graphics processing module 219 captures video data currently being processed, for example, in response to a request from the player control module 212. The graphics processing module 219 stores the captured video data or supplies it to the player control module 212.

`` Video output module 220 ''

The video output module 220 exclusively occupies a portion of the memory 113 of FIG. 1 and uses it as a FIFO (First In First Out) 220A (buffer), and uses the video data from the graphics processing module 219. The video data stored in the FIFO 220A is temporarily read out, and output to the video output terminal 120 (Fig. 1) as appropriate.

`` Audio output module 221 ''

The audio output module 221 exclusively occupies a part of the memory 113 of FIG. 1 and uses it as the FIFO 221A (buffer), and audio from the audio decoder control module 217 (audio decoder 117). The data is temporarily stored, and the audio data stored in the FIFO 221A is appropriately read and output to the audio output terminal 121 (Fig. 1).

In the audio output module 221, the audio data from the audio decoder control module 217 is dual data in which the left channel is audio data of "main audio" and the right channel is audio data of "sub audio". In the case of audio data in the (two languages) mode, audio data from the audio decoder control module 217 is output to the audio output terminal 121 in accordance with the audio output mode specified in advance.

That is, when "main audio" is designated as the audio output mode, for example, the audio output module 221 receives the audio data of the left channel of the audio data from the audio decoder control module 217 and the right channel. Is copied as audio data, and the audio data of the left channel and the right channel (audio data of "main audio") is output to the audio output terminal 121. When "negative voice" is designated as the audio output mode, the audio output module 221 uses the audio data of the right channel among the audio data from the audio decoder control module 217 as audio data of the left channel. It copies and outputs audio data (audio data of "negative audio") of the left channel and the right channel to the audio output terminal 121. When the "main unit" is designated as the audio output mode, the audio output module 221 outputs the audio data from the audio decoder control module 217 to the audio output terminal 121 as it is. .

In addition, when the audio data from the audio decoder control module 217 is audio data in the stereo mode, the audio output module 221 is the audio decoder control module 217 regardless of the designation of the audio output mode. The audio data from the terminal is output to the audio output terminal 121 as it is.

Here, the audio output mode can be designated interactively, for example, by a user operating a remote controller or the like on a screen on which a menu generated by the video content reproduction program 210 is displayed.

[Configuration of Buffer Control Module 215]

Next, FIG. 3 shows an example of the configuration of the buffer control module 215 of FIG.

The buffer control module 215 exclusively uses a part of the memory 113 of FIG. 1 as the buffer 215A, and temporarily stores the data read from the disk 101 in the buffer 215A. The buffer control module 215 reads the data stored in the buffer 215A, and reads the data stored in the buffer 215A to the video decoder control module 216, the audio decoder control module 217, or the subtitle decoder control module 218 of FIG. Supply.

That is, the buffer control module 215 has a data head pointer storage unit 231, which is part of the memory 113, and a data write pointer storage unit 232 in addition to the buffer 215A. The reading function unit 233, the audio reading function unit 234, and the subtitle reading function unit 235 are provided.

The buffer 215A is, for example, a ring buffer, which sequentially stores the data read from the disk 101 and overwrites the oldest data after storing the data for the storage capacity. The latest data is stored in an infinite loop, so to speak.

The data head pointer storage unit 231 stores a data head pointer indicating a position (address) of the data stored in the buffer 215A and the oldest data not read from the buffer 215A. do.

The data write pointer storage unit 232 stores a write pointer indicating the position (address) of the buffer 215A to which the latest data read from the disc 101 is written.

Here, the position indicated by the data write pointer is updated in the buffer 215A in the right direction (clockwise) in the figure whenever the data read from the disk 101 is stored, and the data head pointer is The position indicated is updated in the right direction in the figure as the data from the buffer 215A is read. Therefore, among the data stored in the buffer 215A, the valid data, as it were, is the data stored from the position indicated by the data head pointer to the position indicated by the data write pointer in the right direction.

In response to a request from the video decoder control module 216 of FIG. 2, the video reading function unit 233 reads a video stream (elementary stream relating to video data) from the buffer 215A, and controls the video decoder. Supply to module 216. The audio reading function unit 234 also reads an audio stream (elementary stream relating to audio data) from the buffer 215A in response to a request from the audio decoder control module 217 of FIG. 2, and controls the audio decoder. Supply to module 217. The caption reading function unit 235 also reads a caption stream (elementary stream related to the caption data) from the buffer 215A in response to a request from the caption decoder control module 218 of FIG. Supply to module 218.

That is, for example, a program stream (MPEG2-System Program Stream) conforming to MPEG (Moving Picture Experts Group) 2 is recorded on the optical disc 101, and the optical disc 101 is stored in the buffer 215A. The program stream read from) is stored. This program stream is time-division multiplexed with one or more elementary streams, such as a video stream, an audio stream, and a subtitle stream. The video reading function unit 233 has a function of demultiplexing the program stream, and separates and reads the video stream from the program stream stored in the buffer 215A.

Similarly, the audio reading function unit 234 has a function of demultiplexing the program stream and separates the audio stream from the program stream stored in the buffer 215A. The subtitle reading function unit 235 also has a function of demultiplexing the program stream, and separates and reads the subtitle stream from the program stream stored in the buffer 215A.

The video read function unit 233 includes a video read pointer storage unit 241, a stream_id register 242, and an au_information () register 243, which are part of the memory 113 of FIG.

The video read pointer storage unit 241 stores a video read pointer indicating a position (address) of the video stream in the buffer 215A, and the video read function unit 233 stores the buffer 215A. Reads the data stored at the position indicated by the video read pointer as a video stream. The stream_id register 242 interprets a program stream stored in the buffer 215A, and stores a stream_id described later for identifying (specifying) a video stream read from the program stream. The au_information () register 243 stores au_information () described later, which is data (used for reading a video stream) necessary for reading a video stream from the buffer 215A.

The audio read function unit 234 has an audio read pointer storage unit 251, a stream_id register 252, and a private_stream_id register 253 that are part of the memory 113 of FIG.

The audio read pointer storage unit 251 stores an audio read pointer indicating a position (address) of the buffer 215A, and the audio read function unit 234 stores the buffer 215A. Reads the data stored at the position indicated by the audio read pointer as an audio stream. The stream_id register 252 and the private_stream_id register 253 interpret the program stream stored in the buffer 215A, and store stream_id and private_stream_id which will be described later for identifying the audio stream to be read from the program stream.

The subtitle reading function unit 235 includes a subtitle reading function flag storage unit 261 that is part of the memory 113 of FIG. 1, a subtitle reading pointer storage unit 262, a stream_id register 263, and a private_stream_id register ( 264).

The caption reading function flag storage unit 261 stores the caption reading function flag. If the caption reading function flag stored in the caption reading function flag storage unit 261 is 0, for example, the caption reading function unit 235 does not operate and the caption reading function flag storage unit 261 is performed. If the subtitle reading function flag stored in the subtitle is 1, for example, the subtitle reading function unit 235 functions.

The subtitle read pointer storage unit 262 stores a subtitle read pointer indicating the position (address) of the subtitle stream stored in the buffer 215A, and the subtitle read function unit 235 stores the buffer 215A. Reads the data stored at the position indicated by the subtitle read pointer as a subtitle stream. The stream_id register 263 and the private_stream_id register 264 interpret a program stream stored in the buffer 215A, and store stream_id and private_stream_id which will be described later for identifying a subtitle stream to be read from the program stream.

[Description of Data Format of Data Recorded on Disk 101]

Next, the data format of the data recorded on the disc 101 will be described.

4 schematically illustrates the directory structure of the disc 101.

As the file system of the disk 101, for example, an ISO (International Organization for Standardization) -9660 or a UDF (Universal Disk Format: http://www.osta.org/specs/) is used. The files of data recorded on the disk 101 are managed hierarchically by the directory structure. The file system is not limited to the file system described above.

In FIG. 4, a "VIDEO" directory is placed in a root directory representing the origin of a file system, and two directories of a "CLIP" directory and a "STREAM" directory are placed in a "VIDEO" directory.

In the "VIDEO" directory, two data files, a "SCRIPT.DAT" file and a "PLAYLIST.DAT" file, are placed in addition to the two directories of the "CLIP" directory and the "STREAM" directory.

The "SCRIPT.DAT" file is a script file in which a script program is described. In other words, the "SCRIPT.DAT" file describes a script program used for making the reproduction type of the disc 101 interactive. The script program described in this "SCRIPT.DAT" file is analyzed and executed by the script control module 211 of FIG.

In the "PLAYLIST.DAT" file, one or more play lists (PlayList () in FIG. 5 to be described later) in which the reproduction procedure of contents such as video data recorded on the disc 101 is described are stored.

One or more clip information files are placed in the "CLIP" directory, and one or more clip stream files are placed in the "STREAM" directory. 4, three clip information files "00001.CLP", "00002.CLP", and "00003.CLP" are placed in the "CLIP" directory, and three clip stream files "are placed in the" STREAM "directory. 00001.PS "," 00002.PS ", and" 00003.PS ".

The clip stream file stores a program stream obtained by time division multiplexing one or more elementary streams obtained by compressing and encoding one or more pieces of data (streams) such as video data, audio data, and caption data.

The clip information file describes (file) metadata about the clip stream, such as the properties of the corresponding clip stream file.

In other words, the clip stream file and the clip information file correspond one to one. In FIG. 4, a file name is given to a clip stream file according to a naming convention of five characters of number + period + "PS", and the clip information file has the same five letter number + period + as the corresponding clip stream file. The file name is given according to the naming convention of "CLP".

Therefore, whether the file is one of the clip stream file or the clip information file can be identified by the file name extension (the part on the right side of the period), and the corresponding clip stream file and the clip information file are the file names. The identification can be identified by whether or not the parts other than the extension (parts left from the period) match.

The details of each file recorded on the disc 101 will be described below.

`` PLAYLIST.DAT ''

FIG. 5 shows the internal structure (syntax) of the "PLAYLIST.DAT" file under the "VIDEO" directory of FIG.

Here, in Fig. 5, the description of the column of "Syntax" indicates the data structure, and the description of the column of "No. of bits" indicates the bit length of the data of the column of the "Syntax" of the corresponding row. In addition, "bslbf" (bit string left bit first) in the description of the "Mnemonic" column means that the data of the "Syntax" column of the corresponding row is transmitted from the left bit, and "uimsbf" (unsigned integer most significant bit first) means that the data of the column "Syntax" of the corresponding row is an unsigned integer value and is sent from the most significant bit. The same applies to drawings similar to those of FIG. 5 described below.

In the "PLAYLIST.DAT" file, name_length (8 bits) and name_string (255 bytes) for describing information such as the name (file name) and the like are sequentially arranged from the head.

That is, name_length represents the size of the name_string disposed afterwards in number of bytes. name_string represents the name (file name) of the "PLAYLIST.DAT" file.

In the name_string, up to the number of bytes represented by name_length is used as a valid name. For example, when name_length is the value 10, 10 bytes from the head of name_string are interpreted as a valid name.

After name_string, number_of_PlayLists (16 bits) are arranged. number_of_PlayLists represents the number of PlayList () following. After number_of_PlayLists, as many PlayLists () as the number of number_of_PlayLists are disposed.

PlayList () is a play list in which the playback procedure of the clip stream file recorded on the disc 101 is described, and has the following internal structure.

That is, PlayList_data_length (32 bits) is arranged at the head of PlayList (). PlayList_data_length indicates the size of the PlayList ().

After PlayList_data_length, reserved_for_word_alignment (15 bits) and capture_enable_flag_PlayList (1 bit) are sequentially arranged. The 15-bit reserved_for_word_alignment is arranged to take so-called word alignment (align to 16-bit position) at the position of the 1-bit capture_enable_flag_PlayList to be placed thereafter. capture_enable_flag_PlayList permits secondary use of the video data (video data belonging to PlayList ()) corresponding to the video stream reproduced by PlayList () in the disk apparatus of FIG. 1 in which the optical disc 101 is reproduced. 1-bit flag indicating whether or not. If capture_enable_flag_PlayList is 0 or 1, for example, 1, this indicates that secondary use of video data belonging to PlayList () is allowed, and if capture_enable_flag_PlayList is 0 or 1, for example, 0, PlayList ( Indicates that secondary use of video data pertaining to) is not permitted (prohibited).

In addition, although capture_enable_flag_PlayList is set to 1 bit in FIG. 5, capture_enable_flag_PlayList is constituted by a plurality of bits, and it is possible to allow the secondary use of the video data belonging to PlayList () step by step. In other words, the capture_enable_flag_PlayList can be configured with 2 bits, for example. When the value of capture_enable_flag_PlayList is 00B (B indicates that the previous number is binary), secondary use of the video data is prohibited. When the value of capture_enable_flag_PlayList is 01B, the video data is 64 ×. Only secondary use that is reduced to a size of 64 pixels or less can be allowed. In addition, when the value of capture_enable_flag_PlayList is 10B, since there is no limitation on the size, secondary use of video data can be permitted.

In addition, as described above, in the secondary use of video data, it is also possible not to provide a limit on the size but to limit the use. That is, when the value of the capture_enable_flag_PlayList is 01B, the secondary use only in the video content playback application 210 (FIG. 2) is allowed, and when the value of the capture_enable_flag_PlayList is 10B, the video content playback in the disk device of FIG. Secondary use by any application, including application 210, may be allowed. Here, as an application other than the video content reproduction application 210 in the disk apparatus of FIG. 1, for example, an application which performs processing of displaying a wallpaper (background) or a screen saver or the like.

In addition, when capture_enable_flag_PlayList is set to 2 bits as described above, reserved_for_word_alignment disposed before becomes 14 bits because word alignment is taken.

In addition, the capture_enable_flag_PlayList enables not only the secondary use of the video data in the disk device but also the secondary use outside the disk device. Here, in the case where the secondary use of the video data is permitted outside the disk apparatus, the video data is recorded on, for example, a recording medium detachable from the disk apparatus or a recording medium detachable from another apparatus connectable to the disk apparatus. Or to other devices via a network such as the Internet. In this case, the video data can be added with information that limits the number of times the video data is recorded or distributed.

Following capture_enable_flag_PlayList, PlayList_name_length (8 bits) and PlayList_name_string (255 bytes) are sequentially arranged. PlayList_name_length represents the size of the PlayList_name_string arranged afterwards in bytes, and PlayList_name_string represents the name of PlayList ().

After PlayList_name_string, number_of_PlayItems (16 bits) is disposed. number_of_PlayItems represents the number of PlayItem () following.

After number_of_PlayItems, the structure of PlayItem () as many as the number of number_of_PlayItems is described.

Here, in one PlayList (), the reproduction procedure of the content can be described in units of PlayItem ().

Each PlayItem () of the number_of_PlayItems in the PlayList () is given a unique ID in the PlayList (). That is, the first PlayItem () in the PlayList () is assigned with 0 as the ID, and for the following PlayItem (), the first PlayItem () is followed by the first, second,... The ID of the serial number is attached.

After PlayItem () by the number of number_of_PlayItems, one PlayListMark () is arranged. PlayListMark () is a set of Mark () to be described later, which is a display on the time axis of playback performed in accordance with PlayList (). Details thereof will be described later with reference to FIG.

Description of PlayItem ()

Next, FIG. 6 shows the internal structure of PlayItem () included in PlayList () of FIG.

At the head of PlayItem (), length (16 bits) is arranged, and length indicates the size of PlayItem () including it.

Following length, Clip_Information_file_name_length (16 bits) and Clip_Information_file_name (variable length) are sequentially arranged. The Clip_Information_file_name_length indicates the size of the Clip_Information_file_name to be disposed after, in bytes. The Clip_Information_file_name represents the file name of the clip information file (the file whose extension of FIG. 4 is CLP) corresponding to the clip stream file (file whose extension of FIG. 4 is PS) to be played by PlayItem (). The file names of the clip stream file and the clip information file can recognize the file name of the clip information file to be played by PlayItem () from Clip_Information_file_name and specify the clip stream file according to the above-mentioned naming convention.

Following Clip_Information_file_name, IN_time (32 bits) and OUT_time (32 bits) are sequentially arranged.

IN_time and OUT_time are time information specifying the playback start position and playback end position of the clip stream file specified from Clip_Information_file_name, respectively.

According to IN_time, the midpoint (including the leading) of the clip stream file can be designated as the playback start position, and according to OUT_time, the midpoint (including the last) of the clip stream file can be designated as the playback end position. have.

Here, according to PlayItem (), the contents of the clip stream file specified from Clip_Information_file_name from IN_time to OUT_time are played back. The content reproduced by this PlayItem () is hereinafter referred to as a clip as appropriate.

Description of PlayListMark ()

Next, FIG. 7 shows the internal structure of PlayListMark () included in PlayList () of FIG.

PlayListMark () is a set of zero or more Mark (), which is a display on the time axis of playback performed according to PlayList () (Fig. 5) including the PlayListMark () as described above. One Mark () indicates time information indicating one time (position) on the time axis of playback performed in accordance with the PlayList (), type information indicating the type of Mark (), and the type in which the type information generates an event. When present, it has at least argument information that is the argument of the event.

That is, length (32 bits) is arranged at the head of PlayListMark (). length indicates the size of PlayListMark () including it.

After length, number_of_PlayList_marks (16 bits) are arranged, and number_of_PlayList_marks represents the number of Mark () arranged subsequent to it. After number_of_PlayList_marks, the structure of Mark () is described by the number of the number_of_PlayList_marks.

At the head of Mark (), mark_type (8 bits) is arranged. mark_type is the type information described above and indicates the type of Mark () including it.

In the present embodiment, as the type of Mark (), for example, three types of chapters, indexes, and events are prepared.

Mark () whose type is a chapter (hereinafter, appropriately referred to as a chapter mark) is a display of a head position of a chapter which is a unit of the first search for dividing PlayList (). In addition, Mark () whose type is an index (hereinafter, appropriately referred to as an index mark) is a display of the head position of the index, which is a unit of chapter subdivision. The type Mark () of an event (hereinafter, appropriately referred to as an event mark) is an indication of a position that generates an event during reproduction of content according to PlayList (). The occurrence of the event by the event mark is notified to the script control module 211 as described later.

Here, the relationship between the value of mark_type and the type of Mark () is shown in FIG. According to Fig. 8, 1 is set to mark_type of the chapter mark. In addition, 2 is set to mark_type of the index mark, and 3 is set to mark_type of the event mark. In Fig. 8, 0 and 4 to 255 of the 8-bit value indicated by mark_type are reserved for future expansion.

Returning to Fig. 7, after mark_type, mark_name_length (8 bits) is arranged. In addition, mark_name_string (24 bytes) is arrange | positioned at the end of Mark (). mark_name_length and mark_name_string are for describing the name of Mark (), mark_name_length is the effective size of mark_name_string, and mark_name_string is the name of Mark (), respectively. Therefore, the number of bytes indicated by mark_name_length from the head of mark_name_string indicates a valid name of Mark ().

After mark_name_length, the four elements ref_to_PlayItem_id (16 bits), mark_time_stamp (32 bits), entry_ES_stream_id (8 bits), and entry_ES_private_stream_id (8 bits) that map Mark () defined on PlayList () to a clip stream file are sequentially. Is placed.

In ref_to_PlayItem_id, an ID assigned by serial number to PlayItem () to which Mark () belongs is described. By ref_to_PlayItem_id, PlayItem () (Fig. 6) to which Mark () belongs is specified, and further, as described with reference to Fig. 6, a clip information file and a clip stream file are specified.

mark_time_stamp represents the position (time) indicated by Mark () in the clip stream file specified by ref_to_PlayItem_id.

Here, Fig. 9 shows the relationship between PlayList (), PlayItem (), clips, and program streams stored in clip stream files.

In Fig. 9, PlayList () is composed of three PlayItems (), and ID # 0, # 1, and # 2, which are assigned by serial numbers, are attached to each of the three PlayItems (). Here, PlayItem () with ID #i is described as PlayItem #i as follows.

In addition, in FIG. 9, the clip which is the content reproduced by PlayItem # 0, PlayItem # 1, and PlayItem # 2 is shown as clip A, clip B, and clip C, respectively.

The substance of a clip is a program stream from IN_time to OUT_time in a program stream stored in a clip stream file (which is further specified from a clip information file) specified from Clip_Information_file_name in PlayItem () in FIG. In FIG. 9, the program stream as an entity of the clip A, the clip B, and the clip C is shown as the program stream A, the program stream B, and the program stream C, respectively.

For example, in FIG. 9, in Mark () which is a mark of the position (time) t0 on the time axis of playback performed in accordance with PlayList (), its ref_to_PlayItem_id and mark_time_stamp are described as follows.

That is, since time t0 is a time at which PlayItem # 1 is played, 1, which is the ID of the PlayItem # 1, is described in ref_to_PlayItem_id. In addition, at time t0, since program stream B, which is the substance of clip B, is reproduced by PlayItem # 1, mark_time_stamp describes the time corresponding to time t0 in the clip stream file in which program stream B is stored.

7 again, entry_ES_stream_id and entry_ES_private_stream_id are used to specify the elementary stream when Mark () is associated with a specific elementary stream. That is, entry_ES_stream_id describes stream_id described later of the elementary stream (PES_packet () shown in FIGS. 16 to 18 to be described later) to which Mark () is associated. In addition, entry_ES_private_stream_id describes the private_stream_id described later of the elementary stream associated with Mark () (private_header () in private_stream1_PES_payload () shown in FIG. 21 to be described later), which is disposed as needed.

For example, in a clip in which video stream # 1 and video stream # 2 are multiplexed, when the video stream # 1 is being played, and when video stream # 2 is played, the time of chapter generation is to be changed. In the entry_ES_stream_id and entry_ES_private_stream_id of Mark () at the time of chapter mark generation when playing video stream # 1, stream_id and private_stream_id of video stream # 1 are described. Stream_id and private_stream_id of video stream # 2 are described in entry_ES_stream_id and entry_ES_private_stream_id.

In addition, for example, all zeros are described in entry_ES_stream_id and entry_ES_private_stream_id of Mark () not associated with a specific elementary stream.

After entry_ES_private_stream_id, mark_data (32 bits) is disposed. mark_data is argument information which becomes an argument of an event generated by the event mark when Mark () is an event mark. In addition, mark_data can also be used as the chapter or index number indicated by the chapter mark or index mark when Mark () is a chapter mark or an index mark.

Description of Clip ()

Next, the internal structure of the clip information file of the CLP whose extension is placed in the "CLIP" directory of FIG. 4 will be described.

In FIG. 4, three clip information files "00001.CLP", "00002.CLP", and "00003.CLP" are placed in the "CLIP" directory, and each of the clip stream files "00001 placed in the" STREAM "directory. Metadata indicating the properties of ".PS", "00002.PS", "00003.PS", and the like are stored.

Fig. 10 shows the internal structure of such clip information file Clip ().

At the beginning of the clip information file Clip (), presentation_start_time and presentation_end_time (all 32 bits) are sequentially arranged. presentation_start_time and presentation_end_time represent the beginning and the last time of the clip stream file (program stream stored in) corresponding to the clip information file Clip (). In addition, the time of a clip stream file is described by the multiple of 90kHz used by the time of MPEG2-System.

Following presentation_end_time, reserved_for_word_alignment (7 bits) and capture_enable_flag_Clip (1 bit) are sequentially arranged. The 7-bit reserved_for_word_alignment is for word alignment, and capture_enable_flag_Clip is a flag indicating whether secondary use of video data is allowed, similarly to capture_enable_flag_PlayList in FIG. 5 described above.

However, capture_enable_flag_PlayList in FIG. 5 indicates whether to permit secondary use of video data (video data belonging to PlayList ()) corresponding to the video stream played by PlayList (), and capture_enable_flag_Clip in FIG. Indicates whether to permit secondary use of video data corresponding to the video stream (elementary stream of the video) stored in the clip stream file corresponding to the clip information file Clip (). Therefore, in capture_enable_flag_PlayList in FIG. 5 and capture_enable_flag_Clip in FIG. 10, the unit (range) of video data allowing secondary use is different.

In addition, as described in the capture_enable_flag_PlayList in FIG. 5, the capture_enable_flag_Clip in FIG. 10 may also be a plurality of bits instead of one bit.

After capture_enable_flag_Clip, number_of_streams (8 bits) are arranged, and in this number_of_streams, the number of subsequent StreamInfo () structures is described. Therefore, following number_of_streams, the structure of StreamInfo () is described by the number of the number_of_Streams.

At the head of StreamInfo (), length (16 bits) is arranged, and this length indicates the size of StreamInfo () including it. After length, stream_id (8 bits) and private_stream_id (8 bits) are arranged. The stream_id and private_stream_id identify (identify) an elementary stream associated with StreamInfo ().

Here, FIG. 11 shows the relationship between the stream_id and the private_stream_id identifying the elementary stream and the elementary stream.

The stream_id is the same as that defined in the MPEG2-System standard, and its value is determined in advance for each attribute (type) of the elementary stream (data) in the MPEG2-System standard. Therefore, the elementary stream of the attribute defined in the MPEG2-System standard can be specified only by stream_id.

In this embodiment, the elementary stream of attributes not specified in the MPEG2-System standard can also be handled, and private_stream_id identifies an elementary stream of attributes not defined in the MPEG2-System standard. Information for

In FIG. 11, an elementary stream of video encoded by an encoding (decoding) scheme defined in MPEG, and an elementary stream of audio encoded by an ATRAC (Adaptive TRansform Acoustic Coding) scheme (hereinafter, appropriately, ATRAC) Audio streams), elementary streams of audio encoded with Linear Pulse Code Modulation (LPCM) (hereinafter referred to as LPCM audio streams), and elementary streams of subtitles (hereinafter appropriately, subtitles). An elementary stream of four attributes of a stream (called a stream) is shown to have a relationship with stream_id and private_stream_id.

In the MPEG2-System standard, an elementary stream of video encoded by the encoding scheme specified in MPEG is a value in the range of 0xE0 to 0xEF (0x indicates that a subsequent character string is hexadecimal). Multiplexing is specified by using the stream_id for identifying the mentor stream. Therefore, for the elementary stream of video encoded by the encoding method specified in MPEG, the elementary stream of 16 video identified by stream_id having a value in the range of 0xE0 to 0xEF is multiplexed into a program stream. can do.

In addition, since the elementary stream of video encoded by the encoding method specified in MPEG can be identified by stream_id with a value in the range of 0xE0 to 0xEF, private_stream_id is unnecessary (ignored).

In MPEG2-System, stream_id is not defined for ATRAC audio streams, LPCM audio streams, and subtitle streams.

Therefore, in the present embodiment, for the elementary stream in which the stream_id is not defined in the MPEG2-System, 0xBD, which is a value indicating an attribute of the private_stream_1 in the MPEG2-System, is adopted as the stream_id. As described above, identification (specific) is performed using the private_stream_id.

In other words, private_stream_id having a value in the range of 0x00 to 0x0F is used to identify the ATRAC audio stream. Therefore, 16 ATRAC audio streams can be multiplexed into a program stream. In addition, the value private_stream_id in the range of 0x10 to 0x1F is used for identification of an LPCM audio stream. Therefore, 16 LPCM audio streams can be multiplexed into the program stream. In addition, private_stream_id of the value of the range of 0x80-0x9F is used for identification of a subtitle stream. Therefore, 32 subtitle streams can be multiplexed into the program stream.

In addition, stream_id and private_stream_id are mentioned later.

Returning to Fig. 10, after private_stream_id, StaticInfo () and reserved_for_word_alignment (8 bits) are sequentially arranged. In StaticInfo (), information that does not change during reproduction of the elementary stream specified by stream_id and private_stream_id (described in StreamInfo () including the StaticInfo ()) is described. Details of the StaticInfo () will be described later with reference to FIG. 12.

reserved_for_word_alignment is used to align word alignment.

Following reserved_for_word_alignment, number_of_DynamicInfo (8 bits) is arranged, and number_of_DynamicInfo represents the number of sets of pts_change_point (32 bits) and DynamicInfo () arranged subsequently.

Therefore, following the number_of_DynamicInfo, the structure of pts_change_point and DynamicInfo () of the set number of the number_of_DynamicInfo is described.

pts_change_point indicates the time at which the information of DynamicInfo () set with it becomes valid. Here, pts_change_point indicating the start time of the elementary stream is the same as the presentation_start_time described first of the clip information file Clip () corresponding to the clip stream file in which the elementary stream is stored.

DynamicInfo () describes, in other words, dynamic information that changes during reproduction of the elementary stream specified by stream_id and private_stream_id. The information described in DynamicInfo () becomes effective when the playback time indicated by pts_change_point set with it is reached. In addition, the detail of DynamicInfo () is mentioned later with reference to FIG.

After pts_change_point and DynamicInfo () of the same number of number_of_DynamicInfo sets, EP_map () is arranged. In addition, EP_map () is mentioned later with reference to FIG.

StaticInfo () Description

Next, with reference to FIG. 12, the detail of StaticInfo () of FIG. 10 is demonstrated.

12 shows the syntax of StaticInfo ().

StaticInfo () differs in content depending on the attribute (type) of the corresponding elementary stream. The attribute of the elementary stream corresponding to StaticInfo () is determined by stream_id and private_stream_id included in StreamInfo () of FIG. 10 including the StaticInfo ().

If the elementary stream corresponding to StaticInfo () is a video stream (stream == VIDEO), StaticInfo () is word aligned with picture_size (4 bits), frame_rate (4 bits), and cc_flag (1 bit). It consists of reserved_for_word_alingment to take.

picture_size represents the size of video data (picture displayed by) corresponding to the video stream. frame_rate represents a frame frequency of video data corresponding to a video stream. cc_flag represents whether closed caption data is included in the video stream. That is, for example, when the closed caption data is included in the video stream, cc_flag is 1, and when the closed caption data is not included in the video stream, cc_flag is 0.

If the elementary stream corresponding to StaticInfo () is an audio stream (stream == AUDIO), StaticInfo () indicates audio_language_code (16 bits), channel_configuration (8 bits), lfe_existence (1 bit), and sampling_frequency (4 bits). ) And reserved_for_word_alingment for word alignment.

In audio_language_code, a code indicating a language of audio data included in an audio stream is described. channel_configuration represents an attribute of audio data included in an audio stream, such as monaural / stereo / multichannel. lfe_existence indicates whether or not the low-end emphasis channel is included in the audio stream. The value is 1 if it is included and 0 if it is not included. sampling_frequency is information indicating a sampling frequency of audio data included in the audio stream.

If the elementary stream corresponding to StaticInfo () is a subtitle stream (stream == SUBTITLE), StaticInfo () consists of subtitle_language_code (16 bits) and configurable_flag (1 bit) and reserved_for_word_alingment for word alignment. .

In subtitle_language_code, a code indicating the language of the subtitle data included in the subtitle stream is described. configurable_flag is information indicating whether to change the display of caption data contained in the caption stream from the default display method. For example, 1 is described when the display method is allowed to be changed. If not allowed, 0 is written. As the display system of the caption data, there is a display size of the caption data, a display position, a display color, a display pattern (for example, a flashing display, etc.), a display direction (for example, a vertical direction or a horizontal direction), and the like. .

Explanation of DynamicInfo ()

Next, with reference to FIG. 13, the detail of DynamicInfo () of FIG. 10 is demonstrated.

Fig. 13 shows the syntax of DynamicInfo ().

At the head of DynamicInfo (), reserved_for_word_alignment (8 bits) for word alignment is arranged, and the elements that follow differ depending on the attribute of the elementary stream corresponding to DynamicInfo (). The attribute of the elementary stream corresponding to DynamicInfo () is determined by stream_id and private_stream_id included in StreamInfo () of FIG. 10 including DynamicInfo () as in the case of StaticInfo () described in FIG. 12.

In DynamicInfo (), as described with reference to FIG. 10, dynamic information changed during reproduction of the elementary stream is described. Although the dynamic information is not particularly limited, in the embodiment of FIG. 13, the data corresponding to the elementary stream corresponding to DynamicInfo (), that is, the output attribute of the data output by processing the elementary stream ( Output attributes of data obtained from the elementary stream) are described in DynamicInfo ().

Specifically, when the elementary stream corresponding to DynamicInfo () is a video stream (stream == VIDEO), DynamicInfo () consists of display_aspect_ratio (4 bits) and reserved_for_word_alingment for word alignment. diplay_aspect_ratio describes, for example, the aspect ratio of the video data as an output attribute (display method) of the video data corresponding to the video stream. That is, diplay_aspect_ratio describes, for example, information indicating whether the aspect ratio is either 16: 9 or 4: 3. In addition to the aspect ratio, for example, the size (X pixels × Y pixels) of the image displayed by the video data can be described in the DynamicInfo () of the video stream.

When the elementary stream corresponding to DynamicInfo () is an audio stream (stream == AUDIO), DynamicInfo () is composed of channel_assignment (4 bits) and reserved_for_word_alingment for word alignment. In channel_assignment, when two channels of audio data are included in the audio stream, the output attributes (output system) of the two channels are described. In other words, in the channel_assignment, information indicating whether audio data is assigned to a channel of stereo or dual (two languages) is described.

When the elementary stream corresponding to DynamicInfo () is a subtitle stream (stream == SUBTITLE), DynamicInfo () is composed of reserved_for_word_alingment for word alignment. That is, in the embodiment of Fig. 13, the output attribute as dynamic information is not defined with respect to the caption stream.

Explanation of EP_map ()

Next, with reference to FIG. 14, the detail of EP_map () of FIG. 10 is demonstrated.

Fig. 14 shows the syntax of EP_map ().

In EP_map (), the decode of each elementary stream is decoded for each elementary stream multiplexed into the program stream stored in the clip stream file corresponding to the clip information file Clip () of FIG. 10 including the EP_map (). Information of decode startable points that can be started is described.

Here, for a fixed rate stream, the decoding start point can be obtained by calculation, but for a stream having a different size for each video access unit, such as a variable rate stream or a video stream encoded according to the MPEG standard, The decode start point cannot be found by calculation and cannot be found unless the stream is actually parsed. Quickly recognizing the decode start point is important for performing random access, and according to EP_map (), it is possible to quickly recognize the decode start point.

In MPEG2-Video, the head of an intra picture including Sequence_header () (sequence header) and the like is the decode start point.

At the head of EP_map (), reserved_for_word_alignment (8 bits) for word alignment is arranged, followed by number_of_stream_id_entries (8 bits). number_of_stream_id_entries represents the number of elementary streams in which information on the decoding start point is described in EP_map ().

After number_of_stream_id_entries, the information for identifying an elementary stream and the information which can start decoding of the elementary stream are repeatedly arrange | positioned by the number shown by number_of_stream_id_entries.

That is, immediately after number_of_stream_id_entries, stream_id (8 bits) and private_stream_id (8 bits) as information for identifying the elementary stream are arranged, followed by number_of_EP_entries (32 bits). number_of_EP_entries represents the number of decode start points of the elementary stream identified (specifically) by the immediately preceding stream_id and private_stream_id.

After number_of_EP_entries, a set of PTS_EP_start (32 bits) and RPN_EP_start (32 bits) as information on the decode start point of the elementary stream identified by the immediately preceding stream_id and private_stream_id are repeatedly arranged as many as the number indicated by number_of_EP_entries.

As described above, PTS_EP_start, which is information of a decode start point, is the time (decoding time) of the decode start point within a clip stream file in which a program stream in which the elementary streams specified by stream_id and private_stream_id are multiplexed is stored. ).

In RPN_EP_start, which is another information of the decode start point, the position of the decode start point in the clip stream file in which the program stream in which the elementary streams specified by stream_id and private_stream_id are multiplexed as described above is stored. The value, measured in pack () units of the program stream, is described. In this embodiment, the size of pack () is fixed to 2048 bytes. In addition, in this embodiment, one sector of the disk 101 (FIG. 1) is 2048 bytes.

Here, for the video stream, the private_stream_2 packet (PES_packet () of the attribute of private_stream_2) described later is disposed immediately before the decode start point. The private_stream_2 packet stores information used to decode a video stream disposed between the private_stream_2 packet and the next private_stream_2 packet. For this reason, for the video stream, the position of the head of the private_stream_2 packet disposed immediately before the actual decode start point is described in RPN_EP_start as the information of the decode start point. .

In EP_map (), the sets of PTS_EP_start and RPN_EP_start as information of the decode start point are sorted in advance in order of elementary streams specified by stream_id and private_stream_id. As a result, two sets of PTS_EP_start and RPN_EP_start as information on the decoding start point can be searched.

In addition, a method of random access targeting a variable rate stream or a stream having a different size for each video access unit is described in, for example, Japanese Patent Application Laid-Open No. 2000-341640 (Japanese Patent Application Laid-Open No. 11-317738). .

Clip Stream File Description

Next, the internal structure of the clip stream file of extension PS ("00001.PS", "00002.PS", "00003.PS" in FIG. 4) placed in the "STREAM" directory of FIG. 4 will be described. .

The clip stream file is constructed based on MPEG2_Program_Stream () defined in the MPEG-2 System (ISO / IEC 13818-1).

That is, FIG. 15 shows Table2-31, Table2-32, and Table2-33 described in the MPEG-2 System (ISO / IEC 13818-1: 2000) standard.

The program stream stored in the clip stream file is MPEG2_Program_Stream () defined in Table2-31 of the MPEG-2 System standard, and is composed of one or more pack () and one MPEG_program_end_code. The description of MPEG2_Program_Stream () is also described in Japanese Patent No. 2785220 and the like.

One pack () is composed of one Pack_header () and any number of PES_packet (), as defined in Table2-32 of the MPEG-2 System standard. The details of Pack_header () are defined in Table 2-33 of the MPEG-2 System standard.

In the MPEG-2 System standard, the size of pack () is defined as a variable length. However, as described with reference to FIG. 14, it is assumed that the size of pack () is fixed to 2048 bytes. In this example, the number of PES_packet () in one pack () is one, two, or three. When Pack () is started from a private_stream_2 packet described later, PES_packet () of the video stream corresponding immediately after that (in the same Pack ()) is necessarily present. In addition, padding_packet (padding packet) can be placed as the third PES_packet (). Also, the private_stream_2 packet must be at the head of Pack ().

If Pack () does not start from the private_stream_2 packet, PES_packet () in which content data such as video, audio, subtitle, etc. is stored is placed at the head of Pack (). In addition to this, padding_packet (padding packet) can be placed as the second PES_packet ().

16 to 18 show PES_packet () defined in Table2-17 of the MPEG-2 System standard.

PES_packet () can be roughly divided into packet_start_code_prefix, stream_id, and PES_packet_length (FIG. 16), a header portion (including stuffing_bytes) (FIG. 16 to 18) whose structure is changed by stream_id, etc., and PES_packet_data_byte (FIG. 18). have. If PES_packet () is padding_packet (stream_id == padding_stream), instead of PES_packet_data_byte, padding_byte (0xFF) (Fig. 18) is repeatedly arranged as many times as necessary.

In the header portion of PES_packet (), as shown in Figs. 16 and 17, information indicating a display timing called a PTS (Presentation Time Stamp) and information indicating a decode timing called a DTS (Decoding Time Stamp) are stored. Can be placed. In this embodiment, the PTS is added to all access units (decode units constituting the elementary stream defined in MPEG2-System), and the DTS is added in the case of the MPEG2-System.

The elementary stream multiplexed with the program stream is stored in PES_packet_data_byte (Fig. 18) of PES_packet (). In the stream_id of PES_packet (), a value corresponding to the attribute of the elementary stream is described in order to identify the elementary stream stored in the PES_packet_data_byte.

The relationship between the value described in stream_id of PES_packet () and the attribute (type) of the elementary stream is defined in Table 2-18 of the MPEG-2 System standard. Here, Table 2-18 of the MPEG-2 System standard is shown in FIG.

In this embodiment, for example, the value shown in FIG. 20 is adopted among the stream_ids defined in the MPEG-2 System standard shown in FIG.

That is, in this embodiment, five patterns of 10111101B, 10111110B, 10111111B, 110xxxxxB, and 1110xxxxB are adopted as the values of stream_id. In addition, "x" represents the arbitrary value of 0 or 1.

The stream_id of PES_packet () of the elementary stream of the attribute called private_stream_1 is 10111101B according to FIG. 20. In addition, the stream_id of PES_packet () of padding_packet is 10111110B according to FIG. In addition, the stream_id of PES_packet () of the elementary stream of the attribute called private_stream_2 is 10111111B according to FIG.

In addition, the stream_id of PES_packet () of the audio stream (elementary stream of audio) defined in MPEG is 110xxxxxB. In addition, the lower 5 bits xxxxx in 110xxxxxB are audio stream numbers for distinguishing audio streams, and the program stream (MPEG2_Program_Stream ()) has 32 (= 25) audio streams (in MPEG, which is the number distinguishable by this audio stream number). Defined audio streams) can be multiplexed.

In addition, the stream_id of PES_packet () of the video stream (elementary stream of video) defined in MPEG is 1110xxxxB. The lower 4 bits xxxx in 1110xxxxB are video stream numbers for distinguishing video streams, and the program stream includes 16 (= 24) video streams (video streams defined in MPEG), which are numbers distinguishable by this video stream number. Can be multiplexed.

By the way, PES_packet () having stream_id of 1110xxxxB is used to store a video stream defined in MPEG, and PES_packet () having stream_id of 110xxxxxB is used to store an audio stream defined in MPEG. On the other hand, stream_id of PES_packet () used to store an elementary stream of an encoding method (for example, the ATRAC method) not defined in MPEG is not defined in MPEG, and thus is not defined in MPEG. Unencoded elementary streams cannot be stored in PES_packet () simply by specifying stream_id, similar to video streams and audio streams defined in MPEG.

Therefore, in this embodiment, PES_packet_data_byte of PES_packet () of private_stream_1 is extended and an elementary stream of an encoding method not defined in MPEG is stored.

Here, the extended PES_packet_data_byte of PES_packet () of private_stream_1 is described as private_stream1_PES_payload ().

`` Description of private_stream1_PES_payload () ''

Fig. 21 shows the syntax of private_stream1_PES_payload ().

private_stream1_PES_payload () is composed of private_header () and private_payload (). In private_payload (), an elementary stream of an encoding method not defined in MPEG, such as an ATRAC audio stream, an LPCM audio stream, and a subtitle stream, is stored.

At the head of private_header (), private_stream_id (8 bits) is placed. The private_stream_id is identification information for identifying an elementary stream stored in private_payload (). The private_stream_id is, for example, the following value depending on the attribute (type).

That is, FIG. 22 shows the relationship between the value of the private_stream_id and the attribute of the elementary stream stored in private_payload ().

In Fig. 22, three patterns of 0000xxxxB, 0001xxxxB, and 100xxxxxB are employed as values of private_stream_id. In addition, "x" shows the arbitrary value of 0 or 1 similarly to the case in FIG.

According to FIG. 22, private_stream_id which is private_stream1_PES_payload () in which an ATRAC audio stream is stored in private_payload () is set to 0000xxxxB. The lower 4 bits xxxx in 0000xxxxB are the audio stream numbers for distinguishing the ATRAC audio streams, and the program stream (MPEG2_Program_Stream ()) includes 16 (= 24) ATRAC audio streams which can be distinguished by this audio stream number. Can be multiplexed

22, the private_stream_id of private_stream1_PES_payload () in which the LPCM audio stream is stored in private_payload () is 0001xxxxB. The lower 4 bits xxxx in 0001xxxxB are audio stream numbers for distinguishing LPCM audio streams, and 16 (= 24) LPCM audio streams, which can be distinguished by this audio stream number, can be multiplexed in the program stream.

22, private_stream_id which is private_stream1_PES_payload () in which a subtitle stream is stored in private_payload () becomes 100xxxxxB. The lower 5 bits xxxxx in 100xxxxxB are subtitle stream numbers for distinguishing subtitle streams, and 32 (= 25) subtitle streams, which can be distinguished by the subtitle stream number, can be multiplexed in the program stream.

Here, FIG. 11 mentioned above integrated the relationship of FIG. 20 and FIG.

Returning to Fig. 21, in private_stream1_PES_payload (), the elements following private_stream_id differ in content depending on the attribute of the elementary stream stored in private_payload (). The attribute of the elementary stream stored in private_payload () is determined by the private_stream_id at the head of private_header ().

If the elementary stream stored in private_payload () is an ATRAC audio stream (private_stream_id == ATRAC), reserved_for_future_use (8 bits) for future expansion is disposed, and then AU_locator (16 bits) is disposed. The AU_locator indicates the head position of the audio access unit (ATRAC audio access unit) (audio frame) of the ATRAC audio stream stored in private_payload () based on the position immediately after the AU_locator. When no audio access unit exists in private_payload (), 0xFFFF is described in AU_locator, for example.

If the elementary stream stored in private_payload () is an LPCM audio stream (private_stream_id == LPCM), fs_flag (1 bit), reserved_for_future_use (3 bits), ch_flag (4 bits), and AU_locator (16 bits) are sequentially Is placed.

fs_flag represents the sampling frequency of the LPCM audio stream stored in private_payload (). That is, for example, when the sampling frequency is 48 KHz, fs_flag is 0, and when the sampling frequency is 44.1 KHz, fs_flag is 1.

ch_flag represents the number of channels of the LPCM audio stream stored in private_payload (). For example, if the LPCM audio stream is monaural, ch_flag is 1, and if the LPCM audio stream is stereo, ch_flag is 2.

The AU_locator indicates the head position of the audio access unit (LPCM audio access unit) (audio frame) of the LPCM audio stream stored in private_payload () based on the position immediately after the AU_locator. When no audio access unit exists in private_payload (), 0xFFFF is described in AU_locator, for example.

If the elementary stream stored in private_payload () is a subtitle stream (private_stream_id == SUBTITLE), reserved_for_future_use (8 bits) for future expansion is disposed, and then AU_locator (16 bits) is disposed. The AU_locator indicates the head position of the caption access unit of the caption stream stored in private_payload () based on the position immediately after the AU_locator. When no caption access unit exists in private_payload (), 0xFFFF is described in AU_locator, for example.

Description of private_stream2_PES_payload ()

Next, FIG. 23 shows the syntax of private_stream2_PES_payload ().

private_stream2_PES_payload () is an extension of PES_packet_data_byte (FIG. 18) of PES_packet () of private_stream_2, that is, extended PES_packet_data_byte of PES_packet () of private_stream_2, and describes information used for decoding a video stream.

In this embodiment, PES_packet () of private_stream_2 is disposed just before the decoding start point in the video stream. Therefore, in this embodiment, when PES_packet () of private_stream_2 is found from the program stream, decoding can be started from the immediately following video stream.

Here, RPN_EP_start of EP_map () in FIG. 14 described above indicates the position of the head of PES_packet () of private_stream_2 for the video stream.

private_stream2_PES_payload () is placed at the beginning of reserved_for_future_use (8 bits) for future expansion, followed by video_stream_id (8 bits), 1stRef_picture (16 bits), 2ndRef_picture (16 bits), 3rdRef_picture (16 bits), and 4thRef_picture (16 bits). 16 bits), au_information (), and VBI () are sequentially arranged.

In video_stream_id, the stream_id (same value) of PES_packet () of the video stream placed immediately after PES_packet () of private_stream_2 is described. By this video_stream_id, the video stream (this stored PES_packet ()) to be decoded is specified using the information stored in PES_packet () (private_stream2_PES_payload () of private_stream_2).

1stRef_picture, 2ndRef_picture, 3rdRef_picture, and 4thRef_picture are the last pack containing the 1st, 2nd, 3rd, and 4th reference pictures from the PES_packet () of the private_stream_2 to the PES_packet () of the next private_stream_2 of the video stream specified by the video_stream_id. The positions of () are shown in relative values, respectively. In addition, about 1stRef_picture, 2ndRef_picture, 3rdRef_picture, and 4thRef_picture, the detail is disclosed as Japanese Unexamined-Japanese-Patent No. 09-46712 (Japanese-Patent No. 07-211420) as bytes_to_first_P_pic bytes_to_second_P_pic.

In au_information (), information about a video access unit in a video stream from PES_packet () of private_stream_2 to PES_packet () of next private_stream_2 is described. The details of au_information () will be described later with reference to FIG. 24.

VBI () is used to describe closed caption information.

PES_packet () of private_stream_2 having private_stream2_PES_payload () as described above is arranged for each decode start point of each video stream.

Next, FIG. 24 shows the syntax of au_information () in FIG. 23.

At the head of au_information (), length (16 bits) is arranged. length indicates the size of au_information () that contains it. After length, reserved_for_word_alignment (8 bits) and number_of_access_unit (8 bits) are sequentially arranged. reserved_for_word_alignment is used to align word alignment.

number_of_access_unit represents the number of video access units (pictures) contained between PES_packet () of private_stream_2 including it to PES_packet () of next private_stream_2.

That is, number_of_access_unit is the PAS_packet () of the private_stream_2 having the same video_stream_id as the private_stream2_PES_payload () in FIG. (), Up to the end of the clip stream file) indicates the number of access units (pictures) included in the video stream represented by video_stream_id.

After number_of_access_unit, the contents of the for loop are arranged by the number of the number_of_access_unit. That is, information about each of one or more video access units included between PES_packet () of private_stream_2 including number_of_access_unit from PES_packet () of next private_stream_2 is disposed.

The information (information about the video access unit) disposed in the for loop is as follows.

That is, pic_struct_copy (4 bits), au_ref_flag (1 bit), AU_length (21 bits), and reserved are arranged in the for loop.

pic_struct_copy contains the pic_struct () defined in ISO / IEC 14496-10, D.2.2, which is set for the corresponding video access unit, when the video stream is MPEG4-AVC (ISO / IEC 14496-10). Copy is described. In addition, pic_struct () is information such as displaying a picture as a frame, displaying a top field of a picture, and then displaying a bottom field.

au_ref_flag indicates whether or not the corresponding access unit is a reference picture referred to in decoding of another access unit (picture). The au_ref_flag is 1 if the reference picture is a reference picture, and 0 if it is not the reference picture.

AU_length indicates the size of a corresponding access unit in bytes.

[Specific example of data recorded on disk 101]

Next, Figs. 25 to 28 show specific examples of the data in the above-described format recorded on the disc 101 of Fig. 1.

25 to 28, MPEG2-Video is adopted as the video stream, and ATRAC audio stream is adopted as the audio stream. However, the video stream and the audio stream are not limited to this. That is, as the video stream, for example, MPEG4-Visual, MPEG4-AVC, or the like can be adopted. As the audio stream, for example, MPEG 1/2 audio or LPCM audio stream can be adopted.

In addition, unlike a video stream or an audio stream, a subtitle stream cannot be continuously decoded and displayed (output) at the same interval. That is, the subtitle stream is sometimes supplied from the buffer control module 215 of FIG. 2 to the subtitle decoder control module 218 and decoded.

25 to 28, in the disk 101, as shown in FIG. 4, three clip information files " 00001.CLP ", " 00002.CLP ", " 00003.CLP " The three clip stream files " 00001.PS " and " 00002. " recorded in the " STREAM " directory respectively corresponding to the three clip information files " 00001.CLP ", " 00002.CLP ", " 00003.CLP " Specific examples of the "PLAYLIST.DAT" file, the clip information file "00001.CLP", "00002.CLP", and "00003.CLP" when PS "and" 00003.PS "are recorded are shown. have. 25-28, a part of data, such as a "PLAYLIST.DAT" file, is abbreviate | omitted.

That is, FIG. 25 shows a specific example of the "PLAYLIST.DAT" file explained in FIG.

In Fig. 25, number_of_PlayLists is 2, and therefore, the number of PlayList () included in the "PLAYLIST.DAT" file is 2. In Fig. 25, the first of the two PlayLists () is described as PlayList # 0 and the second as PlayList # 1.

For PlayList # 0, which is the first PlayList (), capture_enable_flag_PlayList is set to 1, so that secondary use of video data reproduced in accordance with PlayList # 0 is permitted. In addition, for PlayList # 0, number_of_PlayItems is 2, and therefore, the number of PlayItems () included in PlayList # 0 is 2. In FIG. 25, the specific example of PlayItem # 0 and PlayItem # 1 which are these two PlayItem () is described below the "PlayList # 0" column.

In PlayItem # 0, which is the first PlayItem () included in PlayList # 0, Clip_Information_file_name described in FIG. 6 is "00001.CLP", In_time is 180,090, and OUT_time is 27,180,090. Therefore, the clip reproduced by PlayItem # 0 of PlayList # 0 is from time 180,090 to 27,180,090 of the clip stream file "00001.PS" corresponding to the clip information file "00001.CLP".

In PlayItem # 1, which is the second PlayItem () included in PlayList # 0, Clip_Information_file_name described in FIG. 6 is "00002.CLP", In_time is 90,000, and OUT_time is 27,090,000. Therefore, the clip reproduced by PlayItem # 1 of PlayList # 0 is from time 90,000 to 27,090,000 of clip stream file "00002.PS" corresponding to clip information file "00002.CLP".

On the other hand, in Fig. 25, capture_enable_flag_PlayList is 0 for PlayList # 1, which is the second PlayList (), and accordingly, secondary use of video data reproduced in accordance with PlayList # 1 is not permitted (prohibited). ). In addition, for PlayList # 1, number_of_PlayItems is 1, therefore, the number of PlayItems () included in PlayList # 1 is 1. In FIG. 25, the specific example of PlayItem # 0 which is this one PlayItem () is described below the "PlayList # 1" column.

In PlayItem # 0, which is one PlayItem () included in PlayList # 1, Clip_Information_file_name described in FIG. 6 is "00003.CLP", In_time is 90,000, and OUT_time is 81,090,000. Therefore, the clip reproduced by PlayItem # 0 of PlayList # 1 is from time 90,000 to 81,090,000 of clip stream file "00003.PS" corresponding to clip information file "00003.CLP".

Next, FIG. 26 shows a specific example of the clip information file Clip () explained in FIG. That is, FIG. 26 shows specific examples of the clip information files "00001.CLP", "00002.CLP", and "00003.CLP" in FIG.

In the clip information file "00001.CLP", presentation_start_time is 90,000 and presentation_end_time is 27,990,000. Therefore, according to the program stream stored in the clip stream file "00001.PS" corresponding to the clip information file "00001.CLP", contents of 310 seconds ((27,990,000-90,000) / 90 kHz) are available.

In addition, in the clip information file "00001.CLP", capture_enable_flag_Clip is set to 1, so that the video stream multiplexed to the program stream stored in the clip stream file "00001.PS" corresponding to the clip information file "00001.CLP" ( Video data corresponding to the above, the secondary use is permitted.

In Fig. 26, the number_of_streams of the clip information file "00001.CLP" is 4, and therefore four elementary streams are multiplexed in the program stream stored in the corresponding clip stream file "00001.PS". .

Now, if the four elementary streams are stream # 0, stream # 1, stream # 2 and stream # 3, the four elementary streams stream # 0, stream # 1 and stream # are shown in FIG. 2, the specific example of StreamInfo () (FIG. 10) of each stream # 3 is described below the column of "00001.CLP".

For the first elementary stream stream # 0 of the clip stream file "00001.PS", stream_id is 0xE0. Therefore, the elementary stream stream # 0 is shown in FIGS. 20 and 22 (or FIG. 11). As described in), it is a video stream. In the present embodiment, the private_stream_id is not related to the video stream as described above, but is 0x00 in FIG. 26.

Also, for video stream stream # 0, which is the first elementary stream of the clip stream file "00001.PS", the picture_size of StaticInfo () (Fig. 12) included in the StreamInfo () is set to "720 x 480". frame_rate is '29 .97Hz 'and cc_flag is' Yes'. Therefore, this video stream stream # 0 is video data of 720 x 480 pixels with a frame period of 29.97 Hz, and also includes closed caption data.

In addition, for video stream stream # 0 which is the first elementary stream of the clip stream file "00001.PS", number_of_DynamicInfo in StreamInfo () (Fig. 10) is 0, and the set of pts_change_point and DynamicInfo () is does not exist.

Next, for the second elementary stream stream # 1 of the clip stream file "00001.PS", stream_id is 0xBD and private_stream_id is 0x00. Accordingly, this elementary stream stream # 1 is an ATRAC audio stream as described with reference to FIGS. 20 and 22.

Also, for the ATRAC audio stream stream # 1 which is the second elementary stream of the clip stream file "00001.PS", audio_language_code of StaticInfo () (Fig. 12) included in the StreamInfo () is "Japanese". The channel_configuration is set to 'STEREO', the lfe_existence is set to 'NO', and the sampling_frequency is set to '48 kHz '. Therefore, this ATRAC audio stream stream # 1 is Japanese and stereo audio data. In addition, the low frequency emphasis channel is not included and a sampling frequency is 48 kHz.

Also, for ATRAC audio stream stream # 1, which is the second elementary stream of the clip stream file "00001.PS", number_of_DynamicInfo in StreamInfo () (Fig. 10) is 0, and a set of pts_change_point and DynamicInfo () is set. Does not exist.

Next, for the third elementary stream stream # 2 of the clip stream file "00001.PS", stream_id is 0xBD and private_stream_id is 0x80. Therefore, this elementary stream stream # 2 is a caption stream as described with reference to FIGS. 20 and 22.

In the subtitle stream stream # 2 which is the third elementary stream of the clip stream file "00001.PS", the subtitle_language_code of the StaticInfo () (Fig. 12) included in the StreamInfo () is "Japanese", and the configurable_flag Is 0, respectively. Therefore, this subtitle stream stream # 2 is Japanese subtitle data, and it is not allowed to change the display system (it is prohibited).

Also, for the subtitle stream stream # 2 which is the third elementary stream of the clip stream file "00001.PS", number_of_DynamicInfo in StreamInfo () (Fig. 10) is 0, and the set of pts_change_point and DynamicInfo () is does not exist.

Next, for the fourth elementary stream stream # 3 of the clip stream file "00001.PS", stream_id is 0xBD and private_stream_id is 0x81. Accordingly, this elementary stream stream # 3 is a caption stream as described with reference to FIGS. 20 and 22.

In addition, in order to distinguish subtitle stream stream # 2 which is the third elementary stream of the clip stream file "00001.PS" and subtitle stream stream # 3 which is the fourth elementary stream, each private_stream_id is It is 0x80 and 0x81.

In the subtitle stream stream # 2 which is the fourth elementary stream of the clip stream file "00001.PS", the subtitle_language_code of the StaticInfo () (Fig. 12) included in the StreamInfo () is "Japanese", and configurable_flag Is 1, respectively. Therefore, this subtitle stream stream # 3 is Japanese subtitle data, and it is permitted to change the display system.

In addition, for the subtitle stream stream # 3 which is the fourth elementary stream of the clip stream file "00001.PS", number_of_DynamicInfo in StreamInfo () (Fig. 10) is 0, and the set of pts_change_point and DynamicInfo () is does not exist.

Next, in Fig. 26, for the clip information file "00002.CLP", presentation_start_time is 90,000 and presentation_end_time is 27,090,000, respectively. Therefore, according to the program stream stored in the clip stream file "00002.PS" corresponding to the clip information file "00002.CLP", content of 300 seconds ((27,090,000-90,000) / 90 kHz) is available.

In addition, in the clip information file "00002.CLP", capture_enable_flag_Clip is 0, therefore, the video stream multiplexed to the program stream stored in the clip stream file "00002.PS" corresponding to the clip information file "00002.CLP" ( Video data corresponding to the video data), the secondary use is not permitted (prohibited).

In Fig. 26, the number_of_streams of the clip information file " 00002.CLP " is 4, therefore, the above-described clip stream file " 00001.PS " is stored in the program stream stored in the corresponding clip stream file " 00002.PS ". As in the case, four elementary streams are multiplexed.

Now, if the four elementary streams are stream # 0, stream # 1, stream # 2 and stream # 3, the four elementary streams stream # 0, stream # 1 and stream # are shown in FIG. 2, the specific example of StreamInfo () (FIG. 10) of each stream # 3 is described below the column of "00002.CLP".

In FIG. 26, the contents of the StreamInfo () of the first to fourth elementary streams streams # 0 to # 3 of the clip stream file "00002.PS" refer to the above-described clip stream file "00001.PS". Since it is the same as the content of StreamInfo () of each of the first to fourth elementary streams streams # 0 to # 3, the description thereof is omitted.

As described above, the contents of the StreamInfo () of each of the first to fourth elementary streams streams # 0 to # 3 of the clip stream file "00002.PS" are set to 1 of the clip stream file "00001.PS". The first elementary stream stream # 0 of the clip stream file "00002.PS" is the video stream since the contents are the same as the contents of the StreamInfo () of the fourth to fourth elementary streams stream # 0 to # 3. The first elementary stream stream # 1 is an ATRAC audio stream. The third elementary stream stream # 2 and the fourth elementary stream stream # 3 are both caption streams.

Next, in Fig. 26, for the clip information file "00003.CLP", presentation_start_time is 90,000 and presentation_end_time is 81,090,000, respectively. Therefore, according to the program stream stored in the clip stream file "00003.PS" corresponding to the clip information file "00003.CLP", contents of 900 seconds ((81,090,000-90,000) / 90 kHz) are available.

In addition, in the clip information file "00003.CLP", capture_enable_flag_Clip is set to 1, and therefore, the video stream multiplexed to the program stream stored in the clip stream file "00003.PS" corresponding to the clip information file "00003.CLP". About the secondary use.

In Fig. 26, number_of_streams of the clip information file "00003.CLP" is set to 3, and therefore, three elementary streams are multiplexed in the program stream stored in the corresponding clip stream file "00003.PS". .

Now, if the three elementary streams are set to stream # 0, stream # 1, and stream # 2, in Fig. 26, the StreamInfo of each of the three elementary streams stream # 0, stream # 1, and stream # 2 is shown. The specific example of () (FIG. 10) is described under the column of "00003.CLP".

For the first elementary stream stream # 0 of the clip stream file "00003.PS", stream_id is 0xE0. Therefore, the elementary stream stream # 0 is shown in FIGS. 20 and 22 (or FIG. 11). As described in), it is a video stream. In addition, similar to the first elementary stream stream # 0 of the clip stream file "00001.PS", the private_stream_id is 0x00.

In addition, for the video stream stream # 0 which is the first elementary stream of the clip stream file "00003.PS", the picture_size of the StaticInfo () (Fig. 12) included in the StreamInfo () is set to "720 x 480". frame_rate is '29 .97Hz 'and cc_flag is' No'. Therefore, this video stream stream # 0 is video data of 720 x 480 pixels with a frame period of 29.97 Hz and does not contain closed caption data.

In addition, for video stream stream # 0 which is the first elementary stream of the clip stream file "00003.PS", number_of_DynamicInfo of StreamInfo () (FIG. 10) is set to 2, and therefore, the StreamInfo () has Two sets of pts_change_point and DynamicInfo () are described.

Next, for the second elementary stream stream # 1 of the clip stream file "00003.PS", stream_id is 0xE1. Therefore, this elementary stream stream # 1 is shown in FIGS. Or as described in FIG. 11). In addition, in order to distinguish the video stream stream # 0 which is the 1st elementary stream of the clip stream file "00003.PS" and the video stream stream # 1 which is the 2nd elementary stream, each stream_id is 0xE0. And 0xE1. In addition, similar to the first elementary stream stream # 0 of the clip stream file "00001.PS", the private_stream_id is 0x00.

For video stream stream # 1, which is the second elementary stream of the clip stream file "00003.PS", picture_size, frame_rate, and cc_flag of StaticInfo () (Fig. 12) included in the StreamInfo () are 1; This is the same as for video stream stream # 0, the first elementary stream. Accordingly, video stream stream # 1, which is the second elementary stream of the clip stream file "00003.PS", is video data of 720 x 480 pixels with a frame period of 29.97 Hz, and also includes closed caption data. Not.

In addition, for video stream stream # 1 which is the second elementary stream of the clip stream file "00003.PS", number_of_DynamicInfo in StreamInfo () (Fig. 10) is 0, and the set of pts_change_point and DynamicInfo () is does not exist.

Next, for the third elementary stream stream # 2 of the clip stream file "00003.PS", stream_id is 0xBD and private_stream_id is 0x00. Therefore, this elementary stream stream # 2 is an ATRAC audio stream as described with reference to FIGS. 20 and 22.

In addition, about ATRAC audio stream stream # 2 which is the 3rd elementary stream of clip stream file "00003.PS", audio_language_code, channel_configuration, lfe_existence, sampling_frequency of StaticInfo () (Fig. 12) included in the StreamInfo (). The same as that of the ATRAC audio stream stream # 1 which is the second elementary stream of the clip stream file "00001.PS". Therefore, ATRAC audio stream stream # 2 which is the third elementary stream of the clip stream file "00003.PS" is Japanese and is stereo audio data. In addition, the low frequency emphasis channel is not included and a sampling frequency is 48 kHz.

In addition, for ATRAC audio stream stream # 2, which is the third elementary stream of the clip stream file "00003.PS", number_of_DynamicInfo in StreamInfo () (Fig. 10) is set to 3, so that StreamInfo () , three sets of pts_change_point and DynamicInfo () are described.

Next, FIG. 27 shows a specific example of EP_map () in the clip information file Clip () explained in FIG. That is, FIG. 27 shows a specific example of EP_map () in FIG. 14 in the clip information file "00001.CLP" in FIG.

In Fig. 27, number_of_stream_id_entries of EP_map () is set to 1, so that information on the decode start point for one elementary stream is described in this EP_map ().

In addition, in EP_map () of FIG. 27, stream_id is 0xE0. Therefore, from what has been described with reference to Figs. 20 and 22, EP_map () describes information (PTS_EP_start and RPN_EP_start (Fig. 14)) of the decoding start enable point for the video stream specified by stream_id of 0xE0. That is, FIG. 27 is EP_map () of the clip information file "00001.CLP". In the clip stream file "00001.CLP" corresponding to the clip information file "00001.CLP", the elementary stream whose stream_id is 0xE0 is shown in FIG. As described with reference to FIG. 26, since it is the first video stream stream # 0 of the clip stream file "00001.CLP", the information described in EP_map () in FIG. 27 starts decoding of the video stream stream # 0. PTS_EP_start and RPN_EP_start of possible points.

In FIG. 27, five points of PTS_EP_start and RPN_EP_start from the head of the first video stream stream # 0 of the clip stream file "00001.CLP" are described, and PTS_EP_start and RPN_EP_start are described. Is omitted.

In addition, in EP_map () of FIG. 27, although private_stream_id is 0x00, when stream_id represents a video stream, private_stream_id is irrelevant (ignore) as mentioned above.

Next, FIG. 28 shows a specific example of PlayListMark () in PlayList # 0 and PlayList # 1 (PlayList () in FIG. 5) described in FIG. 25.

The upper side of Fig. 28 shows PlayListMark () (Fig. 7) of PlayList # 0.

28, the number_of_PlayList_marks in PlayListMark () of PlayList # 0 is set to 7, therefore, the number of Mark () included in PlayList # 0 (PlayListMark ()) is 7.

In the upper part of Fig. 28, Mark # 0, which is the first Mark () of the seven Marks () included in PlayList # 0, is a chapter mark because mark_type (Fig. 7) is 'Chapter'. In addition, Mark # 0 belongs to PlayItem # 0 of two PlayItems # 0 and # 1 of FIG. 25 included in PlayList # 0 because ref_to_PlayItem_id (FIG. 7) is 0. Since mark_time_stamp is 180,090, Mark # 0 is a display on time (playback time) 180,090 of the clip stream file reproduced by PlayItem # 0 included in PlayList # 0. In addition, since Mark # 0 has both entry_ES_stream_id and entry_ES_private_stream_id set to 0, it is not associated with either elementary stream. In addition, since mark #data is 1, Mark # 0 represents the chapter numbered one.

Here, the clip stream file played by PlayItem # 0 included in PlayList # 0 is the clip stream file "00001 specified from" 00001.CLP "described in Clip_Infomation_file_name of the PlayItem # 0 described in FIG. .PS ", and therefore, the above-described time 180,090 indicated by mark_time_stamp of Mark # 0 is the time of the clip stream file" 00001.PS ".

On the upper side of Fig. 28, Mark # 4, which is the fifth Mark () of the seven Marks () included in PlayList # 0, is also the chapter mark similar to the first Mark # 0.

That is, Mark # 4, which is the fifth Mark (), is a chapter mark because mark_type (Fig. 7) is 'Chapter'. In addition, since Mark # 4 has ref_to_PlayItem_id (FIG. 7) as 1, it belongs to PlayItem # 1 of two PlayItems # 0 and # 1 of FIG. 25 contained in PlayList # 0. Since mark_time_stamp is 90,000, Mark # 4 is a display on time 90,000 of the clip stream file reproduced by PlayItem # 1 included in PlayList # 0. In addition, since Mark # 4 has both entry_ES_stream_id and entry_ES_private_stream_id set to 0, it is not associated with either elementary stream. In addition, since Mark_data is 2, Mark # 4 shows the chapter of the number 2.

Here, the clip stream file played by PlayItem # 1 included in PlayList # 0 is the clip stream file "00002 specified from" 00002.CLP "described in Clip_Infomation_file_name of the PlayItem # 1 described in FIG. .PS ", and thus, the above-described time 90,000 indicated by mark_time_stamp of Mark # 4 is the time of the clip stream file" 00002.PS ".

In the upper part of Fig. 28, Mark # 1, which is the second Mark () of the seven Mark (s) included in PlayList # 0, is an index mark because mark_type (Fig. 7) is 'Index'. In addition, since Mark # 1 has ref_to_PlayItem_id (FIG. 7) as 0, it belongs to PlayItem # 0 of two PlayItems # 0 and # 1 of FIG. 25 contained in PlayList # 0. Since mark_time_stamp is 5,580,090, Mark # 1 is a display on time 5,580,090 of the clip stream file reproduced by PlayItem # 0 included in PlayList # 0. In addition, since Mark # 1 has both entry_ES_stream_id and entry_ES_private_stream_id set to 0, it is not associated with either elementary stream. In addition, since mark_data is 1, Mark # 1 represents the index of the number 1.

In addition, here, the clip stream file played by PlayItem # 0 contained in PlayList # 0 is the clip stream file "00001.PS" as mentioned above, Therefore, the time mentioned above indicated by mark_time_stamp of Mark # 1 5,580,090 is the time of the clip stream file "00001.PS".

From the upper side of Fig. 28, the third, sixth, and seventh Mark () of the seven Mark () included in PlayList # 0 are Mark # 2, Mark # 5, Mark # 6, and the second Mark # 1. The same index mark.

In the upper side of Fig. 28, Mark # 3, which is the fourth Mark () of the seven Marks () included in PlayList # 0, is an event mark because mark_type (Fig. 7) is 'Event'. In addition, since Mark_3 has ref_to_PlayItem_id (FIG. 7) being 0, it belongs to PlayItem # 0 of two PlayItems # 0 and # 1 of FIG. 25 contained in PlayList # 0. In addition, since mark_time_stamp is 16,380,090, Mark # 3 is display on the time 16,380,090 of the clip stream file reproduced by PlayItem # 0 contained in PlayList # 0. In addition, since Mark_3 has both entry_ES_stream_id and entry_ES_private_stream_id 0, it is not associated with either elementary stream. In addition, since mark_data is 0, Mark # 3 generates an event with 0 as an argument.

In addition, here, the clip stream file played by PlayItem # 0 contained in PlayList # 0 is the clip stream file "00001.PS" as mentioned above, Therefore, the time mentioned above indicated by mark_time_stamp of Mark # 3 16,380,090 is the time of the clip stream file "00001.PS".

Here, the upper side of FIG. 28 shows the time from the head of the PlayItem () to which Mark () belongs to on the right side of the list of PlayListMark () of PlayList # 0, and on the right side, the head of PlayList # 0 on the right side. Shows the time from.

Next, FIG. 28 shows PlayListMark () (FIG. 7) of PlayList # 1.

In the lower part of Fig. 28, the number_of_PlayList_marks in PlayListMark () of PlayList # 1 is 3, and therefore, the number of Mark () included in PlayList # 1 (PlayListMark ()) is 3.

In the lower part of Fig. 28, Mark # 0, which is the first Mark () of the three Marks () included in PlayList # 1, is a chapter mark because mark_type (Fig. 7) is 'Chapter'. In addition, since Mark # 0 is 0 in ref_to_PlayItem_id (Fig. 7), it belongs to one PlayItem # 0 in Fig. 25 included in PlayList # 1. Since mark_0_stamp is 90,000, Mark # 0 is a display on time 90,000 of the clip stream file reproduced by PlayItem # 0 included in PlayList # 1. In addition, since Mark # 0 has both entry_ES_stream_id and entry_ES_private_stream_id set to 0, it is not associated with either elementary stream. In addition, since mark_data is 0, Mark # 0 represents the chapter whose number is zero.

Here, the clip stream file played by PlayItem # 0 included in PlayList # 1 is the clip stream file "00003 specified from" 00003.CLP "described in Clip_Infomation_file_name of the PlayItem # 0 described in FIG. .PS ", and thus, the above-described time 90,000 indicated by mark_time_stamp of Mark # 0 is the time of the clip stream file" 00003.PS ".

In the lower part of Fig. 28, Mark # 1, which is the second Mark () of the three Marks () included in PlayList # 1, is an event mark because mark_type (Fig. 7) is 'Event'. In addition, since Mark # 1 has 0 in ref_to_PlayItem_id (Fig. 7), it belongs to one PlayItem # 0 in Fig. 25 included in PlayList # 1. In addition, since mark_time_stamp is 27,090,000, Mark # 1 is the display on the time 27,090,000 of the clip stream file reproduced by PlayItem # 0 included in PlayList # 1. In addition, since Mark # 1 has an entry_ES_stream_id of 0xE0 and an entry_ES_private_stream_id of 0, an elementary stream whose stream_id is identified (identified) by 0xE0, that is, associated with a video stream as described with reference to FIGS. 20 and 22. have. In addition, since mark_data is 1, Mark # 1 generates an event with 1 as an argument.

In addition, here, the clip stream file reproduced by PlayItem # 0 contained in PlayList # 1 is the clip stream file "00003.PS" as mentioned above, Therefore, the time mentioned above indicated by mark_time_stamp of Mark # 1 27,090,000 is the time of the clip stream file "00003.PS".

Further, the video stream whose stream_id is 0xE0 to which Mark # 1 is associated is described in "00003.CLP" described in Clip_Infomation_file_name of PlayItem # 0 included in PlayList # 1 of FIG. 25 to which Mark # 1 belongs. Three elementary streams stream # 0 to # 2 multiplexed into a video stream having the specified stream_id of 0xE0, that is, the clip stream file "00003.PS" specified from the clip information file "00003.CLP" in FIG. 1st elementary stream (video stream) stream # 0 among them.

Next, in the lower part of FIG. 28, Mark # 2, which is the third Mark () among the three Mark () included in PlayList # 1, is an event mark because mark_type (FIG. 7) is 'Event'. In addition, since Mark # 2 is 0 in ref_to_PlayItem_id (FIG. 7), it belongs to one PlayItem # 0 of FIG. 25 included in PlayList # 1. In addition, since mark_time_stamp is 27,540,000, Mark # 1 is the display on time 27,540,000 of the clip stream file reproduced by PlayItem # 0 included in PlayList # 1. In addition, since Mark # 2 has an entry_ES_stream_id of 0xE1 and an entry_ES_private_stream_id of 0, an elementary stream whose stream_id is identified (identified) by 0xE1, that is, associated with a video stream as described with reference to FIGS. 20 and 22. have. In addition, since mark_data is 2, Mark # 2 generates an event with 2 as an argument.

In addition, here, the clip stream file played by PlayItem # 0 contained in PlayList # 1 is the clip stream file "00003.PS" as mentioned above, Therefore, the above-mentioned time 27,540,000 which Mark # 2 shows is , The time of the clip stream file "00003.PS".

In addition, the video stream whose stream_id is 0xE1 to which Mark # 2 is associated is described in "00003.CLP" described in Clip_Infomation_file_name of PlayItem # 0 included in PlayList # 1 of FIG. 25 to which Mark # 2 belongs. Three elementary streams stream # 0 to # 2 multiplexed in a video stream having the specified stream_id of 0xE1, that is, the clip stream file "00003.PS" recognized from the clip information file "00003.CLP" in FIG. Second elementary stream (video stream) stream # 1.

28, the time from the head of PlayItem () to which Mark () belongs is shown on the right side of the list of PlayListMark () of PlayList # 1.

In FIG. 28, the chapter and index numbers indicated by the chapter marks and the index marks are described in mark_data. However, the chapter and index numbers indicated by the chapter marks and the index marks are not described in mark_data, for example. This can be recognized by counting the number of chapter marks and index marks in PlayListMark ().

[Description of operation of disk device]

Next, the data (file) as described in FIGS. 25 to 28 is recorded on the disk 101 of FIG. 1, and the operation of the disk device of FIG. 1 will be described.

When the disc 101 is inserted into the disc drive 102, a message indicating its effect is transmitted to the video content playback program 210 via the drive interface 114, and furthermore, the operating system 201 of FIG. . When the video content reproduction program 210 receives a message indicating that the disc 101 is inserted into the disc drive 102 from the operating system 201, the video content reproduction program 210 starts the reproduction preprocess in FIG.

`` Reproduction preprocessing ''

That is, FIG. 29 is a flowchart for explaining reproduction preprocessing performed by the video content reproduction program 210.

Here, the operation or processing of the disk device described below with the flowchart is not necessarily performed in time series in the order described as the flowchart, but may be performed in parallel or separately. In the present specification, for convenience, the operation or processing of the disk device will be described along with a flowchart.

In the reproduction preprocessing, the video content playback program 210 checks the disk 101 using the file system function of the operating system 201 in step S101, and the disk 101 plays the video content playback program 210. Is determined to be a normal disk.

Here, as described above, access to the disk 101 (reading of a file) is performed using the file system function of the operating system 201, but the description thereof will be appropriately omitted below.

In step S101, when it is determined that the disk 101 is not a normal disk, that is, for example, the file system employed in the disk 101 is an unsupported type of the operating system 201, If the "VIDEO" directory is not placed in the root directory, the video content playback program 210 determines that it does not correspond to the disc 101, and proceeds to step S102, where the graphics processing module 219 performs an error process. The reproduction preprocess is terminated.

That is, the graphics processing module 219 generates, as error processing, an error message (video data) indicating that the disk 101 is not normal, and outputs it from the video output module 220, whereby the error message is generated. Is displayed. In addition, as the error processing, for example, it is possible to output an alarm sound from the audio output module 221, eject the disk 101 from the disk drive 102, or the like.

On the other hand, when it is determined in step S101 that the disk 101 is a normal disk, the flow proceeds to step S103, where the video content reproducing program 210 uses the content data supply module 213 for the operating system 201. The two data files of the "SCRIPT.DAT" file and the "PLAYLIST.DAT" file placed in the "VIDEO" directory of the disc 101 (FIG. 4) are requested and read, and the flow advances to step S104. In step S104, the "SCRIPT.DAT" file is supplied to the script control module 211, and the "PLAYLIST.DAT" file is supplied to the player control module 212. FIG.

Thereafter, the process proceeds from step S104 to S105 to S107, where the player control module 212 performs an initialization process. The script control module 211 waits until the initialization processing of the player control module 212 ends.

"Initialization Process of Player Control Module 212"

In the initialization process, in step S105, the player control module 212 analyzes the "PLAYLIST.DAT" file and checks the number of clip information files being used in the "PLAYLIST.DAT" file and its file name.

That is, in this case, the "PLAYLIST.DAT" file is shown in FIG. 25, and the player control module 212 has a number_of_PlayLists of 2 in the "PLAYLIST.DAT" file in FIG. It is recognized that two PlayLists () of the first PlayList # 0 and the second PlayList # 1 exist. In addition, since the number_of_PlayItems is 2 for the first PlayList # 0 in the "PLAYLIST.DAT" file in FIG. 25, the player control module 212 has the first PlayItem # 0 in the PlayList # 0. It recognizes that there are two PlayItem () of and second PlayItem # 1. Then, the player control module 212 refers to the PlayList # by referring to Clip_Information_file_name of each of the first PlayItem # 0 and the second PlayItem # 1 included in the PlayList # 0 in the "PLAYLIST.DAT" file in FIG. 25. It is recognized that the clip information file (file name) of the first PlayItem # 0 included in 0 is "00001.CLP", and the clip information file of the second PlayItem # 1 is "00002.CLP".

The player control module 212 similarly applies to the second PlayList # 1, and since the number_of_PlayItems is 1, there is one PlayItem () (PlayItem # 0), and from the Clip_Information_file_name in the PlayItem # 0, It is recognized that the clip information file of the PlayItem # 0 is "00003.CLP".

After that, the process proceeds from step S105 to S106, and the player control module 212 determines from the disc 101 the clip information file recognized in step S105, that is, the "CLIP" directory in the "VIDEO" directory of the disc 101. Three clip information files "00001.CLP", "00002.CLP", and "00003.CLP" are read from the file.

Here, the clip information file of the PlayItem of the PlayList () to be played first is sufficient to read the clip information file in step S106. However, in the present embodiment, as described above, the clips of the PlayItem () of all the PlayList () are sufficient. It is assumed that the information file is read in advance.

After the process of step S106, it progresses to step S107 and the player control module 212 determines whether the reading of the clip information file recognized by step S105 was successful, and also it reads into the read clip information file. It is determined (checked) whether or not the corresponding clip stream file exists in the disk 101. That is, in step S107, the reading of the clip information files "00001.CLP", "00002.CLP", and "00003.CLP" succeeds, and the clip information files "00001.CLP" and "00002.CLP". , "00003.CLP" and the clip stream files "00001.PS", "00002.PS", and "00003.PS", which differ only in the file name extension, respectively, are stored under the "STREAM" directory under the "VIDEO" directory of the disc 101. "Whether it exists in the directory or not.

If it is determined in step S107 that the read of the clip information file recognized in step S105 has failed, or if it is determined that a clip stream file corresponding to the clip information file does not exist in the disc 101, that is, an example is given. For example, when the clip information file or the clip stream file required for the reproduction according to the "PLAYLIST.DAT" file is not recorded on the disc 101, the video content reproduction program 210 does not correspond to the disc 101. If not, the process proceeds to step S102, where the above-described error processing is performed, and the reproduction preprocess ends.

On the other hand, when it is determined in step S107 that the read of the clip information file recognized in step S105 succeeds and that the clip stream file corresponding to the clip information file exists in the disc 101, the player control module 212 ) Ends the initialization processing, and the flow advances to step S108.

In step S108, the script control module 211 starts analyzing and executing the "SCRIPT.DAT" file.

For example, the script control module 211 executes the "SCRIPT.DAT" file so that playback of the first PlayList () (PlayList # 0) is instructed to the player control module 212. Then, the reproduction processing of FIG. 30 is performed.

`` Playback processing ''

That is, FIG. 30 is a flowchart for describing the reproduction processing performed by the video content reproduction program 210.

`` Playback preparation process ''

In the playback process, the player control module 212 first prepares for playback of the PlayList (), that is, the first PlayList () (PlayList # 0), which has been instructed to play back from the script control module 211 in steps S121 and S122. The process is performed.

That is, in step S121, the player control module 212 checks IN_time (FIG. 6) of the first PlayItem # 0 included in the first PlayList # 0, proceeds to step S122, and proceeds to the first PlayList #. The playback start position corresponding to IN_time of the PlayItem # 0 on the clip stream file "00001.PS" played by the first PlayItem # 0 included in 0 is checked.

Here, when IN_time (Fig. 6) of PlayItem () indicates the head of the clip stream file, the program stream may be read from the head of the clip stream file, but IN_time indicates other than the head of the clip stream file. If so, you need to find (search) the location corresponding to IN_time and read the program stream from it.

Specifically, in the case shown in Fig. 25, the IN_time of the first PlayItem # 0 included in the first PlayList # 0 is 180,090. The player control module 212 starts PlayItem # 0 from EP_map () shown in FIG. 27 of the clip stream file "00001.CLP" played by the first PlayItem # 0 included in the first PlayList # 0. A playback start position suitable for 180,090 which is IN_time is found.

That is, the player control module 212 uses, for example, a binary search (binary search) for the maximum PTS_EP_start satisfying the expression PTS_EP_start IN_time in the PTS_EP_start indicating the decode start point described in EP_map (). Search. The search for PTS_EP_start of IN_time or less is because the position indicated by IN_time cannot be determined as the decoding start possible point.

In this case, IN_time is 180,090 as described above. Further, in EP_map () shown in FIG. 27 of the clip stream file "00001.CLP" played by the first PlayItem # 0 included in the first PlayList # 0, the maximum PTS_EP_start that satisfies the expression PTS_EP_start IN_time. As described, 180,090 is described. Therefore, in the player control module 212, PTS_EP_start of 180,090 is retrieved from EP_map () shown in FIG.

In addition, the player control module 212 reads 305 (sectors) which is RPN_EP_start corresponding to the retrieved PTS_EP_start, and the position on the clip stream file "00001.PS" indicated by RPN_EP_start which is 305 is the playback start position. Is determined as.

The player control module 212 controls the graphics processing module 219 to determine the playback start position as described above, proceeding from step S122 to S123 to display the time code. The graphics processing module 219 generates a time code (video data) under the control of the player control module 212 and outputs it to the video output module 220. As a result, display of the time code is started.

In this case, the time code at which display is started in step S123 is, for example, a value obtained by converting the head of PlayList () into 00:00:00 (hour: minute: second). It is also possible to display the chapter or index number together with the time code or not the time code.

"PlaylistMark () parsing process"

After the display of the time code is started in step S123, the flow proceeds to step S124, where the player control module 212 plays the PlayList (), that is, the first PlayList () (instructed to play back from the script control module 211). Analysis processing for analyzing PlayListMark () (Fig. 7) described in PlayList # 0 is performed.

Specifically, since the player control module 212 has number_of_PlayList_marks as 7 in the PlayListMark () shown above in FIG. 28 of the first PlayList # 0 in the " PLAYLIST.DAT " file already read, It is recognized that the number of Mark () included in the PlayList # 0 is seven.

In addition, the player control module 212 analyzes seven Mark () on the upper side of FIG. 28 included in PlayList # 0, and from the ref_to_PlayItem_id, four Marks from the first to the fourth of the seven Mark (). Recognize that () belongs to the first PlayItem () (PlayItem # 0) of PlayList # 0.

Thereafter, the player control module 212 extracts mark_time_stamp of four Mark () belonging to the first PlayItem # 0 of PlayList # 0, and delivers it to the decode control module 214 as an array having 4 elements. do. That is, the four time points of {180,090}, {5,580,090}, {10,980,090}, and {16,380,090}, which are mark_time_stamp of each of the four Mark (s) from the first to the fourth of the seven Mark (s) in FIG. 28, respectively. This is transmitted from the player control module 212 to the decode control module 214. At this time, the attribute of these times is also "mark processing" and is transmitted from the player control module 212 to the decode control module 214. The decoding control module 214 displays a message indicating that when the time indicated by the timekeeping unit 214A coincides with the time of the attribute of "mark processing", and the time corresponding to the time of the attribute of "mark processing". , And attributes of "mark processing" are transmitted to the player control module 212.

Determination of Elementary Streams to Play

Next, from step S124 to S125, the player control module 212 determines the elementary stream to be reproduced.

That is, the player control module 212 describes the file name in Clip_Information_fime_name of the first PlayItem # 0 (FIG. 25) in the first PlayList # 0, which is PlayList () instructed to play back from the script control module 211. In the clip information file "00001.CLP" shown in FIG. 26, since number_of_streams is 4, it is recognized that four elementary streams are multiplexed in the corresponding clip stream file "00001.PS". In addition, the player control module 212 examines the stream_id and the required private_stream_id of the StaticInfo () of the clip information file "00001.CLP" shown in FIG. 26, in order, for the four elementary streams, and the four elementary streams. Recognize that the mentorary stream is one video stream, one ATRAC audio stream, and two subtitle streams. That is, the number of elementary streams of each attribute multiplexed in the clip stream file "00001.PS" is recognized.

The information on the number of elementary streams of each attribute multiplexed in the clip stream file is used for switching the elementary stream (audio switching, subtitle switching, etc.) during playback. In addition, the subtitle stream may not exist in the clip stream file (the content does not include the subtitle), and the number of elementary streams of the attribute of the "subtitle stream" is determined when the subtitle stream exists. Information is used.

The player control module 212 selects and determines the elementary stream to be played back on the basis of the above-described result of the staticInfo () investigation. Of the four elementary streams, there is only one elementary stream of the attribute of "video stream" and "audio stream". Therefore, the elementary stream of attributes of "video stream" and "audio stream" There is no choice, and one video stream and audio stream (ATRAC audio stream) are determined as elementary streams to be played back.

In addition, two elementary streams of the attribute of the "caption stream" exist among four elementary streams multiplexed in the clip stream file "00001.PS". Subtitle streams are selected and determined as elementary streams to be played. Here, for example, it is assumed that the first subtitle stream is selected in the order of appearance in the clip information file "00001.CLP" among two subtitle streams.

As described above, in recognizing the attributes and the number of the four elementary streams multiplexed in the clip stream file "00001.PS", it is necessary to specify each of the four elementary streams, but the player The control module 212 specifies four elementary streams multiplexed in the clip stream file "00001.PS" by stream_id and required private_stream_id.

That is, the player control module 212 clips the video stream which is an elementary stream of the attribute of "video stream" of four elementary streams multiplexed in the clip stream file "00001.PS" in FIG. As described with respect to the information file "00001.CLP", this is specified by stream_id of 0xE0.

In addition, the player control module 212 shows the ATRAC audio stream which is an elementary stream of the attribute of "audio stream" among four elementary streams multiplexed in the clip stream file "00001.PS" in FIG. As described with respect to the clip information file "00001.CLP", this is specified by stream_id of 0xBD and private_stream_id of 0x00.

In addition, the player control module 212 shows each of two subtitle streams which are elementary streams of the attribute of the "subtitle stream" in the four elementary streams multiplexed in the clip stream file "00001.PS". As described with reference to the clip information file "00001.CLP" at 26, stream_id of 0xBD, private_stream_id of 0x80, stream_id of 0xBD, and private_stream_id of 0x81 are specified, respectively.

As described above, the elementary stream multiplexed in the clip stream file can be identified by the combination of stream_id and private_stream_id described as metadata of the clip information file corresponding to the clip stream file.

Here, the combination of stream_id and private_stream_id is a mechanism set for extending the multiplexing of MPEG2-System. By using this combination of stream_id and private_stream_id in identifying the elementary stream in the metadata (database), it is possible to reliably identify the elementary stream. In the future, even if the meaning of private_stream_id is extended and the number and type (attributes) of corresponding elementary streams are increased, the present mechanism can be used as it is, so that there is more scalability.

That is, for example, in the BD (Blue ray Disc) standard, since the PID (Packet ID) of the transport stream of the MPEG2 standard is used for data specification, it is constrained by the MPEG2 standard. For example, in the DVD-Video standard, sub_stream_id similar to private_stream_id is defined, but sub_stream_id is not intended to be described on a database for stream identification, and describes 8 or 32 stream information. Because it can only be described in a fixed area (for example, see VI4-49, Table 4.2.1-2 (VTS-AST_ATRT) or VI4-52, Table 4.2.1-3 (VTS_SPST_ATRT), etc.) Lack of sex

On the other hand, the combination of stream_id and private_stream_id can be described as many times as the number_of_streams can be described in the clip information file Clip () of FIG. Regardless of the number of elementary streams being multiplexed (in the range of the number that can be represented by number_of_streams), it is possible to identify from the combination of stream_id and private_stream_id as metadata described in the clip information file Clip (). do.

In addition, in this embodiment, the combination of stream_id and private_stream_id is used to identify the elementary stream multiplexed in the corresponding clip stream file in the clip information file of FIG. 10, for example, FIG. As a combination of entry_ES_stream_id and entry_ES_private_stream_id in PlayListMark () of 7, it is also used to specify the elementary stream to which Mark () is associated. In addition, the combination of stream_id and private_stream_id is also used for specifying an elementary stream that describes information of a decodable start point, for example, in EP_map () of FIG. 14.

Output Attribute Control Processing

After that, the process proceeds from step S125 to S126, and the player control module 212 performs control processing of the output attribute of the elementary stream to be played back, that is, the elementary stream determined to be played back in step S125.

Specifically, the player control module 212 firstly outputs a dynamicInfo in which an output attribute is described for each elementary stream to be played back, that is, each of a video stream, an ATRAC audio stream, and a subtitle stream determined to be played back in step S125. Number_of_DynamicInfo (FIG. 10) indicating the number of () (FIG. 13) is examined.

Here, in this case, the video stream, the ATRAC audio stream, and the subtitle stream to be played back are elementary streams multiplexed in the clip stream file "00001.PS", and their number_of_DynamicInfo is "00001.CLP" in FIG. As described above, all are zeros. As described above, when the number_of_DynamicInfo is 0 for all of the elementary streams to be played, the player control module 212 does not particularly perform processing as a control process for the output attribute of the elementary stream to be played.

In addition, when number_of_DynamicInfo for the elementary stream to be reproduced is not 0, the processing performed as control of the output attribute of the elementary stream will be described later.

"Preparation process of reproduction start"

After the process of step S126, it progresses to step S127 and the player control module 212 performs the preparation process of the reproduction start of the elementary stream of a reproduction object.

That is, the player control module 212, with respect to the content data supply module 213, the file name of the clip stream file "00001.PS" in which the elementary stream to be reproduced is multiplexed, and the playback start position determined in step S122. RPN_EP_start (= 305) described in EP_map ().

In addition, the player control module 212 controls the buffer before the program stream stored in the clip stream file "00001.PS" in which the elementary streams to be reproduced are multiplexed is supplied to the buffer control module 215. Initialize module 215.

Specifically, in the buffer control module 215 (Fig. 3), the data head pointer stored in the data head pointer storage unit 231, the data write pointer stored in the data write pointer storage unit 232, and the video read pointer. The same value as the video read pointer stored in the storage unit 241, the audio read pointer stored in the audio read pointer storage unit 251, and the subtitle read pointer stored in the subtitle read pointer storage unit 262. This is assigned.

As a result, the data head pointer stored in the data head pointer storage unit 231 and the data write pointer stored in the data write pointer 232 indicate the same position of the buffer 215A of the buffer control module 215. This represents a state in which no valid data is stored in the buffer 215A.

In addition, the player control module 212 supplies the stream_id as identification information for identifying (specifically) the elementary stream to be played back, and furthermore, private_stream_id to the buffer control module 215 as necessary.

That is, as described above, the video stream having the attribute of "video stream" in the elementary stream to be played is specified by stream_id of 0xE0, and the ATRAC audio stream having the attribute of "audio stream" is 0xBD. It is specified by stream_id of 0 and private_stream_id of 0x00, and the subtitle stream of the attribute of "Subtitle Stream" is identified by stream_id of 0xBD and private_stream_id of 0x80. The player control module 212 supplies these stream_id and private_stream_id to the buffer control module 215.

In the buffer control module 215 (FIG. 3), the video reading function unit 233 stores the stream_id of 0xE0 of the video stream from the player control module 212 in the stream_id register 242. . The audio reading function unit 234 also stores the stream_id of 0xBD and the private_stream_id of 0x00 from the player control module 212 in the stream_id register 252 and the private_stream_id register 253, respectively. Let's do it. In addition, the subtitle reading function unit 235 stores the stream_id of 0xBD and the private_stream_id of 0x80 from the player control module 212 in the stream_id register 263 and the private_stream_id register 264, respectively. Let's do it.

In addition, the player control module 212 stores the stream_id and the private_stream_id of the elementary stream to be reproduced supplied to the buffer control module 215 for further processing. The player control module 212 uses these stream_id and private_stream_id to specify the stream currently being reproduced at the time of generation of a message for requesting stream switching described later or in the mark processing described later.

The player control module 212, as an initialization of the buffer control module 215 (FIG. 3), subtitles a caption reading function flag of a value corresponding to a clip stream file in which an elementary stream to be reproduced is multiplexed. The read function flag storage unit 261 is set.

That is, in this case, since the subtitle stream is included in the clip stream file "00001.PS" in which the elementary streams to be reproduced are multiplexed, the value is 1 for the subtitle reading function unit 235 to function. The caption reading function flag is set in the caption reading function flag storage unit 261. If the subtitle stream is not included in the clip stream file in which the elementary streams to be reproduced are multiplexed, the subtitle read function flag 261 sets a subtitle read function flag with a value of zero. . In this case, the subtitle reading function unit 235 does not function (in particular, no processing is performed).

In addition, the player control module 212 selects 180,090 which is IN_time and 27,180,090 which is OUT_time of the first PlayItem # 0 (FIG. 25) included in the first PlayList # 0 instructed to play back from the script control module 211. To the decode control module 214. In the decoding control module 214, IN_time is used to control decoding start of a clip played by the PlayItem (), and OUT_time is used to control decoding of the clip and further control of a PlayItem change, which will be described later. .

In addition, the player control module 212 initializes an instruction of the display method of the subtitle stream to the graphics processing module 219. That is, the player control module 212 controls the graphics processing module 219 to make the display system of the subtitle stream the default display system.

`` Start reading data ''

After that, the process proceeds from step S127 to S128, whereby the player control module 212 controls the content data supply module 213, whereby the content data supply module 213 controls the function of the operating system 201. In this way, the clip stream file in which the program stream multiplexed by the elementary stream to be reproduced is stored is read out. That is, the content data supply module 213 designates the clip stream file "00001.PS" in the "STREAM" directory under the "VIDEO" directory of the disc 101 (FIG. 4), and is determined in step S122. A sector 305, which is a reproduction start position, is designated, and the operating system 201 is requested to read a file. In addition, the content data supply module 213 specifies to supply the data read out from the disk 101 to the buffer control module 215.

Thereby, reading of the program stream stored in the clip stream file "00001.PS" from the disc 101 is started, and the program stream is supplied to the buffer control module 215.

The buffer control module 215 (FIG. 3) writes the program stream read out from the disk 101 and supplied to the position indicated by the data write pointer of the data write pointer storage unit 232 of the buffer 215A. Increments the data write pointer by the size of the written data.

Here, unless otherwise specified, the content data supply module 213 reads data from the disk 101 when there is a blank portion in the buffer 215A of the buffer control module 215, and the buffer control module ( 215A is supplied to the buffer 215A for storage. Therefore, it is assumed that sufficient data is always stored in the buffer 215A.

`` Decoder control start ''

As described above, when reading of the data from the disk 101 starts, and when the data starts to accumulate in the buffer 215A of the buffer control module 215, the process proceeds from step S128 to S129 to decode the control module. 214 controls the video decoder control module 216, the audio decoder control module 217, and the subtitle decoder control module 218 to start reading data from the buffer 215A as a predecode operation step. .

That is, the video decoder control module 216 requests data from the video read function unit 233 of the buffer control module 215 (FIG. 3), and from the buffer control module 215 according to the request. One video access unit stored in the buffer 215A, a PTS and a DTS (hereinafter, appropriately referred to as a time stamp) added to the video access unit to be delivered, and immediately before the decode start point. pic_struct_copy, au_ref_flag, AU_length, etc., which is information described in PES_packet () of private_stream_2 (hereinafter, appropriately referred to as additional information) are obtained. The time stamp also passes from the video decoder control module 216 to the decode control module 214 every time the video decoder control module 216 obtains a video access unit.

On the other hand, the audio decoder control module 217 also requests data from the audio reading function unit 234 of the buffer control module 215 (FIG. 3), and is transmitted from the buffer control module 215 according to the request. One (ATRAC) audio access unit stored in the buffer 215A and time stamps PTS and DTS added to the audio access unit are obtained. The time stamp also passes from the audio decoder control module 217 to the decode control module 214 every time the audio decoder control module 217 obtains the audio access unit.

In addition, the caption decoder control module 218 requests data from the caption reading function unit 235 of the buffer control module 215 (FIG. 3), and is transferred from the buffer control module 215 according to the request. One caption access unit stored in the buffer 215A and a time stamp added to the caption access unit are obtained. The time stamp is also transmitted from the caption decoder control module 218 to the decode control module 214 every time the caption decoder control module 218 obtains the caption access unit. When the subtitle stream does not exist in the elementary stream to be reproduced or when the subtitle access unit is not stored in the buffer 215A, the subtitle decoder control module 218 from the buffer control module 215. ) Does not pass data.

Here, each time the video decoder control module 216, the audio decoder control module 217, and the subtitle decoder control module 218 request data from the buffer control module 215, the video decoder control module 216, the audio decoder control module 217, and the subtitle decoder control module 218 request the data. To the decode control module 214.

Also, when data is transferred from the buffer control module 215 to the video decoder control module 216, the audio decoder control module 217, and the subtitle decoder control module 218, the buffer 215A of the data. The details of reading from will be described later.

`` Decode start ''

As described above, when the video decoder control module 216, the audio decoder control module 217, and the subtitle decoder control module 218 start reading data from the buffer 215A of the buffer control module 215, step S129. From step S130 onwards, decoding of the data is started.

That is, the decode control module 214 is 180,090 which is IN_time of the first PlayItem # 0 included in the PlayList # 0 supplied from the player control module 212 in step S127, and furthermore, the video decoder control module 216. ), Based on the time stamp transmitted from the audio decoder control module 217 and the subtitle decoder control module 218 as described in step S129, the timing is shifted if necessary to ensure synchronization, and the video decoder starts decoding. The control module 216, the audio decoder control module 217, and the subtitle decoder control module 218 are instructed.

Here, the method of decode start instruction which shifted the timing for ensuring synchronization is described in, for example, Japanese Patent No. 3496725, which is simply a video decoder control module 216 and an audio decoder control module ( 217), the minimum value in the time stamps transmitted from each of the subtitle decoder control modules 218 is set as an initial value of the time time indicated by the timekeeping unit 214A to start time display, and is timed by the time zone 214A. There is a method of instructing the start of decoding when the time coincides with the time stamp.

The video decoder control module 216 receives the decoding start instruction from the decoding control module 214 and, according to the instruction, is obtained from the video reading function unit 233 of the buffer control module 215 (FIG. 3). One video access unit is delivered to the video decoder 116 (FIG. 1) for decoding. In addition, the video decoder control module 216 supplies the video data obtained as a result of the decoding by the video decoder 116 to the graphics processing module 219.

Thereafter, the video decoder control module 216 sequentially decodes each video access unit obtained from the video read function unit 233 of the buffer control module 215 in the video decoder 116, and The resulting video data is supplied to the graphics processing module 219.

On the other hand, the audio decoder control module 217 also receives an instruction to start decoding from the decode control module 214, and according to the instruction, the audio read function unit 234 of the buffer control module 215 (FIG. 3). One audio access unit obtained from the above is delivered to the audio decoder 117 (Fig. 1) for decoding. The audio decoder control module 217 also supplies the audio data obtained as a result of the decoding by the audio decoder 117 to the audio output module 221.

Thereafter, the audio decoder control module 217 sequentially decodes each audio access unit obtained from the audio reading function unit 234 of the buffer control module 215 in the audio decoder 117, The resulting audio data is supplied to the audio output module 221.

The caption decoder control module 218 also receives an instruction to start decoding from the decode control module 214 and, according to the instruction, the caption reading function unit 235 of the buffer control module 215 (FIG. 3). The subtitle access unit obtained from the decode is decoded by the subtitle decode software therein, and the subtitle data (subtitle image data) obtained as a result of the decode is supplied to the graphics processing module 219.

Subsequently, the subtitle decoder control module 218 sequentially decodes each subtitle access unit obtained from the subtitle reading function unit 235 of the buffer control module 215 in the subtitle decoding software having therein, and decodes them. The caption data obtained as a result is supplied to the graphics processing module 219.

`` Graphics processing ''

After that, the process proceeds from step S130 to S131, and the graphics processing module 219 performs the video data supplied from the video decoder control module 216 as described above, and, if necessary, the caption decoder control module ( A graphics process is performed on the caption data supplied from 218.

That is, the graphics processing module 219 first performs caption processing such as enlarging or reducing the caption data from the caption decoder control module 218 in accordance with an instruction of the display method from the player control module 212. If there is no indication of the display method from the player control module 212, or if there is an indication of the default display method, the graphics processing module 219 stores the caption data from the subtitle decoder control module 218 as it is. do.

In addition, the graphics processing module 219 adds the video data from the video decoder control module 216, the caption data from the caption decoder control module 218, or the caption data after the caption processing, and adds the video decoder control module ( The output video data in which the caption data is overlaid on the video data from 216 is obtained and supplied to the video output module 220.

In addition, the graphics processing module 219, from the script control module 211 or the player control module 212, instructs the display of information such as menus, messages, time codes, chapters, or index numbers, for example. If so, the information is generated, overlaid on the output video data, and supplied to the video output module 220.

"Output processing"

After the process of step S131, it progresses to step S132 and the video output module 220 sequentially stores the output video data supplied from the graphics processing module 219 in FIFO 220A as demonstrated in step S131. The output video data stored in the FIFO 220A is sequentially output at a predetermined output rate.

The video output module 220 accepts output video data from the graphics processing module 219 as long as there is room in the storage capacity (remaining amount) of the FIFO 220A. However, when there is no space, the video output module 220 receives the output video data. The graphics processing module 219 is requested to stop the group. Thereby, the graphics processing module 219 stops the processing and requests the video decoder control module 216 and the subtitle decoder control module 218 to stop the processing. As a result, the video decoder control module 216 and the subtitle decoder control module 218 stop processing.

After the video output module 220 requests the graphics processing module 219 to stop the reception of the output video data, the output of the output video data from the FIFO 220A proceeds, and the FIFO 220A is allowed to rest. Is generated, the graphics processing module 219 is requested to accept the output video data. This request is transmitted from the graphics processing module 219 to the video decoder control module 216 and the subtitle decoder control module 218 similarly to the request for stopping the reception of the output video data. As a result, the graphics processing module 219, and furthermore, the video decoder control module 216 and the subtitle decoder control module 218 resume the processing that has been stopped.

On the other hand, the audio output module 221 also sequentially stores the audio data supplied from the audio decoder control module 217 as described in step S130 in the FIFO 221A, and stores the audio data stored in the FIFO 221A. Data is sequentially output at a predetermined output rate (sampling frequency).

The audio output module 221 accepts audio data from the audio decoder control module 217 as long as there is room in the storage capacity (remaining amount) of the FIFO 221A, but accepts audio data when there is no room. The audio decoder control module 217 is requested to stop. As a result, the audio decoder control module 217 stops the processing.

After requesting the audio decoder control module 217 to stop the reception of the audio data, the audio output module 221 outputs the audio data from the FIFO 221A, and the FIFO 221A has a margin. At the time of occurrence, the audio decoder control module 217 is requested to accept the audio data. As a result, the audio decoder control module 217 resumes the stopped process.

As described above, as data is output from the video output module 220 and the audio output module 221, the elementary stream is decoded.

The entire process or flow of the operation when the disk apparatus of FIG. 1 plays back the disk 101 is the same as described with reference to FIGS. 29 and 30. Hereinafter, when the disk 101 is being played back in the disk apparatus. The following describes other processing or operation.

[Change PlayItem]

As described with reference to FIGS. 29 and 30, playback of the first PlayItem # 0 of the first PlayList # 0 in FIG. 25 starts, but according to PlayList # 0, playback of the first PlayItem # 0 is stopped. When finished, playback of the second PlayItem # 1 is started. That is, the PlayItem change which changes PlayItem from PlayItem # 0 to PlayItem # 1 is performed.

Therefore, the process of changing this PlayItem will be described with reference to the flowchart in FIG. 31.

As described with reference to Figs. 29 and 30, when playback of the first PlayItem # 0 (clip) of PlayList # 0 in Fig. 25 is started, the decode control module 214 (Fig. 2) starts the first step. While playback of PlayItem # 0 is being performed, the time indicated by the built-in timekeeping unit 214A is continuously checked.

End Play of PlayItem # 0

Then, the decoding control module 214 is 27,180,090 (FIG. 25) at which the time indicated by the timekeeping unit 214A is OUT_time of the first PlayItem # 0 supplied from the player control module 212 in step S127 of FIG. If it becomes equal to, the decoding stop control is performed in step S151, and playback of PlayItem # 0 is terminated.

That is, the decode control module 214 operates the video decoder control module 216, the audio decoder control module 217, and the subtitle decoder control module 218 to stop the decode operation. The decode control module 214 also controls the video output module 220 and continuously outputs the output video data currently being output.

The decode control module 214 also transmits a message to the player control module 212 indicating that playback of the first PlayItem # 0 has ended.

Start Play of PlayItem # 1

As described above, the player control module 212 recognizes that the first PlayItem # 0 and the second PlayItem # 1 exist in the first PlayList # 0 in step S105 of FIG. 29, and decoded. If the control module 214 receives a message indicating that playback of the first PlayItem # 0 has ended, the process proceeds from step S151 to S152 to perform playback of the second PlayItem # 1 described above. Start as in the case of # 0.

In other words, when the playback procedure of the second PlayItem # 1 is schematically described, first, the player control module 212 performs EP_map () on the second PlayItem # 1 in the same manner as in the step S122 of FIG. Any one of RPN_EP_start described in Fig. 1) is determined as the playback start position.

The player control module 212 also recognizes Mark () belonging to the second PlayItem # 1 as described in step S124 of FIG. 30, and as described in step S125 of FIG. 30, PlayItem # 1. Recognition of the number of elementary streams of each attribute multiplexed in the clip stream file " 00002.PS " to be reproduced by, and subsequently, determination of the elementary stream to be reproduced (to be reproduced) is performed.

And the player control module 212 performs the process similar to the case in step S127 of FIG.

That is, the player control module 212 determines the file name of the RPN_EP_start of EP_map () determined as the playback start position and the clip stream file in which the elementary streams to be played are multiplexed, that is, the second PlayItem # in this case. The file name of the clip stream file "00002.PS" corresponding to "00002.CLP" described in Clip_Information_file_name in FIG. 1 (Fig. 25) is given to the content data supply module 213.

In addition, the player control module 212 controls the buffer before the program stream stored in the clip stream file "00002.PS" in which the elementary stream to be reproduced is multiplexed is supplied to the buffer control module 215. Initialize module 215.

That is, in this way, in the buffer control module 215 (Fig. 3), the data head pointer stored in the data head pointer storage unit 231, the data write pointer stored in the data write pointer storage unit 232, and the video read out. The same as the video reading pointer stored in the pointer storage unit 241, the audio reading pointer stored in the audio reading pointer storage unit 251, and the subtitle reading pointer stored in the subtitle reading pointer storage unit 262. The value is assigned.

The player control module 212 also supplies the buffer control module 215 with stream_id as identification information for identifying the elementary stream to be played back, and furthermore, private_stream_id as necessary.

In the buffer control module 215 (FIG. 3), the video reading function unit 233 stores the stream_id for the video stream in the elementary stream to be played back from the player control module 212 in the stream_id register 242. Remember). In addition, the audio reading function unit 234 sends the stream_id and the private_stream_id of the audio stream in the elementary stream to be played back from the player control module 212 into the stream_id register 252 and the private_stream_id register 253. Remember each.

In addition, since the subtitle stream is included in the clip stream file "00002.PS" in which the elementary stream to be played back is multiplexed, the subtitle reading function unit 235 from the player control module 212 is provided. The stream_id and private_stream_id of the subtitle stream in the elementary stream to be reproduced are supplied, and the subtitle reading function unit 235 stores the stream_id and the private_stream_id in the stream_id register 263 and the private_stream_id register 264, respectively. .

Then, the player control module 212, as an initialization of the buffer control module 215 (FIG. 3), sets a caption reading function flag of a value corresponding to the clip stream file in which the elementary stream to be reproduced is multiplexed. The subtitle reading function flag storage unit 261 is set.

That is, in this case, since the subtitle stream is included in the clip stream file "00002.PS" in which the elementary streams to be reproduced are multiplexed, the value is 1 for the subtitle reading function unit 235 to function. The caption reading function flag is set in the caption reading function flag storage unit 261.

In addition, the player control module 212 provides 90,000 which is IN_time and 27,090,000 which is OUT_time of the second PlayItem # 1 (FIG. 25) to be played back to the decoding control module 214.

In addition, the player control module 212 initializes an instruction of the display method of the subtitle stream to the graphics processing module 219. That is, the player control module 212 controls the graphics processing module 219 to make the display method of the subtitle stream the default display method.

In addition, when configurable_flag (FIG. 12) is set to 1 to allow the display system to be changed, the subtitle stream is displayed from the player control module 212 to the graphics processing module 219 with respect to the subtitle stream to be played. The instruction of the method may be left as it is.

In the following, playback of the second PlayItem # 1 is performed in the same manner as playback of the first PlayItem # 0. The decoding control module 214 continuously checks the time indicated by the built-in timekeeping section 214A while the second PlayItem # 1 is being played, and the timekeeping section 214A reveals. If the present time is equal to 27,090,000 (FIG. 25) which is OUT_time of the second PlayItem # 1 supplied from the player control module 212 in step S152 (FIG. 31), the same decoding stop control as in the case of step S151 is performed. And playback of PlayItem # 1 is terminated.

[Display of time code]

Next, as described above, the display of the time code is started in step S123 of FIG. 30, but the display of the time code is sequentially updated.

Therefore, with reference to the flowchart of FIG. 32, the process of display of a time code is demonstrated.

Decode control module 214 (FIG. 2) is shown by the time display part 214A with the message that 1 second has passed in step S171, when the 1 second time is shown by the built-in time display part 214A. The current time being present is supplied to the player control module 212, and the flow proceeds to step S172. In step S172, the player control module 212 receives the message and the current time from the decode control module 214, converts the current time into a time code, and proceeds to step S173.

In step S173, the player control module 212 controls the graphics processing module 219 to display the time code obtained in step S172, and returns to step S171.

As a result, the time code is updated every second. The time code update interval is not limited to one second.

[Stream switching]

Next, the clip stream file "00001.PS" played by the first PlayItem # 0 constituting the first PlayList # 0 described in FIG. 25 or the clip stream file played by the second PlayItem # 1 " In 00002.PS ", as described with reference to FIG. 26, two subtitle streams are multiplexed.

As described above, when a plurality of elementary streams having the same attribute are multiplexed in the clip stream file, the elementary stream to be played is selected from one of the plurality of elementary streams having the same attribute. The stream switching to another one can be performed.

Therefore, the process of stream switching is demonstrated with reference to the flowchart of FIG.

The stream switching request is, for example, when the instruction for stream switching is described as a script program in the "SCRIPT.DAT" file (FIG. 4), the script control module 211 executes the script program. Or, it is given to the player control module 212 by a user operating a remote control.

That is, the script control module 211 supplies the player control module 212 with a message for requesting stream switching when the script program in which the instruction for stream switching is described is executed. The input interface 115 supplies the player control module 212 with a message for requesting stream switching when the user receives a signal for instructing stream switching from the remote controller by operating the remote controller.

For example, suppose that the message for subtitle stream switching, which is a message for requesting the subtitle stream switching, is supplied to the player control module 212 at this time. The number of subtitle streams recognized at the time of determining the elementary stream to be reproduced performed in step S125 is checked.

If the player control module 212 checks the number of subtitle streams, and if the number is one or less, the player control module 212 ignores the message of the subtitle stream switching, and therefore, subsequent steps S192 to S194 are not performed.

On the other hand, when the number of subtitle streams is two or more, the flow proceeds to steps S192 to S194 sequentially, and the subtitle stream to be reproduced is switched from the currently reproduced subtitle stream to another subtitle stream.

That is, in step S192, the player control module 212 specifies the subtitle stream currently being reproduced on the clip information file. Specifically, for example, the stream_id multiplexed into the clip stream file "00002.PS" by the second PlayItem # 1 constituting the first PlayList # 0 described in FIG. 25 is 0xBD, and the private_stream_id Assuming that a subtitle stream of which is 0x80 is being played back, in step S192, the clip information file "00002.CLP in FIG. 26 among two subtitle streams multiplexed into the clip stream file" 00002.PS "is currently played. It is specified that stream # 2 is the third subtitle stream on the screen.

The player control module 212 then recognizes (specifies) the next subtitle stream on the clip information file of the subtitle stream specified in step S192 as the next subtitle stream to be reproduced. In FIG. 26, since the next subtitle stream of the third subtitle stream stream # 2 is the fourth subtitle stream stream # 3 on the clip information file "00002.CLP", the fourth subtitle stream is determined in step S193. stream # 3 is recognized as the subtitle stream to be played next.

In addition, it is specified that the subtitle stream currently being played is stream # 3 which is the fourth subtitle stream on the clip information file "00002.CLP" in FIG. 26 among the two subtitle streams multiplexed in the clip stream file "00002.PS". In this case, for example, the third subtitle stream stream # 2 is recognized as the subtitle stream to be played next.

Subsequently, the process proceeds to step S194, where the player control module 212 determines the stream_id and private_stream_id of the subtitle stream to be reproduced after the recognition in step S193, and the subtitle reading function unit of the buffer control module 215 (Fig. 3). 235), and the stream_id and private_stream_id are instructed to be used from reading from the buffer 215A of the caption access unit from the next time.

In the subtitle reading function unit 235 of the buffer control module 215 (FIG. 3), the stream_id and the private_stream_id given from the player control module 212 are transferred to the stream_id register 263 and the private_stream_id register 264 in step S194. The newly set and read from the buffer 215A after the next time are directed to the subtitle access unit specified by the stream_id and the private_stream_id newly set in the stream_id register 263 and the private_stream_id register 264, respectively. Is done.

As described above, the subtitle stream to be played back is switched from the currently played subtitle stream to another subtitle stream.

[Process of Buffer Control Module 215]

Next, with reference to FIGS. 34-38, the process of the buffer control module 215 (FIG. 3), ie, the writing of data to the buffer 215A and the reading of the data from the buffer 215A is demonstrated. do.

The buffer control module 215 has five pointers for reading and writing data to and from the buffer 215A as described with reference to FIG. 3.

That is, as shown in Figs. 34 and 35, the buffer control module 215 includes a data head pointer stored in the data head pointer storage unit 231, a data write pointer stored in the data write pointer storage unit 232, Video reading pointer stored in the video reading pointer storage unit 241, Audio reading pointer stored in the audio reading pointer storage unit 251, and subtitle reading stored in the subtitle reading pointer storage unit 262. Has a pointer

34 and 35, the stream_id register 242 and au_information () register 243 of the video read function unit 233 and the stream_id register 252 of the audio read function unit 234 in FIG. The illustration of the private_stream_id register 253 and the subtitle read function flag storage 261, the stream_id register 263, and the private_stream_id register 264 of the subtitle read function unit 235 are omitted.

The data head pointer stored in the data head pointer storage unit 231 indicates the position of the oldest data (the data that needs to be read and the oldest data among the data not yet read) remaining in the buffer 215A. . The data write pointer stored in the data write pointer storage unit 232 indicates a position of writing data into the buffer 215A, and this position is a position where the newest data is written in the buffer 215A.

The video read pointer stored in the video read pointer storage unit 241 indicates the position of the video stream read from the buffer 215A. The audio read pointer stored in the audio read pointer storage unit 251 indicates the position of the audio stream read from the buffer 215A, and the subtitle read pointer stored in the subtitle read pointer storage unit 262. Indicates the position of the subtitle stream read from the buffer 215A.

As described with reference to Fig. 3, the data head pointer, data write pointer, video read pointer, audio read pointer, and subtitle read pointer all move the buffer 215A in the right direction.

In addition, in this embodiment, as shown in FIG. 35, the data head pointer points to the same position as that indicating the position of the oldest data in the video read pointer, the audio read pointer, or the subtitle read pointer. It should always be updated to increase. In FIG. 35, the audio read pointer in the video read pointer, the audio read pointer, or the subtitle read pointer points to the position of the oldest data, and the data head pointer coincides with the audio read pointer. Doing.

In the buffer control module 215 having the data head pointer, data write pointer, video read pointer, audio read pointer, and subtitle read pointer as described above, the data write pointer reads new data from the disc 101. When the data is written to the buffer 215A, it is updated in the right direction to point to the position immediately after the written new data.

In addition, the video read pointer, the audio read pointer, or the subtitle read pointer may be read from the buffer 215A by the amount corresponding to the read amount when the video stream, the audio stream, or the subtitle stream is read. , Is updated in the right direction. Here, the amount according to the reading amount is the part corresponding to the data of the video, audio, and subtitles actually read, and the part of the data of another stream which is included in the read data at the time of reading. It is summed.

Also, the data head pointer indicates the position of the oldest data in the video read pointer, the audio read pointer, or the subtitle read pointer when the video read pointer, the audio read pointer, or the subtitle read pointer is updated. It will be updated to point to the same location you are pointing to.

Here, the buffer control module 215 controls the writing of the data into the buffer 215A so that the data writing pointer does not overtake the data head pointer with respect to the writing of the data into the buffer 215A.

That is, unless the overtaking of the data head pointer by the data write pointer occurs, the buffer control module 215 writes the data read from the disk 101 to the position of the buffer 215A indicated by the data write pointer. The data write pointer is updated. On the other hand, when overtaking of the data head pointer by the data write pointer is likely to occur, the buffer control module 215 stops reading of data from the disk 101 with respect to the content data supply module 213 (stopping). ), And writing of data to the buffer 215A is stopped. As a result, overflow of the buffer 215A can be prevented.

As described above, the writing of the data read out from the disk 101 into the buffer 215A is controlled only by the positional relationship between the two pointers of the data head pointer and the data writing pointer.

On the other hand, the buffer control module 215 reads data from the buffer 215A, and includes a video read pointer, an audio read pointer, a subtitle read pointer, and a data head pointer. The reading of data from the buffer 215A is controlled so as not to overtake.

That is, as long as overtaking of the data write pointer by the video read pointer, the audio read pointer, or the subtitle read pointer does not occur, the buffer control module 215 uses the video decoder control module 216 and the audio decoder control module. 217, or in response to a request from the subtitle decoder control module 218, data is read from the position of the buffer 215A indicated by the video read pointer, the audio read pointer, or the subtitle read pointer to read the video. The bet pointer, the audio read pointer, or the subtitle read pointer are updated, and the data head pointer is updated as necessary. On the other hand, if overtaking of the data read pointer by the video read pointer, the audio read pointer, or the subtitle read pointer is likely to occur, the buffer control module 215 may use the video decoder control module 216 and the audio decoder control module. 217, or the request from the subtitle decoder control module 218 is frozen, for example, and waits until sufficient data is ready. Thereby, underflow of the buffer 215A can be prevented.

As described above, the buffer 215A includes a video decoder control module (in the range from the position indicated by the data head pointer to the position indicated by the data write pointer in the right direction (parts shaded in FIGS. 34 and 35). 216, the data to be supplied to the audio decoder control module 217, and the subtitle decoder control module 218 are stored, and a video read pointer, an audio read pointer, and a subtitle read pointer exist within the range. do.

In the above-described case, the data head pointer is updated so as to indicate the position of the oldest data among the positions indicated by the video read pointer, the audio read pointer, or the subtitle read pointer. The update of the data head pointer can be performed so as to point to the past data position for a predetermined time (for example, 1 second) from the position of the oldest data, for example.

That is, in general, it is expected that the video read pointer and the audio read pointer in the video read pointer, the audio read pointer, or the subtitle read pointer often point to the position of the oldest data.

Therefore, when the data head pointer is updated from the position of the oldest data indicated by the video read pointer or the audio read pointer to point to the past data position for one second, for example, as shown in FIG. As described above, data of the past 1 second can be left in the buffer 215A from the position of the oldest data pointed to by the video read pointer or the audio read pointer. In FIG. 34, the audio read pointer points to the position of the oldest data, and the data head pointer points to the position of the past data for one second from the position.

As described above, the responsiveness of the disk apparatus can be improved by updating the data head pointer so as to point to the past data position for one second.

That is, as shown in Fig. 35, when updating the data head pointer to point to the position of the oldest data pointed to by the audio read pointer, for example, when special playback in the reverse direction is instructed, Since the data which has finished reading from the buffer 215A needs to be read back from the disc 101, a certain amount of time is elapsed until the special playback is instructed after the special playback is instructed. Takes

On the other hand, as shown in Fig. 34, in the case of updating the data head pointer to point to the past data position by one second from the position of the oldest data pointed to by the audio read pointer, the direction in the reverse direction is changed. When the special reproduction is instructed, if the data necessary for starting the special reproduction is past data for one second stored in the buffer 215A, the data from the disk 101 as described above is reread. It is possible to start the special reproduction on the fly without performing.

Also, even when the data head pointer is updated so that the data read pointer is pointed to the past data position by one second from the position of the oldest data pointed to by the audio read pointer, the data necessary for starting the special playback is stored in the buffer ( It may not be stored in 215A). In this case, the data necessary for starting the special playback is read back from the disc 101.

Next, details of reading the video stream, the audio stream, and the subtitle stream from the buffer 215A will be described.

As described in step S127 of FIG. 30, when the reproduction of the clip stream file is started, the buffer control module 215 uses the data head pointer, the data writing pointer, the video reading pointer, the audio reading pointer, and the subtitle reading pointer. Are all initialized to point to the same location on the buffer 215A.

When the program stream (MPEG2-System Program Stream) stored in the clip stream file is read from the disk 101 and supplied to the buffer control module 215, the buffer control module 215 buffers the program stream. In addition to being stored at the position indicated by the data write pointer at 215A, the data write pointer is updated in the right direction.

In addition, in the buffer control module 215 (FIG. 3), the video reading function unit 233 parses the program stream stored in the buffer 215A to respond to the request from the video decoder control module 216. Therefore, the video stream (video access unit) is extracted (separated) from the program stream stored in the buffer 215A, read out, and supplied to the video decoder control module 216.

Similarly, the audio reading function unit 234 also parses the program stream stored in the buffer 215A and, from the program stream stored in the buffer 215A, in response to a request from the audio decoder control module 217. The audio stream (audio access unit) is extracted, read out, and supplied to the audio decoder control module 217. The subtitle reading function unit 235 also parses the program stream stored in the buffer 215A, and subtitles from the program stream stored in the buffer 215A in response to a request from the subtitle decoder control module 218. FIG. The stream (subtitle access unit) is extracted, read out, and supplied to the subtitle decoder control module 218.

Read Video Stream

Next, with reference to the flowchart of FIG. 36, the detail of the reading process of the video stream from the buffer 215A by the video reading function part 233 (FIG. 3) is demonstrated.

First, in step S211, the video reading function unit 233 searches and finds PES_packet () of private_stream_2 in the program stream stored in the buffer 215A. That is, the stream_id of PES_packet () of private_stream_2 is 10111111B (= 0xBF), as described in FIG. 20, and the video reading function unit 233 searches for and finds PES_packet () having stream_id of 10111111B.

Here, for example, as described above, if the elementary stream multiplexed to the program stream stored in the clip stream file "00001.PS" is an elementary stream to be reproduced, the program stream is disc. When reading from 101 and storing in the buffer 215A, in step S122 of FIG. 30, from the information of the decoding start point described in EP_map () (FIG. 27) of the clip stream file "00001.PS", Sector 305 is determined as the playback start position, and in step S128 of FIG. 30, the sector 305 which is the playback start position is designated, and for the operating system 201, of the program stream stored in the clip stream file "00001.PS" Read is required.

In addition, with respect to the video stream, the information of the decode start point described in EP_map () indicates the position of PES_packet () of private_stream_2 disposed immediately before the actual decode start point.

Therefore, immediately after the program stream stored in the clip stream file "00001.PS" is read from the disk 101 and stored in the buffer 215A, the position of the buffer 215A indicated by the data head pointer or the video read pointer is indicated. PES_packet () of private_stream_2 is stored in the table.

If the PES_packet () of private_stream_2 is found in step S211, the video reading function unit 233 proceeds to step S212, and the video_stream_id described in private_stream2_PES_payload () (Fig. 23) which is PES_packet_data_byte of PES_packet () of the private_stream_2. Is extracted, and it is determined whether or not the video_stream_id matches the stream_id of the video stream to be played back, which is stored in the stream_id register 242 (FIG. 3) in step S127 of FIG.

In step S212, when it is determined that the video_stream_id described in private_stream2_PES_payload () does not match the stream_id stored in the stream_id register 242, that is, PES_packet () of private_stream_2 found in the previous step S211 is the target of the playback target. If it is not arranged at the decoding start point of the video stream, the flow returns to step S211 to search for PES_packet () of another private_stream_2 in the program stream stored in the buffer 215A, and the same process is repeated below.

On the other hand, when it is determined in step S212 that the video_stream_id described in private_stream2_PES_payload () matches the stream_id stored in the stream_id register 242, that is, PES_packet () of private_stream_2 found in the previous step S211 is the playback target. If the video stream is located at the decoding start point of the video stream, the process proceeds to step S213 and the video reading function unit 233 buffers au_information () described in private_stream2_PES_payload () of PES_packet () of the private_stream_2. The data is read from 215A, stored in the au_information () register 243 (FIG. 3), and the flow proceeds to step S214.

In step S214, the video reading function unit 233 reads the private_stream_2 whose PES_packet () (video_stream_id (FIG. 23) of the private_stream_2 found in the previous step S211 matches the stream_id stored in the stream_id register 242 (FIG. 3). The video read pointer stored in the video read pointer storage unit 231 is updated by the size of PES_packet ().

That is, in the clip stream file, immediately after PES_packet () of private_stream_2, the video stream (PES_packet ()) of stream_id that matches the video_stream_id is disposed. Updated to point to the actual decode start point.

After that, the process proceeds from step S214 to S215, and the video reading function unit 233 determines whether there is a request for data from the video decoder control module 216, and if it is determined that there is no request, proceeds to step S215. Returning, the same process is repeated.

In addition, in step S215, when it is determined that there is a request for data from the video decoder control module 216, the flow proceeds to step S216, where the video reading function unit 233 buffers 215A indicated by the video reading pointer. Parsing the program stream from the position of the &lt; RTI ID = 0.0 &gt;). &Lt; / RTI &gt; The data is read and supplied to the video decoder control module 216, and the video read pointer is updated by the size of one video access unit read from the buffer 215A.

That is, in au_information (), as described with reference to FIG. 24, number_of_access_unit indicating the number of video access units (pictures) contained between PES_packet () of private_stream_2 including it to PES_packet () of next private_stream_2 is described. It is.

In addition, as described with reference to FIG. 24, au_information () describes pic_struct_copy, au_ref_flag, and AU_length as information about each video access unit by the number of the number_of_access_unit.

Each AU_length described in au_information () by the number of number_of_access_unit is, as described in FIG. 24, the number of number_of_access_unit contained between PES_packet () of the private_stream_2 including it and from PES_packet () of the next private_stream_2. Since the size of each of the video access units is shown, the video reading function unit 233 can cut the access unit without parsing the video stream by using the AU_length.

That is, conventionally, in the case of truncating an access unit of MPEG2-Video or MPEG4-AVC, it is necessary to parse the video stream after knowing the syntax of the video stream, but to the clip stream file recorded on the disc 101. The stored program stream contains a PES_packet () of private_stream_2 describing an AU_length indicating the size of the video access unit immediately before each of one or more actual decode start points in the video stream in units of video access units. The bet function unit 233 reads the video access unit (unit of video stream) from the buffer 215A without parsing the video stream based on the AU_length described in PES_packet () of the private_stream_2. To the video decoder control module 216.

In addition, when the video reading function unit 233 supplies the video access unit to the video decoder control module 216 in step S216, the pic_struct_copy and au_ref_flag described in au_information () as information about the video access unit. , And AU_length and time stamps (PTS, DTS) added to the video access unit unit are also supplied to the video decoder control module 216.

In step S216, after one video access unit is read out from the buffer 215A and supplied to the video decoder control module 216, the flow proceeds to step S217, and the video reading function unit 233 performs au_information ( It determines whether or not the number of access units indicated by number_of_access_unit of au_information () (Fig. 24) stored in the register 243 has been processed.

In step S217, when it is determined that the number of access units indicated by number_of_access_unit has not been processed yet, that is, the number of access units indicated by number_of_access_unit is still read from the buffer 215A, and the video decoder control module 216 ), The process returns to step S215 and the same process is repeated below.

When it is determined in step S217 that the number of access units indicated by number_of_access_unit has been processed, that is, the number of access units indicated by number_of_access_unit is read from the buffer 215A and supplied to the video decoder control module 216. In the case, the process returns to step S211, and the PES_packet () of the next private_stream_2 is searched, and the same process is repeated below.

Read Audio Stream

Next, with reference to the flowchart of FIG. 37, the detail of the audio stream reading process from the buffer 215A by the audio reading function part 234 (FIG. 3) is demonstrated.

First, the audio reading function unit 234 firstly, in step S230, stream_id of the audio stream to be reproduced, stored in the eam_id register 252 (FIG. 3) in step S127 of FIG. 30, is PES_packet () of private_stream_1. It is determined whether is indicated.

In step S230, when it is determined that the stream_id stored in the stream_id register 252 does not indicate PES_packet () of private_stream_1, that is, the stream_id stored in the stream_id register 252 is the MPEG standard as described in FIG. 20. In the case of 110xxxxxB assigned to the audio stream encoded according to the encoding, the flow proceeds to step S231, where the audio reading function unit 234 synchronizes the head of the audio frame determined by MPEG Audio from the program stream stored in the buffer 215A. Find the code. Since the position of the synchronization code is the head of the audio frame, the audio reading function unit 234 updates the audio reading pointer to indicate the position of the head of the audio frame, and proceeds from step S231 to S232. In step S232, the audio read function unit 234 displays the PES_packet () corresponding to the stream_id stored in the stream_id register 252 in the program stream stored in the buffer 215A from the position indicated by the audio read pointer. The search is performed to find out, and the flow proceeds to step S233.

In step S233, the audio reading function unit 234 finds the audio reading pointer stored in the audio reading pointer storage unit 251 in PES_packet_data_byte of PES_packet () found in the previous step S232 (Figs. 16 to 18). Update is made to point to the beginning of the symbol, and the flow advances to step S237.

In step S237, the audio reading function unit 234 determines whether there is a request for data from the audio decoder control module 217, and if not, returns to step S237 to perform the same process. Repeat.

In addition, in step S237, when it is determined that there is a request for data from the audio decoder control module 217, the flow proceeds to step S238, where the audio reading function unit 234 buffers 215A indicated by the audio reading pointer. Parsing the program stream from the position of the &lt; RTI ID = 0.0 &gt;) &lt; / RTI &gt; while reading a known fixed length audio access unit from the buffer 215A and adding the time stamps (PTS, DTS) added to the audio access unit. Together, the audio decoder control module 217 is supplied.

Then, the audio read function unit 234 updates the audio read pointer by the size of one audio access unit read from the buffer 215A, and returns to step S237, and the same processing is repeated below. do.

On the other hand, when it is determined in step S230 that the stream_id stored in the stream_id register 252 indicates PES_packet () of private_stream_1, that is, the stream_id stored in the stream_id register 252 is 10111101B (= 0xBD). As described in section 20, when PES_packet () of private_stream_1 is indicated, the flow proceeds to step S234, and the audio reading function unit 234 searches for PES_packet () of private_stream_1 in the program stream stored in the buffer 215A. Find out. That is, the audio reading function unit 234 searches for and finds PES_packet () having stream_id of 10111101B.

If the PES_packet () of private_stream_1 is found in step S234, the audio reading function unit 234 proceeds to step S235, and the private_stream_id described in private_stream1_PES_payload () (Fig. 21) which is PES_packet_data_byte of PES_packet () of the private_stream_1. Is extracted, and it is determined whether or not the private_stream_id matches the private_stream_id of the audio stream to be played back stored in the private_stream_id register 253 (FIG. 3) in step S127 of FIG.

In step S235, when it is determined that the private_stream_id described in private_stream1_PES_payload () does not match the private_stream_id stored in the private_stream_id register 253, that is, PES_packet () of the private_stream_1 found in the previous step S234 is played back. If it is not an audio stream, the flow returns to step S234 to search for PES_packet () of another private_stream_1 in the program stream stored in the buffer 215A, and the same process is repeated below.

On the other hand, when it is determined in step S235 that the private_stream_id described in private_stream1_PES_payload () matches the private_stream_id stored in the private_stream_id register 253, that is, PES_packet () of the private_stream_1 found in the previous step S234 is a playback target. In the case of the audio stream, the flow proceeds to step S236, where the audio read function 234 reads from the buffer 215A the AU_locator described in private_stream1_PES_payload () (Fig. 21) of PES_packet () of the private_stream_1. The head position of the audio access unit is obtained by adding the position immediately after the AU_locator and the value indicated by the AU_locator.

That is, the AU_locator indicates the head position of the audio access unit (or subtitle access unit) stored in private_payload () of private_stream1_PES_payload () on the basis of the position immediately after the AU_locator as described with reference to FIG. 21. By adding the value indicated by the AU_locator to the position immediately after the AU_locator, the (absolute) head position of the audio access unit can be obtained.

The audio read function unit 234 also updates the audio read pointer stored in the audio read pointer storage unit 251 to point to the head position of the audio access unit obtained as described above in step S236. The flow then advances to step S237.

In step S237, the audio reading function unit 234 determines whether there is a request for data from the audio decoder control module 217, and if not, returns to step S237 to perform the same process. Repeat.

When the audio decoder control module 217 determines that a request for data has been met in step S237, the flow proceeds to step S238. The audio reading function unit 234 stores the buffer pointed to by the audio reading pointer ( While decoding the program stream from the position of 215A), one audio access unit of known fixed length is read from the buffer 215A and accompanied by a time stamp added to the audio access unit. Supply to the control module 217.

The audio read function unit 234 updates the audio read pointer by the size of one audio access unit read from the buffer 215A, and returns to step S237. Is repeated.

Read Subtitle Stream

Next, with reference to the flowchart of FIG. 38, the detail of the process of reading the subtitle stream from the buffer 215A by the subtitle read function part 235 (FIG. 3) is demonstrated.

First, in step S251, the caption reading function unit 235 determines the caption reading function flag stored in the caption reading function flag storage unit 261 in step S127 of FIG. When it is determined in step S251 that the subtitle reading function flag is 0, that is, for example, the subtitle stream is not included in the clip stream file in which the elementary stream to be reproduced is multiplexed, and in step S127 of FIG. When 0 is set in the subtitle reading function flag storage unit 261 in, the subtitle reading function unit 235 does not perform any processing in particular.

On the other hand, when it is determined in step S251 that the subtitle reading function flag is 1, that is, for example, the subtitle stream is included in the clip stream file in which the elementary stream to be reproduced is multiplexed, the step of FIG. If 1 is set in the subtitle reading function flag storage unit 261 in S127, the flow advances to step S252, and the subtitle reading function unit 235 reproduces the data stored in the stream_id register 263 (FIG. 3). PES_packet () matching the stream_id of the target subtitle stream is searched for from the program stream stored in the buffer 215A.

Here, as described in step S127 of FIG. 30, the stream_id of the caption stream to be reproduced is stored in the stream_id register 263 (FIG. 3), but the stream_id of the caption stream is PES_packet of private_stream_1 as described in FIG. 20. 10111101B (= 0xBD) indicating ().

Therefore, in step S252, PES_packet () of private_stream_1 in the program stream stored in the buffer 215A is searched.

In step S252, when PES_packet () of private_stream_1 is searched and PES_packet () of private_stream_1 is found, the flow proceeds to step S253, where the subtitle reading function unit 235 is private_stream1_PES_payload that is PES_packet_data_byte of PES_packet () of the private_stream_1. Whether or not the private_stream_id described in () (FIG. 21) is extracted and the private_stream_id matches the private_stream_id of the subtitle stream to be played back stored in the private_stream_id register 264 (FIG. 3) in step S127 of FIG. Determine.

In step S253, when it is determined that the private_stream_id described in private_stream1_PES_payload () does not match the private_stream_id stored in the private_stream_id register 264, that is, PES_packet () of private_stream_1 found in the previous step S252 is subject to playback. If it is not the subtitle stream, the flow returns to step S252 to search for PES_packet () of another private_stream_1 in the program stream stored in the buffer 215A, and the same processing is repeated below.

On the other hand, when it is determined in step S253 that the private_stream_id described in the private_stream1_PES_payload () matches the private_stream_id stored in the private_stream_id register 264, that is, PES_packet () of the private_stream_1 found in the previous step S252 is played back. In the case of the subtitle stream, the flow proceeds to step S254, where the subtitle reading function unit 235 reads the AU_locator described in the private_stream1_PES_payload () (Fig. 21) of PES_packet () of the private_stream_1 from the buffer 215A. The head position of the caption access unit is obtained by adding the position immediately after the AU_locator and the value indicated by the AU_locator.

That is, since the AU_locator indicates the head position of the caption access unit (or audio access unit) stored in the private_payload () of private_stream1_PES_payload () on the basis of the position immediately after the AU_locator as described with reference to FIG. By adding the value indicated by the AU_locator to the position immediately after the AU_locator, the (absolute) head position of the caption access unit can be obtained.

The caption reading function unit 235 further updates the caption reading pointer stored in the caption reading pointer storage unit 262 to point to the head position of the caption access unit obtained as described above in step S254. The flow then advances to step S255.

In step S255, the caption reading function unit 235 determines whether there is a request for data from the caption decoder control module 218, and if not, returns to step S255 to perform the same process. Repeat.

If it is determined in step S255 that there is a request for data from the caption decoder control module 218, the flow proceeds to step S256 and the caption reading function unit 235 buffers 215A indicated by the caption reading pointer. Time at which one subtitle access unit of the size described at the beginning of the subtitle access unit is read from the buffer 215A while the program stream is parsed from the position of the subtitle access unit. Together with the stamp, it is supplied to the subtitle decoder control module 218. That is, the size of the caption access unit is described at the head of the caption access unit, and the caption read function unit 235 indicates the data corresponding to the size by the caption read pointer. It reads from the position of the buffer 215A which exists, and supplies the caption access unit which is this read data to the caption decoder control module 218 with the time stamp added to the caption access unit.

The caption reading function unit 235 updates the caption reading pointer by the size of one caption access unit read from the buffer 215A, and returns to step S255, after which the same processing is repeated. do.

[Resynchronization Processing]

Next, the synchronous control of the video data and the audio decoder by the decode control module 214 of FIG. 2 will be described.

As described in S130 of FIG. 30, the decode control module 214 shifts the timing if necessary to secure synchronization, and starts decoding by the video decoder control module 216, the audio decoder control module 217, and The subtitle decoder control module 218 is instructed, but, for example, in accordance with the progress of the decoding process of the video decoder 116 and the audio decoder 117, in synchronization with the output of the video data and the video data. The output of audio data as output data to be output may be shifted.

Therefore, the decode control module 214 corrects misalignment occurring in the output of the video data and the output of the audio data to be output in synchronization with the video data, and resynchronizes the processing so that the video data and the audio data are output in synchronization. Is performed.

A resynchronization process will be described with reference to the flowchart in FIG. 39.

In the resynchronization process, first, in step S271, the decode control module 214 performs the time stamp of the video access unit from the video decoder control module 216 and the time of the audio access unit from the audio control module 217. It is determined whether the deviation from the stamp is large.

That is, as described in step S129 of FIG. 30, each time the video decoder control module 216 obtains the video access unit from the buffer control module 215, the video decoder control module 216 sets the time stamp of the video access unit to the decode control module 214. Supplies). Similarly, the audio control module 217 also supplies the time stamp of the audio access unit to the decode control module 214 each time the audio access unit is obtained from the buffer control module 215.

In step S271, the decode control module 214 is provided with a time stamp supplied from each of the video decoder control module 216 and the audio control module 217 at the same timing (in a certain time, which can be regarded as the same timing). The comparison is made with each other, and it is determined whether the deviation of these time stamps is large.

In step S271, when it is determined that the deviation between the time stamp of the video access unit from the video decoder control module 216 and the time stamp of the audio access unit from the audio control module 217 is not large, that is, the video access unit If the deviation of the time stamp of the audio access unit from the time stamp of the audio access unit is within a range that can be regarded as a predetermined synchronization, for example, two video frames (about 66 milliseconds), the process returns to step S271. The determination (monitoring) of the deviation between time stamps is continued.

On the other hand, in step S271, when it is determined that the deviation between the time stamp of the video access unit from the video decoder control module 216 and the time stamp of the audio access unit from the audio control module 217 is large, that is, video access If the deviation between the time stamp of the unit and the time stamp of the audio access unit is outside the range in which the predetermined synchronization can be considered, the process proceeds to step S272, where the decode control module 214 performs the video decoder control module ( By comparing the time stamp of the video access unit from 216 with the time stamp of the audio access unit from the audio control module 217, it is determined whether any one of the output (decode) of the video data and the output of the audio data is delayed. Determine.

If it is determined in step S272 that the output of the video data is delayed than the output of the audio data, the flow proceeds to step S273, where the decode control module 214 advances the processing of the video access unit by one video access unit. For this purpose, the video decoder control module 216 outputs an instruction not to perform decoding and output (display) of the video access unit, that is, an instruction to skip processing of the video access unit, and proceeds to step S274. .

In step S274, the video decoder control module 216 receives the skip instruction from the decode control module 214, and is supplied with the video access unit from the buffer control module 215 in accordance with the skip instruction. au_ref_flag (FIG. 24) is checked.

That is, au_information () (FIG. 24) arranged in private_stream2_PES_payload () (FIG. 23) of PES_packet () of private_stream_2 contains au_ref_flag as information about an access unit, and the buffer control module 215 is shown in FIG. As described in step S129 or step S216 in FIG. 36, together with the video access unit, au_ref_flag of the video access unit is supplied to the video decoder control module 216.

In step S274, the au_ref_flag of the access unit, which is supplied with the access unit in this way, is checked.

The video decoder control module 216 then proceeds from step S274 to S275, and based on the result of the inspection of the au_ref_flag of the video access unit supplied from the buffer control module 215, the video access unit determines that another video is to be used for other pictures. It is determined whether or not the picture is a non-reference picture that is not referenced in decoding.

Here, as described with reference to FIG. 24, the au_ref_flag of the video access unit indicates whether the access unit is a reference picture, and is 1 when it is a reference picture, and when it is not a reference picture, that is, when it is a non-reference picture. Will be zero.

In step S275, when it is determined that the video access unit supplied from the buffer control module 215 is not a non-reference picture (video access unit of), that is, the video access unit supplied from the buffer control module 215 is a reference picture. In the case, the process proceeds to step S276 where the video decoder control module 216 processes the video access unit to the video decoder 116 as usual, and the next video access unit is supplied from the buffer control module 215. It waits for it to return, and it returns to step S274.

In addition, when it is determined in step S275 that the video access unit supplied from the buffer control module 215 is a non-reference picture, the flow proceeds to step S277, where the video decoder control module 216 performs the video decoder of the video access unit. The processing by 116 is skipped, and the next video access unit waits to be supplied from the buffer control module 215, and returns to step S271.

In this way, the processing of the video access unit is skipped, so that the processing of the video access unit advances by approximately one video access unit (the processing time is shortened). As a result, the output of video data which is delayed is faster than the output of audio data.

On the other hand, when it is determined in step S272 that the output of the video data is not delayed than the output of the audio data, that is, when the output of the audio data is delayed than the output of the video data, the process proceeds to step S278 and decodes. The control module 214 instructs the video decoder control module 216 to repeatedly output the video data corresponding to the video access unit that is now decoded, so as to wait for the processing of the video access unit. It outputs and it progresses to step S279.

In step S279, the video decoder control module 216 receives the instruction of the repetitive output from the decode control module 214, and according to the instruction of the repetitive output, the video access unit that is now decoded by the video decoder 116. The video data corresponding to the above is repeatedly output to the graphics processing module 219, and the next video access unit waits to be supplied from the buffer control module 215, and returns to step S271.

As described above, the decode control module 214 determines whether the output of the video data is delayed than the output of the audio data, and if the output of the video data is delayed than the output of the audio data, 1. Video decoder control module 216 is instructed to skip processing of two access units. Then, the video decoder control module 216 determines whether the access unit is a reference picture or a non-reference picture based on the au_ref_flag of the access unit to which skip is instructed, and in the case of the non-reference picture, the video decoder ( 116 skips the processing of the access unit to which the skip is indicated. Therefore, synchronization between the output of the video data and the output of the audio data can be easily achieved.

In other words, when the access unit skipping processing is a reference picture, video data corresponding to the access unit needs to be decoded for reference at the time of decoding of another access unit to be decoded thereafter. Therefore, in the synchronization control for synchronizing the output of the video data with the output of the audio data, if the processing of the access unit of the reference picture is skipped, other access units that refer to the reference picture cannot be decoded. As a result, in the display of video data, synchronous control appears as noise.

For this reason, it is preferable to skip processing by an access unit other than a reference picture, that is, an access unit of a non-reference picture.

On the other hand, in order to find an access unit of a non-referenced picture with respect to a conventional elementary stream, it is necessary to parse the elementary stream. However, for example, an elementary obtained by encoding according to MPEG4-AVC or the like. Because streams are very complex, parsing can be expensive.

On the other hand, in the program stream stored in the clip stream file recorded on the disc 101, a private_stream2_PES_payload () in which PES_packet_data_byte is extended, apart from PES_packet () (Figs. 16 to 18) in which the video access unit is arranged in PES_packet_data_byte (Fig. ), PES_packet () of private_stream_2 is multiplexed, and au_information () (FIG. 24) of the private_stream2_PES_payload () shows au_ref_flag indicating whether the video access unit is a reference picture or a non-reference picture for each video access unit. Is described. The au_ref_flag is supplied from the buffer control module 215 to the video decoder control module 216 together with the corresponding video access unit. Accordingly, the video decoder control module 216 examines the au_ref_flag of the video access unit, which is supplied with the video access unit, uses little cost and determines whether the video access unit is a reference picture or a non-reference picture. I can recognize it.

[Mark processing]

Next, with reference to the flowchart of FIG. 40, the mark process performed based on Mark () described in PlayListMark () (FIG. 7) is demonstrated.

The decode control module 214 always checks the current time indicated by the built-in timekeeping unit 214A. In step S301, the current time is any of the Marks described in PlayListMark () (Fig. 7). It is determined whether or not the mark_time_stamp of () is matched.

That is, as described in step S124 of FIG. 30, when the player control module 212 tries to play the first PlayItem # 0 of the first PlayList # 0 shown in FIG. 25, the player control module 212 is shown in the upper side of FIG. 28. Of the seven Mark () included in the PlayListMark (), four Mark () s from 1st to 4th are recognized as belonging to the first PlayItem # 0 of PlayList # 0, and the four Mark () {180,090}, {5,580,090}, {10,980,090}, and {16,380,090} which are mark_time_stamp are passed to the decode control module 214 with the intention that the attribute of the time indicated by the mark_time_stamp is "mark processing".

In step S301, in the decode control module 214, whether or not the current time coincides with any one of the time (mark_time_stamp) of the attribute of "mark processing" supplied from the player control module 212 as described above. It is determined.

If it is determined in step S301 that the current time does not coincide with any of the times of the attribute of "mark processing", the process returns to step S301 and the same processing is repeated.

In addition, when it is determined in step S301 that the current time coincides with any one of the time of the attribute of "mark processing", the decoding control module 214 determines that the current time is the time of the attribute of "mark processing". The message of effect and the time of the attribute of "mark processing" coinciding with the current time are supplied to the player control module 212, and the flow proceeds to step S302.

In step S302, the player control module 212 decodes the message indicating that the current time has become the time of the attribute of "mark processing", and the time (mark_time_stamp) of the attribute of "mark processing" matching the current time. Received from the control module 214, Mark () whose mark_time_stamp coincides with the current time is recognized as Mark () (hereinafter referred to as processing target mark appropriately) as the processing target of mark processing.

That is, the player control module 212 recognizes the PlayItem () of the PlayList () currently being played and matches the PlayList () and PlayItem () with the current time from the decode control module 214. The processing target mark is referred to by referring to PlayListMark () (FIG. 7) of the "PLAYLIST.DAT" file (FIG. 5) from the time (mark_time_stamp) of the "mark processing" attribute (hereinafter, appropriately referred to as mark time). Recognize.

Specifically, for example, suppose that the first PlayItem # 0 of the first PlayList # 0 shown in FIG. 25 is now played back, whereby the player control module 212 has the mark time. It recognizes that it is mark_time_stamp of any one of four Mark () from 1st to 4th of seven Mark () contained in PlayListMark () shown in FIG.

If the mark time supplied from the decode control module 214 to the player control module 212 was 16,380,090, for example, the player control module 212 is included in the PlayListMark () shown in the upper part of FIG. Mark_time_stamp recognizes the fourth Mark () corresponding to 16,380,090, which is the mark time, as the processing target mark.

When the player control module 212 recognizes the mark to be processed as described above, the process proceeds from step S302 to S303, in which the entry_ES_stream_id and entry_ES_private_stream_id (FIG. 7) for specifying the elementary stream are described. It is determined whether there is.

In step S303, when it is determined that entry_ES_stream_id and entry_ES_private_stream_id (FIG. 7) for specifying the elementary stream are not described in the processing target mark, that is, when both entry_ES_stream_id and entry_ES_private_stream_id are 0x00, step S304 is skipped. Proceeding to step S305, the process according to the process target mark is performed.

In addition, when it is determined in step S303 that entry_ES_stream_id and entry_ES_private_stream_id (FIG. 7) for specifying the elementary stream are described in the processing target mark, the flow advances to step S304, whereby the player control module 212 proceeds to play Eli. It is determined whether the elementary stream contains the elementary stream specified by the entry_ES_stream_id, and furthermore, entry_ES_private_stream_id as necessary.

In step S304, when it is determined that the elementary stream being reproduced does not contain the elementary stream specified by entry_ES_stream_id and entry_ES_private_stream_id of the processing target mark, the flow returns to step S301. That is, when the elementary stream specified by entry_ES_stream_id and entry_ES_private_stream_id of the mark to be processed is not reproduced, the mark to be processed is ignored.

On the other hand, in step S304, when it is determined that the elementary stream being played includes the elementary stream specified by entry_ES_stream_id and entry_ES_private_stream_id of the mark to be processed, that is, the element identified by entry_ES_stream_id and entry_ES_private_stream_id of the mark to be processed. If the mentor stream is being reproduced, the processing target mark is assumed to be valid, and the flow proceeds to step S305, whereupon the processing corresponding to the processing target mark is performed.

That is, in step S305, the player control module 212 determines the processing target mark by referring to the mark_type (FIG. 7) of the processing target mark.

In step S305, when it is determined that the processing target mark is a chapter mark or an index mark, that is, when the mark_type of the processing target mark is 'Chapter' or 'Index', the process proceeds to step S306, whereby the player control module 212 Instructs the graphics processing module 219 to update the display of the chapter or index number to the chapter or index number indicated by the chapter mark or index mark which is the processing target mark, and returns to step S301.

In addition, when it is determined in step S305 that the process target mark is an event mark, that is, when the mark_type of the process target mark is 'Event', the process proceeds to step S307, where the player control module 212 generates an event. The script control module 211 is notified (supplied) of the event message indicating and mark_data of the mark to be processed, and the flow proceeds to step S308.

In step S308, the script control module 211 receives the event message and mark_data from the player control module 212, sets the event message as an interrupt request, and performs a series of processes previously described in the "SCRIPT.DAT" file. and mark_data as arguments, and the flow returns to step S301.

In other words, the script control module 211 performs processing corresponding to mark_data.

Specifically, for example, in PlayListMark () of PlayList # 1 shown below in FIG. 28, the second Mark () (Mark # 1) and the third Mark () (Mark # 2) are both: Although mark_type is "Event", mark_data differs into 1 (Mark # 1) and 2 (Mark # 2), respectively.

In any case, the script control module 211 receives the event message corresponding to the second Mark () and the event message corresponding to the third Mark (). Therefore, although processing is performed in the same event handler (interrupt processing routine), different processing is performed for each mark_data for the event message by checking mark_data supplied with the event message in the event handler.

Specifically, for example, when mark_data is 1, the script control module 211 controls the graphics processing module 219 to display the first type of icon. For example, when mark_data is 2, the script processing module 211 controls the graphics processing module 219 to display the second type of icon.

In addition, mark_data is not limited to 1 or 2, and the process performed corresponding to mark_data is not limited to display of a simple icon as mentioned above.

That is, for example, when mark_data is a value in the range of 3-18, the script control module 211 controls the graphics processing module 219 to subtract 2 from mark_data to display the first type of icon. It is performed with brightness corresponding to a value (number of 1-16). For example, if mark_data is a value in the range of 19 to 34, the script control module 211 controls the graphics processing module 219 to subtract 18 from the mark_data to display the second type of icon. It is performed with brightness corresponding to a value (number of 1-16).

In addition, for example, the controller which a user operates is connected to the input interface 115 (FIG. 1), and the DC motor which attached the weight which the controller attached to the axis | shaft of a DC (Direct Current) motor is attached. If a built-in vibrating motor is generated when vibration is generated, when the mark_data is a value in the range of 35 to 42, the vibrating motor is operated by the operation time according to the value obtained by subtracting 34 from the mark_data (the value of 1 to 8). You can.

mark_data is a numerical value, and its usage and algorithm can be described by a script program executed by the script control module 211. Therefore, mark_data can be used not only by using a predetermined rule, but also by a rule independently set by the manufacturer of the disc 101, a content provider that provides data recorded on the disc 101, or the like.

As described above, in the mark processing, when the current time coincides with the time of the attribute of "mark processing", the processing target mark is recognized from the mark time which is the time of the attribute of "mark processing". In addition, when entry_ES_stream_id and entry_ES_private_stream_id for specifying the elementary stream are not described in the processing target mark, processing according to the mark_type of the processing target mark is performed. In addition, even if entry_ES_stream_id and entry_ES_private_stream_id that specify an elementary stream are described in the mark to be processed, if the elementary stream specified by the entry_ES_stream_id and entry_ES_private_stream_id is being played, processing according to mark_type of the mark to be processed is performed. Is done.

Therefore, for example, suppose that the reproduction of the second PlayList # 1 shown in Fig. 25 is performed now, the following mark processing is performed.

That is, in PlayListMark () of the second PlayList # 1, as shown in the lower part of Fig. 28, the first Mark () (Mark # 0) and the second Mark_time_stamp are respectively designated 90,000, 27,090,000, and 27,540,000. Mark () (Mark # 1) and the third Mark () (Mark # 2) are described.

In the PlayListMark () at the bottom of Fig. 28, 0xE0 and 0xE1 are described in the entry_ES_stream_id of the second Mark () and the third Mark (), respectively, so that the second Mark () and the third Mark are respectively described. () Is associated with an elementary stream whose stream_id is specified by 0xE0 and 0xE1, respectively.

As described with reference to Fig. 25, only one PlayItem () (PlayItem # 0) is described in the second PlayList # 1, and according to the PlayItem # 0, the clip stream file "00003.PS" is played. In the clip stream file "00003.PS", as described in the clip information file "00003.CLP" in FIG. 26 corresponding to the clip stream file "00003.PS", the video stream identified by stream_id of 0xE0 is specified. The three elementary streams of the video stream stream # 1 identified by stream # 0, stream_id of 0xE1, stream_id of 0xBD, and private stream_id of 0x00 are multiplexed.

Therefore, the second Mark () of PlayListMark () at the bottom of Fig. 28 is associated with the video stream stream # 0 having the stream_id of 0xE0 multiplexed in the clip stream file "00003.PS" and the third Mark (). Mark () is associated with a video stream stream # 1 having a stream_id of 0xE1 multiplexed with a clip stream file "00003.PS".

When playback of PlayItem # 0 of the second PlayList # 1 of FIG. 25 is started, as described in step S124 of FIG. 30, the player control module 212 is included in the PlayListMark () shown in FIG. 28 below. Recognizes that three Mark () s belong to PlayItem # 0 of PlayList # 1, and that {90,000}, {27,090,000}, and {27,540,000}, which are mark_time_stamp of the three Mark (), of the time indicated by the mark_time_stamp The attribute is passed to the decode control module 214 with the intention of "mark processing".

In the mark processing, the current time clocked by the time releasing unit 214A during the playback of PlayItem # 0 of PlayList # 1 by the decoding control module 214 has the attributes {90,000}, {27,090,000} , {27,540,000} is always matched (step S301), and if the current time matches the time of "mark processing", the time of the attribute of "mark processing" matching the current time is A message indicating that the mark time and the current time have become the time of the attribute of "mark processing" is supplied to the player control module 212.

That is, for example, if it is assumed that now the current time coincides with 27,090,000 of the time {90,000}, {27,090,000}, and {27,540,000} of the attribute of "mark processing", the decode control module 214 is the current time. The player control module 212 supplies a message to the player control module 212 indicating that the mark time 27,090,000 which is the time of the attribute of "mark processing" and the current time have become the time of the attribute of "mark processing".

The player control module 212 recognizes that PlayItem # 0 of PlayList # 1 is currently played, and PlayItem # 0 of Mark () described in PlayListMark () shown in FIG. 28 below of PlayList # 1. By comparing 90,000, 27,090,000, and 27,540,000 which are mark_time_stamp of three Mark () belonging to each other with 27,090,000 which is the mark time from the decode control module 214, the Mark () whose mark_time_stamp matches the mark time 27,090,000, that is, The second Mark () (Mark # 1) described in the PlayListMark () at the lower side in Fig. 28 is recognized as the processing target mark (step S302).

In the second Mark () described in PlayListMark () at the lower side in Fig. 28, 0xE0 is designated as entry_ES_stream_id. The entry_ES_stream_id of 0xE0 indicates the video stream stream # 0 (FIG. 26) in which stream_id is 0xE0, which is multiplexed into the clip stream file "00003.PS" from the above. ) Determines whether the video stream stream # 0 is included in the elementary stream being played back (steps S303, S304).

If the video stream stream # 0 is not included in the elementary stream being played back, the processing target mark is ignored (step S304).

On the other hand, when the video stream stream # 0 is included in the elementary stream being played back, the processing target mark is assumed to be valid, and processing corresponding to the processing target mark is performed (steps S305 to S308).

That is, in this case, the second Mark () described in PlayListMark () at the lower side of Fig. 28, which is the processing target mark, is an event mark because its mark_type is 'Event', and therefore, the player control module 212 ) Supplies an event message indicating the occurrence of the event and mark_data of the processing target mark to the script control module 211 (steps S305 and S307). Then, the script control module 211 uses the event message from the player control module 212 as an interrupt request, and performs a series of processes described in the "SCRIPT.DAT" file in advance, and mark_data supplied with the event message. It performs as an argument (step S308).

As described above, according to the mark processing, zero or more Mark () including mark_time_stamp indicating one playback time on the time axis of PlayList (), mark_type indicating the type of Mark (), and mark_data as an argument of the event mark. According to PlayList () (FIG. 5) including PlayListMark () (FIG. 7), the current time, which is the playback time of the clip stream file being played, is determined to match mark_time_stamp, and the current time is mark_time_stamp. In the case of coinciding with, Mark () having the same mark_time_stamp as the mark time as the coincidence current time is recognized as the mark to be processed. If the mark_type of the mark to be processed indicates the type of generating an event, that is, if the mark to be processed is an event mark, the mark_data and the event message of the mark to be processed are notified, and the processing according to the mark_data is performed. Is executed. Therefore, according to the playback time of the clip stream file, it is possible to execute the processing corresponding to mark_data.

[Control Processing of Output Properties]

Next, with reference to the flowchart of FIG. 41, the detail of the control process of the output attribute performed by step S126 of FIG. 30 etc. is demonstrated.

As described in step S126 of FIG. 30, the player control module 212 firstly, for each of one or more elementary streams to be reproduced, that is, one or more elementary streams determined to be reproduced in step S125 of FIG. 30, Number_of_DynamicInfo (FIG. 10) indicating the number of DynamicInfo () (FIG. 13) in which the output attribute is described is examined.

When the number_of_DynamicInfo is 0 for all one or more elementary streams to be played back, the player control module 212 does not perform processing in particular.

On the other hand, when number_of_DynamicInfo regarding the elementary stream to be played back is not 0, the player control module 212 performs the process of controlling the output attribute according to the flowchart of FIG.

Therefore, in the case where the three clip information files " 00001.CLP ", " 00002.CLP ", " 00003.CLP " recorded on the disc 101 are as shown in FIG. When the clip stream file "00001.PS" (the first PlayItem # 0 of the first PlayList # 0 to play back) corresponding to the information file "00001.CLP" is played back, the clip information file "00001.CLP" ( In Fig. 26), for all of the four elementary streams stream # 0 to stream # 3 multiplexed in the clip stream file "00001.PS", the number_of_DynamicInfo is 0, so that the output attribute control process is performed. I do not lose.

Similarly, even when the clip stream file "00002.PS" (the second PlayItem # 1 of the first PlayList # 0 that plays back) corresponding to the clip information file "00002.CLP" is played, the clip information file "00002." In the CLP "(FIG. 26), since number_of_DynamicInfo is 0 for all four elementary streams stream # 0 to stream # 3 multiplexed in the clip stream file" 00002.PS ", the output attribute is controlled. No processing is done.

On the other hand, when the clip stream file "00003.PS" (PlayItem # 0 of the second PlayList # 1 that plays back) corresponding to the clip information file "00003.CLP" is played back, the clip information file "00003.CLP" is played. In Fig. 26, video stream stream # 0, which is the first elementary stream, among the three elementary streams stream # 0 to stream # 2 multiplexed in the clip stream file "00003.PS", and the third The number_of_DynamicInfo is set to 2 and 3 instead of 0 for audio stream stream # 2 which is an elementary stream of?, So that output attribute control processing is performed.

That is, in the output attribute control process, first, in step S320, the player control module 212 selects pts_change_point described in the clip information file Clip () (Fig. 10) corresponding to the clip stream file to be played back, " With the intention that the time of the attribute of the DynamicInfo () process is conveyed, it is transmitted to the decode control module 214, and the decode control module 214 transmits the time of the attribute of the "DynamicInfo () process" from the player control module 212. After receiving pts_change_point, the process proceeds to step S321.

In step S321, the decode control module 214 determines whether or not the current time indicated by the timekeeping unit 214A coincides with any one of pts_change_point which is the time of the attribute of the "DynamicInfo () process". If it is determined that they do not match, the flow returns to step S321.

In addition, when it is determined in step S321 that the current time coincides with any one of the time of the attribute of "DynamicInfo () processing", the decoding control module 214 determines that the current time is "DynamicInfo () processing". A message indicating that the time has passed to the attribute and the time of the attribute of the "DynamicInfo () process" corresponding to the current time (hereinafter, appropriately referred to as DynamicInfo time) are supplied to the player control module 212. Proceed to S322.

In step S332, the player control module 212 receives a message indicating that the current time has become the time of the attribute of "DynamicInfo () processing" and the DynamicInfo time from the decoding control module 214, and the DynamicInfo time. DynamicInfo (), which is set with pts_change_point (Fig. 10) matching with, is recognized as the processing target DynamicInfo () which is the DynamicInfo () of the processing target, and the flow proceeds to step S323.

In step S323, the player control module 212 supplies the output attribute described in DynamicInfo () (Fig. 13), which is the processing target DynamicInfo (), to the graphics processing module 219 or the audio output module 221. The flow proceeds to step S324.

In step S324, the graphics processing module 219 or the audio output module 221 controls the output of the video data or the audio data, respectively, in accordance with the output attribute supplied from the player control module 212 in the previous step S323. The process then returns to Step S321.

Thereby, video data is output according to the aspect ratio described as an output attribute (display system), for example, or audio data is described as output attribute (output system), for example, stereo or It is output according to dual (two languages).

Next, with reference to FIG. 42, the detail of the control process of an output attribute is further demonstrated.

That is, FIG. 42 shows a set (p. 10) of pts_change_point and DynamicInfo () described in the clip information file "00003.CLP" in FIG.

As described above, the video stream stream # 0 which is the first elementary stream among the three elementary streams stream # 0 to stream # 2 multiplexed in the clip stream file "00003.PS", and 3, For the audio stream stream # 2 which is the first elementary stream, the number_of_DynamicInfo is 2 and 3 in the clip information file "00003.CLP" in FIG. 26, respectively. Therefore, in the clip information file "00003.CLP", two sets of pts_change_point and DynamicInfo () are described for the first video stream stream # 0 of the clip stream file "00003.PS", and the third audio stream is described. For stream # 2, three sets of pts_change_point and DynamicInfo () are described.

The upper side of FIG. 42 shows two sets of pts_change_point and DynamicInfo () described with respect to the first video stream stream # 0 of the clip stream file "00003.PS", and the lower side of FIG. 42 shows the clip stream file "00003." Three sets of pts_change_point and DynamicInfo () are described for the third audio stream stream # 2 of ".PS".

In addition, in addition to the two sets of pts_change_point and DynamicInfo () described for the first video stream stream # 0, the clip information file " 00003.CLP " Stream_id (= 0xE0), private_stream_id (= 0x00), and number_of_DynamicInfo (= 2) described in FIG. Similarly, in the lower side of FIG. 42, in addition to the three sets of pts_change_point and DynamicInfo () described for the third audio stream stream # 2, the clip information file " 00003.CLP " Stream_id (= 0xBD), private_stream_id (= 0x00), and number_of_DynamicInfo (= 3) described in FIG.

Above the FIG. 42, in the first set of two sets of pts_change_point and DynamicInfo () described with respect to video stream stream # 0, pts_change_point is 90,000, and display_aspect_ratio (FIG. 13) of DynamicInfo () is '4: 3'. ' In the second set, pts_change_point is 54,090,000, and display_aspect_ratio of DynamicInfo () is '16: 9 '.

On the other hand, at the lower side of FIG. 42, in the first set of the three sets of pts_change_point and DynamicInfo () described for the audio stream stream # 2, pts_change_point is 90,000, and the channel_assignment (FIG. 13) of DynamicInfo () is 'Dual'. ' In the second set, pts_change_point is 27,090,000, and channel_assignment of DynamicInfo () is 'Stereo'. In the third set, pts_change_point is 32,490,000, and channel_assignment of DynamicInfo () is 'Dual'.

For example, at step S125 in Fig. 30, the first video stream stream # 0 identified by stream_id of 0xE0 of the clip stream file "00003.PS", stream_id and 0x00 of 0xBD It is assumed that the third audio stream stream # 2 identified by the private_stream_id present is determined as the stream to be played.

In this case, the player control module 212 includes two sets of pts_change_point and DynamicInfo () on the upper side of FIG. 42 described with respect to video stream stream # 0 specified by stream_id of 0xE0, stream_id and 0x00 of 0xBD. The audio stream stream # 2 identified by the private_stream_id described above is examined by examining the three sets of pts_change_point in FIG. 42 and pts_change_point in DynamicInfo (), and recognizes the initial value.

That is, pts_change_point is 90,000 in the first set of two sets of pts_change_point and DynamicInfo () on the upper side of FIG. 42 described with respect to video stream stream # 0 identified by stream_id of 0xE0. The time of 90,000 is the clip stream file "00003.PS" in the clip information file "00003.CLP" in FIG. 26 corresponding to the clip stream file "00003.PS" in which video stream stream # 0 is multiplexed. This coincides with the time 90,000 described in presentation_start_time indicating the time of the beginning of.

Similarly, pts_change_point is 90,000 in the first set of three sets of pts_change_point and DynamicInfo () shown below in FIG. 42 described for the audio stream stream # 2 identified by stream_id of 0xBD and private_stream_id of 0x00. . The time of 90,000 is the clip stream file "00003.PS" in the clip information file "00003.CLP" in FIG. 26 corresponding to the clip stream file "00003.PS" in which audio stream stream # 2 is multiplexed. This coincides with the time 90,000 described in presentation_start_time indicating the time of the beginning of.

The player control module 212 recognizes, as an initial value, pts_change_point corresponding to the time 90,000 described in presentation_start_time indicating the start time of the clip stream file "00003.PS". Therefore, the first set of two sets of pts_change_point and DynamicInfo () on the upper side of FIG. 42 and the pts_change_point of the first set of three sets of pts_change_point and DynamicInfo () on the lower side of FIG. 42 are recognized as initial values.

Then, the player control module 212, in accordance with pts_change_point recognized as the initial value and DynamicInfo () set as the initial value, before playback of the clip stream file "00003.PS" is started (in step S126 in FIG. 30). Indicates the output attribute of the corresponding elementary stream.

That is, for video stream stream # 0 identified by stream_id of 0xE0, display_aspect_ratio is set to '4: 3' in the upper side of FIG. 42 in pts_change_point having an initial value of 90,000 and DynamicInfo () set. have. In this case, the player control module 212 displays information on the output attribute that the display_aspect_ratio is '4: 3', that is, the video stream stream # 0 is 4: 3 aspect ratio video data. The graphics processing module 219 is controlled.

In addition, for audio stream stream # 2 identified by stream_id of 0xBD and private_stream_id of 0x00, in the lower part of FIG. 42, pts_change_point having an initial value of 90,000 and DynamicInfo () set as a channel_assignment are ' Dual '. In this case, the player control module 212 informs the audio output module 221 of the output attribute that the channel_assignment is 'Dual', that is, that the audio stream stream # 2 is dual audio data. Supply.

Here, in step S126 of FIG. 30, the output attribute control process which targets pts_change_point as an initial value as mentioned above is performed.

The player control module 212 then has two pts_change_points of 90,000 and 54,090,000 above FIG. 42 for video stream stream # 0, and three pts_change_points of 90,000, 27,090,000, lower than FIG. 42 for audio stream stream # 2. And {27,090,000}, {32,490,000}, and {54,090,000}, which are times other than the initial value of 90,000, of 32,490,000 are passed to the decode control module 214 with the purpose of the attribute time of "DynamicInfo () processing" (step) S320).

The decode control module 214 receives the time {27,090,000}, {32,490,000}, {54,090,000} of the attribute of "DynamicInfo () processing" from the player control module 212, and also receives the video streams stream # 0 and After the start of the playback of the audio stream stream # 2 (the playback of the PlayItem # 0 of the second PlayList # 1 that plays the clip stream file "00003.PS"), the monitoring of the current time as indicated by the time lag 214A is performed. It starts.

When the current time coincides with any one of the time {27,090,000}, {32,490,000}, and {54,090,000} of the attribute of "DynamicInfo () processing", the decode control module 214 matches the current time with " The DynamicInfo time which is the time of the attribute of "DynamicInfo () processing" is supplied to the player control module 212 (step S321).

That is, for example, if the current time is set to 27,090,000, the decoding control module 214 sets the 27,090,000 that matches the current time in the attribute time of "DynamicInfo () processing" as the DynamicInfo time, Supply to the control module 212.

The player control module 212 receives 27,090,000 which is the DynamicInfo time from the decode control module 214, and the two pts_change_points on the upper side of FIG. 42 for the video stream stream # 0, and the lower side of FIG. 42 on the audio stream stream # 2. From among the three pts_change_points, pts_change_point matching the DynamicInfo time 27,090,000 is examined, and the dynamicInfo () set with the pts_change_point corresponding to the 27,090,000, i.e., the second lower part of FIG. 42 for the audio stream stream # 2 The DynamicInfo () is recognized as the processing target DynamicInfo () (step S322).

If the processing target DynamicInfo () is the DynamicInfo () for the video stream, the player control module 212 supplies the graphics processing module 219 with the output attribute described in the processing target DynamicInfo () (step S323). ). In addition, when the processing target DynamicInfo () is the DynamicInfo () for the audio stream, the player control module 212 supplies the output attribute described in the processing target DynamicInfo () to the audio output module 221 ( Step S323).

When the output attribute is supplied from the player control module 212, the graphics processing module 219 starts controlling the output of the video data in accordance with the output attribute (step S324).

That is, the graphics processing module 219 is, for example, an indication of the aspect ratio of the video data indicated by the output attribute from the player control module 212 (display_aspect_ratio (FIG. 13)) and the video output terminal of FIG. 1. The aspect ratio of the video data output to the video output module 220 is converted based on the aspect ratio of the video output device connected to 120.

Specifically, for example, when the aspect ratio of the video output device is 16: 9, when the indication of the aspect ratio of the video data as the output attribute indicates the aspect ratio of 4: 3, the graphics processing module ( 219 squeezes the video data output to the video output module 220 in the horizontal direction, and outputs black light on the left and right sides. For example, when the aspect ratio of the video output device is 4: 3, when the indication of the aspect ratio of the video data as the output attribute indicates the aspect ratio of 16: 9, the graphics processing module 219 Squeezes the video data output to the video output module 220 in the vertical direction, and puts black light up and down to output it. For example, when the aspect ratio of the aspect ratio of the video output apparatus and the aspect ratio indicated by the aspect ratio of the video data as the output attributes are both 4: 3 and 16: 9, the graphics processing module ( 219 outputs the video data output to the video output module 220 without being squeezed.

Here, according to two sets of pts_change_point and DynamicInfo () described with respect to video stream stream # 0 identified by stream_id of 0xE0 on the upper side of FIG. 42, the time is starting from time 90,000 at the start of playback of video stream stream # 0. Up to 54,090,000, the video stream stream # 0 obtains 4: 3 aspect ratio video data. After the time 54,090,000, video data having an aspect ratio of 16: 9 is obtained from the video stream stream # 0.

Therefore, for example, if the aspect ratio of the video output device connected to the video output terminal 120 of FIG. 1 is 4: 3, the graphics processing module 219 will display the video from the time 90,000 to the time before the time 54,090,000. The 4: 3 aspect ratio video data obtained from the stream stream # 0 is supplied to the 4: 3 aspect ratio video output device as it is, and displayed.

After the time 54,090,000, the 16: 9 aspect ratio video data obtained from the video stream stream # 0 is squeezed vertically, and the 4: 3 aspect ratio video signal with black light is added up and down. Is supplied to a video output device with an aspect ratio of 4: 3 and displayed.

On the other hand, if the output attribute is supplied from the player control module 212, the audio output module 221 starts controlling the output of the audio data in accordance with the output attribute (step S324).

That is, the audio output module 221 inputs the channel assignment instruction (channel_assignment (FIG. 13)) of the audio data indicated by the output attribute from the player control module 212, for example, by the user operating the remote controller. Based on the audio output mode supplied from the player control module 212 via the interface 115 (FIG. 1), audio data from the audio decoder control module 217 is processed to output an audio output terminal 121 (FIG. 1). )

Specifically, for example, the instruction for channel assignment of audio data indicated by the output attribute indicates that the left channel is audio data of "main audio" and the right channel is dual (2) audio data of "sub audio". In the case of a native language mode, the audio output module 221 processes audio data from the audio decoder control module 217 in accordance with the audio output mode supplied from the player control module 212, and outputs an audio output terminal. Output to (121).

That is, when "main audio" is designated as the audio output mode, for example, the audio output module 221 receives the audio data of the left channel of the audio data from the audio decoder control module 217 and the right channel. Is copied as audio data, and the audio data of the left channel and the right channel (audio data of "main audio") is output to the audio output terminal 121. When "negative voice" is designated as the audio output mode, the audio output module 221 uses the audio data of the right channel among the audio data from the audio decoder control module 217 as audio data of the left channel. It copies and outputs audio data (audio data of "negative audio") of the left channel and the right channel to the audio output terminal 121. When the "main unit" is designated as the audio output mode, the audio output module 221 outputs the audio data from the audio decoder control module 217 to the audio output terminal 121 as it is. .

For example, when the instruction of channel assignment of audio data indicated by the output attribute indicates a stereo mode, the audio output module 221 is connected to the audio output mode supplied from the player control module 212. Regardless, the audio data from the audio decoder control module 217 is output to the audio output terminal 121 as it is.

In the lower part of FIG. 42, according to three sets of pts_change_point and DynamicInfo () described for audio stream stream # 2 specified by stream_id of 0xBD and private_stream_id of 0x00, playback of audio stream stream # 2 is started. Dual audio data is obtained from audio stream stream # 2 from the visual recognition time 90,000 until immediately before the visual 27,090,000. Further, stereo audio data is obtained from audio stream stream # 2 from time 27,090,000 to just before time 32,490,000, and dual audio data is obtained from audio stream stream # 2 after time 32,490,000.

Thus, for example, suppose that "main voice" is designated as the audio output mode. In the audio output module 221, the dual audio obtained from the audio stream stream # 2 from the time 90,000 until immediately before the time 27,090,000 is obtained. Audio data of the left channel in the data is copied as audio data of the right channel, and audio data of the left channel and the right channel are output to the audio output terminal 121.

In addition, from the time 27,090,000 until just before time 32,490,000, the stereo audio data obtained from the audio stream stream # 2 is output to the audio output terminal 121 as it is.

After time 32,490,000, the audio data of the left channel of the dual audio data obtained from the audio stream stream # 2 is copied as the audio data of the right channel, and the audio data of the left channel and the right channel is output to the audio output terminal ( 121).

As described above, in the output attribute control process, for each elementary stream multiplexed in the clip stream file, pts_change_point indicating the playback time of the elementary stream, and DynamicInfo (including the output attribute of the elementary stream) ), Based on the description of the clip information file Clip () (FIG. 10) including zero or more sets, it is determined whether or not the reproduction time of the elementary stream being reproduced coincides with pts_change_point. When the playback time of the elementary stream being played coincides with pts_change_point, the DynamicInfo () set with the pts_change_point is recognized, and the playing element is played according to the output attribute included in the recognized DynamicInfo (). The output of the mentor stream is controlled. Therefore, the output of the elementary stream can be controlled in accordance with the reproduction time and the output attribute of the elementary stream.

[Subtitle Display Control Processing]

Subsequently, a caption display control process for controlling the display of caption data corresponding to the caption stream will be described with reference to the flowchart in FIG. 43.

When playback of PlayList () (PlayItem () in Fig. 5) is started, in step S341, the player control module 212 initializes an instruction of the display system of the caption data to the graphics processing module 219. That is, the player control module 212 controls the graphics processing module 219 to make the display method of the caption data the default display method. In addition, the initialization of the instruction | command of the display system performed in step S341 corresponds to the initialization of the instruction | command of the display system demonstrated by 127 of FIG.

After the process of step S341, it progresses to step S342, and the player control module 212 determines whether the display method of the caption data was instruct | indicated from the input interface 115 by the user operating a remote control. Determine whether or not.

If it is determined in step S342 that there is an indication of a new display system, the flow proceeds to step S343, where the player control module 212 determines whether or not the caption stream (corresponding caption data) is currently being reproduced.

If it is determined in step S343 that the subtitle stream has not been reproduced, the process returns to step S342.

If it is determined in step S343 that the subtitle stream has been reproduced, the flow proceeds to step S345, where the player control module 212 determines whether or not the instruction of the new display system is the instruction of the default display system. When it is determined in step S343 that the instruction of the new display system is the instruction of the default display system, the flow returns to step S341, and as described above, the player control module 212 displays the display system of the caption data as the default display. To control the graphics processing module 219.

On the other hand, when it is determined in step S345 that the instruction of the new display system is not the instruction of the default display system, that is, the instruction of the new display system displays, for example, enlarged or reduced the caption data, or In the case of an instruction of a display method other than the default, such as changing the brightness to make it easier to see, the flow advances to step S346, where the player control module 212 includes clip information corresponding to the clip stream file in which the subtitle stream currently being reproduced is multiplexed. In StaticInfo () (FIG. 12) of the file Clip () (FIG. 10), StaticInfo () with respect to the currently reproduced subtitle stream is obtained, and the flow proceeds to step S347.

In step S347, the player control module 212 determines the configurable_flag of the StaticInfo () obtained in step S346.

If it is determined in step S347 that the configurable_flag is 0 in that the change of the display system of the caption data is not allowed, the flow proceeds to step S348, where the player control module 212 controls the graphics processing module 219. By overlaying the output message with an error message indicating that the display system of the caption data cannot be changed, the flow returns to step S342. As a result, an error message is displayed.

On the other hand, when it is determined in step S347 that configurable_flag is 1 for the purpose of allowing the change of the display system of the caption data, the flow proceeds to step S349, where the player control module 212 inputs the user by operating the remote controller. The instruction of the new display method supplied from the interface 115 is supplied to the graphics processing module 219, and the flow proceeds to step S350.

In step S350, the graphics processing module 219 enlarges or reduces the caption data supplied from the caption decoder control module 218 in accordance with an instruction of the display method supplied from the player control module 212 in step S349 immediately before. Or a process of changing the brightness is started and the flow returns to step S342. Thereby, the caption data is displayed by the display size, display position, display color, etc. according to the display system which the user instructed by operating the remote control.

On the other hand, when it is determined in step S342 that there is no indication of a new display system, the flow proceeds to step S351, where the player control module 212 determines whether or not the PlayItem () described in FIG. 31 has been changed, If it is determined not to be performed, the flow returns to step S342.

If it is determined in step S351 that the PlayItem () is changed, the process returns to step S341, and as described above, the player control module 212 sets the display method of the caption data to be the default display method. The graphics processing module 219 is controlled. That is, in this case, when the PlayItem () is changed, the display method of the caption data returns to the default display method.

As described above, in the subtitle display control process, the display method of the subtitle data corresponding to the subtitle stream is, for example, a user only when the configurable_flag of the subtitle stream is set to 1 to allow the display system to be changed. Is changed in accordance with the indication of the display mode input by operating the remote controller.

Thus, for example, according to the clip information file "00001.CLP" shown in FIG. 26, the third elementary stream of four elementary streams multiplexed in the corresponding clip stream file "00001.PS" The configurable_flag for subtitle stream stream # 2 is set to 0 to disallow changes in display format, so the user can operate the remote control to change the subtitle display when the subtitle stream stream # 2 is displayed. The display does not change.

On the other hand, for example, the configurable_flag for the subtitle stream stream # 3, which is the fourth elementary stream among the four elementary streams multiplexed in the clip stream file "00001.PS", allows the display system to be changed. Since the value is 1, when the user operates the remote control to change the display of the subtitles while the subtitle stream stream # 3 is displayed, the display size of the subtitles is changed according to the operation.

That is, for example, it is assumed that the clip stream file "00001.PS" is reproduced in accordance with the first PlayItem # 0 of the first PlayList # 0 in FIG. As described with respect to the clip information file "00001.CLP" in Fig. 26, the third and fourth of the four elementary streams multiplexed with the clip stream file "00001.PS" are subtitle streams. It is assumed that the third subtitle stream stream # 2 and the fourth subtitle stream stream # 3, for example, the third subtitle stream stream # 2 are currently played.

When the user inputs an instruction of the display method of the caption by operating the remote control (step S342), the instruction of the display method is supplied to the player control module 212 from the input interface 115 (FIG. 1). The player control module 212 finds, from the clip information file, the StaticInfo () (Fig. 10) corresponding to the subtitle stream being played back when the instruction of the display method is supplied (step S346).

That is, in this case, the subtitle stream being played is the third subtitle stream stream # 2 multiplexed on the clip stream file "00001.PS", and the player control module 212 determines the corresponding clip information file "00001. CLP ", to find the StaticInfo () for the third subtitle stream stream # 2.

In addition, the player control module 212 determines the configurable_flag of 0 described in StaticInfo () for the third subtitle stream stream # 2 in FIG. 26 (step S347), whereby the third Recognize that subtitle stream stream # 2 is not allowed to change the display format.

In this case, the player control module 212 determines that the subtitle stream (corresponding to the subtitle data) that is being played does not correspond to enlargement or reduction, and controls the graphics processing module 219 to generate an error message for that purpose. (Step S348), the video data is overlaid and output.

On the other hand, the third subtitle stream stream # 2 of the four elementary streams multiplexed in the clip stream file "00001.PS", and the third subtitle stream stream # 2 of the fourth subtitle stream stream # 3 On the other hand, when the fourth subtitle stream stream # 3 is currently being played back, the player control module 212, which has been supplied with the instruction of the display method by the user operating the remote control, sends the corresponding clip information file "00001.CLP. ", Then find StaticInfo () for the fourth subtitle stream stream # 3.

In addition, the player control module 212 determines the configurable_flag of 1 described in StaticInfo () for the fourth subtitle stream stream # 3 in FIG. 26 (step S347), whereby the fourth Recognize that subtitle stream stream # 3 is permitted to change its display format.

In this case, the player control module 212 determines that the subtitle stream (corresponding to the subtitle data) that is being played corresponds to enlargement and reduction, etc., and gives an instruction of the display system supplied by the user operating the remote control. 219) (step S349).

Thereby, the graphics processing control module 219 then enlarges or reduces the caption data from the caption decoder control module 218 in accordance with the instruction of the display method from the player control module 212, and the video. The video data from the decoder control module 216 is overlaid and output.

In addition, the player control module 212 initializes the instruction of the display system of the caption data to the graphics processing module 219 at the start of playback of the first PlayItem () of the PlayList () (step S341). That is, the player control module 212 controls the graphics processing module 219 to make the display method of the caption data the default display method.

The player control module 212 also initializes the instruction for displaying the caption data to the graphics processing module 219 even when the PlayItem () is switched (steps S341 and S351).

However, when the PlayItem () is switched, the configurable_flag for the new subtitle stream played in accordance with the newly-played PlayItem () is examined. If the configurable_flag is 0, the subtitle data for the graphics processing module 219 is changed. When the instruction of the display method of the initialization is initialized and configurable_flag is 1, it is possible to keep the instruction of the display method for the graphics processing module 219 as it is before the change of the PlayItem ().

In addition, in the caption display control process of FIG. 43, when the user inputs an instruction of a new display system by operating the remote controller, the instruction of the new display system is supplied to the graphics processing module 219 (step S349). ), The instruction of the display method is stored in the nonvolatile memory constituting the memory 113 (FIG. 1), and the instruction of the display method stored in the nonvolatile memory is sent to the graphics processing module 219. It is possible to supply.

That is, for example, when the instruction of the display method of the user setting is stored in the nonvolatile memory as the initial setting of the disk device of FIG. 1 and the instruction of the new display method is input by the user operating the remote controller. It is possible to update the instruction of the display method stored in the nonvolatile memory to the instruction of the new display method and to supply the instruction of the display method stored in the nonvolatile memory to the graphics processing module 219. In this case, since the instruction of the display method at the end of the previous playback is retained in the nonvolatile memory, when the user plays the remote control at the time of the next PlayList () playback, the display method at the end of the previous playback is Even if no instruction is input, display of the caption data is started in the display manner.

In this case, the indication of the display system stored in the nonvolatile memory includes, for example, an enlargement rate or a reduction rate when the subtitle data is enlarged or reduced.

As described above, according to the caption display control process, the caption data in the StaticInfo () which is not changed during reproduction of the elementary stream for each elementary stream included in the clip information file Clip () (Fig. 10). The default display of the caption data being played, based on the configurable_flag obtained from the StaticInfo () obtained and contained in the StaticInfo () indicating whether to allow the display of the caption data to be changed from the default display method. It is determined whether or not the change is allowed from the method. If it is permitted to change the display of the caption data being reproduced from the default display method, the display processing of the caption data, i.e., the caption data, in accordance with the instruction of the change of the display method of the caption data. Is displayed by enlarging or reducing the display or changing the display color. Therefore, it is possible to control the change of the display method of the caption data.

[Capture Control Processing]

Next, with reference to the flowchart of FIG. 44, the capture control process for controlling the capture of video data corresponding to the video stream will be described. FIG. 44 also shows a flowchart for explaining a capture control process, and a flowchart for explaining a background / screen saver process, which is an example of a process of using video data captured by the capture control process secondarily.

The capture control process is started when a capture instruction for instructing capture of video data is supplied to the player control module 212 via the input interface 115 (FIG. 1), for example, by the user operating the remote controller. .

That is, in the capture control process, first, in step S371, when the player control module 212 determines whether the video stream is being played back and determines that it is not playing, the capture control process ends.

On the other hand, when it is determined in step S371 that the video stream is being played back, the process proceeds to step S372 where the player control module 212 acquires capture_enable_flag_PlayList from PlayList () (Fig. 5) corresponding to the video stream being played back. At the same time, capture_enable_flag_Clip is obtained from the clip information file Clip () (Fig. 10) corresponding to the video stream being played back.

Here, capture_enable_flag_PlayList in PlayList (), as described with reference to Fig. 5, whether or not to permit secondary use of video data (video data belonging to PlayList ()) corresponding to the video stream played by the PlayList (). Indicates. In addition, capture_enable_flag_Clip in the clip information file Clip () permits secondary use of video data corresponding to the video stream stored in the clip stream file corresponding to the clip information file Clip (), as described with reference to FIG. Indicates whether or not to do so.

After the process of step S372, it progresses to step S373, and the player control module 212 based on capture_enable_flag_PlayList and capture_enable_flag_Clip acquired in step S373 just before, the capture instruction was input from the input interface 115 (FIG. 1). It is determined whether to capture the picture of the video data that was played back at the time.

If it is determined in step S373 that the picture of the video data reproduced when the capture instruction is input from the input interface 115 is impossible to be captured, that is, at least one of capture_enable_flag_PlayList or capture_enable_flag_Clip acquired in the previous step S373, If it is 0 that the secondary use of the video data is not allowed, the flow proceeds to step S374, in which the player control module 212 controls the graphics processing module 219 to capture video data. Overlay error message, and the capture control process ends. As a result, an error message is displayed.

On the other hand, when it is determined in step S373 that the picture of the video data reproduced when the capture instruction is input from the input interface 115 is possible to be captured, that is, both capture_enable_flag_PlayList and capture_enable_flag_Clip acquired in the previous step S373, If it is set to 1 to permit secondary use of the video data, the flow proceeds to step S375, where the player control module 212 proceeds to the picture of the video data reproduced when the capture instruction is input from the input interface 115. The instruction to capture the data is supplied to the graphics processing module 219, and the flow proceeds to step S376.

In step S376, the graphics processing module 219 captures the picture of the video data from the video decoder control module 216 in accordance with the instruction of the capture from the player control module 212, and the memory 113 (Fig. 1). ) To complete the capture control process. In addition, when capture_enable_flag has a plural-bit structure and the use condition is restricted, correspondence is performed at this point. In other words, if there is a limit on the size of the captured image, the reduced image at this point is captured.

In addition, when there are restrictions on the application to be used, a flag indicating the effect is simultaneously recorded.

As described above, in the capture control process, the capture_enable_flag_PlayList and the capture_enable_flag_Clip of the PlayList () (FIG. 5) and the clip information file Clip () (FIG. 10) corresponding to the video stream being played when a capture instruction is received from the user, respectively. When the logical product is taken and the logical product is 1, that is, when both capture_enable_flag_PlayList and capture_enable_flag_Clip are both 1 for allowing secondary use, it is determined that secondary use of video data is possible, and the capture is performed.

Thus, for example, according to the first PlayItem # 0 of the first PlayList # 0 in FIG. 25, the playback of the video stream, that is, the playback of the video stream multiplexed in the clip stream file "00001.PS" is performed. When the capture instruction from the user is received, capture_enable_flag_PlayList in the first PlayList # 0 is 1, and the diagram corresponding to the clip stream file "00001.PS" played by the first PlayItem # 0 is shown. Since capture_enable_flag_Clip in the clip information file "00001.CLP" of 26 is 1, it is determined that secondary use of the video data being played (video data corresponding to the video stream multiplexed in the clip stream file "00001.PS") is possible. Capture is performed.

For example, according to the second PlayItem # 1 of the first PlayList # 0 in FIG. 25, the video stream is played back, that is, the video stream multiplexed in the clip stream file "00002.PS" is played. When the capture instruction from the user is received, capture_enable_flag_PlayList in the first PlayList # 0 is 1, and the diagram corresponding to the clip stream file "00002.PS" played by the second PlayItem # 1 is obtained. Since capture_enable_flag_Clip in the clip information file "00002.CLP" of 26 is 0, it is determined that secondary use of the video data being played back (video data corresponding to the video stream multiplexed in the clip stream file "00002.PS") is impossible. And no capture is performed.

For example, when the video stream is played back, i.e., the video stream multiplexed in the clip stream file "00003.PS" is performed in accordance with PlayItem # 0 of the second PlayList # 1 in FIG. In the second PlayList # 1, the capture_enable_flag_PlayList in the second PlayList # 1 is 0 and corresponds to the clip stream file " 00003.PS " played by the PlayItem # 0 in the second PlayList # 1. Since capture_enable_flag_Clip in the clip information file "00003.CLP" of 26 is 1, it is determined that secondary use of the video data being played back (video data corresponding to the video stream multiplexed in the clip stream file "00003.PS") is impossible. No capture is performed.

In this case, when it is confirmed that capture_enable_flag_PlayList in the second PlayList # 1 is 0, it can be determined that the secondary use of the video data is impossible, so that playback is performed by PlayItem # 0 in the second PlayList # 1. Confirmation of capture_enable_flag_Clip in the clip information file "00003.CLP" in FIG. 26 corresponding to the clip stream file "00003.PS" to be referred to may be omitted.

The pictures captured by the capture control process and stored in the memory 113 can be secondarily used in the background / screen saver process.

In the background / screen saver process, for example, the player control module 212 is in operation, but the elementary stream is not played, that is, the disk 101 in the disk drive 102 (FIG. 1). Is inserted, or when the elementary stream has finished playing.

In other words, in the background / screen saver processing, in step S381, the player control module 212 controls the graphics processing module 219 to display the picture stored in the memory 113 by the capture control processing. The graphics processing module 219 displays the pictures stored in the memory 113 by the capture control processing in accordance with the control from the player control module 212.

In the graphics processing module 219, when a picture stored in the memory 113 is displayed as a still image, a so-called wallpaper (background) is realized, and when the screen is displayed while being enlarged, reduced, or moved at a constant cycle, the screen saver Is realized. In addition, the background / screen saver process of displaying the picture stored in the memory 113 by the capture control process can be performed by another independent application instead of the player control module 212.

In this case, if a flag indicating usage restriction is added to the picture stored in the memory 113, the restriction is followed.

As described above, capture_enable_flag_PlayList or capture_enable_flag_Clip for video data being played, which indicates whether to permit secondary use of video data corresponding to, for example, PlayList () or PlayItem (), in units larger than the video access unit. Is obtained, and based on the capture_enable_flag_PlayList or capture_enable_flag_Clip, it is determined whether secondary use of the video data being reproduced is permitted. When it is determined that secondary use of the video data being reproduced is permitted, the video data being reproduced is captured, and the background / screen saver processing using the captured video data is executed. Thus, control of secondary use of video data becomes possible.

In addition, in the capture control process of FIG. 44, in the PlayList () (FIG. 5), capture_enable_flag_PlayList is provided, and in the clip information file Clip () (FIG. 10) corresponding to the clip stream file reproduced by PlayItem (), Although capture_enable_flag_Clip is provided and the permission of the secondary use is determined by using both capture_enable_flag_PlayList and capture_enable_flag_Clip, in PlayList () (Fig. 5), only capture_enable_flag_PlayList is provided, or in PlayItem (). In the clip information file Clip () (FIG. 10) corresponding to the clip stream file to be reproduced, it is also possible to determine whether secondary use is possible using only one of capture_enable_flag_PlayList or capture_enable_flag_Clip by providing capture_enable_flag_Clip. .

In addition, in the capture control process of FIG. 44, in step S376, the graphics processing module 219 according to the capture instruction from the player control module 212, the picture of the video data from the video decoder control module 216, That is, although only one picture is to be captured, it is also possible to capture a plurality of pictures. That is, it is possible to capture a plurality of pictures (sequences of a plurality of pictures as video images) in a time series output by the video decoder control module 216. In this case, the number of pictures captured at one time can be determined in advance, for example. Alternatively, the bits of capture_enable_flag_PlayList and capture_enable_flag_Clip may be extended to include information on the number of pictures that can be captured at one time in the capture_enable_flag_PlayList or capture_enable_flag_Clip.

In addition, in the above-described case, usage permission information (capture_enable_flag_PlayList, capture_enable_flag_Clip) of whether or not to permit secondary use of video data is described in PlayList () or clip information file Clip (), and the permission information is used. Although it is determined whether or not the secondary use of the entire video data reproduced by the PlayList () or the entire video data corresponding to the video stream multiplexed in the clip stream file corresponding to the clip information file Clip () is allowed, The information is described with respect to other arbitrary video data, and based on the use permission information, it is possible to determine whether or not secondary use is applied to the video data in any arbitrary unit.

That is, FIG. 45 shows the syntax of private_stream2_PES_payload () in which the use permission information is arranged, and FIG. 46 shows the syntax of au_information () in which the use permission information is arranged.

In addition, private_stream2_PES_payload () of FIG. 45 is comprised similarly to the case of FIG. 23 except that capture_enable_flag_ps2 as usage permission information is arrange | positioned immediately before video_stream_id. The au_information () in FIG. 46 is also configured similarly to the case in FIG. 24 except that capture_enable_flag_AU as the usage permission information is disposed immediately before pic_struct_copy.

Capture_enable_flag_ps2 disposed in private_stream2_PES_payload () of FIG. 45 allows secondary use of video data corresponding to the video stream disposed from PES_packet () of private_stream_2 including its private_stream2_PES_payload () to immediately before PES_packet () of next private_stream_2. Indicates whether to allow. Accordingly, according to capture_enable_flag_ps2 disposed in private_stream2_PES_payload () in FIG. 45, it is possible to determine whether or not to permit the secondary use for video data between any decode start point and the next decode start point. have.

In addition, capture_enable_flag_AU arranged in au_information () in FIG. 46 indicates whether to permit secondary use of video data of the video access unit corresponding to the capture_enable_flag_AU. Therefore, according to capture_enable_flag_AU arranged in au_information () of FIG. 46, it is possible to determine whether to permit the secondary use for video data in units of video access units, that is, in units of pictures.

Here, capture_enable_flag_PlayList as permission information in PlayList () (FIG. 5), capture_enable_flag_Clip as permission information in clip information file Clip () (FIG. 10), capture_enable_flag_ps2 as permission information in private_stream2_PES_payload () (FIG. 45), capture_enable_flag_AU as the usage permission information in au_information () (FIG. 46) can be used in duplicate of two or more of them. In this case, whether or not the secondary use of a picture of arbitrary video data is used in duplicate is adopted. The determination can be made based on a logical product of two or more usage permission information.

In addition, the PES_packet () of the private_stream_2 including the private_stream2_PES_payload () of FIG. 23 or 45 where the au_information () of FIG. 46 is disposed is, as described in step S211 of FIG. 36, the buffer control module 215 (FIG. 3). The video reading function unit 233 searches from the program stream stored in the buffer 215A. Therefore, when employing private_stream2_PES_payload () of FIG. 45 in which capture_enable_flag_ps2 is arranged or au_information () of FIG. 46 in which capture_enable_flag_AU is arranged, the player control module 212 determines whether or not secondary use of video data is possible. It is necessary to query the video reading function unit 233 for capture_enable_flag_ps2 and capture_enable_flag_AU.

In addition, in this embodiment, although the above-mentioned series of processes are performed by software, the above-mentioned series of processes can also be performed by exclusive hardware.

In addition, in this embodiment, although the hardware decoder is employ | adopted as the video decoder 116 (FIG. 1), the software decoder can also be employ | adopted as the video decoder 116. FIG. The same applies to the audio decoder 117 (FIG. 1).

In the present embodiment, a software decoder is adopted as the subtitle decoder. However, a hardware decoder may be employed as the subtitle decoder.

Claims (8)

A data processing apparatus for processing encoded data, The coded data, Encoded video data obtained by encoding video data in a predetermined unit, and Usage information used for decoding of the encoded video data disposed immediately before each of one or more decode start points in the encoded video data in the unit of the access unit. Including, The use information includes size information indicating the size of each of the one or more access units arranged between the use information and the next use information, Search means for searching for the use information from the encoded data; According to a request from a video decoder control means for controlling a video decoder that decodes the encoded video data, the encoded video data is read from the encoded data in units of the access unit based on the size information included in the usage information. Supply means for supplying and supplying to the video decoder A data processing apparatus comprising: a. The method of claim 1, The use information further includes number information indicating the number of the access units arranged between the use information and the next use information, The supply means is configured to read the encoded video data in units of the access unit from the encoded data on the basis of the size information included in the usage information, and to supply the encoded video data to the video decoder. Repeat as many times as the number information indicates A data processing device, characterized in that. The method of claim 1, The encoded video data obtained by encoding video data in a predetermined unit is a variable length of data. A data processing device, characterized in that. As a data processing method for processing encoded data, The coded data, Encoded video data obtained by encoding video data in a predetermined unit, and Usage information used for decoding of the encoded video data disposed immediately before each of one or more decode start points in the encoded video data in the unit of the access unit. Including, The use information includes size information indicating the size of each of the one or more access units arranged between the use information and the next use information, A search step of searching for the use information from the encoded data; According to a request from a video decoder control means for controlling a video decoder that decodes the encoded video data, the encoded video data is read from the encoded data in units of the access unit based on the size information included in the usage information. A supplying step for supplying to the video decoder Data processing method comprising a. delete A program recording medium on which a program for causing a computer to perform data processing for processing encoded data is recorded. The coded data, Encoded video data obtained by encoding video data in a predetermined unit, and Usage information used for decoding of the encoded video data disposed immediately before each of one or more decode start points in the encoded video data in the unit of the access unit. Including, The use information includes size information indicating the size of each of the one or more access units arranged between the use information and the next use information, A search step of searching for the use information from the encoded data; According to a request from a video decoder control means for controlling a video decoder that decodes the encoded video data, the encoded video data is read from the encoded data in units of the access unit based on the size information included in the usage information. A supplying step for supplying to the video decoder And a program recording medium having a program recorded thereon. delete delete

Images