CN100559499C - The manufacture method of reproducing device, playback method and recording medium - Google Patents

Abstract

The present invention relates to a kind of reproducing device, a kind of playback method, a kind of program, a kind of recording medium, a kind of data structure and a kind of recording medium manufacturing method, wherein, can be different between the stream of main flow, the content that be reset is switched.Playlist comprises and is used for quoting the video of main TS and the main path of audio frequency, the subpath-B that is used for quoting the subpath-A of the secondary video of sub-TS and secondary audio frequency and is used for quoting the audio frequency of sub-TS.Used STN_table (), it is to be used for the video of segment AV stream file-0 and audio selection for playing-1, and with the audio selection in the secondary video in the segment AV stream file-1 and secondary audio frequency or the segment AV stream file-2 be and play the information that-1 son of resetting is simultaneously play item (SPI).The present invention can be applicable to reproducing device.

Description

The manufacture method of reproducing device, playback method and recording medium

Technical field

The present invention relates to the manufacture method of reproducing device, playback method, program, recording medium, data structure and recording medium.More particularly, the present invention relates to be suitable for when resetting to the content of main AV stream, and can be to the stream that is different from main AV stream or the various content items of data file, as the Voice ﹠ Video content item, carry out the manufacture method of reproducing device, playback method, program, recording medium, data structure and the recording medium of playback time use.

Background technology

At DVD (Digital Versatile Disc, the digital versatile dish) in the video standard, can carry out interactive operation, promptly, when to being recorded in AV (the Audio Visual in the recording medium, audio frequency and video) content such as film carry out playback time, and the user can be switched (for example, seeing non-patent literature 1) to sound or captions.More particularly, the sound switching push button 11 of user's remote controller 2 or captions switching push button 12, thus sound or the captions that are presented at the AV content on the display device shown in Figure 11 are switched.For example, as shown in Figure 2, when having set sound 1 in the original state of display device 1, if the user operates sound switching push button 11, then sound 1 is switched to sound 2.

With the form of MPEG (Moving Picture Experts Group, Motion Picture Experts Group) 2 program streams, the AV content based on the DVD video is carried out record.As shown in Figure 3, in the MPEG2 program stream, video flowing (among Fig. 3 by " video " expression), a plurality of audio stream (among Fig. 3 by " audio frequency 1 ", " audio frequency 2 " and " audio frequency 3 " expression) and a plurality of sub-picture streams (being represented by " sprite 1 ", " sprite 2 " and " sprite 3 " among Fig. 3) are carried out multiplexed, make that audio stream and sub-picture streams and video flowing AV are synchronous.Sub-picture streams ( sprite 1,2 and 3) be bitmap images by the stream of run length coding, RLC (run-length coded), be mainly used in captions.

Usually, a plurality of audio streams are used to write down the sound of different language, and a plurality of sub-picture streams is used to write down the captions of different language.When playback of video, the user can utilize telepilot 2, selects to wish the sound or the captions of language with interactive mode.

The DVD video in program stream, defined offer the user, expression is used for a plurality of audio streams ( audio frequency 1,2 and 3) and the sound number of a plurality of sub-picture streams ( sprite 1,2 and 3) and the tableau format of the relation between the captions number.

Fig. 4 shows the example this user of offering, that represent the stream number form of the relation between sound signal and the caption signal.In this form, the sound number is called as " A_SN (Audio Stream Numbers, audio stream number) ", and the captions number is called as " S_SN (Sub-picture Stream Numbers, sub-picture streams number) ".In stream number form shown in Figure 4, A_SN is provided for each audio stream, and S_SN is provided for each sub-picture streams.A_SN=1: audio frequency 2, A_SN=2: audio frequency 1, and A_SN=3: audio frequency 3.In addition, S_SN=1: sprite 3, S_SN=2: sprite 1 and S_SN=3: sprite 2.In this case, less A_SN or S_SN number user's sound signal or the caption signal of indicating to offer according to higher priority.That is, A_SN=1 is the audio stream of resetting as default value, and S_SN=1 is the sub-picture streams of resetting as default value.

More particularly, the sound of resetting in the original state in Fig. 11 is audio frequency 2, and it is A_SN=1 (Fig. 4), and in Fig. 2, after sound 1 switched, the sound of being reset 2 was audio frequency 1, and it is A_SN=2.

[non-patent literature 1]

The DVD standard part 3 that is used for read-only disk; Version 1.1

Known a kind of subpath (Sub Path) playback technology (for example, seeing patent documentation 1) of the sound (so-called " dubbing sound (dubbed sound) ") of record in addition that is used to utilize.

[patent documentation 1]

Uncensored Japanese Patent Application No.2002-158972.

Summary of the invention

The problem to be solved in the present invention

But according to the DVD video, when the user was switched sound or captions during at the playback of video program stream, the user can only select from audio stream being multiplexed into the current program stream of being reset or sub-picture streams.That is, when resetting the MPEG2 program stream shown in Figure 3, the user can only be from audio frequency 1 to audio frequency when switching sound selects 3.

Therefore, even it is available to be different from another stream program stream, that have audio stream and captions of current playback, the user can not switch to sound or captions audio stream or the captions in this various flows.Therefore, the extensibility aspect selection stream is lower.

Think in addition that in the near future the content that is switched will be not limited to sound, but will expand to various types of content items, as video.Since when switching these dissimilar contents, be difficult to from the stream of being reset chosen content item the homogeneous turbulence not, therefore, the extensibility aspect selection stream is with step-down.

Although patent documentation 1 has disclosed the technology of the sound (so-called " dubbing sound ") that utilizes subpath to reset other record,, it does not disclose the stream with two same types, that is, and two audio streams or two video flowing combinations and the configurations of resetting.

Consider such background, proposed the present invention.The objective of the invention is from the stream that is different from main AV stream or data file, to select various types of contents,, make the content of selecting to reset with main AV stream as sound and video.

The measure of dealing with problems

According to one aspect of the present invention, reproducing device is to be used for the reproducing device that convection current is reset.This reproducing device comprises: deriving means, be used to obtain playback management information, and playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And selection information is used in the middle of at least one stream of being quoted by main playback path, the stream of selecting at least one class to be reset, and, be used for selecting by the stream that class that quote, at least one will be reset of at least one sub-playback path; Receiving trap is used for receiving the selection to the stream that will be reset according to the selection information that is included in the playback management information that is obtained by deriving means; Reading device, be used for, if receiving trap receives the selection to the stream that will be reset, main by reference playback path, read from the central at least one class stream selected of at least one stream of being quoted by main playback path and be received the device reception, and Dui Ying sub-playback path reads from the central at least one class stream selected of at least one stream of being quoted by at least one sub-playback path and be received the device reception by reference; And composite set, be used for, if at least two streams of predetermined class be included in quote by main playback path and be read at least one class stream that device reads and quote by the sub-playback path of correspondence and be read at least one class stream that device reads, then with these at least two stream combinations.Selection information comprises what expression will be quoted by main playback path, first-class corresponding with the quilt playback path of predetermined class is quoted, the information of the second stream combination of predetermined class, receiving trap is according to selection information, reception is to the selection of the stream that will be reset, if receiving trap receives the selection to first-class and second stream that will be reset, then reading device reads and is quoted by main playback path, the sub-playback path first-class and that quilt is corresponding of predetermined class is quoted, second stream of predetermined class, and composite set device reads to being read, first-class and second stream of predetermined class makes up.

Reproducing device can also comprise decoding device, is used for the stream quoted by main playback path and be read at least one class that device reads and the stream quoted by corresponding sub-playback path and be read at least one class that device reads are decoded.

The stream of the predetermined class of the device that is combined combination can be audio stream or video flowing.

The stream of the predetermined class of being quoted by main playback path can be first video flowing, and selection information can also comprise first audio stream relevant with first video flowing and is different from the information that the combination of second audio stream of first audio stream defines.

Receiving trap can receive the selection to the stream that will be reset in the middle of following: by main playback path quote first-class; Second stream that the sub-playback path that quilt is corresponding is quoted; By quote first-class of main playback path and quoted by corresponding sub-playback path, be included in the combination that second in the file different with comprising first file flows; The combination of second stream that the sub-playback path that quilt is corresponding is quoted; By quote first-class of main playback path and quoted by corresponding sub-playback path, be included in and comprise the combination that second in the identical file of first file flows.

The playback management information that is obtained by deriving means can also comprise the information about the combination of second stream that quoted by corresponding sub-playback path, predetermined class, if receiving trap receives the selection to the combination of two streams that will be reset, predetermined class, then reading device can read the combination of the stream of two predetermined class being quoted by the sub-playback path of correspondence, and composite set can make up the stream that is read two predetermined class that device reads.

Selection information can also comprise whether expression enters the information of the stream that is combined, receiving trap can be according to the information of representing whether to enter the stream that is combined, reception is to by the selection of the combination of at least one stream that quote, same item in main playback path and the corresponding sub-playback path, perhaps, reception is to the selection of the single stream of same item, and reading device can read and be received device stream that receive, that entered according to selection information.

The stream of the predetermined class of being quoted by main playback path can be first video flowing, and selection information can also comprise the information that the combination to second video flowing that is different from first video flowing and second audio stream relevant with second video flowing defines.

The stream of the predetermined class of being quoted by main playback path can be first video flowing, and selection information can also comprise the information that the combination to second video flowing that is different from first video flowing and first image information relevant with second video flowing defines.

Reproducing device can also comprise: first memory storage, the information that is used for whether storage representation shows second image information relevant with first video flowing or whether first image information relevant with second video flowing is shown; Second memory storage shows second image information if be used for storage representation, then constitutes the information that can will be reset according to which stream in the middle of the stream of second image information of selecting Information Selection; The 3rd memory storage shows first image information if be used for storage representation, then constitutes the information that can will be reset according to which stream in the middle of the stream of first image information of selecting Information Selection; The 4th memory storage, being used for storage representation still is the information that second image information shows to first image information.Reading device can read and first image information that will be shown or the relevant stream of second image information by the information of further reference stores in first memory storage, second memory storage, the 3rd memory storage and the 4th memory storage.

The stream of the predetermined class of being quoted by main playback path can be first video flowing, and selection information can also comprise the information that the combination to second video flowing that is independent of first video flowing and the text message relevant with second video flowing defines.

Can be according to the type of the stream of being quoted by corresponding sub-playback path, at least one class at least one sub-playback path defines, and, at least one the sub-playback path that is included in the playback management information can be classified as at least one predefined type through the type of definition, and, can be included in the playback management information about the information of the classification type of at least one sub-playback path.

At least one type through definition can comprise such type, and wherein, at least one class stream is quoted by corresponding sub-playback path.

At least one type through definition can comprise such type, and wherein, at least one class stream is quoted by corresponding sub-playback path, and at least one class stream can be included in and comprises by in the different file of the file of main playback path reference stream.

At least one type through definition can comprise such type, and wherein, at least one class stream is quoted by corresponding sub-playback path, and at least one class stream can be included in and comprises by in the identical file of the file of main playback path reference stream.

Reproducing device can also comprise display control unit, and the demonstration that is used for the display screen of information that demonstration is used to help the user to carry out input operation is controlled.The stream of the predetermined kind of being quoted by main playback path can be first video flowing, and, if receiving trap receive to be independent of first video flowing, will with second video flowing of the first video flowing synchronized playback, then display control unit can be to controlling with the tabulation that is displayed on the stream that second video flowing is reset explicitly on the display screen, and, receiving trap can be shown the quoting of display screen of control device control according to the user to demonstration, receive the selection to the stream that can reset explicitly with second video flowing.

According to one aspect of the present invention, playback method/program comprises the steps: obtaining step, is used to obtain playback management information, and playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And selection information is used in the middle of at least one stream of being quoted by main playback path, the stream of selecting at least one class to be reset, and, be used for selecting by the stream that class that quote, at least one will be reset of at least one sub-playback path; Receiving step is used for receiving the selection to the stream that will be reset according to the selection information that is included in the playback management information that is obtained by the processing of obtaining step; Read step, be used for, if receive selection to the stream that will be reset by the processing in the receiving step, then main by reference playback path, read from the central at least one class stream selected of at least one stream of being quoted by main playback path, and, be used for corresponding by reference sub-playback path, read from the central at least one class stream selected of at least one stream of being quoted by at least one sub-playback path; And, combination step, be used for, if at least two streams of predetermined class are included at least one class stream of being quoted by main playback path and read by the processing in the read step and are included at least one class stream of being quoted by the sub-playback path of correspondence and read by the processing in the read step, then will at least two stream combinations.Selection information comprises what expression will be quoted by main playback path, first-class corresponding with the quilt playback path of predetermined class is quoted, the information of the second stream combination of predetermined class, in the processing of receiving step, according to selection information, reception is to the selection of the stream that will be reset, in the processing of read step, if receive selection to will be reset first-class and second stream by the processing in the receiving step, second stream of the predetermined class that then reads the first-class of the predetermined class quoted by main playback path and quoted by corresponding sub-playback path, and in the processing of combination step, first-class and second stream of the predetermined class that read by the processing in the read step is made up.

According to one aspect of the present invention, according to reproducing device, playback method and program, obtain playback management information, playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And selection information is used in the middle of at least one stream of being quoted by main playback path, the stream of selecting at least one class to be reset, and, be used for selecting by the stream that class that quote, at least one will be reset of at least one sub-playback path.According to the selection information in the playback management information that is included in acquisition, receive selection to the stream that will be reset.If receive selection to the stream that will be reset, then main by reference playback path, read from the central at least one class stream selected of at least one stream of being quoted by main playback path, and, be used for corresponding by reference sub-playback path, read from the central at least one class stream selected of at least one stream of being quoted by at least one sub-playback path.If at least two streams of predetermined class are included at least one class stream of being quoted by main playback path, read and at least one class stream of quoting by the sub-playback path of correspondence, read in, then with at least two stream combinations of predetermined class.The information that selection information comprises is that expression will be quoted by main playback path, second stream first-class and that quoted by corresponding sub-playback path, predefined type of predefined type makes up, in the processing of receiving step, according to selection information, receive selection to the stream that will be reset.If receive selection, then read the first-class of the predetermined class quoted by main playback path and second stream of the predetermined class quoted by corresponding sub-playback path to will be reset first-class and second stream.Second stream to the first-class of the predetermined class that reads and the predetermined class that reads makes up.

According to one aspect of the present invention, recording medium recording comprise the data of playback management information, playback management information is used to manage the replay operations at least one stream.Playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And, selection information, comprise and being used in the middle of at least one stream of being quoted by main playback path, the stream of selecting at least one class to be reset, and, be used for selecting the information of the stream that will be reset by a class that quote, at least one of at least one sub-playback path, first-class second stream with the predetermined class of being quoted by at least one sub-playback path of the predetermined class that this information representation will be quoted by main playback path makes up.

According to one aspect of the present invention, data structure comprises playback management information, and playback management information is used to manage the replay operations at least one stream, and playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And, selection information, comprise and being used in the middle of at least one stream of being quoted by main playback path, the stream of selecting at least one class to be reset, and, be used for selecting the information of the stream that will be reset by a class that quote, at least one of at least one sub-playback path, this expression is made up first-class second stream with the predetermined class of being quoted by at least one individual sub-playback path of the predetermined class quoted by main playback path.

According to one aspect of the present invention, recording medium/data structure comprises the data of playback management information, and playback management information is used to manage the replay operations to first file that comprises at least one stream.More particularly, playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And, selection information, comprise and being used in the middle of at least one stream of being quoted by main playback path, the stream of selecting at least one class to be reset, and, be used for selecting the information of the stream that will be reset by a class that quote, at least one of at least one sub-playback path, this expression is made up first-class second stream with the predetermined class of being quoted by at least one individual sub-playback path of the predetermined class quoted by main playback path.

According to one aspect of the present invention, the method for making that is used for recording medium is the method for making that is used on recording medium the recording medium of the data that record can be reset by reproducing device.This method for making comprises the steps, generates the data with the data structure that comprises playback management information, and, the data that generate are recorded on the recording medium, wherein, playback management information is used to manage the replay operations at least one stream.Playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And, selection information, be used in the middle of at least one stream of being quoted by main playback path, the stream of selecting at least one class to be reset, and, be used for selecting by the stream that class that quote, at least one will be reset of at least one sub-playback path the second stream combination of the first-class and predetermined class of being quoted by at least one sub-playback path of the predetermined class that this information representation will be quoted by main playback path.

According to one aspect of the present invention, the method for making that is used for recording medium is the method for making that is used on recording medium the recording medium of the data that record can be reset by reproducing device.In method for making, generate data, and the data that generate are recorded on the recording medium with following data structure, this data structure comprises playback management information, playback management information is used to manage the replay operations at least one stream.Playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And selection information is used in the middle of at least one stream of being quoted by main playback path, the stream of selecting at least one class to be reset, and, be used for selecting by the stream that class that quote, at least one will be reset of at least one sub-playback path; The second stream combination of the first-class and predetermined class of being quoted by at least one sub-playback path of the predetermined class that this information representation will be quoted by main playback path.

Advantage

According to the present invention, the AV that can reset stream specifically, can be selected various types of contents from flowing not homogeneous turbulence or the data file with main AV, as sound and video.

Description of drawings

Fig. 1 shows known sound and switches.

Fig. 2 shows known sound and switches.

Fig. 3 shows the structure of MPEG2 program stream.

Fig. 4 shows and offers the stream number form user, that represent sound signal and caption signal.

Fig. 5 shows at the example that is installed in the application form on the recording medium of having used on the reproducing device of the present invention.

Fig. 6 shows the structure of main path and subpath.

Fig. 7 shows the example of main path and subpath.

Fig. 8 shows another example of main path and subpath.

Fig. 9 shows the grammer of PlayList ().

Figure 10 shows the grammer of SubPath ().

Figure 11 shows the example of SubPath_type.

Figure 12 shows the grammer of SubPlayItem (i).

Figure 13 shows the grammer of PlayItem ().

Figure 14 shows the grammer of a STN_table ().

Figure 15 shows first example of the grammer of stream_entry ().

Figure 16 shows the grammer of the 2nd STN_table ().

Figure 17 shows second example of the grammer of stream_entry ().

Figure 18 shows the grammer of stream_attribute ().

Figure 19 shows stream_coding_type.

Figure 20 shows video_format.

Figure 21 shows frame_rate.

Figure 22 shows aspect_ratio.

Figure 23 shows audio_presentation_type.

Figure 24 shows sampling_frequency.

Figure 25 shows character code.

Figure 26 shows and offers the example user, that represent the stream number form of the relation between sound signal and the caption signal.

Figure 27 is the block diagram that shows the example of the configuration of having used reproducing device of the present invention.

Figure 28 is the block diagram that shows the example of the configuration of having used reproducing device of the present invention.

Figure 29 is the process flow diagram that shows the playback processing of being undertaken by the reproducing device shown in Figure 28.

Figure 30 is the process flow diagram that shows the playback processing of being undertaken by the reproducing device shown in Figure 28.

Figure 31 is the process flow diagram that shows the playback processing of being undertaken by the reproducing device shown in Figure 28.

Figure 32 is the process flow diagram that shows in response to the processing of carrying out from the instruction of user's switching sound.

Figure 33 is the process flow diagram that shows the details of the step S59 among Figure 32.

Figure 34 shows the example that two audio streams are mixed and reset.

Figure 35 shows the grammer of Three S's TN_table ().

Figure 36 is the block diagram that shows another example of the configuration of having used reproducing device of the present invention.

Figure 37 shows the grammer of the 4th STN_table (), is used for the combination of audio stream #1 and audio stream #2 is defined.

Figure 38 shows the example of the bitmap grammer of Combination_of_Primary_and_Secondary.

Figure 39 shows and offers the stream number form user, that represent sound signal and caption signal.

Figure 40 shows another example that two audio streams are mixed and reset.

Figure 41 shows the grammer of the 5th STN_table (), is used for the combination of audio stream #1 and audio stream #2 is defined.

Figure 42 shows the grammer of the 6th STN_table (), is used for the combination of audio stream #1 and audio stream #2 is defined.

Figure 43 shows picture-in-picture techniques.

Figure 44 shows the grammer of the 6th STN_table (), is used for secondary (secondary) video flowing, audio stream, secondary audio stream and a caption stream that definition can be reset with (primary) video flowing once.

Figure 45 shows the grammer of the 7th STN_table (), is used to define secondary video stream, audio stream, secondary audio stream and the caption stream that can reset with a video flowing.

Figure 46 shows the stream number form that offers the combination user, expression sound signal, vision signal and caption signal.

Figure 47 shows and is used for user's selection operation that the combination of the secondary video stream that can reset with a video flowing, audio stream, secondary audio stream and a caption stream is selected.

Figure 48 shows the playlist (PlayList) of the SubPath_type generation that utilizes shown in Figure 11, so that realize picture-in-picture techniques.

Figure 49 shows the example of another SubPath_type different with the SubPath_type shown in Figure 11.

Figure 50 shows the 3rd example of stream_entry ().

Figure 51 shows the playlist of the SubPath_type generation that utilizes shown in Figure 49, so that realize the example of picture-in-picture techniques.

Figure 52 shows the playlist of the SubPath_type generation that utilizes shown in Figure 49, so that realize another example of picture-in-picture techniques.

Figure 53 is the block diagram that shows the example of the configuration of having used reproducing device of the present invention, and this example is different with the example shown in Figure 36.

Figure 54 is the process flow diagram that shows the secondary video hand-off process of being undertaken by the reproducing device shown in Figure 53.

Figure 55 is the process flow diagram that shows the secondary video hand-off process of being undertaken by the reproducing device shown in Figure 53.

Figure 56 shows the type of application_type.

Figure 57 shows subpath (Sub Path) restriction technologies, and more particularly, Figure 57 shows the subpath that can offer playlist according to the type of playlist.

Figure 58 shows the subpath restriction technologies, and more particularly, Figure 58 shows the relation between the number of the number of the broadcast item (PlayItem) that is arranged in playlist and subpath.

Figure 59 shows the object lesson of the playlist that is generated by the subpath restriction technologies shown in Figure 57 to 59.

Figure 60 shows the object lesson of the playlist that is generated by the subpath restriction technologies shown in Figure 57 to 59.

Figure 61 shows the object lesson of the playlist that is generated by the subpath restriction technologies shown in Figure 57 to 59.

Figure 62 shows the object lesson of the playlist that is generated by the subpath restriction technologies shown in Figure 57 to 59.

Figure 63 shows to be used for reproducing device shown in Figure 53, the process flow diagram that the playback that the playlist with application_type=3 is carried out is handled.

Figure 64 shows to be used for reproducing device shown in Figure 53, the process flow diagram that the playback that the playlist with application_type=3 is carried out is handled.

Figure 65 shows to be used for reproducing device shown in Figure 53, the process flow diagram that the playback that the playlist with application_type=1 or 2 is carried out is handled.

Figure 66 shows to be used for reproducing device shown in Figure 53, the process flow diagram that the playback that the playlist with application_type=1 or 2 is carried out is handled.

Figure 67 shows to be used for reproducing device shown in Figure 53, the process flow diagram that the playback that the playlist with application_type=1 or 2 is carried out is handled.

Figure 68 shows to be used for reproducing device shown in Figure 53, the process flow diagram that the playback that the playlist with application_type=1 or 2 is carried out is handled.

Figure 69 shows the grammer of the 8th STN_table (), is used for the combination of combination, video flowing #2 and the audio stream #1 of audio stream #1 and audio stream #2 and the combination of video flowing #2 and video flowing #2 text subtitle stream are defined.

Figure 70 shows the grammer of the 8th STN_table (), is used for the combination of combination, video flowing #2 and the audio stream #1 of audio stream #1 and audio stream #2 and the combination of video flowing #2 and video flowing #2 text subtitle stream are defined.

Figure 71 shows register.

Figure 72 shows when carrying out the PiP display operation, the example of the PG TextST stream of resetting.

Figure 73 shows when carrying out the picture-in-picture display operation, the example of playback picture-in-picture application PGTextST stream.

Figure 74 uses the process flow diagram that PG TextST resets and handles for showing PiP (picture-in-picture).

Figure 75 is the process flow diagram that shows PiP PG TextST stream display process.

Figure 76 shows the grammer of the 9th STN_table (), is used to define more substantial combination.

Figure 77 shows the grammer of the 9th STN_table (), is used to define more substantial combination.

Figure 78 shows the grammer of the 9th STN_table (), is used to define more substantial combination.

Figure 79 shows register.

Figure 80 shows when carrying out the picture-in-picture display operation, the example that audio stream and secondary audio stream are mixed and reset.

Figure 81 shows when carrying out the picture-in-picture display operation, the example of an audio stream of playback picture-in-picture application.

Figure 82 shows the process flow diagram that PiP uses audio stream playback processing 1.

Figure 83 shows the grammer of the tenth STN_table (), is used to define more substantial combination.

Figure 84 shows the grammer of the tenth STN_table (), is used to define more substantial combination.

Figure 85 shows the grammer of the tenth STN_table (), is used to define more substantial combination.

Figure 86 shows when carrying out the picture-in-picture display operation, the example that audio stream of picture-in-picture application and secondary audio stream are mixed and reset.

Figure 87 shows the process flow diagram that PiP uses audio stream playback processing 2.

Figure 88 shows the manufacture method of recording medium, and having write down on this recording medium will be by the data of reproducing device playback.

Figure 89 shows the manufacture method of recording medium, and having write down on this recording medium will be by the data of reproducing device playback.

Figure 90 shows the configuration of personal computer.

Reference numeral

1: reproducing device

11: recording medium

21: controller

22: CD drive

23: storer

24: the local memory device

The 26:AV demoder

32: switch

51 to 54: impact damper

55,56:PID wave filter

57 to 59: switch

71: the background demoder

72: Video Decoder/first Video Decoder

73: present (presentation) graphic decoder

74: the interactive graphics (IG) demoder

75: audio decoder

The 76:Text-ST compositor

77: switch

91: the background plane maker

92: the video plane maker/first video plane maker

93: present the graphics plane maker

94: the interactive graphics plane maker

95: impact damper

96: video data processor

97: hybrid processor

101: hybrid processor

141: reproducing device

The 151:AV demoder

The 161:PID wave filter

162: switch

401: reproducing device

The 403:AV demoder

The 411:PID wave filter

412: the second Video Decoders

413: the second video plane makers

414: the prestrain impact damper

Embodiment

Hereinafter with reference to accompanying drawing, to describing according to embodiments of the invention.

Fig. 5 shows being built in the local memory device (for example hard disk or storer) of having used reproducing device 1 of the present invention (discussing to it with reference to Figure 27 and 28 in the back) and goes up or will be installed in the example of the application form (application format) on the recording medium in the reproducing device 1.Recording medium is CD, disk or the semiconductor memory of discussing later.

Use form and comprise two layers, that is, playlist layer and sheet tomography (Clip layer) are used to manage AV (audio frequency and video) stream.In this case, with AV stream and a clip information being associated with this AV stream constitute to being used as an object, be called as " segment (clip) ".AV stream is also referred to as " AV stream file ".The AV stream file not only can comprise voice data and video data, and can comprise the various stream files of resetting with voice data and video data.Clip information is also referred to as " clip information file ".

Usually, the file that uses in computing machine is processed as byte serial.On the other hand, the content of AV stream file is extended on the time shaft, and, mainly according to playlist, utilize time mark to specify accessing points in the segment.That is, we can say that playlist and segment have constituted two layers that AV flow to the line pipe reason.

If according to playlist, utilize time mark to represent accessing points in the segment, then clip information file is used to find from time mark and the relevant information in address that begins to decode in the AV stream file.

Playlist is one group of AV stream playback section (a playback zone).The section of resetting in the AV stream is called as one " playing (PlayItem) ", by a pair of IN point (playback starting point) on the time shaft and OUT point (playback end point) expression.Therefore, as shown in Figure 5, playlist has one or more broadcasts items.

In Fig. 5, a left side is played first playlist and is had two broadcast items, plays first half and the latter half that item is quoted the AV stream in the segment that is included in the left side among Fig. 5 for these two.Second playlist played on a left side has one to play, and this is play item and quotes the whole of the AV stream that is included in the segment of right side.A left side is played the 3rd playlist and is had two and play, plays certain part that item is quoted certain part of the AV stream that is included in the segment of left side and is included in the AV stream in the segment of right side for these two.

If the dish Navigator among Fig. 5 will be included in a left side and play left side in first playlist and play item and be appointed as information about current replay position, then to playing that item is quoted, as to be included in the AV stream in the segment of a left side first half and reset by appointed.By this way, playlist as playback management information, is used for the replay operations of AV stream file is managed.

The dish Navigator has the function that the playback order of appointment in the playlist is controlled, and, have the function that the interactive playback operation that utilizes playlist is controlled.The dish Navigator also has the function of display menu screen, is used to allow the user to send instruction, thereby carries out various replay operations.The dish Navigator is described with programming language, for example, and Java ^TM, and be recorded on the recording medium.

In the present embodiment, the playback path that comprises at least one broadcast (played in order item) in the playlist is called as " main path (Main Path) ", and, in playlist with main path and deposit, comprise that at least one height plays a playback path of (can be order or non-played in order item) and be called as " subpath (Sub Path) ".Promptly, in playlist, on the local memory that is built in reproducing device 1 (following it is discussed) with reference to Figure 27 and 28 or be installed in application form on the recording medium in the reproducing device 1 and have the subpath that at least one and main path are reset explicitly.

Fig. 6 shows the structure of main path and subpath.Playlist allows single main path and at least one subpath.Main path comprises at least one broadcast item, and a subpath comprises at least one height broadcast item.

Playlist shown in Fig. 6 has one and comprises three main path and three subpaths of playing item.Begin from the head, ID is provided (identification, identifier) for the broadcast item that constitutes main path.More particularly, main path comprises plays item, as PlayItem_id=0, PlayItem_id=1 and PlayItem_id=2.Begin from the head, also provide ID, as Subpath_id=0, Subpath_id=1 and Subpath_id=2 to subpath.Subpath_id=0 has a sub item of playing, and Subpath_id=1 has two sub-broadcast items, and Subpath_id=2 has a son broadcast item.

For example, be comprised in son among the Sub path_id=0 and play the stream that item quotes and dub the sound of film, and can replace the audio stream that is comprised in the AV stream file that main path quotes and reset for Japanese.For example, a son broadcast stream of quoting that is comprised among the Sub path_id=1 is director's montage (Director ' s Cut), and can be inserted into the predetermined portions of the AV stream file of being quoted by main path, as director's comment.

Play a segment AV stream file of quoting by one and comprise video stream data (main image data) at least.Segment AV stream file can also comprise at least one audio stream, it and video flowing (main image data) (synchronously) playback simultaneously that is also contained in the segment AV stream file.Segment AV stream file can also comprise at least one bitmap subtitle stream files (presenting graphical stream (Presentation Graphicsstream)), it and the video flowing synchronized playback that is also contained in the segment AV stream file.Segment AV stream file can also comprise at least one interactive graphic stream files, it and the video flowing synchronized playback that is also contained in the segment AV stream file.Video flowing in the segment AV stream file and multiplexed with audio stream, bitmap caption stream or the interactive graphic stream of this video flowing synchronized playback will be included in.In other words, by one play a segment AV stream file that item quotes comprise video stream data and with at least 0 audio stream data of this video stream data synchronized playback, at least 0 bitmap caption stream data or at least 0 interactive graphics (IG) flow data, make them be multiplexed in the segment AV stream file.

That is, play a segment AV stream file of quoting by one and comprise polytype stream, as video flowing, audio stream, bitmap caption stream or interactive graphic stream.

Son is play item and is for example quoted audio stream data or the caption data that is included in the stream file different with being played segment AV stream file that item quotes.

When playback included only the playlist of main path, the user can only select a sound and captions from audio stream being multiplexed into the segment that this main path quotes and sub-picture streams.By comparison, when playback comprises the playlist of main path and subpath, the audio stream and sub-picture streams in being multiplexed into the segment AV stream file of being quoted by this main path, the user can also quote audio stream and the sub-picture streams that is multiplexed in the quilt broadcast segment of quoting.

As discussed above, a plurality of subpaths are included in the playlist, and the son of each subpath is play the stream that item is quoted correspondence.Therefore, can provide AV stream with highly scalable and high degree of flexibility.Can add son promptly and play item.

Fig. 7 shows the example of main path and the example of subpath.In Fig. 7, utilize subpath to represent the audio playback path of resetting with the main path while (synchronously).

Playlist shown in Figure 7 comprises as one of main path to be play, i.e. PlayItem_id=0, and play as a son of subpath.PlayItem (), promptly PlayItem_id=0 quotes the disconnected AV stream of main leaf.SubPlayItem () comprises following data.SubPlayItem () comprises Clip_Information_file_name, is used to specify to be played the segment that the subpath in the tabulation is quoted.In the example of Fig. 7, son is play the auxiliary audio stream that item is quoted SubClip_entry_id=0.SubPlayItem () also comprises SubPlayItem_IN_time and SubPlayItem_OUT_time, is used to specify the playback section (in this case, being auxiliary audio stream) of the subpath that is included in the segment.SubPlayItem () also comprises sync_PlayItem_id and sync_start_PTS_of_PlayItem, is used to specify on the time shaft of main path the time that the replay operations of subpath begins.In Fig. 7, sync_PlayItem_id=0 and sync_start_PTS_of_PlayItem=t1.Utilize this information, can specify in the time t1 of the replay operations of beginning subpath on the time shaft of PlayItem=0 of main path.That is, in the example of Fig. 7, the playback start time of main path is identical with the playback start time of subpath, i.e. t1.

The segment AV audio stream of being quoted by subpath should not comprise the non-sequential time point of STC (the non-sequential time point of base during system).The segment audio sample clock that is used for subpath is locked into the audio sample clock that is used for main path.

In other words, SubPlayItem () comprises that the segment that is used for being quoted by subpath carries out specified message, is used for the playback section of subpath is carried out specified message and be used for the time that the replay operations to subpath begins on the time shaft of main path carrying out specified message.Do not comprise STC owing to be used for the segment AV stream of subpath, therefore the user can (be used for the segment of being quoted by subpath is carried out specified message according to the information that is included among the SubPlayItem (), be used for the playback section of subpath is carried out specified message and be used for the time that the replay operations to subpath begins on the time shaft of main path carrying out specified message), the different segment AV audio stream of the segment AV stream of quoting and being quoted (the main AV stream that will be reset), and this segment AV audio stream of resetting by main path.

As mentioned above, play item and manage segment AV stream file independently with son broadcast item.Be played a segment AV stream file (main AV stream file) of management and be different from the segment AV stream file that quilt is play the item management.

In the mode similar, can utilize subpath to represent the caption stream playback path of resetting simultaneously with main path to example shown in Figure 7.

Fig. 8 shows another example of main path and another example of subpath.In Fig. 8, utilize subpath to represent the audio playback path of resetting with the main path AV while (AV-simultaneously).Similar among the disconnected AV stream file of the main leaf of being quoted by the broadcast item of main path and Fig. 7, and omitted explanation to it.

Suppose that now the segment AV stream of being quoted by main path is movie contents (AV content), and, the auxiliary audio stream of being quoted by the audio playback path of subpath (segment) is the director's comment about this film, so, the auxiliary audio stream of being quoted by subpath is mixed to (overlapping with the segment AV audio stream of being quoted by main path) in the segment AV audio stream of being quoted by main path.In this case, can use configuration shown in Figure 8.More particularly, when watching this film, when the user has imported the instruction of listening to about the director of this film comment, in other words, when the auxiliary audio stream of being quoted by subpath is mixed in the sound of the segment AV stream of being quoted by main path, can use configuration shown in Figure 8.

In Fig. 8, with three broadcast items, that is, PlayItem_id=0,1 and 2 places main path, and two son broadcast items are placed subpath (Subpath_id=0).Play a SubPlayItem_IN_time and the SubPlayItem_OUT_time that (back is with reference to Figure 12 discussion) comprises the playback section of the auxiliary audio stream (have the English auxiliary audio frequency stream fragments of Subclip_entry_id=0 and have the Japanese auxiliary audio frequency stream fragments of Subclip_entry_id=1) that is used to specify subpath by the son that subpath (Subpath_id=0) (back is with reference to Figure 10 discussion) calls.

Example among Fig. 8 is compared with the example among Fig. 7, can be found, in the example in Fig. 8, son broadcast item can be quoted has Subclip_entry_id=0 or Subclip_entry_id=1 auxiliary audio stream (English or Japanese audio stream).That is, use son broadcast item to make it possible to quote a plurality of audio streams, and, when the son of resetting is play item, can from a plurality of audio stream files, select the audio stream file, that is, in the example of Fig. 8, selection English audio stream file or Japanese audio stream file.More particularly, from user's instruction, select among Subclip_entry_id=0 and the Subclip_entry_id=1 according to for example, and the auxiliary audio stream quoted of the selecteed ID that resets.If the instruction that auxiliary audio stream is reset with the audio stream of being quoted by main path is provided, first audio stream that will be quoted by main path and mixed by second audio stream that subpath is quoted and reset then.Two audio streams being quoted by two subpaths can be mixed and reset.Discuss to this in the back.

Below be to realize with reference to Fig. 6 to the main path of Fig. 8 discussion and the data structure (grammer) of subpath structure.

Fig. 9 shows the grammer of PlayList ().

Length is 32 signless integers, and expression promptly, is represented the field of the byte number that () finishes from reserved_for_future_use to PlayList from immediately following the byte number that finishes to PlayList () after the length field.After length, what follow is 16 reserved_for_future_use field.Number_of_PlayItems is 16 bit fields, and expression is included in the quantity of the broadcast item in the playlist.Under the situation of the example in Fig. 6, the quantity of playing is three, the order that in playlist, occurs according to PlayItem (), since 0 to playing an assignment, as PlayItem_id.For example, as Fig. 6 and shown in Figure 8, distribute PlayItem_id=0,1 and 2.

Number_of_SubPath is 16 bit fields, and expression is included in the quantity (quantity of clauses and subclauses) of the subpath in the playlist.Under the situation of the example in Fig. 6, the quantity of subpath is three, and, according to the order that SubPath () occurs, play an assignment since 0 to son, as SubPath_id in playlist.For example, as shown in Figure 6, distribute SubPath_id=0,1 and 2.Then, in FOR statement subsequently, it is identical with the quantity of playing item to play a number of times that is cited, and the number of times that subpath is cited is identical with the quantity of subpath.

Figure 10 shows the grammer of SubPath ().

Length is 32 signless integers, expression begins after the length field to the number of the byte of SubPath () end, just, this length field is the field of the expression byte number that () finishes from reserved_for_future_use to SubPath.After length, be 16 reserved_for_future_use.SubPath_type is 8 bit fields, the application type of expression subpath, that is and, the type of subpath is as audio frequency, bitmap captions or text subtitle.First example of SubPath_type is discussed in the back with reference to Figure 11.After SubPath_type, that follow is 15 reserved_for_future_use.The is_repeat_SubPath field is a bit field, and expression more particularly, when being illustrated in the playback main path, is reset still only playback once with subpath repeatedly to the playback method of subpath.For example, when (for example being included in by the playback sequential of the playback sequential of the stream in the segment of subpath appointment and main AV stream when different, when main path is rest image lantern slide (slideshow), and the audio frequency subpath is background music (the background music of main path, BGM) time), use this field.After the is_repeat_SubPath field, be 8 reserved_for_future_use.Number_of_SubPlayItems is 8 bit fields, and expression is included in the quantity (entry number) that a son in the subpath is play item.For example, in Fig. 6, the quantity that the son of SubPath_id=0 is play item is one, and the quantity of the son of SubPath_id=1 broadcast item is 2.In FOR statement subsequently, a sub number of times that is cited of playing is identical with the quantity of son broadcast item.

Figure 11 shows first example (sub paths types) of SubPath_type.For example, as shown in figure 11, can the type of subpath be defined.

In Figure 11, SubPath_type=0,1 is retained.But SubPath_type=2 presents the path for the audio frequency of browsable slide shows.In SubPath_type=2, the audio frequency of being quoted by subpath presents the path and to be played the main path that the broadcast item in the tabulation quotes asynchronous.

SubPath_type=3 is that interactive graphics (IG) presents menu.In SubPath_type=3, the interactive graphics (IG) of being quoted by subpath presents menu and to be played the main path that the broadcast item in the tabulation quotes asynchronous.

SubPath_type=4 is that text subtitle presents the path.In SubPath_type=4, the text subtitle of being quoted by subpath presents the path and to be played the main path that the broadcast item in the tabulation quotes synchronous.

SubPath_type=5 is that second audio frequency presents path (it is the path that is used to quote second audio stream).In SubPath_type=5, second audio frequency of being quoted by subpath presents the path and to be played the main path that the broadcast item in the tabulation quotes synchronous.For example, second audio stream of being quoted by this subpath is the director's comment (sound) about film.For the subpath by the representative of the SubPath_id=0 among Fig. 8, SubPath_type is the SubPath_type=5 among Figure 10.

SubPath_type=6 is that second video presents path (it is the path that is used to quote second video flowing).In SubPath_type=6, second video of being quoted by subpath presents the path and to be played the main path that the broadcast item in the tabulation quotes synchronous.For example, second video flowing of being quoted by this subpath is the director's comment (motion picture) about film.When reference Figure 27 and Figure 28 are described the processing of being carried out by reproducing device 1, only discuss to audio frequency is synthetic.But, also can motion picture be synthesized according to the configuration similar with the configuration shown in Figure 28 to Figure 27, the back will go through this.

SubPath_type=7 to 255 is retained.

Figure 12 shows the grammer of SubPlayItem (i).

Length is 16 signless integers, and expression begins after the length field to the byte number of SubPlayItem () end.

In Figure 12, grammer is divided into two parts, more particularly, shows a part and a sub part of quoting a plurality of segments of playing that son broadcast item is quoted a segment.

Son at first is discussed is play the part that item is quoted a segment.

SubPlayItem () comprising: Clip_Information_file_name[0], be used to specify segment; Clip_codec_identifier[0], be used to specify the decoding method that is used for this segment; Reserved_for_future_use; Is_multi_Clip_entries, it is a sign of representing whether to have registered a plurality of segments; And, ref_to_STC_id[0], it is the information about the non-order point of STC (the non-order point of system time reference).If is_multi_Clip_entries is masked as ON, then the grammer that SubPlayItem () is quoted the part of a plurality of segments is checked.SubPlayItem () also comprises: SubPlayItem_IN_time and SubPlayItem_OUT_time are used to specify the playback section of the subpath that is included in the segment; And sync_PlayItem_id and sync_start_PTS_of_PlayItem, be used to specify the playback start time that the replay operations of subpath begins on the time shaft of main path.As shown in Figure 7 and Figure 8, when the playback sequential of main AV stream is identical with the playback sequential of stream in being included in the file of being quoted by subpath, use sync_PlayItem_id and sync_start_PTS_of_PlayItem, but, when the playback sequential of main AV stream is different with the playback sequential of stream in being included in the file of being quoted by subpath (for example, rest image lantern slide (main path) is asynchronous with the BGM (subpath) that is used for lantern slide), do not use sync_PlayItem_id and sync_start_PTS_of_PlayItem.SubPlayItem_IN_time, SubPlayItem_OUT_time, sync_PlayItem_id and sync_start_PTS_of_PlayItem use jointly for the segment of being quoted by SubPlayItem ().

Then, SubPlayItem is discussed and quotes the part of a plurality of segments (if (is_multi_Clip_entries==1b)).More particularly, as shown in Figure 8, SubPlayItem is quoted the situation of a plurality of segments and discuss.

Num_of_Clip_entries represents the quantity of segment, and indicate to be different from have Clip_Information_file_name[0] those segments of the segment of [SubClip_entiry_id].Promptly, num_of_Clip_entries indicates to be different from has Clip_Information_file_name[0] those segments of segment, as have Clip_Information_file_name[1], Clip_Information_file_name[2] etc. those segments.SubPlayItem () also comprises: Clip_codec_identifier[SubClip_entry_id], be used to specify the decoding method that is used for this segment; Ref_to_STC_id[SubClip_entry_id], it is the information about the non-order point of STC (the non-order point of system time reference); And, reserve_for_future_use.

SubPlayItem_IN_time, SubPlayItem_OUT_time, sync_PlayItem_id and sync_start_PTS_of_PlayItem are that the segment that SubPlayItem () is quoted is used jointly.In the example of Fig. 8, SubPlayItem_IN_time, SubPlayItem_OUT_time, sync_PlayItem_id and sync_start_PTS_of_PlayItem are that SubClip_entry_id=0 and SubClip_entry_id=1 use jointly.According to SubPlayItem_IN_time, SubPlayItem_OUT_time, sync_PlayItem_id and sync_start_PTS_of_PlayItem, to be used for selected SubClip_entry_id, the text based captions reset.

According to Clip_Information_file_name[SubClip_entiry_id] order that in SubPlayItem (), occurs, since 1, to SubClip_entiry_id order assignment numerical value.Clip_Information_file_name[0] SubClip_entiry_id be 0.

Figure 13 shows the grammer of PlayItem ().

Length is 16 signless integers, and expression begins after the length field to the byte number of PlayItem () end.Clip_Information_file_name[0] for being used to specify the field of the segment of being quoted by PlayItem ().In the example of Fig. 7, by Clip_Information_file_name[0] quote the disconnected AV stream file of main leaf.PlayItem () also comprises: Clip_codec_identifier[0], specify the decoding method that is used for this segment; Reserve_for_future_use; Is_multi_angle; Connection_condition; And, ref_to_STC_id[0], it is the information about the non-order point of STC (the non-order point of system time reference).PlayItem () also comprises IN_time and OUT_time, is used to specify the playback section of the broadcast item in the segment.In the example of Fig. 7, IN_time and OUT_time specify the playback section of the disconnected AV stream file of main leaf.PlayItem () also comprises UO_mask_table (), PlayItem_random_access_mode and still_mode.Here do not provide the description of is_multi_angle being represented the situation of a plurality of angles, this is because this situation is directly not related to the present invention.

If at least one subpath that provides target to play item and reset explicitly with this target broadcast item, then when the user is switched sound or captions, STN_table () provides and has been used for allowing the user from being included in the mechanism of being selected by the stream of the segment of playing segment that item quotes and being quoted by subpath at least.

Figure 14 shows the example (STN_table ()) of the grammer of STN_table ().The one STN_table () is set to the attribute of PlayItem ().The mechanism that a STN_table () shown in Figure 14 provides the combination that allows the segment that the user quotes to the segment that is played item and quotes with by subpath to select.

Length is 16 signless integers, and expression begins after the length field to the byte number of STN_table () end.After length, be 16 reserved_for_future_use.Number_of_video_stream_entries is illustrated in the quantity of input stream (registration), that provide video_stream_id among the STN_table ().Video_stream_id is the information that is used for identification video stream.Video_stream_number is the video flowing number that can be seen by the user when Switch Video.Number_of_audio_stream_entries is illustrated in the quantity of input stream (registration), that provide audio_stream_id among the STN_table ().Audio_stream_id is the information that is used to discern audio stream.Audio_stream_number is the audio stream number that can be seen by the user when switch audio.

Number_of_PG_txtST_stream_entries is illustrated in the quantity of input stream (registration), that provide PG_txtST_stream_id among the STN_table ().In STN_table () shown in Figure 14, bitmap captions such as DVD sprite have been imported by stream of run length coding, RLC (PG, Presentation Graphics streams presents graphical stream) and text subtitle file (txtST).PG_txtST_stream_id is the information that is used for identification caption stream, and PG_txtST_stream_number is the caption stream number (text subtitle stream number) that can be seen by the user when the switching captions.

Number_of_IG_stream_entries represents to import the quantity of stream in STN_table (), that provide IG_stream_id.In STN_table () shown in Figure 14, imported interactive graphic stream.IG_stream_id is the information that is used to discern interactive graphic stream.IG_stream_number is the graphical stream number that can be seen by the user when switching figure.

The following grammer that stream_entry () is discussed with reference to Figure 15.

Length is 8 signless integers, and expression begins after the length field to the byte number of stream_entry () end.Type is one 8 bit field, and the type of the needed information of unique appointment is carried out in expression to the stream that provides above-mentioned stream number.

If type=1 or type=3 then specify one 16 packet ID (PID), be used for specifying a basic stream a plurality of basic stream that the main leaf of quoting is disconnected from being multiplexed into to be played.Ref_to_stream_PID_of_mainClip represents this PID.That is, if type=1 or type=3, then by would specifying PID in the disconnected AV stream file of main leaf, to determine this stream uniquely.

If type=2 or type=3 in order to specify a basic stream in a plurality of basic stream from be multiplexed into the segment that the subpath that comprised a plurality of segments quotes, specify SubPath_id, Clip_id and the packet ID (PID) of subpath.Ref_to_SubPath_id represents this SubPath_id, and ref_to_SubClip_entry_id represents this Clip_id, and ref_to_stream_PID_of_SubClip represents this PID.When group is play item and quoted a plurality of segments and each segment and quote a plurality of basic stream, use this field.

More particularly, if type=3, then be used for being played when specifying the packet ID (PID) of a basic stream the disconnected a plurality of basic stream of main leaf that item quotes from being multiplexed into when specifying, and, when subpath is quoted a plurality of segments and a plurality of basic stream simultaneously and is multiplexed in each segment, by SubPath_id, Clip_id be used for from a plurality of basic stream that is multiplexed into a sub-segment, specifying two streams of packet ID (PID) input of a basic stream.For example, can import two audio streams, that is, and audio stream of being quoted by main path and the audio stream of being quoted by subpath.Hereinafter, the audio stream of being quoted by main path is otherwise known as " first audio stream ", the audio stream of being quoted by subpath be otherwise known as " second audio stream ".

Play and subpath that at least one is reset explicitly with this broadcasts item if provide, then type (three kinds of type) can be used to from be played the segment that item quotes and the segment quoted by at least one subpath in specify one to flow substantially.The segment that type=1 represents to be quoted by main path (main leaf is disconnected), type=2 or type=3 represent the segment (sub-segment) quoted by subpath.

If type=3 then can specify and import the audio stream (first audio stream) of the segment AV stream file of being quoted by main path and the audio stream of being quoted by subpath (second audio stream).For example, can and reset first audio stream and second audio stream combination (mixing).

Return with reference to the description to the STN_table () among Figure 14, in the FOR of video flowing ID (video_stream_id) circulation, the video-frequency basic flow for being each stream_entry () appointment distributes video_stream_id since 0.Replace video flowing ID (video_stream_id) with video flowing number (video_stream_number), in this case, since 1 assignment numbers.That is be video_stream_number, by making video_stream_id add a number that obtains.Because therefore the video flowing number that video_stream_number can be seen by the user when being Switch Video distributes this number since 1.

Similarly, in the FOR of audio stream ID (audio_stream_id) circulation,, distribute audio_stream_id since 0 for for the audio frequency of each stream_entry () appointment flows substantially.With the same in the video flowing,, in this case, distribute this number since 1 with audio stream number (audio_stream_number) substituted audio stream ID (audio_stream_id).That is be audio_stream_number, by making audio_stream_id add a number that obtains.Because audio_stream_number is the audio stream number that can be seen by the user when switching sound, therefore distributes this number since 1.

Similarly, in the FOR of caption stream ID (PG_txtST_stream_id) circulation,, distribute PG_txtST_stream_id since 0 for for the bitmap captions or the text subtitle of each stream_entry () appointment flows substantially.With the same in the video flowing, replace caption stream ID (PG_txtST_stream_id) with caption stream number (PG_txtST_stream_number), in this case, distribute this number since 1.That is be PG_txtST_stream_number, by making PG_txtST_stream_id add a number that obtains.Because PG_txtST_stream_number is the caption stream number that can be seen by the user when switching captions, therefore distributes this number since 1.

Similarly, in the FOR of graphical stream ID (IG_stream_id) circulation,, distribute IG_stream_id since 0 for for the interactive graphics (IG) of each stream_entry () appointment flows substantially.With the same in the video flowing, replace graphical stream ID (IG_stream_id) with graphical stream number (IG_stream_number), in this case, distribute this number since 1.That is be IG_stream_number, by making IG_stream_id add a number that obtains.Because IG_stream_number is the graphical stream number that can be seen by the user when switching figure, therefore distributes this number since 1.

Below be the stream_attribute () among the STN_table () shown in Figure 14.In stream_attribute (), write down about by the attribute information of the stream of stream_entry () appointment.

Stream_attribute () in the FOR of video flowing ID (video_stream_id) circulation provides about by the attribute information of a video-frequency basic flow of each stream_entry () appointment.That is, in stream_attribute (), indicated about by the stream attribute information of a video-frequency basic flow of each stream_entry () appointment.

Stream_attributes () in the FOR circulation of audio stream ID (audio_stream_id) provides the stream attribute information that flows substantially about by at least one audio frequency of each stream_entry () appointment.That is, in stream_attributes (), indicated the stream attribute information that flows substantially about by at least one audio frequency of each stream_entry () appointment.More particularly, in stream_entry () shown in Figure 15, if type=1 or type=2, then by the audio frequency of this stream_entry () appointment substantially stream have only one.Therefore, stream_attributes () provides the stream attribute information that flows substantially about this audio frequency.If type=3, then by the audio frequency of this stream_entry () appointment substantially stream two (that is, first audio stream of being quoted by main path and second audio streams of being quoted by subpath) are arranged.Therefore, stream_attributes () provides about these two stream attribute information that audio frequency flows substantially.

By this way, if type=3 promptly, if main path and subpath are all quoted audio stream, then can insert two stream_attributes elements.That is, be used for the FOR statement of audio stream, if in stream_entry (), type=3 then imports two stream_attributes () element.

More particularly, among the STN_table () in Figure 14, for each stream_entry () of audio stream ID (audio_stream_id) has defined stream_attributes ().If type=3 then distributes to stream_entry () with two stream_attributes () element.Therefore, because for an audio_stream_id, import two stream_attributes () element of the audio stream of being quoted by main path and subpath, therefore can import two audio streams being reset simultaneously.

Stream_attribute () in the FOR circulation of caption stream ID (PG_txtST_stream_id) provides about being flowed substantially or the stream attribute information that text subtitle flows substantially by bitmap captions of each stream_entry () appointment.That is, in stream_attribute (), indicated about being flowed substantially or the stream attribute information that text subtitle flows substantially by bitmap captions of each stream_entry () appointment.

Similarly, the stream_attribute () in the FOR of graphical stream ID (IG_stream_id) circulation provides about by a stream attribute information that interactive graphics (IG) flows substantially of each stream_entry () appointment.That is, in stream_attribute (), indicated about by a stream attribute information that interactive graphics (IG) flows substantially of each stream_entry () appointment.

With reference to Figure 14 and Figure 15, the example of the audio stream importing two audio streams, the audio stream of promptly being quoted by main path and quoted by subpath is discussed.In Figure 16 and 17, show the grammer of the 2nd STN_table () that allows two audio streams that input quoted by two subpaths and the grammer of the 2nd stream_entry () respectively.In Figure 16 and 17,, the element corresponding with element in Figure 14 and 15 do not described for fear of repetition.

Figure 16 shows the grammer of the 2nd STN_table ().The 2nd STN_table () is set to the attribute of playing item.Figure 17 shows the grammer of the 2nd stream_entry ().

In Figure 17, if type=1 then in order to specify a basic stream from being multiplexed into to be played in a plurality of basic stream of the main leaf quoted of item disconnected, specifies one 16 packet ID (PID).Ref_to_stream_PID_of_mainClip represents this PID.That is, if type=1 then by specifying PID, determines this stream uniquely in the disconnected AV stream file of main leaf.

If type=2 in order to specify a basic stream in a plurality of basic stream from be multiplexed into the segment that the subpath that comprised a plurality of segments quotes, indicates SubPath_id, Clip_id and packet ID (PID).Ref_to_SubPath_id represents this SubPath_id, and ref_to_SubClip_entry_id represents this Clip_id, and ref_to_stream_PID_of_SubClip represents this PID.When group is play item and quoted a plurality of segments and each segment and quote a plurality of basic stream, use this type.

By this way, play and during when providing with at least one subpath of this broadcasts item playback explicitly, type (two kinds of type, that is, type1 and type2) can be used to from be played the segment that item quotes and the segment quoted by at least one subpath in specify a basic stream.The segment that type=1 represents to be quoted by main path (main leaf is disconnected), type=2 represents the segment (sub-segment) quoted by subpath.

Return with reference to description, in the FOR of audio stream ID (audio_stream_id) circulation,, distribute audio_stream_id since 0 for for the audio frequency of each stream_entry () appointment flows substantially to the 2nd STN_table () among Figure 16.Different with a STN_table () shown in Figure 14, at the stream_entry () that is used for (by the first audio decoder 75-1 of reproducing device shown in Figure 28 1 decoding) first audio stream and stream_attributes () afterwards, provide the secondary_audio_present_flag that represents whether to have defined the secondary audio stream.If definition secondary audio stream, then secondary_audio_present_flag is set to 1, and, in IF statement subsequently, definition secondary audio stream in stream_entry () and stream_attributes ().If secondary_audio_present_flag is 1, then in the FOR of audio stream ID (audio_stream_id) circulation, define two stream_entry () element, and, for being flowed substantially, distribute the audio_stream_id assignment since 0 by two audio frequency of this two stream_entry () element appointment.The same with the situation of video flowing, with audio stream number (audio_stream_number) substituted audio stream ID (audio_stream_id), in this case, distribute audio_stream_number since 1.That is be audio_stream_number, by making audio_stream_id add a number that obtains.Because audio_stream_number is the audio stream number that can be seen by the user when switching sound, therefore distributes this number since 1.

Can not import the secondary audio stream, i.e. secondary stream_entry ().In this case, secondary_audio_present_flag is set to 0, and, only import an audio stream (main audio stream).That is,, then do not import secondary stream_entry () if there is not the secondary audio stream.In this case, do not carry out two audio streams are mixed.

In the FOR of audio stream ID (audio_stream_id) circulation, two combinations of stream_entry () and stream_attributes () have been indicated.For the audio stream of being decoded by the first audio decoder 75-1 of the reproducing device shown in Figure 28 1, defined first combination of stream_entry () and stream_attributes (), and, for by the audio stream of the second audio decoder 75-2 of the reproducing device shown in Figure 28 1 decoding, defined second combination of the stream_entry () and the stream_attributes () of input when secondary_audio_present_flag is 1.That is, can define two audio streams.

In the FOR of audio stream ID (audio_stream_id) circulation, stream_attributes () provides the stream attribute information that flows substantially about at least one audio frequency of each stream_entry () appointment.That is, in stream_attributes (), indicated the stream attribute information that flows substantially about at least one audio frequency of each stream_entry () appointment.More particularly, if the secondary_audio_present_flag shown in Figure 16 is 1, then have by two audio frequency of two stream_entry () element appointment and flow substantially, therefore, each stream_attributes () provides the stream attribute information that flows substantially about corresponding audio.More particularly, in the FOR of audio stream ID (audio_stream_id) circulation, the one stream_entry () has defined by the audio stream of the first audio decoder 75-1 of the reproducing device shown in Figure 28 1 decoding, then, provide the stream attribute information that the audio frequency about appointment flows substantially by a stream_attributes ().Similarly, if secondary_audio_present_flag is 1, then the 2nd stream_entry () in the FOR of audio stream ID (audio_stream_id) circulation has defined by the audio stream of the second audio decoder 75-2 of the reproducing device shown in Figure 28 1 decoding, then, provide the stream attribute information that the audio frequency about appointment flows substantially by the 2nd stream_attributes () in the FOR of audio stream ID (audio_stream_id) circulation.

For example, be the film audio that the film audio dubbed of Japanese or English are dubbed by the audio stream of the definition of the stream_entry () in the FOR of audio stream ID (audio_stream_id) circulation.For example, if the secondary_audio_present_flag in the FOR of audio stream ID (audio_stream_id) circulation is 1, be the film audio of working as director's montage of using when the director comments on the predetermined portions that is inserted into the AV stream file of being quoted by main path then by the audio stream of the 2nd stream_entry () definition.

Promptly, when two audio streams are made up, shown in Figure 16, expression exists and will be set to 1 with the secondary_audio_present_flag of the audio stream of (first) audio stream combination once, makes it possible to quote the stream_entry () and the stream_attributes () of secondary audio stream.

More particularly, now in the hypothesis audio stream that will be combined is set to the audio stream quoted by main path (by the main audio stream of the first audio decoder 75-1 of the reproducing device shown in Figure 28 1 decoding, discuss to this in the back), and another audio stream is set to the audio stream of being quoted by subpath (by the secondary audio stream of the second audio decoder 75-2 of the reproducing device shown in Figure 28 1 decoding, discuss to this in the back).In this case, the type of the stream_entry () among Figure 16 is set at 1 (type=1), and, the stream attribute information that the audio frequency about appointment flows substantially provided by stream_attributes ().Then, secondary_audio_present_flag among Figure 16 is set at 1, and, the type of the 2nd stream_entry () is set at 2 (type=2), and, provide the stream attribute information that the audio frequency about appointment flows substantially by stream_attributes ().

If will be made up by two audio streams that subpath is quoted, then the type with the stream_entry () in the FOR circulation of the audio stream ID (audio_stream_id) among Figure 16 is set at 2 (type=2), and, provide the stream attribute information that the audio frequency about appointment flows substantially by stream_attributes.Then, secondary_audio_present_flag in the FOR circulation of the audio stream ID (audio_stream_id) among Figure 16 is set at 1, and the type of the 2nd stream_entry () is set to 2 (type=2).So, provide the stream attribute information that the audio frequency about appointment flows substantially by stream_attributes ().That is, if the audio stream that the audio stream that is combined is quoted by subpath, then the type of the stream_entry () among Figure 17 is 2 (type=2).

As mentioned above, because audio stream (or video flowing) can be specified and addition by subpath, therefore, can be to being stored in the audio stream (or video flowing) in the dish and resetting synchronously with one another by the audio stream (or video flowing) that download to obtain or be stored in the local memory.Perhaps, can with by the audio stream (or video flowing) that download to obtain be stored in video flowing (or audio stream) synchronized playback in the dish or that obtain from external source.

If obtain playlist, then can with synchronously reset by the video flowing of main path appointment (or audio stream) by two audio streams (or video flowing) of subpath appointment.

If only reset by the audio stream of main path appointment or only reset, then the secondary_audio_present_flag among Figure 16 is set at 0 by the audio stream of subpath appointment.So, if audio stream is quoted by main path, then the type of a stream_entry () is set to 1 (type=1), and if audio stream is quoted by subpath, then the type of a stream_entry () is 2 (type=2).Provide the stream attribute information that the audio frequency about appointment flows substantially by stream_attributes ().That is, there be not under the mixed situation audio stream of can only resetting.

By this way, in Figure 16, can insert stream_entry () and stream_attributes for two audio frequency flow substantially.That is, in the FOR of audio stream statement, utilize two stream_entry () element, can import corresponding stream_attributes ().

That is, in the 2nd STN_table () shown in Figure 16, two stream_entry () element definition of audio stream ID (audio_stream_id) corresponding stream_attributes ().Therefore, for an audio_stream_id, can import combination and the stream_entry () that quotes by a subpath or by two subpaths and another combination of stream_attributes of the stream_entry () that quoted by main path and stream_attributes.Therefore, can import two audio streams being reset simultaneously.

Similar among video flowing ID (video_stream_id) among Figure 16, caption stream ID (PG_txtST_stream_id) and graphical stream ID (IG_stream_id) and Figure 14.

Following with reference to Figure 18, the grammer of stream_attribute () is discussed.

Length is 16 signless integers, and expression begins after the length field to the byte number of stream_attribute () end.

As shown in figure 19, stream_coding_type represents the type of coding of basic stream.The type of coding of basic stream comprises MPEG-2 video flowing, HDMV LPCM audio frequency, DoLbyAC-3 audio frequency, dts audio frequency, presents graphical stream, interactive graphic stream and text subtitle stream.Can also expand stream_coding_type, make and to handle the video flowing that is compressed by the coding method of other type, as MPEG4AVC and VC-1.

As shown in figure 20, video_format represents the video format of video-frequency basic flow.The video format of video-frequency basic flow comprises 480i, 576i, 480p, 1080i, 720p and 1080p.

As shown in figure 21, frame_rate represents the frame rate of video-frequency basic flow, and the frame rate of video-frequency basic flow comprises 24000/1001,24,25,30000/1001,50 and 60000/1001.

As shown in figure 22, aspect_ratio represents the length breadth ratio of video-frequency basic flow.The length breadth ratio of video-frequency basic flow comprises 4: 3 and shows length breadth ratio and show length breadth ratio at 16: 9.

As shown in figure 23, audio_presentation_type represents the type that presents that audio frequency flows substantially.The type that presents that audio frequency flows substantially comprises only sound channel (single mono channel), two monophony (dual mono channel), stereo (2-channel) and multichannel.

As shown in figure 24, sample_frequency represents the sample frequency that audio frequency flows substantially.The sample frequency that audio frequency flows substantially comprises 48kHz and 96kHz.

Audio_language_code represents the language codes (for example, Japanese, Korean or Chinese) that audio frequency flows substantially.

PG_language_code represents the language codes (for example, Japanese, Korean or Chinese) that the bitmap captions flow substantially.

IG_language_code represents the language codes (for example, Japanese, Korean or Chinese) that interactive graphics (IG) flows substantially.

TextST_language_code represents the language codes (for example, Japanese, Korean or Chinese) that text subtitle flows substantially.

As shown in figure 25, character_code represents the character code that text subtitle flows substantially.The character code that text subtitle flows substantially comprises Unicode V1.1 (ISO 10646-1), Shift JIS (Japanese), comprises KSC 5601-1987, the GB18030-2000 (Chinese) of the KSC 5653 that is used for Roman character (Korean), GB2312 (Chinese) and BIG5 (Chinese).

Hereinafter with reference to Figure 18 and 19 to 25, the specific examples of the grammer of the stream_attribute () shown in Figure 18 is described.

If the type of coding (stream_coding_type among Figure 18) of basic stream is MPEG2 video flowing (Figure 19), then stream_attribute () comprises video format (Figure 20), frame rate (Figure 21) and the length breadth ratio (Figure 22) of basic stream.

If the type of coding (stream_coding_type among Figure 18) of basic stream is HDMV LPCM audio frequency, DoLby AC-3 audio frequency or dts audio frequency (Figure 19), then stream_attribute () comprises that the audio frequency that audio frequency flows substantially presents type information (Figure 23), sample frequency (Figure 24) and language codes.

If the type of coding (stream_coding_type among Figure 18) of basic stream is for presenting graphical stream (Figure 19), then stream_attribute () comprises the language codes that the bitmap captions flow substantially.

If the type of coding (stream_coding_type among Figure 18) of basic stream is interactive graphic stream (Figure 19), then stream_attribute () comprises the language codes that interactive graphics (IG) flows substantially.

If the type of coding (stream_coding_type among Figure 18) of basic stream is text subtitle stream (Figure 19), then stream_attribute () comprises character code (Figure 25) and the language codes that text subtitle flows substantially.

Attribute information is not limited to the above-mentioned type.

By this way, play item and at least one and the broadcast item subpath of playback explicitly if provide, then by reference by this broadcast segment of quoting and the segment of being quoted by at least one subpath, can utilize stream_attribute () definition about by the basic stream of stream_entry () appointment (if type=1 or type=2, be a basic stream, if and type=3 then is two basic streams) attribute information.

By checking attribute information (stream_attribute ()), reproducing device can determine whether it has the function of resetting corresponding basic stream.In addition, by checking attribute information, reproducing device can be selected basic stream according to the initial information about the language set in reproducing device.

For example, suppose that reproducing device has the function that playback bitmap captions flow substantially, and the function that the text subtitle of not resetting flows substantially.In this case, in response to from the instruction user, switch languages, reproducing device select progressively bitmap captions from the FOR circulation of caption stream ID (PG_txtST_stream_id) flow substantially, and the basic stream of resetting and selecting.

If the initial information about the language set in reproducing device is a Japanese, in response to from the user, switch to sub-audio (promptly from main audio, the secondary audio frequency) or with the instruction of main audio and secondary audio mix, reproducing device a select progressively is prepared as the secondary audio frequency from the FOR of audio stream ID (audio_stream_id) circulation, language codes is that the audio frequency of Japanese flows substantially, and the basic stream of resetting and selecting.

If AV video flowing and AV audio stream (film) that playback is quoted by main path, in response to from the user, switch sound and will be flowed the instruction that mix with the AV that is quoted by main path by the audio stream (director or performer's comment) that subpath is quoted, reproducing device will be mixed (on first audio stream of being quoted by main path that will be added to by second audio stream that subpath is quoted) mutually by second audio stream that subpath is quoted with first audio stream of being quoted by main path, and will reset with video flowing through the audio stream that mixes.

In response to the instruction of switching sound and will be mixed (promptly by two audio streams that two subpaths are quoted, reset with in the grammer shown in Figure 16 and 17, secondary_audio_present_flag shown in Figure 16 be 1 and Figure 17 shown in types be the instruction of 2 audio frequency ID corresponding audio stream), reproducing device will be mixed (overlapping) by two audio streams that two subpaths are quoted, and will reset with video flowing through the audio stream that mixes.

As mentioned above, by the STN_table among the PlayItem () () is provided, play the subpath that item and at least one and this broadcast item are reset explicitly if provide, then when switching sound or captions, the user can be from the segment that is played the segment quoted of item and is quoted by at least one subpath, the stream that selection will be reset.Thus, can carry out interactive operation to the stream or the data file that are different from the AV stream that to be reset.

Quote a son and play item owing to a playlist comprises a plurality of subpaths and each subpath, realized that therefore the AV with highly scalable and high degree of flexibility flows.That is, can add son later on and play item.For example, comprised the playlist replacement of segment AV stream file and new subpath if comprise the playlist of the segment AV stream file of being quoted by main path, then according to new playlist, the user not only can select from the segment AV stream file of being quoted by main path, and can select from the segment AV stream file of being quoted by subpath.Therefore, AV stream has highly scalable.

If at least one subpath of playing and resetting explicitly with this broadcasts item is provided, then the STN_table () among the PlayItem () provides the segment audio stream that is used for being quoted by two subpaths to mix and will be through the mechanism of stream (Figure 16 and the 17) playback of mixing.Therefore, when going up, can carry out interactive operation when being overlapped onto by the audio stream of second audio decoder 75-2 decoding (for example, director's montage) by the audio stream (for example, the sound of film dubbed in Japanese) of first audio decoder 75-1 decoding.

By in PlayItem (), providing STN_table (), if provide play and with at least one subpath that this broadcasts item is reset explicitly, provide then that be used for will be by this broadcast mechanism that first audio stream of quoting mix with second audio stream of being quoted by subpath.Therefore, when the audio stream that will be different from the disconnected AV stream of main leaf (as second audio stream, for example, director's comment) overlaps onto when being played on the audio stream that item quotes, the user can carry out interactive operation.

Provide specific examples with reference to Figure 26.Figure 26 shows and offers the example user, that represent the stream number form of the relation between sound number and the captions number.Stream number form shown in Figure 26 is corresponding with the 2nd STN_table shown in Figure 16 and 17 and the 2nd Stream_entry () respectively.

In Figure 26, the sound number is called as " A_SN " (Audio Stream Nmuber, audio stream number), and the captions number is called as " S_SN " (SubPicture Stream Nmuber, sub-picture streams number).In Figure 26, give each in a plurality of segment AV audio streams of being quoted by main path and a plurality of segment AV audio streams of being quoted by subpath in each A_SN is provided.That is, the audio frequency of being quoted by main path 2 is assigned to A_SN=1, and the audio frequency of being quoted by subpath 1 is assigned to A_SN=2, and is assigned to A_SN=3 by the audio frequency 3 that main path is quoted.

A_SN is distributed like this, make the audio stream quoted by subpath can with provide A_SN=1 each in the audio stream of A_SN=3 and mix.More particularly, will be distributed to A_SN=4 with the combination of the audio frequency of being quoted by main path 2 by the audio frequency 4 that another subpath is quoted.To be distributed to A_SN=5 with the combination of audio frequency 1 by the audio frequency 4 that subpath is quoted.In other words, A_SN=4 is assigned with and is used for the audio stream that will be quoted by main path and mixed by the audio stream that subpath is quoted, and A_SN=5 is assigned with two audio streams that are used for being quoted by two subpaths and mixes.

S_SN is provided in a plurality of sub-picture streams of the disconnected AV stream of the main leaf of being quoted by main path each.More particularly, sprite 3 is distributed to S_SN=1, sprite 1 is distributed to S_SN=2, sprite 2 is distributed to S_SN=3.In this case, the number that A_SN or S_SN represent is more little, then with big more priority corresponding audio signal or sub-picture streams is offered the user.That is, the audio stream that A_SN=1 resets for acquiescence, the sub-picture streams that S_SN=1 resets for acquiescence.

More particularly, be audio frequency 2 (Figure 26) according to the sound of resetting about the initial information of the language in reproducing device, set, it is A_SN=1, and is audio frequency 1 at the sound of playback after audio frequency 2 switches, it is A_SN=2 (Figure 26).

For such stream number code table is provided, STN_table () among the PlayItem () that is quoted by PlayList () should be configured to, a main path that makes " audio frequency 1 or audio frequency 3 " and " sprite 1, sprite 2 or sprite 3 " can be played is quoted, and " audio frequency 2 or audio frequency 4 " can be quoted by the SubPath () that resets explicitly with PlayItem ().So, in STN_table () (Figure 16), audio_stream_id=0 (A_SN=1) is assigned to audio frequency 2 (type=1), audio_stream_id=1 (A_SN=2) is assigned to audio frequency 1 (type=2), audio_stream_id=2 (A_SN=3) is assigned to audio frequency 3 (type=1), audio_stream_id=3 (A_SN=4) is assigned to audio frequency 2 and audio frequency 4 (type=1 and type=2), and audio_stream_id=4 (A_SN=5) is assigned to audio frequency 1 and audio frequency 4 (type=2 and type=2).

Under the situation of audio_stream_id=3 (A_SN=4), by with a corresponding stream_entry () and the Stream_attributes () of audio stream ID among Figure 16, can register the audio stream of being quoted by main path (type=1), and, secondary_audio_present_flag subsequently is set at 1.Then, by the 2nd stream_entry () and the 2nd Stream_attributes (), can register the audio stream of being quoted by subpath (type=2).In this case, utilize audio_stream_id, the combination of the audio stream that can quote to the audio stream quoted by main path with by subpath defines.That is to say, do not define inconsistent combination.This makes the user always can select the combination of the audio stream that can be reset.That is, in example shown in Figure 26, not to inconsistent combination, as audio frequency 2 and audio frequency 3, define, therefore, the user can select the combination that can be reset.

As discussed above, the Stream_entry () of STN_table () in PlayItem () in (Figure 16) (Figure 17) in, by secondary_audio_present_flag is provided, can import first audio stream that (registration) quoted by main path and second audio stream of being quoted by subpath.Then,, can provide the combination of first audio stream and second audio stream, make that two audio streams can be mixed and reset by audio_stream_id.That is, from polytype stream, the stream (in this case, being audio stream) of same type can be mixed (overlapping or combination), and reset simultaneously.

Under the situation of audio_stream_id=4 (A_SN=5), by with a corresponding stream_entry () and a Stream_attributes () and the 2nd stream_entry () and the 2nd Stream_attributes () of audio stream ID among Figure 16, can register the audio stream of being quoted by two subpaths (type=2).In this case, utilize audio_stream_id, can the combination of two audio streams being quoted by two subpaths be defined.That is, inconsistent combination is not defined.This makes the user always can select the combination of the audio stream that can be reset.

As discussed above, the stream_entry () of the STN_table () in PlayItem () in (Figure 16) (Figure 17) in, can import two audio streams that (registration) quoted by two subpaths.Then,, can provide the combination of two audio streams, make that two audio streams can be mixed and reset by audio_stream_id.That is, from polytype stream, the stream (in this case, being audio stream) of same type can be mixed (overlapping or combination), and reset simultaneously.

In addition, the user can select the audio stream that will reset from a plurality of predetermined combinations of audio stream, and does not need to select separately two audio streams.

In addition, in the grammer shown in Figure 14 and 15, the combination (audio_stream_id=3 (A_SN=4)) of second audio stream that can quote to first audio stream quoted by main path with by the subpath among Figure 26 defines.In this case, in stream_entry () shown in Figure 14,, register, then, insert two stream_attributes () element to the audio stream quoted by main path with by the audio stream that subpath is quoted by type=3.By this way, the Stream_entry () of STN_table () in PlayItem () in (Figure 14) (Figure 15) in, can import first audio stream that (registration) quoted by main path and second audio stream of being quoted by subpath (type=3), and, utilize audio_stream_id, with the combination of first audio stream and second audio stream, make that these two audio streams can be mixed and reset.That is, from polytype stream, the stream (in this case, being audio stream) of same type can be mixed (overlapping or combination), and reset simultaneously.

Below will discuss to first example of the configuration of having used reproducing device 1 of the present invention.Figure 27 is the block diagram that shows the example of the configuration of having used reproducing device 1 of the present invention.Reproducing device 1 is the reproducing device 1 that the playlist that comprises above-mentioned main path and subpath is reset.

Controller 21 is carried out the predetermined control program.Perhaps, 21 pairs of memory drivers 22 of controller are controlled, with the Navigator of reading and recording on recording medium 11 or local memory 24, and, this program is expanded in the storer 23, to carry out Navigator.Then, the overall operation of 21 pairs of reproducing devices 1 of controller is controlled.For example, when recording medium 11 was loaded into reproducing device 1, controller 21 externally showed the predetermined menus screen on the display device.

Under the control of controller 21, memory driver 22 is reading of data from recording medium 11, and the data that read are outputed to controller 21, storer 23 or AV demoder 26.If the information that reads is Navigator or playlist, then it is outputed to controller 21 or storer 23 from recording medium 11.If the information that reads is AV stream or text data, then will output to AV demoder 26 from the information that memory driver 22 reads from recording medium 11.

Storer 23 memory controllers 21 are carried out the needed data of various Processing tasks.Storer 23 comprises various registers, has wherein set reproducing device 1 and has reset and handle needed information.Local memory 24 can be HDD (Hard Disk Drive, a hard disk drive).

Internet interface 25 is connected to network 2 by wired or wireless device, and, under the control of controller 21, communicate by letter with server 3, so that will offer local memory 24 from server 3 data downloaded by network 2.In this case, for example, as content from server 3 data downloaded to as shown in Figure 5, the information that is recorded on the recording medium 11 that is installed in the reproducing device 1 carries out data updated.Local memory 24 can will be recorded in wherein from server 3 downloaded contents by network 2.

26 pairs of AV demoders are decoded from AV stream or text data that memory driver 22 or local memory 24 provide, and with the vision signal that produces and audio signal output to exterior display device.For example, in display device, according to the signal of being decoded, the content (video or sound) of output record on recording medium 11 by AV demoder 26.

Operate the input that input block 29 receives from the user, and it is offered controller 21, operation input block 29 comprises: input media, as button, key, touch-screen, roller key (jog dial) or mouse; And receiver is used for received signal, as the infrared signal that sends from predetermined telepilot.

If desired, driver 27 is connected to controller 21, and with removable medium 28 driver 27 of packing into, removable medium 28 comprise disk (comprising floppy disk), CD (comprise CD-ROM (Compact Disk-Read Only Memory, compact disc read-only memory) and DVD), magneto-optic disk (comprising MD (registered trademark)) or semiconductor memory.

Figure 28 is the block diagram that shows the AV demoder 26 of reproducing device shown in Figure 27 1.

In example shown in Figure 28, controller 21 is at first read play list file from memory driver 22 or local memory 24, and, according to information about play list file, by memory driver 22, from local memory 24 or recording medium 11 as HDD, Blu-raydisc ^TMOr read AV among the DVD and flow or the AV data.The user can utilize operation input block 29, sends the instruction of switching sound or captions to controller 21.Controller 21 reads the various set informations that comprise about the initial information of the language of setting in the reproducing device 1 from the register of storer 23.

Play list file not only comprises about the information of main path with about the information of subpath, and comprises STN_table ().Controller 21 is by memory driver 22, from recording medium 11 or local memory 24, read the disconnected AV stream file of main leaf, quilt that the broadcast item that is comprised in the play list file quotes and play sub-segment AV stream file and the quilt that item quotes and play the text subtitle data that item is quoted.In this case, being played the disconnected AV stream file of a main leaf of quoting can be recorded on the different recording mediums with the sub-segment AV stream file that quilt broadcast item is quoted.For example, the disconnected AV stream file of main leaf can be recorded on the recording medium 11, and corresponding sub-segment AV stream file can provide and be stored in local memory 24 as among the HDD by network 2 (not shown)s.Be set in the various set informations in the register of storer 23 by reference, 21 pairs of reproducing devices 1 of controller are controlled, with playback according to reproducing device 1, select and the basic stream of playback, perhaps, according to initial information about the language of setting in reproducing device 1, the basic stream of selecting and reset.

AV demoder 26 comprises impact damper 51 to 54, pid filter 55 and 56, switch 57 to 59, background demoder 71, MPEG (Motion Picture Experts Group) 2 Video Decoders 72, present graphic decoder 73, interactive graphics (IG) demoder 74, the first audio decoder 75-1, the second audio decoder 75-2, Text-ST compositor 76, switch 77, background plane maker 91, video plane maker 92, present graphics plane maker 93, interactive graphics plane maker 94, impact damper 95, video data processor 96 and hybrid processor 97 and 98.The first and second audio decoder 75-1 and 75-2 decode to audio stream.The first audio decoder 75-1 is had precedence over the second audio decoder 75-2 and is used.More particularly, if having only one to want decoded audio stream,, all utilize the first audio decoder 75-1 to decode no matter then this audio stream belongs to the disconnected AV stream file of main leaf or belongs to sub-segment AV stream file.That is, reproducing device 1 comprises two audio decoders (the first audio decoder 75-1 and the second audio decoder 75-2), is used for two audio streams are decoded.Hereinafter, abbreviate the first and second audio decoder 75-1 and 75-2 as " audio decoder 75 ", they are distinguished from each other except that nonessential.

By detuner the file data that controlled device 21 reads is carried out demodulation, and by the ECC demoder to through demodulation, multiplex stream carries out error correction.Then, under the control of controller 21, switch 32 is according to the multiplexed stream of type selecting of stream, and these streams are offered corresponding impact damper 51 to 54.More particularly, under the control of controller 21, switch 32 offers impact damper 51 with background image data, and the disconnected AV stream file data of main leaf are offered impact damper 52, sub-segment AV stream file data are offered impact damper 53, and the text-ST data are offered impact damper 54.Then, impact damper 51 to 54 respectively with the disconnected AV stream file data of background image data, main leaf, sub-segment AV stream file data and text-ST metadata cache in wherein.

The disconnected AV stream file of main leaf is such stream (for example, transport stream), and wherein, at least one stream in video flowing, audio stream, bitmap captions (presenting figure) stream and the interactive graphic stream is multiplexed with video flowing.Sub-segment AV stream file is such stream, and wherein, at least one stream in audio stream, bitmap caption stream (presenting graphical stream) and the interactive graphic stream is by multiplexed.Text subtitle data file (text-ST) can be the stream that process is multiplexed, and as transport stream, but this not necessarily.

When from memory driver 22 (recording medium 11), reading main leaf disconnected AV stream file, sub-segment AV stream file and text subtitle data, can they alternately be read according to time division way.Perhaps, can read main leaf disconnected before, respectively sub-segment AV stream file or text subtitle data all are pre-loaded to impact damper 53 or 54.

Reproducing device 1 reads these data, so that video, bitmap captions, interactive graphics (IG) and audio frequency are reset by memory driver 22 from recording medium 11.

More particularly, from as the flow data of reading the impact damper 52 of segment AV stream file read buffer, outputed to PID (packet ID) wave filter 55 that is positioned at after the impact damper 52 to schedule.Pid filter 55 will be included in the stream in the disconnected AV stream file of main leaf, according to PID (packet ID), distribute to corresponding basic stream decoder.More particularly, pid filter 55 offers Video Decoder 72 with video flowing, to present graphical stream offers switch 57, interactive graphic stream is offered switch 58, audio stream is offered switch 59, wherein, switch 57 offers graphical stream and presents graphic decoder 73, and switch 58 offers interactive graphics (IG) demoder 74 with graphical stream, and switch 59 offers the first audio decoder 75-1 with audio stream.

For example, presenting graphical stream is bitmap subtitle data, and again for example, text subtitle data is a text subtitle data.

From as the flow data of reading the impact damper 53 of sub-segment AV stream file read buffer, outputed to PID (packet ID) wave filter 56 that is positioned at after the impact damper 53 to schedule.Pid filter 56 will be included in the stream in the sub-segment AV stream file, according to PID (packet ID), distribute to corresponding basic stream decoder.More particularly, pid filter 56 will present graphical stream and offer switch 57, interactive graphic stream is offered switch 58, sub-segment audio stream is offered switch 59, wherein, switch 57 offers graphical stream and presents graphic decoder 73, switch 58 offers interactive graphics (IG) demoder 74 with graphical stream, and switch 59 offers the first audio decoder 75-1 and the second audio decoder 75-2 with audio stream.

To schedule, will be from offering background demoder 71 as the data of reading the impact damper 51 of background image data impact damper.Then, 71 pairs of background image datas of background demoder are decoded, and will offer background plane maker 91 through the data of decoding then.

The video flowing that is distributed by pid filter 55 is provided for the Video Decoder 72 that is positioned at after the pid filter 55.72 pairs of video flowings of Video Decoder are decoded, and will offer video plane maker 92 through decoded video stream then.

Switch 57 presenting graphical stream and being included in presenting in the graphical stream from the sub-segment AV stream file that pid filter 56 provides from the disconnected AV stream file of the main leaf that provides from pid filter 55 is provided selected one, and will select present graphical stream offer be positioned at switch 57 afterwards present graphic decoder 73.Present 73 pairs of graphic decoders and present graphical stream and decode, then they are offered switch 77, switch 77 offers them and presents graphics plane maker 93.

Switch 58 from the disconnected AV stream file of the main leaf that provides from pid filter 55 is provided interactive graphic stream and be included in the interactive graphic stream from the sub-segment AV stream file that pid filter 56 provides and select one, and the interactive graphic stream of selecting is offered the interactive graphics (IG) stream decoder 74 that is positioned at after the switch 58.That is, the interactive graphic stream that is input to simultaneously in the interactive graphics (IG) demoder 74 is the stream that separates with disconnected AV stream file of main leaf or sub-segment AV stream file.74 pairs of interactive graphic streams of interactive graphics (IG) demoder are decoded, and will offer interactive graphics plane maker 94 through the stream of decoding then.

Switch 59 from the disconnected AV stream file of the main leaf that provides from pid filter 55 is provided audio stream and be included in the audio stream from the sub-segment AV stream file that pid filter 56 provides and select one, and the audio stream of selecting is offered the first audio decoder 75-1 or the second audio decoder 75-2.The audio stream that is input to simultaneously among the first audio decoder 75-1 is the stream that separates with disconnected AV stream file of main leaf or sub-segment AV stream file.The audio stream that is input to simultaneously among the second audio decoder 75-2 is the stream that separates with sub-segment AV stream file.

More particularly, switch 59 is selected audio stream according to the type among the stream_entry () shown in Figure 15 or 17.If type=1, then switch 59 selects to be included in the audio stream from the disconnected AV stream file of main leaf that pid filter 55 provides, and they are offered the first audio decoder 75-1.If type=2, then switch 59 selects to be included in the audio stream from the sub-segment AV stream file that pid filter 56 provides, and they are offered the first audio decoder 75-1 or the second audio decoder 75-2.

If the instruction that the audio stream in having sent the audio stream that will be included in the sub-segment AV stream file and being included in the disconnected AV stream file of main leaf mixes (promptly, if the type among the stream_entry () of a STN_table shown in Figure 14 is 3 (type=3), perhaps, if the secondary_audio_present_flag among the stream_entry of the 2nd STN_table shown in Figure 16 is the type among the 1 and the 2nd stream_entry () is 2 (type=2)), then switch 59 audio stream that will be included in the disconnected AV stream file of the main leaf that provides from pid filter 55 offers the first audio decoder 75-1, and the audio stream that will be included in from the sub-segment AV stream file that pid filter 56 provides offers the second audio decoder 75-2.

If sent instruction that two audio streams that will be included in the sub-segment AV stream file mix (promptly, if the secondary_audio_present_flag among Figure 16 is 1, the type of the one stream_entry () is 2 (type=2), and the type of the 2nd stream_entry () is 2 (type=2)), if the corresponding audio stream that then is included in from the sub-segment AV stream file that pid filter 56 provides is corresponding with the audio stream that is defined by the stream_entry () in the FOR of audio stream ID (audio_stream_id) the shown in Figure 16 circulation, then switch 59 offers the first audio decoder 75-1 with this audio stream, in addition, if the corresponding audio stream that is included in from another sub-segment AV stream file that pid filter 56 provides is corresponding with the audio stream that is defined by the 2nd stream_entry () in the FOR of audio stream ID (audio_stream_id) the shown in Figure 16 circulation, switch 59 offers the second audio decoder 75-2 with this audio stream.

Promptly, the audio stream that will read from the impact damper 52 as the disconnected AV stream file impact damper of main leaf is (in Figure 15, when type=1 or type=3, perhaps, in Figure 17, during type=1) and will from as the audio stream that read the impact damper 53 of sub-segment AV stream file impact damper (in Figure 15, when type=2 or type=3, perhaps, in Figure 17, during type=2) offer the first audio decoder 75-1.Only the audio stream that will read from impact damper 53 offers the second audio decoder 75-2.

The first audio decoder 75-1 decodes to audio stream, and will offer hybrid processor 101 through the audio stream of decoding.The second audio decoder 75-2 decodes to audio stream, and will offer hybrid processor 101 through the audio stream of decoding.

If with two overlapping and playbacks of audio stream, then will offer hybrid processor 101 by the audio stream of first audio decoder 75-1 decoding with by the audio stream of second audio decoder 75-2 decoding.

For example, if first audio stream that will be quoted by main path and second audio stream of being quoted by subpath are overlapping and reset (if among Figure 15, type=3, perhaps, in Figure 16, secondary_audio_present_flag is 1, and, the type of the one stream_entry () is 1 (type=1), and, the type of the 2nd stream_entry () is 2 (type=2)), then will be included in the disconnected AV stream file of main leaf, by the audio stream of first audio decoder 75-1 decoding be included in the sub-segment AV stream file, audio stream by second audio decoder 75-2 decoding offers hybrid processor 101.

If it is will be by two audio streams that subpath is quoted overlapping and reset (if in Figure 16, secondary_audio_present_flag is 1, and, if the type of the type of a stream_entry () and the 2nd stream_entry () is 2 (type=2)), then will be included in the sub-segment AV stream file, by the audio stream of first audio decoder 75-1 decoding (in Figure 16, type=2, and by a stream_entry () definition) and be included in another sub-segment AV stream file, by the audio stream of second audio decoder 75-2 decoding (in Figure 16, when secondary_audio_present_flag is 1, type=2, and by the 2nd stream_entry () definition) offers hybrid processor 101.

Hybrid processor 101 will mix (overlapping) from the voice data of the first audio decoder 75-1 with from the voice data of the second audio decoder 75-2, and synthetic data are offered hybrid processor 97.In the present embodiment, to being also referred to as " combination " from the voice data of first audio decoder 75-1 output with from the mixing (overlapping) that the voice data of second audio decoder 75-2 output carries out.That is, two voice data combinations are just mixed two voice datas.

The voice data of being selected by switch 32 is provided for impact damper 95 and is cached in wherein.Impact damper 95 offers voice data hybrid processor 97 to schedule.For example, voice data is the effect sound that can select from menu.The voice data that hybrid processor 97 mixes mixed processor 101 (by mixing the voice data that obtains with the voice data of exporting from the second audio decoder 75-2 from the voice data of first audio decoder 75-1 output) mixes (overlapping) with the voice data that provides from impact damper 95, and with the data that obtain as audio signal output.

At the fixed time, be output to the text subtitle compositor (demoder) 76 that is positioned at after the impact damper 54 from the data that read as the impact damper 54 of text subtitle read buffer.76 pairs of text-ST data of text subtitle compositor are decoded, and will offer switch 77 through the data of decoding.

Switch 77 selects to be presented presenting graphical stream and by one among the Text-ST (text subtitle data) of text subtitle compositor 76 decodings, and the data of selecting are offered presenting graphics plane maker 93 of graphic decoder 73 decodings.That is, offer simultaneously the captions image that presents graphics plane maker 93 be from present graphic decoder 73 output or from the captions image of text subtitle (Text-ST) compositor 76 outputs.Being input to the graphical stream that presents that presents graphic decoder 73 simultaneously is the stream that separates with disconnected AV stream file of main leaf or sub-segment AV stream file (being selected by switch 57).Therefore, being input to the captions image that presents graphics plane maker 93 simultaneously is presenting graphical stream, present graphical stream or text subtitle data from sub-segment AV stream file from the disconnected AV stream file of main leaf.

Background plane maker 91 is according to the background image data that provides from background demoder 71, the generation background plane, and the background plane that generates is offered video data processor 96, and when coming display video image by the size that reduces video image, background plane is as for example wallpaper image.Video plane maker 92 generates video plane according to the video data that provides from Video Decoder 72, and the video plane that generates is offered video data processor 96.Present graphics plane maker 93 according to the data of selecting by switch 77 (presenting graphical stream or text subtitle data), generate the graphics plane that presents that for example is used as rendering image (rendering image), and the graphics plane that presents that will generate offers video data processor 96.Interactive graphics plane maker 94 generates interactive graphics plane according to the interactive graphics (IG) flow data that provides from interactive graphics (IG) demoder 74, and the interactive graphics plane that generates is offered video data processor 96.

96 pairs of background planes of video data processor from background plane maker 91, from the video plane of video plane maker 92, from presenting presenting graphics plane and making up of graphics plane maker 93 from the interactive graphics plane of interactive graphics plane maker 94, and the plane of combination is exported as vision signal.

Switch 57 to 59 and switch 77 by the operation selection carried out of input block 29 or according to the type that comprises the file of target data, are selected data according to the user.For example, if only comprise audio stream in sub-segment AV stream file, then switch 59 will select to change to the side (output of pid filter 56) that sub-segment AV stream file is provided.

Following with reference to the process flow diagram among Figure 29 to 31, the playback processing of being undertaken by reproducing device shown in Figure 28 1 is described.When the user sends the instruction of resetting predetermined AV stream by operation input block 29, begin this processing.

In step S11, controller 21 is by memory driver 22, reading and recording at recording medium 11 or local memory 24 as the play list file on the HDD (hard disk drive), play list file as shown in Figure 9.

In step S12, controller 21 reads main leaf disconnected AV stream file, sub-segment AV stream file and text subtitle data (text-ST).More particularly, controller 21 is according to the broadcast item that is included in the playlist shown in Figure 9, from main leaf is disconnected, read the disconnected AV stream file of corresponding main leaf, and, according to shown in Figure 10 to 12, be comprised in son that the subpath in the playlist quotes and play, read sub-segment AV stream file and text subtitle data.

In step S13,21 pairs of switches 32 of controller are controlled, and the data that read (main leaf break AV stream file, sub-segment AV stream file and text subtitle data) are offered corresponding impact damper 51 to 54.More particularly, 21 pairs of switches 32 of controller are controlled, and background image data is offered impact damper 51, and the disconnected AV stream file data of main leaf are offered impact damper 52, sub-segment AV stream file data are offered impact damper 53, and the Text-ST data are offered impact damper 54.

In step S14, under the control of controller 21, switch 32 provides aforesaid corresponding data.Then, background image data is offered impact damper 51, the disconnected AV stream file data of main leaf are offered impact damper 52, sub-segment AV stream file data are offered impact damper 53, and text subtitle data is offered impact damper 54.

In step S15, impact damper 51 to 54 with the metadata cache that provides in wherein.More particularly, impact damper 51 cache context view data, the impact damper 52 buffer memory main leaves AV stream file data of breaking, the sub-segment AV stream file of impact damper 53 buffer memorys data, and impact damper 54 buffer memory Text-ST data.

In step S16, impact damper 51 is to background demoder 71 output background image datas.

In step S17, impact damper 52 is to the flow data of the disconnected AV stream file of pid filter 55 output main leaves.

In step S18, pid filter 55 is given corresponding basic stream decoder according to the PID that depends on TS (transport stream) packet that constitutes the disconnected AV stream file of main leaf with basic flow distribution.More particularly, pid filter 55 offers Video Decoder 72 with video flowing, to present graphical stream and offer switch 57, interactive graphic stream is offered switch 58, audio stream is offered switch 59, and wherein, switch 57 will present graphical stream and offer and present graphic decoder 73, switch 58 offers interactive graphics (IG) demoder 74 with interactive graphic stream, and switch 59 offers the first audio decoder 75-1 with audio stream.As discussed above, give video flowing, present graphical stream, interactive graphic stream and audio stream different PID is provided.

In step S19, impact damper 53 outputs to pid filter 56 with the flow data of sub-segment AV stream file.

In step S20, pid filter 56 is given corresponding decoder according to PID with basic flow distribution.More particularly, pid filter 56 will present graphical stream and offer switch 57, interactive graphic stream is offered switch 58, audio stream is offered switch 59, wherein, switch 57 will present graphical stream and offer and present graphic decoder 73, switch 58 offers interactive graphics (IG) demoder 74 with interactive graphic stream, and switch 59 offers the first audio decoder 75-1 or the second audio decoder 75-2 with audio stream.

In step S21, under the control of controller 21, be positioned at pid filter 55 and 56 switch 57 to 59 afterwards, select in disconnected AV stream file of main leaf and the sub-segment AV stream file.More particularly, the graphical stream that presents that presents graphical stream or sub-segment AV stream file of the disconnected AV stream file of main leaf that provides from pid filter 55 is provided for switch 57, and the stream that will select offer be positioned at switch 57 afterwards present graphic decoder 73.The interactive graphic stream of the disconnected AV stream file of main leaf that provides from pid filter 55 or the interactive graphic stream of sub-segment AV stream file are provided for switch 58, and the stream that will select offers and is positioned at switch 58 interactive graphics (IG) demoder 74 afterwards.The audio stream of the disconnected AV stream file of main leaf that provides from pid filter 55 or the audio stream of sub-segment AV stream file are provided for switch 59, and the stream that will select offers and is positioned at the switch 59 first audio decoder 75-1 afterwards.If the user has sent the instruction of switching sound, then switch 59 offers the second audio decoder 75-2 with the audio stream of sub-segment AV stream file.But,, therefore be not described here owing in this processing, do not consider to switch sound.

In step S22, impact damper 54 outputs to text subtitle compositor 76 with text subtitle data.

In step S23,71 pairs of background image datas of background demoder are decoded, and will offer background plane maker 91 through the data of decoding.

In step S24,72 pairs of video flowings of Video Decoder are decoded, and will offer video plane maker 92 through the stream of decoding.

In step S25, present the graphical stream that present that 73 pairs of graphic decoders are selected by switch 57 and decode, and will offer through the stream of decoding to be positioned at and present graphic decoder 73 switch 77 afterwards.

In step S26, the interactive graphic streams that 74 pairs of interactive graphics (IG) demoders are selected by switch 58 are decoded, and will offer through the stream of decoding and be positioned at interactive graphics (IG) demoder 74 interactive graphics plane maker 94 afterwards.

In step S27, the first audio decoder 75-1 decodes to the voice data of being selected by switch 59, and will output to through the data of decoding and be positioned at first audio decoder 75-1 hybrid processor 101 afterwards.When the user does not send the instruction of switching sound, in the processing of resetting (playback shown in Figure 29 to 32 is handled), not from the second audio decoder 75-2 outputting audio data.Therefore, hybrid processor 101 will directly output to hybrid processor 97 from the voice data of first audio decoder 75-1 output.

In step S28,76 pairs of text subtitle data of Text-ST compositor are decoded, and will output to the switch 77 that is positioned at after the Text-ST compositor 76 through the data of decoding.

In step S29,77 pairs on switch is selected from the data that present graphic decoder 73 or Text-ST compositor 76.More particularly, 77 pairs on switch is presented presenting graphical stream or selecting from the Text-ST (text subtitle data) of Text-ST compositor 76 of graphic decoder 73 decoding, and the data of selecting are offered presents graphics plane maker 93.

In step S30, background plane maker 91 is according to the background image data that provides from background demoder 71, generation background plane.

In step S31, video plane maker 92 generates video plane according to the video data that provides from Video Decoder 72.

In step S32, present graphics plane maker 93 according to that select and by switch 77 in step S29 from presenting the data that graphic decoder 73 or Text-ST compositor 76 provide, generate and present graphics plane.

In step S33, interactive graphics plane maker 94 generates interactive graphics plane according to the interactive graphics (IG) flow data that provides from interactive graphics (IG) demoder 74.

In step S34,95 pairs of voice datas of selecting in step S14 of impact damper carry out buffer memory, and it are offered hybrid processor 97 at the fixed time.

In step S35, video data processor 96 is with these plane combinations, and the data of output combination.More particularly, video data processor 96 will be from background plane maker 91, video plane maker 92, present the data combination of graphics plane maker 93 and interactive graphics plane maker 94, and the data of combination are exported as video data.

In step S36, hybrid processor 97 will mix (combination) from the voice data of hybrid processor 101 outputs with voice data, and with the data output that obtains.Then, processing finishes.

According to the processing shown in Figure 29 to 31, by the disconnected AV stream file of main leaf that the main path that is included in the playlist is quoted, be included in sub-segment AV stream file and the text subtitle data that the subpath of the correspondence in the playlist quotes and quote the corresponding data of resetting.By main path and the subpath in the playlist is provided, can specify and the different segment AV stream file of AV stream file that broken by the main leaf of main path appointment by subpath.Thus, can with by the data of the disconnected different sub-segment AV stream file of the main leaf of the broadcast item appointment of main path with data (synchronously) playback that is included in the main leaf disconnected AV stream file of main leaf in disconnected.

In Figure 29 to 31, the order of step S16 and S17 can be put upside down, perhaps, and can executed in parallel step S16 and S17.Similarly, the order of step S18 and S20 can be put upside down, perhaps, and can executed in parallel step S18 and S20.Step S23 can put upside down to the order of S28, perhaps can executed in parallel step S23 to S28.Step S30 can put upside down to the order of S33, perhaps, can executed in parallel step S30 to S33.The order of step S35 and S36 can be put upside down, perhaps, and can executed in parallel step S35 and S36.Promptly, in Figure 28, vertically disposed parts on one deck, that is, and the Processing tasks of impact damper 51 to 54, the Processing tasks of switch 57 to 59, the Processing tasks of demoder 71 to 76, the Processing tasks of plane maker 91 to 94, and the Processing tasks of video data processor 96 and hybrid processor 97 can executed in parallel, and, their order is not particularly limited.

Hereinafter with reference to the process flow diagram among Figure 32, to when having sent the instruction of switching sound, the processing of being undertaken by reproducing device 1 is described.For example, when the playback processing of carrying out shown in Figure 29 to 31, carry out this processing.

In step S51, controller 21 obtains the sequential list (can be ID) of audio stream number.More particularly, controller 21 is quoted the STN_table () of the PlayItem () that discusses with reference to Figure 13, to obtain the sequential list of the audio stream number (ID) of input in reference Figure 14 or 16 STN_table () that discuss.When the playback shown in beginning Figure 29 to 31 is handled, carry out this step.

In step S52, in response to the instruction of user by the switching sound that sends of operation input block 29, controller 21 receives from the instruction user, that switch sound.In this case, controller 21 can be controlled the exterior display device (not shown), externally to show the stream number form, stream number form as shown in figure 26 on the display device.By this way, controller 21 shows the sound signal and the caption signal that can offer the user, and receives from the instruction user, that switch sound (selecting a sound).In fact, in Figure 32, carried out step S51, and, in response to from the instruction user, that switch sound, execution in step S52.

In step S53, controller 21 obtains the audio stream number audio stream number afterwards of current playback.For example, if reset audio stream shown in Figure 8, that have SubClip_entry_id=0 (auxiliary audio stream), then obtain to have the audio stream of SubClip_entry_id=1.If current playback and audio frequency 3 (A_SN=3) corresponding audio stream file shown in Figure 26, then audio stream subsequently is the combination (A_SN=4) of audio frequency 2 and audio frequency 4.Therefore, controller 21 obtain with the audio frequency 2 corresponding audio stream number of being quoted by main path and with the audio frequency 4 corresponding audio stream number of being quoted by subpath.

In step S54, controller 21 determines whether reproducing devices 1 have the function of the audio stream that is associated with the number of acquisition reset.More particularly, controller 21 is according to the information (Figure 18) that indicates in stream_attribute (), and if necessary, the various set informations of registration in storer 23 carry out this and determine by reference.For example, if type=1 among the stream_entry () in Figure 15 or 17, then controller 21 has determined whether to provide the function of resetting the audio stream that the disconnected AV of main leaf that is associated with the number that obtains flows.If type=2 among the stream_entry () in Figure 15 or 17, then controller 21 has determined whether to provide the function of resetting the audio stream that the sub-segment AV that is associated with the number that obtains flows.

If sent that audio stream with the audio stream of the disconnected AV stream of main leaf and sub-segment AV stream mixes and the instruction of resetting (promptly, if among the STN_table in Figure 14, type=3 among the stream_entry () in Figure 15, perhaps, if among the 2nd STN_table in Figure 16, secondary_audio_present_flag is 1, and, if the type among the stream_entry () is the type among 1 (type=1) and the 2nd stream_entry () is 2 (type=2)), then controller 21 determines whether to have the function that playback only is included in the audio stream in the disconnected AV stream file of main leaf.In other words, when the audio stream of the disconnected AV stream file of main leaf and the audio stream of sub-segment AV stream file are mixed and playback time, can omit determining to the function of the audio stream that whether has the sub-segment AV stream file of resetting.This is because the disconnected AV stream file of main leaf comprises that the possibility of dilatant flow or hyperchannel stream is very high, and because the extensibility of sub-segment AV stream file is restricted, sub-segment AV stream file comprises that the possibility of such file is very low.Therefore, do not need to determine whether to have the function that the audio stream that is included in the sub-segment AV stream file is reset.Perhaps, controller 21 can determine whether it has the function that the audio stream that is included in the sub-segment AV stream file is reset.

If sent that two audio streams with two sub-segment AV stream files mix and the instruction of resetting (promptly, if among the 2nd STN_table in Figure 16, secondary_audio_present_flag is 1, and, if the type of a stream_entry () is the type of 2 (type=2) and the 2nd stream_entry () is 2 (type=2)), then controller 21 determines whether reproducing devices 1 have being associated with the number that obtains, the function of being reset by the audio stream of first audio decoder 75-1 decoding (first audio stream in the FOR circulation among the audio stream ID (audio_stream_id) in Figure 16).Whether to have the secondary_audio_present_flag among the STN_entry () in Figure 16 about reproducing device 1 is determining and can omitting of second audio stream of the sub-segment AV stream file of input after 1 function of resetting.This be because, first audio stream in the FOR circulation among the audio stream ID (audio_stream_id) in Figure 16 may be the film audio that Japanese is dubbed, second audio stream that its quality is higher than the sub-segment AV stream file of importing among the 2nd stream_entry in Figure 16 (for example, director's montage), and, do not need to whether have antithetical phrase segment AV stream file, have the function that low-qualityer second audio stream resets and determine.Perhaps, controller 21 can determine whether to have the function that second audio stream is reset.

If in step S54, determine not provide the function that the audio stream that is associated with the number that obtains is reset, then handle and proceed to step S55, in step S55, the stream number that controller 21 obtains after current stream number.That is, skip current stream number (it not being reset), and obtain stream number subsequently.Then, after step S55, handle turning back to step S54.That is, processing repeats, till the audio stream number that controller 21 obtains to be reset by reproducing device 1.

If in step S54, determine to provide the function that the audio stream that is associated with the number that obtains is reset, then handle and proceed to step S56.In step S56,21 pairs of controllers be included in the audio stream of the main leaf that is associated with the number that the obtains disconnected AV stream of main leaf in disconnected and be included in sub-segment that the number that obtains is associated in the audio stream of sub-segment AV stream file check.In example shown in Figure 8, owing to the SubClip_entry_id=1 that obtains is quoted by subpath, so controller 21 can determine to comprise the audio stream that is associated with the number that obtains in sub-segment AV stream file.If the type=1 among the stream_entry () in Figure 15 or 17, then controller 21 can be determined to comprise the audio stream that is associated with the number that obtains in the disconnected AV stream file of main leaf.If the type=2 among the stream_entry () in Figure 15 or 17, then controller 21 can determine to comprise the audio stream that is associated with the number that obtains in sub-segment AV stream file.If mix and reset (if among the STN_table in Figure 14 to being included in the audio stream in the disconnected AV stream of main leaf and being included in audio stream in the sub-segment AV stream, the type of stream_entry () among Figure 15 is 3 (type=3), perhaps, if among the 2nd STN_table in Figure 16, secondary_audio_present_flag is 1, and, if the type among the stream_entry () is the type among 1 (type=1) and the 2nd stream_entry () is 2 (type=2)), then controller 21 can be determined, all comprises the audio stream that is associated with the number that obtains in disconnected AV stream file of main leaf and sub-segment AV stream file.If the audio stream of two sub-segment AV stream files is mixed and resets (promptly, if among the 2nd STN_table in Figure 16, secondary_audio_present_flag is 1, and, if the type of a stream_entry () is the type of 2 (type=2) and the 2nd stream_entry () is 2 (type=2)), then controller 21 can be determined, comprises the audio stream that is associated with the number that obtains in sub-segment AV stream file.

In step S57, controller 21 is specified the audio stream of wishing.More particularly, 21 pairs of controllers are included in the disconnected AV stream of the main leaf that is associated with the number that obtains or are included in audio stream in the sub-segment AV stream that is associated with the number that obtains, that wish and specify.If in Figure 15 or 17, type=1, then controller 21 is specified the predetermined audio stream in the disconnected AV stream file of main leaf, perhaps, if type=2, the then predetermined audio stream in the sub-segment AV stream file of controller 21 appointments.If in Figure 15, type=3, perhaps, if in Figure 17, secondary_audio_present_flag is 1, and the type of a stream_entry () is that the type of 1 (type=1) and the 2nd stream_entry () is 2 (type=2), and then predetermined audio stream in the disconnected AV stream file of 21 pairs of main leaves of controller and the predetermined audio stream in the sub-segment AV stream file are specified.If in Figure 17, secondary_audio_present_flag is 1, and, if the type of a stream_entry () is the type of 2 (type=2) and the 2nd stream_entry () is 2 (type=2), then two predetermined audio stream in 21 pairs two sub-segment AV stream files of controller are specified.

In step S58, controller 21 demanded storage drivers 22 from the segment that comprises audio stream (include only the disconnected AV stream file of main leaf segment, include only sub-segment AV stream file segment, comprise the segment of disconnected AV stream file of main leaf and sub-segment AV stream file or comprise the segment of two sub-segment AV stream files) read the audio stream of appointment.Perhaps, from local memory 24, controller 21 reads the audio stream of this appointment from the segment of the audio stream that comprises appointment.In response to the instruction that comes self-controller 21, memory driver 22 reads target audio stream.Then, controller 21 offers AV demoder 26 with the audio stream that reads, and orders it that this audio stream is reset.If among the STN_table in Figure 14, the type of stream_entry () in Figure 15 is 3 (type=3), perhaps, if among the 2nd STN_table in Figure 16, secondary_audio_present_flag is 1, and, if the type of a stream_entry () is the type of 1 (type=1) and the 2nd stream_entry () is 2 (type=2), audio stream during then 26 pairs of main leaves of controller 21 order AV demoders break and the audio stream in the sub-clip are all reset.

In step S59,26 pairs of audio streams of AV demoder are decoded, and with its output.More particularly, will be mixed with the voice data of exporting from impact damper 95 by the voice data that audio decoder 75 is decoded, and as audio signal output.More particularly, if in Figure 15 or 17, type=1, then the first audio decoder 75-1 decodes to the predetermined audio stream in the disconnected AV stream file of main leaf, and will offer hybrid processor 97 by hybrid processor 101 through the audio stream of decoding.If in Figure 15 or 17, type=2, then the predetermined audio stream in the first audio decoder 75-1 or the second audio decoder 75-2 (determining according to the description among the STN_table) the antithetical phrase segment AV stream file is decoded, and will offer hybrid processor 97 by hybrid processor 101 through the audio stream of decoding.

In this case, if the audio stream in the disconnected AV stream file of main leaf and the audio stream in the sub-segment AV stream file are mixed and reset (if the type of the stream_entry () in Figure 15 is 3 (type=3), perhaps, if among the 2nd STN_table in Figure 16, secondary_audio_present_flag is 1, and, if the type of a stream_entry () is the type of 1 (type=1) and the 2nd stream_entry () is 2 (type=2)), then the first audio decoder 75-1 decodes to the predetermined audio stream in the disconnected AV stream of main leaf, and will offer hybrid processor 101 through the audio stream of decoding, and, predetermined audio stream in the second audio decoder 75-2 antithetical phrase segment AV stream is decoded, and will offer hybrid processor 101 through the audio stream of decoding.If the audio stream in two sub-segment AV stream files is mixed and resets (if in Figure 16, secondary_audio_present_flag is 1, and, if the type of a stream_entry () is the type of 2 (type=2) and the 2nd stream_entry () is 2 (type=2), then the predetermined audio stream in the first audio decoder 75-1 antithetical phrase segment AV stream file is decoded, and will offer hybrid processor 101 through the audio stream of decoding, and, the second audio decoder 75-2 decodes to the predetermined audio stream in another sub-segment AV stream file, and will offer hybrid processor 101 through the audio stream of decoding.Voice data that 101 pairs of hybrid processors provide from the first audio decoder 75-1 and the voice data that provides from the second audio decoder 75-2 mix (overlapping or combination), and the data that obtain are offered hybrid processor 97.Voice data that 97 pairs of hybrid processors provide from hybrid processor 101 and the voice data that provides from impact damper 95 mix (overlapping or combination), and with the data that obtain as audio signal output.

Hereinafter with reference to the process flow diagram among Figure 33, the details of the step S59 among Figure 32 is described.Figure 33 is the process flow diagram of example that shows the processing of the audio stream that is used for exporting AV demoder 26.

In step S81, under the control of controller 21, AV demoder 26 determines whether the audio stream that will reset only is included in the disconnected AV stream file of main leaf.For example, AV demoder 26 determines in Figure 14 or 16 whether the type of the audio stream of input is 1, that is, in Figure 15 or 17, type=1 whether.

Only be included in the disconnected AV stream file of main leaf if determine the audio stream that will reset in step S81, then the audio stream of the disconnected AV stream file of being selected by pid filter 55 by 59 pairs on switch of main leaves is selected, and it is offered the first audio decoder 75-1.Then, in step S82, the first audio decoder 75-1 decodes to the audio stream of the disconnected AV stream file of main leaf, and they are offered the hybrid processor 101 that is positioned at after the first audio decoder 75-1.Then, hybrid processor 101 directly outputs to voice data and is positioned at hybrid processor 101 hybrid processor 97 afterwards.

If determining not all audio stream in step S81 is included in the disconnected AV stream file of main leaf (promptly, if among Figure 15, type=2 or type=3, perhaps, if among Figure 17, at least one type is 2 (type=2)), then in step S83, under the control of controller 21, AV demoder 26 determines whether the audio stream that will reset only is included in the sub-segment AV stream file.That is, AV demoder 26 determines whether the type of the audio stream of input in Figure 14 or 16 only is 2 (type=2) among Figure 15 or 17.If in step S83, determine, not all audio stream is included in the sub-segment AV stream file, then this means, the audio stream of resetting is the combination of the audio stream of the audio stream of the disconnected AV stream file of main leaf and sub-segment AV stream file, promptly, the type of the audio stream among Figure 15 is 3 (type=3), perhaps, in Figure 16, secondary_audio_present_flag is 1, and the type of a stream_entry () is that the type of 1 (type=1) and the 2nd stream_entry () is 2 (type=2).The audio stream of the disconnected AV stream file of being selected by pid filter 55 by 59 pairs on switch of main leaves is selected, and it is offered the first audio decoder 75-1, and, select by the audio stream that 59 couples of sub-segment AV that selected by pid filter 56 of switch flow, and it is offered the second audio decoder 75-2.

Then, in step S84, the first audio decoder 75-1 decodes to the audio stream of the disconnected AV stream file of main leaf, and will offer through the audio stream of decoding and be positioned at first audio decoder 75-1 hybrid processor 101 afterwards.

In step S85, the audio stream of the second audio decoder 75-2 antithetical phrase segment AV stream file is decoded, and will offer the hybrid processor 101 that is positioned at after the second audio decoder 75-2 through the audio stream of decoding.The order of step S84 and S85 can be put upside down, perhaps, and can executed in parallel step S84 and S85.

In step S86,101 pairs of hybrid processors mix (overlapping or combination) by audio stream first audio decoder 75-1 decoding, the disconnected AV stream file of main leaf and by second audio decoder 75-2 audio stream decoding, sub-segment AV stream file.Then, hybrid processor 101 will offer hybrid processor 97 through the voice data that mixes.

If in step S83, determine, (type in Figure 15 or 17 only is 2 (type=2) to the audio stream of resetting in order only to be included in audio stream in the sub-segment AV stream, then handle and proceed to step S87, under the control of controller 21, determine whether the audio stream that will reset is the combination of the audio stream in the sub-segment AV stream file.That is, AV demoder 26 is determined in step S87, among the stream_entry in Figure 16, is after 1 at secondary_audio_present_flag, and if the type of Figure 17 be 2, whether import two audio streams.Under the situation of the grammer of Figure 14 and 15, there is not the combination of two audio streams of antithetical phrase segment AV stream file to define, therefore, determine that in step S87 the audio stream that will reset is not the combination of the audio stream of sub-segment AV stream file.

If determining the audio stream that will reset in step S87 is not that the combination of audio stream of sub-segment AV stream is (if in Figure 14 or 15, type=2, perhaps, if in Figure 16 or 17, secondary_audio_present_flag is that the type of the 0 and the one stream_entry () is 2 (type=2)), that is, if only import an audio stream, then this audio stream is the audio stream of sub-segment AV stream file.Select by 59 pairs of audio streams of being selected by pid filter 56 of switch, and it is offered the first audio decoder 75-1.Then, in step S88, the audio stream of the first audio decoder 75-1 antithetical phrase segment AV stream file is decoded, and will offer the hybrid processor 101 that is positioned at after the first audio decoder 75-1 through the stream of decoding.Then, hybrid processor 101 outputs to hybrid processor 97 with the voice data that provides.

If the combination that the definite audio stream that will reset is the audio stream of sub-segment AV stream file in step S87 is (if in Figure 16, secondary_audio_present_flag is 1, and, if the type of a stream_entry () and the 2nd stream_entry () is 2 (type=2)), this means two by the audio stream of pid filter 56 segment AV stream files that select, child.Then, in the FOR circulation of switch 59 in will the audio stream ID (audio_stream_id) in Figure 16 at first the audio stream of input offer the first audio decoder 75-1, and the secondary_audio_present_flag in the FOR circulation in will the audio stream ID (audio_stream_id) in Figure 16 is that the audio stream of input after 1 offers the second audio decoder 75-2.

Then, in step S89, the first audio decoder 75-1 decodes to the audio stream that provides, and will offer the hybrid processor 101 that is positioned at after the first audio decoder 75-1 through the stream of decoding.

In step S90, the second audio decoder 75-2 decodes to the audio stream that provides, and will offer the hybrid processor 101 that is positioned at after the second audio decoder 75-2 through the stream of decoding.The order of step S89 and S90 can be put upside down, and can executed in parallel step S89 and S90.

In step S91, hybrid processor 101 will mix by the audio stream of first audio decoder 75-1 decoding with by the audio stream (that is the audio stream of two sub-segment AV stream files) of second audio decoder 75-2 decoding.In other words, (combination or overlapping) will be provided with the voice data that provides from the second audio decoder 75-2 from the voice data that the first audio decoder 75-1 provides hybrid processor 101.Hybrid processor 101 offers hybrid processor 97 with synthetic voice data.

After step S82, S86, S88 or S91, handle proceeding to step S92.In step S92, hybrid processor 97 mixes the voice data that provides with the voice data that provides from impact damper 95, and with the data output that obtains.Among the step S92 after step S82, hybrid processor 97 mixes the voice data of the audio stream of the disconnected AV stream of main leaf with voice data.Among the step S92 after step S88, hybrid processor 97 mixes the voice data of the audio stream of sub-segment AV stream file with voice data.Among the step S92 after step S86, hybrid processor 97 will mix the voice data that generates and mix with voice data with the audio stream of sub-segment AV stream file by the audio stream with the disconnected AV stream file of main leaf.Among the step S92 after step S91, hybrid processor 97 will mix the voice data that generates and mix with voice data by the audio stream with two sub-segment AV stream files.

According to processing shown in Figure 33, the audio stream of being quoted by main path can be mixed with the audio stream of being quoted by subpath and resets.Perhaps, two audio streams being quoted by two subpaths can be mixed and reset.

According to the processing that reference Figure 33 discusses, can determine the selection of switch 59 in the step S21 of Figure 30 among Figure 28.More particularly, if in the processing of Figure 33, the audio stream that will be reset is the audio stream that only is included in the disconnected AV stream file of main leaf, and then the autonomous in the future side of switch 59 is pid filter 55 audio stream offers the first audio decoder 75-1 (result of step S81 is YES).If have only an audio stream of a sub-segment AV stream file to be reset, then switch 59 will be that the audio stream of pid filter 56 offers the first audio decoder 75-1 (result of step S87 is NO) from son side.If be the combination of audio stream with the audio stream of sub-segment AV stream file of the disconnected AV stream file of main leaf by the audio stream reset, then switch 59 will offer the first audio decoder 75-1 from the audio stream of pid filter 55 and will offer the second audio decoder 75-2 (result of step S83 is NO) from the audio stream of pid filter 56.If the audio stream of being reset is the combination of the audio stream of two sub-segment AV stream files, then switch 59 will offer the first audio decoder 75-1 or the second audio decoder 75-2 (result of step S87 is YES) from the audio stream of pid filter 56.

As mentioned above, controller 21 can be controlled the switching of sound (audio frequency) according to the STN_table () of PlatItem ().Controller 21 is the stream_attribute of STN_table () by reference, only selects the stream that can be reset by reproducing device 1.According to STN_table (), controller 21 can also overlap on the audio stream that is included in the disconnected AV stream file of main leaf and to it and resets being included in audio stream in the sub-segment AV stream file, can also be overlapping and it is reset with being included in two audio streams in the sub-segment AV stream file.

If use the grammer (STN_table) among Figure 14 and 15, then the combination of two audio streams of two sub-segment AV stream files is not defined.Therefore, the result of the step S87 among Figure 33 is NO always, and the step of execution in step S88 and back thereof.Therefore, not execution in step S89, S90 and S91.

Although in processing shown in Figure 32, according to audio stream number switch audio stream,, also can switch them according to audio stream ID (audio_stream_id).In this case, be audio stream ID by the audio stream number being subtracted a number that obtains.

In above-mentioned example, mix (combination) to the audio stream quoted by main path with by the audio stream that subpath is quoted and reset (Figure 14 and 15, perhaps, Figure 16 and 17), perhaps, the audio stream of being quoted by two subpaths is mixed (combination) and reset (Figure 16 and 17).But the type of stream is not limited to audio frequency, and various streams can both be mixed and be reset, as long as their stream type is identical.For example, can be to video flowing (stream type is a video flowing) make up and reset (picture-in-picture demonstration).The stream file of the predefined type in therefore, can be disconnected, define with break stream file in the identical sub-segment of type or the stream file of the same type in the sub-segment of main leaf to main leaf.Therefore, can make up and reset the stream of being quoted by main path and the stream of being quoted by subpath (streams of two same types), and can the stream of being quoted by two subpaths (streams of two same types) be made up and reset.

Above-mentioned configuration can be used to so-called " PinP (picture-in-picture) " shows, more particularly, discuss with reference to Figure 43, will be shown as full screen by the video flowing that main path is quoted as the back, and will be presented at by the video flowing that subpath is quoted in the full screen, as sub-screen.The back will provide the details that shows by the PinP that uses above-mentioned configuration realization.

Provide to comprise the audio frequency different or the stream or the data file of caption data, and playlist comprises main path and subpath with main AV stream.Utilize this configuration, when switching sound or captions, the user can select from being included in the stream and be included in the stream that is different from main leaf disconnected sub-segment of main leaf disconnected.

In the first or the 2nd STN_table (), can select to be included in main leaf in disconnected audio stream and be included in the combination of the audio stream in the sub-segment.This makes the user to carry out overlapping and playback to two audio streams.More particularly, in STN_table (), can import the stream_entry () of two audio streams, and in stream_entry (), can be by audio stream during main leaf is disconnected and the combination of the audio stream in the sub-segment, input audio stream.Therefore, the user can send instruction two audio streams is overlapping and that reset.

In the 2nd STN_table (), shown in Figure 16 and 17, can select to be included in the combination (because secondary_audio_present_flag is provided) of two audio streams in two sub-segments.Therefore, the user can carry out overlapping and playback to two audio streams.More particularly, in the 2nd STN_table (), can utilize audio stream ID input two stream_entry () element and two stream_attribute () element, make the user can send instruction two audio streams is overlapping and that reset thus.

In the broadcast item of main path, the STN_table () that provides the type of the data of quoting to the type that is multiplexed into the data in the AV stream file and by subpath to define.Therefore, can realize having the stream of highly scalable.

The stream_attribute of STN_table () by reference, the reproducing device 1 enough stream of being reset by reproducing device 1 of exoergic of can sequentially only selecting to lay equal stress on.

Below processing that reproducing device 1 is carried out summarize.

Reproducing device 1 obtains to be recorded in the playlist on the recording medium, as playback management information.Playlist comprises a main path and a plurality of subpath, and wherein, main path is the playback path of the position of the expression disconnected AV stream file of main leaf that comprises at least one stream, and each subpath is represented the position of the sub-segment AV stream file reset with the main flow file synchronization.The disconnected AV stream file of main leaf can comprise polytype stream.According to the main flow of the predefined type of the disconnected AV stream file of expression main leaf (for example, first audio stream) with sub-segment AV stream identical with the main flow file type, that reset with the main flow file synchronization (for example, the STN_table () of the information of combination second audio stream) (by playing the STN_table () that item indicates) receives the selection to the stream that will be reset.

When (for example receiving to the main flow of the predefined type of the disconnected AV stream file of main leaf, first audio stream) with sub-segment AV stream identical with the main flow file type, that reset with the main flow file synchronization (for example, during the selection of combination second audio stream), reproducing device 1 will be read with the disconnected AV stream file of main leaf by the sub-segment AV stream file that subpath is quoted.Then, the hybrid processor 101 of reproducing device 1 is with two audio streams (through the audio stream of decoding) combination, and hybrid processor 97 (AV demoder 26) is to reset through the stream of combination (output).

As shown in figure 34, suppose to comprise video data and voice data that sub-segment AV stream file comprises director's English comment and director's Japanese comment as the film of the disconnected AV stream file of main leaf.In this case, the user can be from audio_stream_number=1 (having only main audio (film)), audio_stream_number=2 (main audio and English comment) and audio_stream_number=3 (main audio and Japanese comment), the audio stream that selection will be reset.If the user has selected the combination (audio_stream_number=1 or 2) of disconnected AV stream file of main leaf and sub-segment AV stream file, then can make up and reset two files.

By this way, playlist comprises main path and subpath, and main path is quoted different segment AV stream files with subpath.Therefore, can realize having the stream of highly scalable.In addition, (for example, Fig. 8), so the user can select from a plurality of not homogeneous turbulences because a subpath can be quoted a plurality of files.

The broadcast item of main path comprises a STN_table () who discusses with reference to Figure 14 or the 2nd STN_table () that discusses with reference to Figure 16, as to by multiplexed (comprising) in the AV stream file of being quoted by main path companion data (for example, audio stream) and the form that is defined by the companion data that subpath is quoted.Therefore, can realize having the stream of highly scalable.In addition, by companion data being imported STN_table (), can expand subpath easily.

In STN_table (), provide shown in Figure 180, as the stream_attribute () of stream attribute information.This makes reproducing device 1 can determine whether it has the function that the stream of selecting is reset.Stream_attribute () by reference, reproducing device 1 can only select the stream that can be reset.

In the first or the 2nd STN_table () (Figure 14 or 16), defined the combination of stream file of being quoted by main path and stream file that quoted by subpath, same type (being audio file in this case) by stream_entry (Figure 15 or 17).In addition, shown in Figure 16 and 17, defined the combination of two audio stream files being quoted by subpath.As shown in figure 28, two audio decoders (the first audio decoder 75-1 and the second audio decoder 75-2) and hybrid processor 101 are provided for reproducing device 1, hybrid processor 101 is used for being made up (mixing) by the audio stream of the first and second audio decoder 75-1 and 75-2 decoding.Therefore, two stream combinations of same type also can be reset simultaneously.

If selected to be included in two sub-segment AV streams in the sub-segment AV stream file, predefined type (promptly, in the 2nd STN_table (), secondary_audio_present_flag is 1, if and the type of a stream_entry () and the 2nd stream_entry () is 2 (type=2)), then reproducing device 1 reads two sub-segment AV streams.Then, the hybrid processor 101 of reproducing device 1 mixes these two audio streams (through the audio stream of decoding), and hybrid processor 97 (AV demoder 26) is to reset through the stream that mixes (output).

Subpath comprises: SubPath_type, and the type (as audio frequency or captions) of expression subpath, as shown in figure 11; Clip_Information_file_name, the name of the sub-segment that expression is quoted by subpath, as shown in figure 12; And SubPlayItem_IN_time and SubPlayItem_OUT_time, the IN point and the OUT point of the segment that expression is quoted by subpath, as shown in figure 12.Therefore, can specify the data of being quoted by subpath exactly.

Subpath also comprises: sync_PlayItem_id (for example, the sync_PlayItem_id shown in Fig. 7 and 8), and it is the AV stream file that is used to specify on the main path, makes it possible to the information that subpath and main path are reset simultaneously; And sync_start_PTS_of_PlayItem (for example, sync_start_PTS_of_PlayItem shown in Fig. 7 and 8), it is the time on the main path, at this constantly, on the time shaft of main path, the IN point of the data of being quoted by subpath begins simultaneously.Therefore, shown in Fig. 7 and 8, the data (file) that the disconnected AV stream file of the main leaf that can quote with main path is synchronously reset and quoted by subpath.

Being stored the data that driver 22 read and be provided for the AV demoder 26 among Figure 28 is to be recorded in recording medium 11 as the data on the DVD (digital versatile dish).Be recorded in local memory 24 and also be provided for AV demoder 26 as the data on the hard disk.The data that are recorded on the local memory 24 can be by network 2 data downloaded.In other words, offering AV demoder 26 can be to be recorded in data on the recording medium 11, to be stored in data in the reproducing device 1, the data that provide from another equipment by network 2 or the combination of these data in advance.For example, can be according to playlist and the sub-segment downloading and be recorded on the local memory 24, and according to the disconnected AV stream file of main leaf that is recorded on the recording medium 11, AV stream is reset.Perhaps, can from recording medium 11, read sub-segment, can also from local memory 24, read the disconnected AV stream file of main leaf and reset according to the playlist that is recorded on the local memory 24.

If the stream that will be reset that will be quoted by main path and the stream of being quoted by subpath that will be reset, perhaps, carried by flowing down of will being reset of quoting of two subpaths that (transport stream TS), then will be included in two audio streams combinations among the different TS for different transport stream.If will be obtained by two streams that two subpaths are quoted, then will be included in two audio stream combinations among the single TS to comprising at least one TS of these two streams.

If utilize main path and subpath that two audio streams are defined (promptly, in a STN_table () shown in Figure 14, if the type=3 among the stream_attribute in Figure 15), perhaps, if utilize main path and subpath or two subpaths that two audio streams are defined (promptly, in the 2nd STN_table () shown in Figure 16, if secondary_audio_present_flag is 1, if and in Figure 17, two audio streams in stream_attribute (), have been defined), then the first audio decoder 75-1 decodes to the disconnected AV stream file of main leaf or a sub-segment AV stream file, and the second audio decoder 75-2 decodes to another sub-segment AV stream file.In this case, can be in STN_table (), the combination of the audio stream of two segments with same-code type (for example, the DolbyAC-3 audio frequency among Figure 19) is defined.In other words, may apply certain restriction, make that audio stream definition, that will be decoded simultaneously has identical type of coding in STN_table ().Its reason is as follows.If type of coding is identical, then because just the data type at decoded audio stream is identical, therefore, can (for example will be in by hybrid processor 101 by the combination of the audio stream in the first audio decoder 75-1 and the second audio decoder 75-2 process of decoding, during mpeg decode, audio stream by re-quantization but also do not pass through IDCT).

In above-mentioned reproducing device 1, STN_table () among Figure 14 or the 2nd STN_table () among Figure 16 by reference, can to reset together, be played segment that item quotes and the combination of segment being quoted by subpath or two segments being quoted by subpath is selected.Below will be described another example of wanting the mechanism that two audio streams mixed and that reset select being used for.

Figure 35 shows when two audio streams being mixed also the 3rd example of the STN_table () grammer (Three S's TN_table ()) of playback time.Identical with the situation among the first or the 2nd STN_table (), Three S's TN_table () also is set to the attribute of PlayItem ().In Three S's TN_table (), can select the segment that will reset according to hope, rather than the combination of some segments of quoting to the combination of a segment being played the segment quoted of item and being quoted by a subpath or by the plurality of sub path is selected.In Figure 35, with the explanation of omitting to the part similar to the part of Figure 14.

The difference of a STN_table () among Three S's TN_table () shown in Figure 35 and Figure 14 is, has defined two types audio stream.Similar among Length, number_of_video_stream_entries, video_stream_id and video_stream_number and Figure 14.

Number_of_audio_stream_entries is illustrated in the number of first audio stream input, that provide audio_stream_id among the Three S's TN_table ().Audio_stream_id is the information that is used to discern first audio stream.Audio_stream_number is the audio stream number that the user can see when switching sound.Number_of_audio_stream2_entries is illustrated in the number of second audio stream input, that provide audio_stream_id2 among the Three S's TN_table ().Audio_stream_id2 is the information that is used to discern second audio stream.Audio_stream_number is the audio stream number that the user can see when switching sound.

More particularly, by the audio stream that the audio stream of the number_of_audio_stream_entries representative of importing in Three S's TN_table () is decoded by the first audio decoder 75-1 of the reproducing device 401 shown in the reproducing device shown in Figure 36 141 or Figure 53, will discuss to reproducing device 141 and 401 in the back.The audio stream of the number_of_audio_stream2_entries of input representative is by the audio stream of the second audio decoder 75-2 of the reproducing device 401 shown in the reproducing device shown in Figure 36 141 or Figure 53 decoding in Three S's TN_table ().By this way, among the Three S's TN_table () shown in Figure 35, can import by two types audio stream of two decoder decodes.

Below will be called " audio stream #1 " (being called perhaps as described below, " audio stream ") by the audio stream first audio decoder 75-1 of the reproducing device 401 shown in the reproducing device shown in Figure 36 141 or Figure 53 decoding, that represent by number_of_audio_stream_entries.Below will be called " audio stream #2 " (perhaps as described below, being called " secondary audio stream ") by audio stream second audio decoder 75-2 decoding, that represent by number_of_audio_stream2_entries.Audio stream #1 is than the preferential audio stream of resetting of audio stream #2.

Number_of_PG_txtST_stream_entries, PG_txtST_stream_id and PG_txtST_stream_number to discuss with reference to Figure 14 similar.

Number_of_IG_stream_entries, IG_stream_id and IG_stream_number to discuss with reference to Figure 14 similar.

The grammer of stream_entry () to discuss with reference to Figure 17 similar.

Identical during the FOR circulation of the video flowing ID (video_stream_id) that discuss with reference Figure 14 and 16 and the FOR of audio stream ID (audio_stream_id) circulate, in the FOR of audio stream ID2 (audio_stream_id2) circulation, for for the audio frequency of each stream_entry () appointment flows substantially, distribute audio_stream_id2 since 0.With identical in the video flowing, can in this case, distribute audio_stream_number2 with audio stream number 2 (audio_stream_number2) substituted audio stream ID2 (audio_stream_id2) since 1.That is be audio_stream_number2, by making audio_stream_id2 add a number that obtains.Distribute this number to be because audio_stream_number2 is the audio stream number 2 that the user can see when switching sound since 1.

That is, among the Three S's TN_table () in Figure 35, defined by the audio stream #1 of number_of_audio_stream_entries representative and the audio stream #2 that represents by number_of_audio_stream2_entries.In other words, utilize Three S's TN_table (), can import audio stream #1 and audio stream #2, make the user can select two audio streams resetting simultaneously.

ID in the FOR of the FOR of caption stream ID (PG_txtST_stream_id) circulation and graphical stream ID (IG_stream_id) circulation similar to reference to Figure 14 or 16 discussion.

Below be the stream_attribute () among the Three S's TN_table () among Figure 35.Similar among the grammer of stream_attribute () and Figure 18 to 25.

After reserved_for_future_use, in the FOR statement, the number of times that video flowing is cited is identical with the quantity of video flowing, and the number of times that audio stream is cited is identical with the quantity of main path of being set by dish manufacturer and subpath.The number of times that PG textST stream is cited is identical with the quantity of PG textST stream, and the number of times that IG stream is cited is identical with the quantity of IG stream.

In the FOR of video flowing ID (video_stream_id) circulation, stream_attribute () has provided the stream attribute information about being a video-frequency basic flow of each stream_entry () appointment.That is, be indicated among the stream_attribute () about stream attribute information for a video-frequency basic flow of each stream_entry () appointment.

Similarly, in the FOR of audio stream ID (audio_stream_id) circulation, stream_attributes () has provided about being a stream attribute information that audio frequency flows substantially of each stream_entry () appointment.That is, be indicated among the stream_attributes () about the stream attribute information that flows substantially for an audio frequency of each stream_entry () appointment.For example and since by the audio frequency of type=1 among the stream_entry () among Figure 15 or type=2 appointment substantially stream have only one, therefore, stream_attributes () has provided the stream attribute information that flows substantially about this audio frequency.

Similarly, in the FOR of audio stream ID2 (audio_stream_id2) circulation, stream_attributes () has provided about being a stream attribute information that audio frequency flows substantially of each stream_entry () appointment.That is, be indicated among the stream_attributes () about the stream attribute information that flows substantially for an audio frequency of each stream_entry () appointment.For example and since by the audio frequency of type=1 among the stream_entry () among Figure 15 or type=2 appointment substantially stream have only one, therefore, stream_attributes () has provided the stream attribute information that flows substantially about this audio frequency.

Similarly, in the FOR of caption stream ID (PG_txtST_stream_id) circulation, stream_attribute () has provided about flowing substantially or the stream attribute information that text subtitle flows substantially for bitmap captions of each stream_entry () appointment.That is, be indicated among the stream_attributes () about the stream attribute information that flows substantially for a bitmap of each stream_entry () appointment or text subtitle flows substantially.

Similarly, in the FOR of graphical stream ID (IG_stream_id) circulation, stream_attribute () has provided about being a stream attribute information that interactive graphics (IG) flows substantially of each stream_entry () appointment.That is, be indicated among the stream_attribute () about the stream attribute information that flows substantially for an interactive graphics (IG) of each stream_entry () appointment.

As discussed above, utilize Three S's TN_table, play and at least one is during with the subpath of this broadcasts playback explicitly when providing, can pass through stream_attributes (), in the middle of the segment that is played the segment quoted of item and is quoted by at least one subpath, identification is about be an attribute information that flows substantially of each stream_entry () appointment.

With identical among the first or the 2nd STN_table (), by checking attribute information (stream_attribute ()), reproducing device can check whether it has the function that basic stream is reset.By checking attribute information, reproducing device can also be selected stream substantially according to the initial information about the language set in reproducing device.

Utilize the Three S's TN_table () among Figure 35, audio stream #1 and audio stream #2 can be included in the audio stream in the main path.Perhaps, audio stream #1 and audio stream #2 can be included in the audio stream and the audio stream that is included in the segment of being quoted by subpath in the segment of being quoted by main path.By this way, utilize Three S's TN_table (), can select, mix and reset superimposed two audio streams on the disconnected AV stream of the main leaf of being quoted by main path.

The Three S's TN_table () that utilization provides in PlayItem (), play the subpath that item and at least one and this broadcast item are reset explicitly if provide, then can provide such mechanism, promptly, when switching sound or captions, select the stream combination the segment that allows the user to quote from the segment quoted by main path with by at least one subpath according to hope.Therefore, the user can be to homogeneous turbulence or data file are not carried out interactive operation with the stream that comprises the AV stream that will reset.

With identical among a STN_table () and the 2nd STN_table (), in Three S's TN_table (), play item for one and comprise a plurality of subpaths, and each subpath quoted at least one height broadcast item.Therefore, realized having the AV stream of highly scalable and high degree of flexibility.That is, can after being played the content of resetting of tabulating, add son and play item.

Three S's TN_table () among Figure 35 provides will be by the audio stream #1 of the first audio decoder 75-1 of the reproducing device among the reproducing device among Figure 36 141 or Figure 53 401 decoding and the mechanism of being mixed by the audio stream #2 of the second audio decoder 75-2 of reproducing device 141 or 401 decoding.For example, if the subpath that provides PlayItem () and at least one and PlayItem () to reset explicitly, then will be included in the audio stream that is played in the segment of quoting and be set at audio stream #1, the audio stream that is included in the segment of being quoted by subpath is set at audio stream #2, then, audio stream #1 and audio stream #2 are mixed and reset.Perhaps, can be set at audio stream #1 and audio stream #2, and these two audio streams are mixed and reset being included in two audio streams that are played in the segment (main leaf disconnected) that item quotes.Utilize such configuration, the audio stream different with main audio stream (for example, director's comment) can be overlapped on the main audio stream.In addition, can carry out overlapping (mixing) and playback to two audio stream #1 and the #2 that overlaps on the disconnected AV stream of main leaf.

More particularly, identical with the stream number form shown in Figure 26, in the stream number form that offers the relation user, between expression sound number and the captions number, the sound number is called as " A_SN " (audio stream number), and the captions number is called as " S_SN " (sub-picture streams number).A_SN is provided among the audio stream #1 (audio stream of representing by audio_stream_id) of input in the Three S's TN_table () of the broadcast item of the main path that constitutes playlist each, and the user selects the audio stream #1 that will reset from the audio stream that provides A_SN.Similarly, A_SN2 is provided among the audio stream #2 (audio stream of representing by audio_stream_id2) of input among Three S's TN_table () each, and the user selects the audio stream #2 that will mix with the audio stream #1 that has selected from the audio stream that provides A_SN2.

Independently A_SN that provides for selection audio stream #1 and the A_SN2 that provides for selection audio stream #2 are selected by the user.Therefore, also can switch audio stream #1 and audio stream #2 independently.

That is, by defining two types the audio stream (audio stream #1 and audio stream #2) that will reset respectively, the user can select two audio streams according to hope from the stream of definition.In other words, the user can select two audio streams according to hope from the stream of definition, thus, has improved the dirigibility aspect the selection audio stream.For example, the user can select audio frequency 2 and the combination of audio frequency 4 (A_SN=1 and A_SN2=1) or the combination of audio frequency 2 and audio frequency 5 (A_SN=1 and A_SN2=2).

As mentioned above, among the stream_entry () of the Three S's TN_table () in PlayItem () (Figure 35), can import two audio streams, make it possible to two audio streams are mixed and reset.That is, can from dissimilar stream, select the stream (being audio stream in this case) of two same types, make that they can be mixed (overlapping or combination) and reset simultaneously.The user can provide the instruction that convection current mixes and resets.

As another example of using reproducing device of the present invention, below provide description to reproducing device 141, reproducing device 141 can utilize two audio streams of Three S's TN_table () input among STN_table (), for example Figure 35, the audio stream of selecting is mixed and reset.

Except the AV demoder 151 of having arranged the AV demoder 26 that replaces the reproducing device 1 shown in Figure 27, the configuration of reproducing device 141 is similar to the configuration of reproducing device 1.Figure 36 is the block diagram of example that shows the configuration of AV demoder 151.The reproducing device 141 that comprises AV demoder 151 can be according to the playlist playback AV stream that comprises above-mentioned main path and subpath, and the Three S's TN_table shown in Figure 35 is indicated in main path and the subpath.

Except having replaced pid filter 55 with pid filter 161 and replaced the switch 59 with switch 162, the configuration of the AV demoder 151 of reproducing device 141 is similar to the configuration of the AV demoder 26 of reproducing device 1.The first audio decoder 75-1 is to being decoded by the audio stream of the representative of the audio_stream_id among the Three S's TN_table () among Figure 35, and the second audio decoder 75-2 is to being decoded by the audio stream of the representative of the audio_stream_id2 among the Three S's TN_table ().

By detuner the file data that controlled device 21 reads is carried out demodulation, then, the multiplex stream through demodulation is carried out error correction by the ECC demoder.Then, under the control of controller 21, switch 32 is divided multiplex stream according to the type of stream, and will offer corresponding impact damper 51 to 54 through the stream of dividing.More particularly, under the control of controller 21, switch 32 offers impact damper 51 with background image data, the data that will read from main leaf is disconnected (promptly, the main leaf AV stream file data of breaking) offer impact damper 52, the data that will read from sub-segment (that is, sub-segment AV stream file data) offer impact damper 53, and the text-ST data are offered impact damper 54.Then, impact damper 51 to 54 respectively with the disconnected AV stream file data of background image data, main leaf, sub-segment AV stream file data and text-ST metadata cache in wherein.

From as the flow data of reading the impact damper 52 of segment AV stream file read buffer, outputed to PID (packet ID) wave filter 161 that is positioned at after the impact damper 52 to schedule.Pid filter 161 will be included in the stream in the disconnected AV stream file of main leaf, according to PID (packet ID), distribute to the basic stream decoder that is positioned at pid filter 161 correspondence afterwards.More particularly, pid filter 161 offers Video Decoder 72 with video flowing, to present graphical stream offers switch 57, interactive graphic stream is offered switch 58, audio stream is offered switch 162, wherein, switch 57 offers graphical stream and presents graphic decoder 73, and switch 58 offers interactive graphics (IG) demoder 74 with graphical stream, and switch 162 offers the first audio decoder 75-1 or the second audio decoder 75-2 with audio stream.

From as the flow data of reading the impact damper 53 of sub-segment AV stream file read buffer, outputed to PID (packet ID) wave filter 56 that is positioned at after the impact damper 53 to schedule.Pid filter 56 with the stream that is included in the sub-segment AV stream file, is distributed to corresponding basic stream decoder according to PID (packet ID).More particularly, pid filter 56 will present graphical stream and offer switch 57, interactive graphic stream is offered switch 58, sub-segment audio stream is offered switch 162, wherein, switch 57 offers graphical stream and presents graphic decoder 73, switch 58 offers interactive graphics (IG) demoder 74 with graphical stream, and switch 162 offers the first audio decoder 75-1 or the second audio decoder 75-2 with audio stream.

The video flowing that is distributed by pid filter 161 is provided for the Video Decoder 72 that is positioned at after the pid filter 161.72 pairs of video flowings of Video Decoder are decoded, and will offer video plane maker 92 through decoded video stream then.

Switch 57 presenting graphical stream and being included in presenting in the graphical stream from the sub-segment AV stream file that pid filter 56 provides from the disconnected AV stream file of the main leaf that provides from pid filter 161 is provided selected one, and will select present graphical stream offer be positioned at switch 57 afterwards present graphic decoder 73.Present 73 pairs of graphic decoders and present graphical stream and decode, then they are offered switch 77, switch 77 offers them and presents graphics plane maker 93.

Switch 58 from the disconnected AV stream file of the main leaf that provides from pid filter 161 is provided interactive graphic stream and be included in the interactive graphic stream from the sub-segment AV stream file that pid filter 56 provides and select one, and the interactive graphic stream of selecting is offered interactive graphics (IG) stream decoder 74.That is, the interactive graphic stream that is input to simultaneously in the interactive graphics (IG) demoder 74 is the stream that separates with disconnected AV stream file of main leaf or sub-segment AV stream file.74 pairs of interactive graphic streams of interactive graphics (IG) demoder are decoded, and will offer interactive graphics plane maker 94 through the stream of decoding then.

Switch 162 from the disconnected AV stream file of the main leaf that provides from pid filter 161 is provided audio stream and be included in the audio stream from the sub-segment AV stream file that pid filter 56 provides and select one, and the audio stream of selecting is offered the first audio decoder 75-1 or the second audio decoder 75-2 that is positioned at after the switch 162.The audio stream that is input to simultaneously among the first audio decoder 75-1 is the stream that separates with disconnected AV stream file of main leaf or sub-segment AV stream file.The audio stream that is input to simultaneously among the second audio decoder 75-2 is the stream that separates with disconnected AV stream file of main leaf or sub-segment AV stream file.If the disconnected AV stream file of main leaf comprises audio stream #1 and audio stream #2, then pid filter 161 carries out filtering according to the PID of audio stream to audio stream #1 and audio stream #2, and they are offered switch 162.

More particularly, 162 pairs on switch offers the audio stream #1 of the first audio decoder 75-1 and selects from the audio stream #2 that pid filter 161 offers the second audio decoder 75-2 from pid filter 161.

The first audio decoder 75-1 decodes to audio stream #1, and will offer hybrid processor 101 through the audio stream of decoding.The second audio decoder 75-2 decodes to audio stream #2, and will offer hybrid processor 101 through the audio stream of decoding.

If sent audio stream #1 is overlapped on the audio stream #2, and to the instruction of resetting through the stream of lap over (if the user has selected two audio streams, as the audio stream that will reset), then be provided for hybrid processor 101 by first audio decoder 75-1 audio stream #1 decoding, appointment with by second audio decoder 75-2 audio stream #2 decoding, appointment.

Hybrid processor 101 will mix (overlapping) with voice data from the second audio decoder 75-2 from the voice data of the first audio decoder 75-1, and the data that obtain are offered the hybrid processor 97 that is positioned at after the hybrid processor 101.In the present embodiment, to being also referred to as " combination " from the voice data of first audio decoder 75-1 output with from the mixing (overlapping) that the voice data of second audio decoder 75-2 output carries out.That is be exactly that two voice datas are mixed, with two voice data combinations.

The voice data of being selected by switch 32 is provided for impact damper 95 and is cached in wherein.Impact damper 95 offers voice data hybrid processor 97 to schedule.For example, voice data is the effect sound that can select from menu.(overlapping or make up) is provided with the voice data that provides from impact damper 95 voice data that hybrid processor 97 mixes mixed processor 101 (by mixing the voice data that obtains with voice data from second audio decoder 75-2 output from the voice data of first audio decoder 75-1 output), and with the data that obtain as audio signal output.

To text subtitle (Text-ST) data, present graphical stream, background image data and video data processing similar to the AV demoder 26 of reproducing device 1 basically.

Switch 57,58,162 and 77 by the operation selection carried out of input block 29 or according to the type that comprises the file of target data, is selected data according to the user.For example, if only comprise audio stream in sub-segment AV stream file, then switch 162 will select to change to the side (output of pid filter 56) that sub-segment AV stream file is provided.

Below be that the playback that the reproducing device 141 shown in Figure 36 is carried out is handled.Utilize the instruction input of operation input block 29, that predetermined AV stream is reset in response to the user, controller 21 is according to play list file, play list file as reference Fig. 9 discussion, and be included in broadcast item in the playlist and son and play, by memory driver 22 from recording medium 11 or from local memory 24 as HDD (hard disk drive) read the disconnected AV stream of main leaf, sub-segment AV flows and text subtitle data (text-ST data).

Controller 21 becomes switch 32 background image data is offered impact damper 51, and the disconnected AV flow data of main leaf is offered impact damper 52, sub-segment AV flow data is offered impact damper 53, and the Text-ST data are offered impact damper 54.Then, impact damper 51 to 54 with the metadata cache of correspondence in wherein.

Then, switch 32 become background image data is offered impact damper 51, the disconnected AV flow data of main leaf is offered impact damper 52, sub-segment AV flow data is offered impact damper 53, and text subtitle data is offered impact damper 54.Then, the data of 51 to 54 pairs of correspondences of impact damper are carried out buffer memory.

Then, impact damper 51 outputs to background demoder 71 with background image data.Impact damper 52 offers pid filter 161 with the disconnected AV flow data of main leaf.Impact damper 54 offers text subtitle compositor 76 with text subtitle data.Impact damper 53 offers pid filter 56 with sub-segment AV flow data.

Pid filter 161 offers Video Decoder 72 with video flowing, to present graphical stream and offer switch 57, interactive graphic stream is offered switch 58, audio stream is offered switch 162, wherein, switch 57 will present graphical stream and offer and present graphic decoder 73, and switch 58 offers interactive graphics (IG) demoder 74 with interactive graphic stream, and switch 162 offers the first audio decoder 75-1 or the second audio decoder 75-2 with audio stream.Video flowing, present graphical stream, interactive graphic stream and audio stream and be provided PID.

Pid filter 56 will present graphical stream and offer switch 57, interactive graphic stream is offered switch 58, audio stream is offered switch 162, wherein, switch 57 offers graphical stream and presents graphic decoder 73, switch 58 offers interactive graphics (IG) demoder 74 with graphical stream, and switch 162 offers the first audio decoder 75-1 or the second audio decoder 75-2 with audio stream.

Be positioned at switch 57,58 and 162 after pid filter 161 and 56 under the control of controller 21, select in the disconnected and sub-segment of main leaf.More particularly, the graphical stream that presents of the disconnected AV stream of main leaf that provides from pid filter 161 or sub-segment AV stream is provided for switch 57, and will select present graphical stream offer be positioned at switch 57 afterwards present graphic decoder 73.The disconnected AV stream of main leaf that provides from pid filter 161 or the interactive graphic stream of sub-segment AV stream are provided for switch 58, and the interactive graphic stream of selecting is offered the interactive graphics (IG) demoder 74 that is positioned at after the switch 58.Switch 162 is selected the disconnected AV audio stream of main leaf that provides from pid filter 161 or sub-segment AV audio stream (in this case, because switching the instruction of sound does not also send, therefore be audio stream #1), and the audio stream of selecting offered be positioned at the switch 162 first audio decoder 75-1 afterwards.If the user has sent the instruction of switching sound, then switch 162 offers the second audio decoder 75-2 with the disconnected AV audio stream of main leaf, and sub-segment AV audio stream is offered the first audio decoder 75-1 or the second audio decoder 75-2.But discussed here is to switch sound playback before to handle, and the explanation of switching sound processing afterwards is omitted.

71 pairs of background image datas of background demoder are decoded, and will offer background plane maker 91 through the data of decoding then.72 pairs of video flowings of Video Decoder are decoded, and will offer video plane maker 92 through decoded video stream then.Present the graphical stream that present that 73 pairs of graphic decoders are selected by switch 57 and decode, they are offered be positioned at the switch 77 that presents after the graphic decoder 73 then.The interactive graphic streams that 74 pairs of interactive graphics (IG) demoders are selected by switch 58 are decoded, and they are offered the interactive graphics plane maker 94 that is positioned at after the interactive graphics (IG) demoder 74.76 pairs of text subtitle data of Text-ST compositor are decoded, and it is offered the switch 77 that is positioned at after the Text-ST compositor 76.

The first audio decoder 75-1 decodes to the audio stream of being selected by switch 162 (audio stream #1), and they are outputed to hybrid processor 101.If the user does not send the instruction of switching sound, then not from the second audio decoder 75-2 outputting audio data.Therefore, hybrid processor 101 will directly offer hybrid processor 97 from the voice data of the first audio decoder 75-1.

Switch 77 is selected from one in the data that present graphic decoder 73 or Text-ST compositor 76, and the data of selecting are offered presents graphics plane maker 93.Background plane maker 91 is according to the background image data that provides from background demoder 71, generation background plane.Video plane maker 92 generates video plane according to the video data that provides from Video Decoder 72.Present graphics plane maker 93 according to 77 that select by switch, from the data that present graphic decoder 73 or Text-ST compositor 76, generate and present graphics plane.Interactive graphics plane maker 94 generates interactive graphics plane according to the data from interactive graphics (IG) demoder 74.95 pairs of voice datas that provide of impact damper carry out buffer memory, and it are offered hybrid processor 97 at the fixed time.

Make up on 96 pairs of various planes of video data processor, and will export as video data through the data of combination.Hybrid processor 97 will (be exported) voice data and mix (combination) with voice data from hybrid processor 101, and will export the data that obtain.

According to above-mentioned processing, utilize main path and the subpath be included in the playlist, the disconnected AV stream of main leaf, sub-segment AV stream and text subtitle data are quoted and reset.As mentioned above, by main path and subpath are provided in playlist, can utilize subpath to specify and flowed by the different sub-segment AV of the disconnected AV stream file of the main leaf of main path appointment.Therefore, can be included in the disconnected different sub-segment of the main leaf of being quoted by the broadcast item of main path in the data (simultaneously) of data in main leaf is disconnected reset.

Below the processing of being carried out by reproducing device 141 when having sent the instruction of switching sound is discussed.At first the processing of carrying out in response to the instruction of audio stream #1 being carried out the sound switching is described.The processing of carrying out in response to the instruction of audio stream #2 being carried out the sound switching is discussed in the back.Reproducing device 141 is carried out this processing when carrying out the playback processing.

Controller 21 at first obtains the sequential list of audio stream number (can be ID).More particularly, controller 21 is quoted the STN_table () of PlayItem (), to obtain the sequential list of the audio stream number (ID) of input among the Three S's TN_table () in Figure 35.When handling beginning, carry out this processing when resetting.

In response to the user utilize the operation input block 29 that send, audio stream #1 is carried out the instruction that sound switches, controller 21 receives these instructions.In this case, controller 21 can be controlled the exterior display device (not shown), shows the stream number form on display device.Because this processing is that audio stream #1 is carried out the sound switching processing, therefore, the user sends the instruction of the sound that switches A_SN=1, A_SN=2 or A_SN=3, more particularly, switches to audio frequency 1 (A_SN=2) from audio frequency 2 (A_SN=1).Controller 21 receive from the user, audio stream #1 is carried out the instruction that sound switches.

Controller 21 obtains the audio stream number audio stream number afterwards of current playback.For example, if current playback and A_SN=1 corresponding audio stream file, then controller 21 obtains and A_SN=2 corresponding audio stream number.

Controller 21 according to stream_attribute () (Figure 18) determines whether reproducing device 141 has the function of the number corresponding audio stream (audio stream #1) of resetting and obtaining.For example, if the type of stream_entry () is 1 (type=1), then controller 21 determines whether to have to reset and is included in the function of the audio stream of the main leaf that is associated with the number that obtains in disconnected.Because therefore the audio stream that is associated with the number that obtains, determines whether the first audio decoder 75-1 can decode to audio stream #1 by the audio stream #1 of first audio decoder 75-1 decoding.

If the function that the audio stream that is associated with the number that obtains is reset is not provided, then controller 21 obtains current stream number stream number afterwards.That is,, then skip this stream number (it not being reset) if the function that the audio stream that is associated with current stream number is reset is not provided.The processing that is used to obtain stream number subsequently repeats, till obtaining the audio stream number (audio stream #1) that can be reset.

If the function that the audio stream that is associated with the number that obtains is reset is provided, then 21 pairs of segments that comprise these audio streams of controller are checked.For example, controller 21 is according to the type of Stream_entry (), check the audio stream that is associated with the number that obtains be included in main leaf disconnected in (type=1) still be in the sub-segment (type=2).If in Stream_entry (), type=1, then controller 21 can identify, audio stream be comprised in main leaf disconnected in.If type=2, then controller 21 can identify, and audio stream is comprised in the sub-segment.

Then, controller 21 is specified the audio stream of wishing, more particularly, specify in that the main leaf that comprises the stream that is associated with the number that obtains breaks or sub-segment in the audio stream of hope.For example, if the audio stream that is associated with the number that obtains be comprised in main leaf disconnected in, then controller 21 is according to the information of importing in stream_entry () as type=1 (ref_to_stream_PID_of_mainClip), specifies to be included in the predetermined audio stream of main leaf in disconnected.If the audio stream that is associated with the number that obtains is comprised in the sub-segment, then controller 21 is according to the information (ref_to_SubPath_id that imports in stream_entry () as type=2, ref_to_SubPath_entry_id, and ref_to_stream_PID_of_SubClip), specify the predetermined audio stream that is included in the sub-segment.Appointed audio stream is as the audio stream #1 that is decoded by the first audio decoder 75-1.

Then, read the audio stream of appointment the segment AV stream (from disconnected AV stream file of main leaf or sub-segment AV stream file) that controller 21 demanded storage drivers 22 are comprised from the audio stream of hope is multiplexed in wherein segment, and, memory driver 22 reads the audio stream of appointment, and it is offered AV demoder 151.Perhaps, (from disconnected AV stream file of main leaf or sub-segment AV stream file) reads the audio stream of appointment the segment AV stream of controller 21 on being recorded in local memory 24, multiplexed audio stream of wishing in this segment AV stream, and the audio stream that reads offered AV demoder 151.Then, controller 21 offers the first audio decoder 75-1 of AV demoder 151 with the audio stream (being audio stream #1) of hope, and orders the first audio decoder 75-1 that this audio stream is decoded.

The first audio decoder 75-1 of AV demoder 151 decodes to audio stream #1 (audio stream that order reads to handle in step S58), and it is outputed to hybrid processor 101.If audio stream #2 is decoded by the second audio decoder 75-2, then hybrid processor 101 mixes audio stream #1 with audio stream #2, and will offer hybrid processor 97 through the stream that mixes.If the second audio decoder 75-2 does not decode to audio stream #2, then hybrid processor 101 directly offers hybrid processor 97 with audio stream #1.Then, the voice data that hybrid processor 97 will provide from hybrid processor 97 (voice data that obtains by audio stream #1 is decoded or by to audio stream #1 and audio stream #2 decodes and their are mixed the voice data that obtains) mix with the voice data of exporting from impact damper 95, and with the data that obtain as audio signal output.

Below to the processing of carrying out is described in response to audio stream #2 being carried out the instruction that sound switches.When carrying out the playback processing, carry out this processing.Usually when playback of audio streams #2, also playback of audio streams #1.Therefore, this is handled with the playback to audio stream #1 and handles executed in parallel, and, when the user does not select audio stream #2, only to the audio stream #1 processing of resetting.

Controller 21 is at first quoted the STN_table () among the PlayItem (), and obtains the sequential list of the audio stream number (ID) of the middle input of Three S's TN_table () in Figure 35.When beginning to reset processing, carry out this processing.

In response to the user utilize the operation input block 29 that send, audio stream #2 is carried out the instruction that sound switches, controller 21 receives these instructions, switches audio stream #2 is carried out sound.In this case, controller 21 can be controlled the exterior display device (not shown), shows the stream number form shown in Figure 26 on display device.Because this processing is that audio stream #2 is carried out the sound switching processing, therefore, the user sends switches for example instruction of the sound of A_SN2=1, A_SN2=2.Controller 21 receives audio stream #2 is carried out the instruction that sound switches.Controller 21 obtains the audio stream number audio stream number afterwards of current playback.

Controller 21 according to stream_attribute () (Figure 18) determines whether controller 21 (reproducing device 141) has the function of the number corresponding audio stream (audio stream #2) of resetting and obtaining.Because therefore the audio stream that is associated with the number that obtains, determines whether the second audio decoder 75-2 can decode to audio stream #2 by the audio stream #2 of second audio decoder 75-2 decoding.

If the audio stream #1 by first audio decoder 75-1 decoding has than by the higher extensibility (as in multiple stream (multi-streams)) of audio stream #2 of second audio decoder 75-2 decoding, then can omit this processing.For example, if the first audio decoder 75-1 than the higher performance of the second audio decoder 75-2 (for example has, if audio stream #1 is normal film audio, and audio stream #2 is the director's comment about this film), then probably to having been applied certain restriction by the audio stream #2 of second audio decoder 75-2 decoding.Therefore, it is very low to be set at the possibility of audio stream #2 by the stream of second audio decoder 75-2 decoding.

If the function that the audio stream that is associated with the number that obtains is reset is not provided, then controller 21 obtains current stream number stream number afterwards.That is,, then skip this stream number (it not being reset) if reproducing device 141 does not have the function that the audio stream that is associated with current stream number is reset.The processing that is used to obtain stream number subsequently repeats, till obtaining the audio stream number (audio stream #2) that can be reset.

If the function that the audio stream that is associated with the number that obtains is reset is provided, then controller 21 is according to the type of Stream_entry (), check the audio stream that is associated with the number that obtains be included in main leaf disconnected in (type=1) still be (type=2) in the sub-segment.If in Stream_entry (), type=1, then controller 21 can be checked out, audio stream be comprised in main leaf disconnected in.If type=2, then controller 21 can be checked out, and audio stream is comprised in the sub-segment.

Then, controller 21 is specified the audio stream of wishing at the main leaf that comprises the stream that is associated with the number that obtains in the disconnected or sub-segment.For example, if the audio stream that is associated with the number that obtains be comprised in main leaf disconnected in, then controller 21 is according to the information of importing in stream_entry () as type=1 (ref_to_stream_PID_of_mainClip), specifies to be included in the predetermined audio stream of main leaf in disconnected.If the audio stream that is associated with the number that obtains is comprised in the sub-segment, then controller 21 is according to the information (ref_to_SubPath_id that imports in stream_entry () as type=2, ref_to_SubPath_entry_id, and ref_to_stream_PID_of_SubClip), specify the predetermined audio stream that is included in the sub-segment.Appointed audio stream is as the audio stream #2 that is decoded by the second audio decoder 75-2.

Then, the audio stream that controller 21 demanded storage drivers 22 read hope is multiplexed in segment AV stream (disconnected AV stream file of main leaf or sub-segment AV stream file) wherein, and memory driver 22 reads the stream file of appointment according to this instruction, and it is offered AV demoder 151.Perhaps, 21 pairs of local memories 24 of controller are controlled, and the segment AV that is multiplexed in wherein with the audio stream of reading hope flows (disconnected AV stream file of main leaf or sub-segment AV stream file), and it is offered AV demoder 151.Then, the second audio decoder 75-2 of controller 21 order AV demoders 151 decodes to the audio stream (being audio stream #2) that is included in the hope in the clip that reads.

151 pairs of audio streams of audio decoder (audio stream #2) are decoded, and with its output.More particularly, the second audio decoder 75-2 decodes to audio stream #2 (audio stream that is read by order in the processing in step S78), and it is outputed to hybrid processor 101.Because audio stream #2 is decoded by the second audio decoder 75-2, audio stream #1 is by first audio decoder 75-1 decoding and be output to hybrid processor 101.Then, hybrid processor 101 mixes audio stream #1 with audio stream #2, and will offer hybrid processor 97 through the stream that mixes.Then, the voice data that hybrid processor 97 will provide from hybrid processor 101 (by to audio stream #1 and audio stream #2 decodes and their are mixed the voice data that obtains) mix with the voice data of exporting from impact damper 95, and with the data that obtain as audio signal output.

As mentioned above, can mix and reset two audio streams.More particularly, if having only an audio stream to be reset, then switch 162 will offer the first audio decoder 75-1 from the audio stream that pid filter 161 or 56 provides.If there are two audio streams to be reset, then switch 162 will offer the second audio decoder 75-2 from the audio stream that pid filter 161 or pid filter 56 provide.

In brief, controller 21 is according to the STN_table () of PlayItem (), and switching is controlled to sound (audio frequency), and, the stream_attribute of STN_table () by reference, the stream of controller by only selecting to be reset by reproducing device 141 switches resetting and to control.Controller 21 is controlled wanting two audio streams superimposed and that reset also according to STN_table ().Controller 21 can also be controlled, feasible audio stream #1 and conduct and the audio stream #2 mixing of homogeneous turbulence (being audio stream in this case) mutually of audio stream #1 type as main flow, and simultaneously they are reset.

Though the switching to audio stream is carried out according to the audio stream number,, also can switch them according to audio stream ID (audio_stream_id).In this case, be audio stream ID by the audio stream number being subtracted a number that obtains.

Identical with the processing that utilizes the first or the 2nd STN_table (), except audio stream, the processing that utilizes Three S's TN_table () can also be applied to various types of stream files, as long as their stream type is identical.For example, this configuration can be used for two video flowings (stream type is a video flowing) are made up and the picture-in-picture reset shows.Therefore, can the stream file of same type be made up and reset.

That is, discuss with reference to Figure 43 as the back, the video flowing of being quoted by main path (video flowing #1) is shown as full screen, and is displayed on the full screen the inside by the video flowing (video flowing #2) that main path or subpath are quoted, as sub-screen.

With identical in the reproducing device 1, in reproducing device 141, provide audio frequency or captions flowing not in homogeneous turbulence or the data file, and playlist comprises main path and subpath with main AV.This makes the user to select audio frequency or caption data from the disconnected AV stream of main leaf, can also select audio frequency or caption data from flowing not homogeneous turbulence or the data file with the disconnected AV of main leaf.

In addition, be used for the broadcast item that STN_table () that the type of the data quoted to the type of the data that are multiplexed into the AV stream file with by subpath defines is arranged in main path.Therefore, can realize having the stream of highly scalable.

With identical in the reproducing device 1, the stream_attribute of STN_table () by reference, reproducing device 141 can also sequentially only select the stream that can be reset by reproducing device 141.

Reproducing device 141 processing carried out of the Three S's TN_table among Figure 35 by reference can be summarized as follows.

Reproducing device 141 obtains playlist, as playback management information.Playlist comprises a main path and a plurality of subpath, and wherein, main path is the playback path of the position of the expression disconnected AV stream file of main leaf that comprises at least one stream, and each subpath is represented the position of the sub-segment AV stream file reset with the main flow file synchronization.Reproducing device 141 is according to STN_table (), reception comprises the instruction that the stream that will be reset in playlist is selected, STN_table () with the pre-constant current of the disconnected AV stream file of the main leaf that elects (for example, audio stream #1) and the information of stream (for example, audio stream #2) identical with the main flow file type, that reset with the main flow file synchronization.

In response to the instruction of the stream (audio stream) of selecting two same types, reproducing device 141 reads the file of two streams that comprise selection.Then, the hybrid processor 101 of reproducing device 141 is with these two audio stream combinations, and hybrid processor 97 (AV demoder 151) is to reset through the stream of combination (output).

As a result, two audio streams being selected by user's (by switching) can be mixed (combination) and playback.

With identical in the reproducing device 1, in reproducing device 141, playlist comprises main path and subpath, and main path is quoted different segment AV stream files with subpath.Therefore, can realize having the stream of highly scalable.In addition, discuss as reference Fig. 8, because a subpath can be quoted a plurality of files, therefore, the user can select from a plurality of not homogeneous turbulences.

The broadcast item of main path comprises the STN_table () that discusses with reference to Figure 35, as being used for data (for example, audio stream) that are multiplexed into the AV stream file of being quoted by main path and the form that is defined by the data that subpath is quoted.Therefore, can realize having the stream of highly scalable.In addition, by making additional data input STN_table (), can expand subpath easily.

In STN_table (), provide shown in Figure 18, as the stream_attribute () of stream attribute information.This makes reproducing device 141 can determine whether it has the function that the stream of selecting is reset.Stream_attribute () by reference, reproducing device 141 can only select the stream that can be reset.

In STN_table () (Figure 35), defined the stream file (being the audio stream file in this case) of two same types, and reproducing device 141 comprises two audio decoders (the first audio decoder 75-1 and the second audio decoder 75-2) and is used for the voice data through decoding is made up the hybrid processor 101 of (mixing).Therefore, can be with the stream combination and the playback simultaneously of two same types.

With identical in the reproducing device 1, in reproducing device 141, subpath comprises: SubPath_type, and the type (as audio frequency or captions) of expression subpath, as shown in figure 11; Clip_Information_file_name, the name of the sub-segment that expression is quoted by subpath, as shown in figure 12; And SubPlayItem_IN_time and SubPlayItem_OUT_time, the IN point and the OUT point of the segment that expression is quoted by subpath, as shown in figure 12.Therefore, can specify the data of being quoted by subpath exactly.

In addition, with identical in the reproducing device 1, subpath also comprises: sync_PlayItem_id (for example, the sync_PlayItem_id shown in Fig. 7 and 8), it is the AV stream file that is used to specify on the main path, makes it possible to the information that subpath and main path are reset simultaneously; And sync_start_PTS_of_PlayItem (for example, sync_start_PTS_of_PlayItem shown in Fig. 7 and 8), it is the time on the main path, at this constantly, on the time shaft of main path, the IN point of the data of being quoted by subpath is begun simultaneously.Therefore, the data (file) that can synchronously reset and be quoted by subpath with the disconnected AV stream file of the main leaf of being quoted by main path are shown in Fig. 7 and 8.

For two audio streams being mixed and resetting, the first audio decoder 75-1 decodes to audio stream #1, and the second audio decoder 75-2 decodes to audio stream #2.Determine (for example, the Dolby AC-3 audio frequency among Figure 19) to the type of coding of audio stream #1 and audio stream #2 is whether identical.Its reason is as follows.If type of coding is identical,, therefore can be in by two streams in the first audio decoder 75-1 and the second audio decoder 75-2 process of decoding and mixes by 101 pairs of hybrid processors then because just the data type at decoded audio stream is identical.

The data of AV demoder 151 shown in Figure 36, that offer reproducing device 141 can be recorded in recording medium 11 as the data on the DVD (digital versatile dish), be recorded in local memory 24 as the data on the hard disk, by network 2 data downloaded or their combination.

During the playback that Three S's TN_table () in Figure 35 by reference carries out is handled, the user can be respectively to the reproducing device shown in Figure 36 141, select by the audio stream #1 of first audio decoder 75-1 decoding with by the audio stream #2 of second audio decoder 75-2 decoding decoding.Perhaps, can determine can be mixed audio stream #1 and the combination of audio stream #2, and the indication user select to want the combination of mixed audio stream.That is, can the combination of the audio stream #2 that can reset with audio stream #1 be defined.

Definition to the combination of the stream that will be reset below is discussed.

Figure 37 shows the 4th example (the 4th STN_table ()) of the grammer of the STN_table () when the combination to audio stream #1 and audio stream #2 defines.Can carry out the playback that the 4th STN_table () by reference carries out by the reproducing device shown in Figure 36 141 handles.In Figure 37,, the part similar to the part among Figure 35 do not described for fear of repetition.

In Figure 37, in the FOR of audio stream ID2 (audio_stream_id2) circulation,, distribute audio_stream_id2 since 0 for for an audio frequency of each stream_entry () appointment flows substantially.In this case,, except stream_entry () and stream_attributes (), defined new field for audio_stream_id2, that is, and Combination_of_Primary_and_Secondary.Combination_of_Primary_and_Secodary is used for the information that the combination to audio stream #1 (once stream) and audio stream #2 (secondary flow) defines.That is, in the FOR of audio stream ID2 circulation, having defined expression can be with the information of which audio stream #1 with the audio stream #2 that is represented by audio stream ID2 (audio_stream_id2) combination.In other words, in Combination_of_Primary_and_Secondary, can be to defining with the audio stream #2 of audio stream #1 combination.Be substituted in the FOR circulation of audio stream ID1 defining with the audio stream ID2 of audio stream ID1 combination, in the FOR of audio stream ID2 circulation, respectively audio stream ID1 and audio stream ID2 are defined, and the combination of audio stream #1 and audio stream #2 is defined.Utilize such configuration, even the quantity of the audio stream ID1 that will register is fixed, the combination of audio stream ID1 and audio stream ID2 is not also to the number count of registering.Therefore, can use the quantity of the audio stream that can be registered effectively.

Describe as reference Figure 35, can in this case, distribute audio_stream_number2 with audio stream number 2 (audio_stream_number2) substituted audio stream ID2 (audio_stream_id2) since 1.That is be audio_stream_number2, by making audio_stream_id2 add a number that obtains.Distribute this number to be because audio_stream_number2 is the number that the user can see when switching sound since 1.

Hereinafter with reference to Figure 38, the example of the bitmap grammer of the Combination_of_Primary_and_Secondary shown in Figure 37 is described.

The bitmap grammer of Combination_of_Primary_and_Secondary shown in Figure 38 is 32.In Figure 38, audio_stream_id is illustrated in the audio_stream_id (audio stream ID) of the middle definition of the 4th STN_table () among Figure 37, and this designator has indicated the sign of an expression audio_stream_id, and audio_stream_id is used for specifying with the audio stream #1 that is made up by the audio stream #2 of corresponding audio_stream_id2 (audio stream ID2) appointment.That is, by audio_stream_id is combined with designator, can be to specifying with the audio_stream_id of the audio stream #1 of the audio stream #2 combination of being represented by audio_stream_id2.

Combination_of_Primary_and_Secondary as appointment in the FOR circulation of the audio_stream_id2 in Figure 37, be each audio_stream_id2 definition Combination_of_Primary_ang_Secondary, and indicate by being instructed to accord with, audio_stream_id, can specify can with the audio stream #1 of the audio stream #2 that represented by audio_stream_id2 combination.

More particularly, if designator is 0, then Dui Ying audio_stream_id2 is with unconnected by the audio stream #1 of audio_stream_id appointment.If designator is 1, then Dui Ying audio_stream_id2 be associated by the audio stream #1 of audio_stream_id appointment.

Figure 38 show by two audio streams (audio stream #1) of audio_stream_id=0 and audio_stream_id=1 appointment can with made up by the audio stream #2 of audio_stream_id2 (audio stream ID2) appointment.

Although in Figure 38, specify audio stream #1 by audio_stream_id,, also can use the audio stream number, in this case, distribute the audio stream number since 1.

As shown in figure 38 and since the bitmap syntactic definition by 32 Combination_of_Primary_and_Secondary, therefore can be each the definition audio stream #2 among 32 audio stream #1.

According to Figure 37 and 38, can utilize the combination of audio_stream_id, audio_stream_id2 and Combination_of_Primary_and_Secondary definition audio stream #1 and audio stream #2.That is, combination does not define to inconsistent audio stream, and this makes the user can select the combination of the audio stream that always can be reset.

Followingly object lesson is discussed with reference to Figure 39.Figure 39 shows and offers the stream number form user, that represent the relation between sound signal and the caption stream caption signal.Description to caption signal (sprite) is similar to the description among Figure 26, has therefore omitted the explanation to it.

In Figure 39, each among the 4th STN_table () of the PlayItem () that gives at the main path that constitutes playlist among the audio stream #1 (by the audio stream of audio_stream_id appointment) of input provides A_SN.

More particularly, audio frequency 2 is distributed to A_SN=1, audio frequency 1 is distributed to A_SN=2, audio frequency 3 is distributed to A_SN=3.

In this case, audio frequency 4 (audio_stream_id2=0, that is, audio stream number 2 is 1) can make up with the audio frequency 2 that is associated with A_SN=1.Audio frequency 4 (audio_stream_id2=1, that is, audio stream number 2 is 1) and audio frequency 5 (audio_stream_id2=1, that is, audio stream number 2 is 2) can make up with the audio frequency 1 that is associated with A_SN=2.

More particularly, for audio frequency 4 (audio_stream_id2=0), in the bitmap grammer of Combination_of_Primary_and_Secondary in Figure 38, the indicator value that is used for audio_stream_id=0 and audio_stream_id=1 is 1, is 0 and be used for audio_stream_id=2 entirely to the indicator value of audio_stream_id=31.For audio frequency 5 (audio_stream_id2=1), in the bitmap grammer of Combination_of_Primary_and_Secondary in Figure 38, the indicator value that is used for audio_stream_id=1 is 1, and being used for audio_stream_id=0 and audio_stream_id=2 is 0 to the indicator value of audio_stream_id=31 entirely.

The user selects audio stream #1 from the audio stream that provides A_SN, select audio stream #2 from the audio stream of representing on the right side of Figure 39.In the example of Figure 39, if the user is chosen as audio stream #1 with audio frequency 2 (A_SN=1), then the audio stream #2 that can mix with audio stream #1 has only audio frequency 4, and therefore, the user determines whether to select with audio frequency 4 and audio frequency 2 combinations.In Figure 39, the audio frequency 4 usefulness X that are associated with audio frequency 2 represent, this means it with audio frequency 2 combinations.The user becomes O with X, thereby selects audio frequency 2 and audio frequency 4 are made up and reset.

In Figure 39,, then can from the audio frequency 4 represented on the right side of Figure 39 and audio frequency 5, select the audio stream #1 that can mix with audio stream #2 if the user is chosen as audio stream #1 with audio frequency 1 (A_SN=2).Therefore, the user determines whether to select audio frequency 4 or audio frequency 5.In Figure 39, represent the audio frequency 4 or the audio frequency 5 that are associated with audio frequency 1 with X, this means in them each with audio frequency 1 combination.The user becomes O with X, thereby selection is made up with audio frequency 5 audio frequency 2 and audio frequency 4 or audio frequency 2 and reset.

Below provide the object lesson of the instruction that audio stream is selected.When selecting with audio frequency 2 that A_SN=1 is associated, if the user has sent the instruction of switch audio stream, then replay operations is switched to audio frequency 2 and audio frequency 4 is made up (in Figure 39, will become O with audio frequency 2 corresponding audio 4).If the user has further sent the instruction of switch audio stream, then replay operations is switched to the audio frequency 1 (in Figure 39, will become X with audio frequency 2 corresponding audio 4) that is associated with A_SN=2.If the user has further sent the instruction of switch audio stream, then replay operations is switched to audio frequency 1 and audio frequency 4 combinations (in Figure 39, will become O with audio frequency 1 corresponding audio 4).If the user has further sent the instruction of switch audio stream, then replay operations is switched to audio frequency 1 and audio frequency 5 combinations (in Figure 39, will become X with audio frequency 1 corresponding audio 4, and audio frequency 5 becoming O).

As shown in figure 40, by switching the selection to the audio stream that will be reset, audio frequency 1 and audio frequency 5 that the user can select to be associated with A_SN=2 make up.Therefore, can mix and reset audio frequency 1 (audio stream #1) and audio frequency 5 (audio stream #2).

Utilize audio_stream_id, audio_stream_id2 and Combination_of_Primary_and_Secondary, can the combination of audio stream #1 and audio stream #2 be defined.Inconsistent combination is not defined, and this makes the user can select the combination of the audio stream that always can be reset.That is, in the example in Figure 39, the user can select audio stream under the situation of not selecting inconsistent combination such as audio frequency 2 and audio frequency 5.

In other words, among the 4th STN_table () in PlayItem () (Figure 37), can utilize Combination_of_Primary_and_Secondary, to shown in Figure 36, define by the audio stream #1 of first audio decoder 75-1 decoding with by the combination of the audio stream #2 of second audio decoder 75-2 decoding.Therefore, can mix and reset two audio streams.That is, can be in the middle of polytype stream, the stream (being audio stream in this case) of same type is mixed (combination or overlapping), and reset simultaneously.

Utilize such configuration, the user can select audio stream from predetermined combinations, does not need to select separately two audio streams.

Hereinafter with reference to Figure 41, from the combination of definition, select second example of the combination of audio stream #1 and audio stream #2 to be described to the order user.In other words, Figure 41 shows second example that the audio stream that can mix with audio stream #1 is defined as audio stream #2.

Figure 41 shows the 5th example (the 5th STN_table ()) of the grammer that is used for the STN_table () that the combination to audio stream #1 and audio stream #2 defines.Can carry out the playback that the 5th STN_table () by reference carries out by the reproducing device shown in Figure 36 141 handles.In Figure 41,, the part similar to the part among Figure 35 do not described for fear of repetition.

In Figure 41, in the FOR of audio stream ID2 (audio_stream_id2) circulation,, distribute audio_stream_id2 since 0 for having specified an audio frequency of record position to flow substantially for each stream_entry ().In this case, for audio_stream_id2 has defined number_of_combinations, in the FOR statement after number_of_combinations, provided the number audio_stream_id identical with the number of number_of_combinations.FOR statement after number_of_combinations and the number_of_combinations is to be used for the information that the combination to audio stream #1 and audio stream #2 defines, and, can be number_of_combinations with the number of the audio stream #1 that is made up by the audio stream #2 of audio_stream_id2 appointment.In the FOR statement after number_of_combinations, defined to can with the audio_stream_id that is carried out appointment by the audio stream #1 of the audio stream #2 of audio_stream_id2 appointment combination.

Promptly, different with the 4th STN_table () among Figure 37, in the FOR statement of audio stream ID2 (audio_stream_id2) among the 5th STN_table () in Figure 41, by number_of_combinations to can with defined by the number of the audio stream #1 of the audio stream #2 of audio stream ID2 appointment combination, and, in the FOR statement after number_of_combinations, directly defined the audio_stream_id that audio stream #1 is carried out appointment.

By this way, in the 5th STN_table (), in the FOR statement after the number_of_combinations of audio stream ID2, to representing which audio stream #1 and being defined by the information of the audio stream #2 of audio stream ID2 (audio_stream_id2) appointment combination.In other words, in the FOR statement after the number_of_combinations of audio stream ID2, defined can with the audio stream #2 of audio stream #1 combination.

Discuss as reference Figure 35, can flow ID2 (audio_stream_id2) with audio stream number 2 (audio_stream_number2) substituted audio.Can flow ID (audio_stream_id) with audio stream number (audio_stream_number) substituted audio.That is, the audio stream number can replace the audio_stream_id that defines in the FOR statement after number_of_combinations.

In Figure 41, utilize number_of_combinations and FOR statement subsequently, can the combination of audio stream #1 and audio stream #2 be defined.That is, combination does not define to inconsistent audio stream, and this makes the user can select the combination of the audio stream that always can be reset.

The object lesson of stream number form is to similar with 40 object lessons of discussing with reference to Figure 39.

If the stream number form shown in Figure 39 is applied to the 5th STN_table () among Figure 41, as can with audio frequency 4 (audio_stream_id2=0, promptly, audio stream number 2 is 1) combination audio stream #1, defined audio frequency 2 (audio_stream_id=0) that is associated with A_SN=1 and the audio frequency 1 (audio_stream_id=1) that is associated with A_SN=2.In this case, the number_of_combinations corresponding with audio_stream_id2=0 is 2, and the audio_stream_id of definition is audio_stream_id=0 and audio_stream_id=1.In addition, as can with the audio stream #1 of audio frequency 5 (audio_stream_id2=1, that is, audio stream number 2 is 2) combination, defined the audio frequency 1 (audio_stream_id=1) that is associated with A_SN=2.In this case, the number_of_combinations corresponding with audio_stream_id2=1 is 1, and defined audio_stream_id is audio_stream_id=1.

By switching shown in Figure 39, the audio stream that be reset, the user selects audio frequency 1 for example and the combination of the audio frequency 5 that is associated with A_SN=2, as shown in figure 40.Then, can mix and reset audio frequency 1 (audio stream #1) and audio frequency 5 (audio stream #2).

As mentioned above, utilize number_of_combinations and FOR statement subsequently, can the combination of audio stream #1 and audio stream #2 be defined.Inconsistent combination is not defined, and this makes the user can select the combination of the audio stream that always can be reset.For example, in Figure 39, not to inconsistent combination for example audio frequency 2 and audio frequency 5 define, the stream that only provides the user to select is provided thus.

In other words, among the 5th STN_table () in PlayItem () (Figure 41), in number_of_combinations and FOR statement subsequently, defined the combination with the audio stream #2 that is decoded by the second audio decoder 75-2 by the audio stream #1 of first audio decoder 75-1 decoding.Therefore, can mix and reset two audio streams.That is, in the middle of polytype stream, can mix (combination or overlapping) to the stream (being audio stream in this case) of same type, and reset simultaneously.

Utilize the 5th STN_table (), the user can select the audio stream that will reset from predetermined combinations, do not need to select separately two audio streams.

Figure 42 shows the 6th example (the 6th STN_table ()) of the grammer that is used for the STN_table () that the combination to audio stream #1 and audio stream #2 defines.Also can carry out the playback that the 6th STN_table () by reference carries out by the reproducing device shown in Figure 36 141 handles.In Figure 42,, the part similar to the part in Figure 35 or 41 do not described for fear of repetition.

In the FOR circulation of audio stream ID (audio_stream_id) in Figure 42, identical with the Three S's TN_table () shown in Figure 35, an audio stream #1 for being each stream_entry () appointment distributes audio_stream_id since 0.Similar among the Three S's TN_table () among stream_attributes () after the FOR of the audio stream ID circulation and Figure 35.

But, among the 6th STN_table () in Figure 42, below be used for the FOR circulation that information that the combination to audio stream #1 and audio stream #2 defines is included in audio stream ID (audio_stream_id).=0), then provides number_of_audio_stream2_ref_entries.Number_of_audiostream2_ref_entries represent can with by the number of the audio stream #2 of the audio stream #1 of audio_stream_id appointment combination.After the FOR of number_of_audio_stream2_ref_entries statement, defined audio_stream2_id_ref to carrying out appointment with the audio stream #2 of stream #1 combination.

With identical in other examples of STN_table (), can flow ID2ref (audio_stream_id2_ref) with audio stream number 2ref (audio_stream_number2_ref) substituted audio, and, can flow ID (audio_stream_id) with audio stream number (audio_stream_number) substituted audio.

By this way, the 6th STN_table () among Figure 42 can define the combination of audio stream #1 and audio stream #2 by reference.That is, combination does not define to inconsistent audio stream, and this makes the user can select the combination of the audio stream that always can be reset.

As mentioned above, be recorded on the recording medium that is installed in the reproducing device of the present invention or the application form of the data on the local memory of reproducing device of the present invention is made of two-layer, i.e. playlist layer and sheet tomography.Playlist comprises main path and at least one subpath that is arranged in parallel with main path, and wherein, main path has at least one and plays (a played in order item), and subpath has at least one height broadcast (can be that order or non-order is play item).

Utilize such configuration, as shown in figure 43, corresponding content such as the film of the AV stream that can in full screen 301, reset and be quoted (by the video flowing 311 of the expression of the video (Primary Video) among Figure 43 and the audio stream of representing by the audio frequency (Primary Audio) among Figure 43 312) by main path, and, can be in the sub-screen in being comprised in full screen 311 312, to corresponding with the AV stream of being quoted by subpath, the content (by the video flowing 313 of the secondary video among Figure 43 (Secondary Video) expression and the audio stream of representing by the secondary audio frequency among Figure 43 (Secondary Audio) 314) that is different from the AV stream of being quoted by main path, for example, reset about director's comment of film.

That is the different content item of can in complete (master) screen 301 and sub-screen 302, resetting simultaneously.

This technology is called as " picture-in-picture " technology.

As discussed above, and by the corresponding sound of the audio stream 312 of an audio representation and can be mixed and reset, this means two audio streams are mixed and output by the corresponding sound of the audio stream 314 of secondary audio representation.

As mentioned above, the real object that be reset is sound or the image corresponding with stream.But,, in the following description, it can be called " predetermined stream is reset " in order to simplify description.

In order to realize using the application of picture-in-picture techniques, for example, need following grammer.In the present embodiment, by the number of the video flowing of the video_stream_id among the STN_table () definition (for example, hereinafter referred to as " video flowing ", the video flowing of being represented by the video flowing shown in Figure 43 (Video Stream) 311 is called as " video flowing ") be 1.Consider this fact,, then can realize picture-in-picture techniques, that is, utilize the application of picture-in-picture techniques if prepared the grammer that the combination to the stream that can reset simultaneously with a video flowing defines.

In the present embodiment,, prepared following four kinds of streams in the present embodiment as the stream that can utilize picture-in-picture techniques and video flowing to reset simultaneously, that is, and the stream of first to the 4th type.

The stream of the first kind is the audio stream by the definition of the audio_stream_id among the STN_table (), promptly, above-mentioned audio stream #1 (, for example, being called as " audio stream ") by the audio stream 312 of an audio representation shown in Figure 43 hereinafter referred to as " audio stream ".

The stream of second type is the video flowing (hereinafter referred to as " secondary video stream ", for example, the video flowing of being represented by the secondary video shown in Figure 43 313 is called as " secondary video stream ") by the definition of the video_stream_id2 among the STN_table ().

The stream of the 3rd type is the audio stream by the definition of the audio_stream_id2 among the STN_table (), promptly, above-mentioned audio stream #2 (, for example, being called as " secondary audio stream ") by the audio stream 314 of the secondary audio representation shown in Figure 43 hereinafter referred to as " secondary audio stream ".

Text subtitle stream that the stream of the 4th type is quoted by subpath (txtST) or the stream (PG presents graphical stream) that obtains by run length coding, RLC bitmap captions such as DVD sprite.For example, the caption stream of being represented by the captions among Figure 43 315 is examples of the stream of the 4th type.The stream of the 4th type, promptly txtST and PG are called as " caption stream ".Caption stream is not necessarily reset (demonstration) in sub-screen, but may be displayed on any position in the full screen.Therefore, in the example of Figure 43 caption stream 315 outside sub-screen 302.

As discussed above, in order to realize using the application of picture-in-picture techniques, need be to the stream that can reset simultaneously with a video flowing, that is, secondary video stream, audio stream, secondary audio stream and a caption stream, combination define.

By defining multiple combination, not only can be to being presented at a video flowing or the audio stream on the full screen 301, and can switch easily the secondary video stream or the caption stream that are presented on the sub-screen 302.Following with reference to Figure 46 and 47, the example of blocked operation is discussed.

For example, in the 7th STN_table () shown in Figure 44 and 45, provide definition to the combination of the stream that can reset simultaneously with a video flowing.Figure 44 and 45 shows the 7th example (the 7th STN_table ()) of STN_table () grammer, be used for the secondary video stream that can reset with a video flowing, the combination of audio stream, secondary audio stream and a caption stream are defined, write down their position (stream_entry) and attribute (stream_attribute).For fear of repetition, part among Figure 44 and 45, similar to the part shown in Figure 41 is not described.

In the example shown in Figure 44 and 45, the secondary video stream that can reset with a video flowing, the combination of audio stream, secondary audio stream and a caption stream are defined as follows.At first, defining at least one can flow with the secondary video that a video flowing is reset simultaneously.Then, the audio stream that can reset simultaneously with each secondary video stream of definition (audio stream and secondary audio stream) and caption stream.

More particularly, in Figure 44, number_of_video_stream2_entries is illustrated in input (registration) among the 7th STN_table (), and provides the number of the stream of video_stream_id2.Video_stream_id2 is the information that is used to discern secondary video stream, and the video_stream_number2 secondary video stream number that the user can see when being Switch Video.

In Figure 45, in the FOR of video flowing ID2 (video_stream_id2) circulation,, distribute video_stream_id2 since 0 for flow (as the video-frequency basic flow of secondary video stream) substantially for a secondary video of each stream_entry () appointment.

For video_stream_id2, provide number_of_Audio_combinations_for_video2.In FOR statement subsequently, provide the number identical with audio_stream_id2 for audio_stream_id with number_of_Audio_combinations_for_video2.That number_of_Audio_combinations_for_video2 and FOR statement subsequently can be reset with second video flowing simultaneously with opposing, by audio stream of audio_stream_id appointment and the information that defines by the combination of the secondary audio stream of audio_stream_id2 appointment.Can be number_of_Audio_combinations_for_video2 with number by the audio stream of the secondary video of video_stream_id2 appointment stream combination (audio stream and secondary audio stream).Then, in the FOR statement after number_of_Audio_combinations_for_video2, defined can with audio_stream_id and the audio_stream_id2 combination of secondary video stream, that respectively audio stream and secondary audio stream are carried out appointment.

Video_stream_id2 for identical provides number_of_Subtitle_combinations_for_video2.In FOR statement subsequently, provide number the PG_textST_stream_id identical with the number of number_of_Subtitle_combinations_for_video2.Number_of_Subtitle_combinations_for_video2 and FOR statement subsequently can flow the information that the combination of the caption stream of playback simultaneously defines with secondary video with opposing.The number of the caption stream that can make up with the secondary video stream by the video_stream_id2 appointment is number_of_Subtitle_combinations_for_video2.Then, in the FOR statement after number_of_Subtitle_combinations_for_video2, the PG_textST_stream_id that definition is carried out appointment to the caption stream that can make up with the secondary video stream by the video_stream_id2 appointment.

With identical in other example of STN_table (), can replace audio_stream_id with audio stream number (audio_stream_number), and, can replace audio_stream_id2 with audio stream number 2.Same way is applicable to video flowing and caption stream.

According to the 7th STN_table () shown in Figure 44 and 45, can flow with the secondary video that a video flowing is reset by the video_stream_id2 definition.Then, utilize video_stream_id2, audio_stream_id, audio_stream_id2 and PG_textST_stream_id, can define and to flow an audio stream, secondary audio stream and the captions audio stream of resetting simultaneously with each secondary video.That is, can define the secondary video stream that can reset simultaneously with a video flowing, the combination of audio stream, secondary audio stream and a captions audio stream.

Utilize such configuration, the inconsistent combination to video flowing can resetting simultaneously with a video flowing and secondary video stream, audio stream, secondary audio stream and a captions audio stream does not define.Therefore, the user can select easily can with the stream of video flowing combination.

Following with reference to Figure 46 and 47, object lesson is described.Figure 46 shows when using the 7th STN_table (), offers sound signal, the vision signal that is associated with secondary video the stream user, that expression is associated with audio stream or secondary audio stream and the stream number form of the combination of the caption signal that is associated with caption stream.Sound number and captions number to discuss with reference to Figure 26 or 39 similar, therefore omitted explanation to it.

In Figure 46, V2_SN is provided (video 2 stream number (Video2 Stream Number) (secondary video stream number)) for each in flowing of secondary video by the video_stream_id2 appointment of input in the 7th STN_table () of the broadcast item of the main path that constitutes playlist.

More particularly, video 2 is distributed to V2_SN=1, and video 1 is distributed to V2_SN=2.

In this case, for the video 2 that is associated with V2_SN=1, can with as the audio frequency 2 of an audio stream (in Figure 45, when video_stream_id2 designated 2, an audio stream of importing among the audio_stream_id in the FOR statement), as the audio frequency 4 of secondary audio stream (in Figure 45, when video_stream_id2 designated 2, the secondary audio stream of importing among the audio_stream_id2 in the FOR statement) and as the sprite 3 of caption stream (in Figure 45, when video_stream_id2 designated 2, the caption stream of importing among the PG_textST_stream_id in the FOR statement) combination.

For the video 1 that is associated with V2_SN=2, can with as the audio frequency 1 of an audio stream (in Figure 45, when video_stream_id2 designated 1, an audio stream of importing among the audio_stream_id in the FOR statement), as the audio frequency 4 of secondary audio stream or audio frequency 5 (in Figure 45, when video_stream_id2 designated 1, in the secondary audio stream of importing among the audio_stream_id2 in the FOR statement each) and as the sprite 1 of caption stream (in Figure 45, when video_stream_id2 designated 1, the caption stream of importing among the PG_textST_stream_id in the FOR statement) combination.

In Figure 45, in the FOR statement when video_stream_id2 is video 1,, defined first combination and second and made up as the combination of the audio stream that can reset simultaneously with the video 1 that is associated with V2_SN=2.First combination is as the audio frequency 1 of an audio stream with as the audio frequency 4 of secondary audio stream.Second combination is as the audio frequency 1 of an audio stream with as the audio frequency 5 of secondary audio stream.

When stream number form shown in Figure 46 is provided (it is unrestricted how to offer the user), the user is (by operation) at first, one in video 2 (VS_SN=1) or the video 1 (VS_SN=2) is chosen as and the video that can reset simultaneously with film, the secondary video stream that is associated of director comment for example, as be presented at sub-screen (sub-screen 302 in the example among Figure 43) on the corresponding secondary video stream of video.

For example, if video 2 (VS_SN=1) is chosen as secondary video stream, then as shown in figure 46, the combination of once having only audio frequency 2, audio frequency 4 and sprite 3 that can reset simultaneously with video 2 with the combination of secondary audio stream and caption stream.Therefore, when video 2 (VS_SN=1) was selected as secondary video stream, the user no longer carried out any other selection.

On the other hand, for example, if video 1 (VS_SN=2) is chosen as secondary video stream, then as shown in figure 47, as can with video 1 reset simultaneously once with the combination of secondary audio stream and caption stream, two kinds of combinations are arranged, that is, and first combination of audio frequency 1, audio frequency 4 and sprite 1 and second combination of audio frequency 1, audio frequency 5 and sprite 1.Therefore, when selecting video 1 (VS_SN=2), the user can select in first combination and second combination.

More particularly, in the similar mode of discussing to reference Figure 39 of selection operation, when the user selects with video 1 (VS_SN=2) is reset together stream (with the right side of the corresponding demonstration of stream number form), the user can become O with symbol X, and when the user does not select this stream, user's hold mark X.Discuss as reference Figure 39, O is the symbol that the expression user has selected the correspondence stream that will be reset, and the symbol that the X correspondence that to be the expression user also not have selects to be reset flows.

Figure 47 shows the example of first combination of having selected audio frequency 1, audio frequency 4 and sprite 1.More particularly, as shown in figure 47, because audio frequency 1 is selected as an audio stream resetting simultaneously with video 1 (VS_SN=2), therefore, the selection mode of audio frequency 1 becomes O from X.Because audio frequency 4 selected (owing to not selecting audio frequency 5) is the secondary audio stream of resetting simultaneously with video 1, therefore, the selection mode of audio frequency 4 becomes O from X.On the contrary, the selection mode of audio frequency 5 remains X.Because sprite 1 is selected as the caption stream of resetting simultaneously with video 1, therefore, the selection mode of sprite 1 becomes O from X.

According to above-mentioned a series of selection operations, selected video 1, audio frequency 1, audio frequency 4 and sprite 1, and preparation is reset with main video (video flowing).

In above-mentioned example, as selection operation, at first select secondary video stream to the stream that can reset simultaneously with a video flowing, then,, select audio stream, secondary audio stream and caption stream one time according to secondary video stream.

But selection operation is not limited to the above-mentioned type.For example, audio stream be can at first select one time, secondary video stream, secondary audio stream and caption stream selected then.More particularly, in the stream number form shown in Figure 47, the selection operation of discussing with reference Figure 39 is identical, the audio frequency 2 that is associated with A_SN=1, the audio frequency 1 that is associated with A_SN=2 or the audio frequency 3 that is associated with A_SN=3 at first are chosen as audio stream one time, select secondary video stream, secondary audio stream and caption stream then.

Perhaps, caption stream be can at first select, audio stream, secondary video stream and secondary audio stream selected then one time.More particularly, in the stream number form shown in Figure 47, at first the sprite 3 that will be associated with S_SN=1, the sprite 1 that is associated with S_SN=2 and the sprite 2 that is associated with S_SN=3 are chosen as caption stream, select secondary video stream, audio stream and secondary audio stream then, though that this selection operation does not have is shown in Figure 47.

In the present embodiment, forbid that the user switches the secondary audio stream.Therefore, in the example in Figure 47, A_SN is provided for the secondary audio stream.That is, audio frequency 1, audio frequency 2 and audio frequency 3 are used as audio stream one time, and audio frequency 4 and audio frequency 5 are used as the secondary audio stream.

If utilize the grammer of the 7th STN_table () shown in Figure 44 and 45 to realize picture-in-picture techniques,, then can generate the playlist shown in Figure 48 if then use the SubPath_type shown in Figure 11.

In Figure 48, the video (video flowing) and the audio frequency (audio stream) that are included in the segment AV stream file-0 that the playlist 1 (PlayItem-1) that is configured main path quotes (main leaf break AV stream file) are used separately as a video flowing and an audio stream.In this case, with STN_table () in video_stream_id and the corresponding stream_entry () of audio_stream_id in, set type=1.In the example in Figure 43, the video and the audio frequency that are included in the segment AV stream file-0 are respectively a video flowing 311 and an audio stream 312.Video flowing 311 of playback in full screen 301, simultaneously, (output) audio stream 312 of resetting.

Be included in the secondary video (video flowing) that the son that is comprised in the subpath 1 plays in the segment AV stream file-1 (sub-segment AV stream file) that (SPI) quote and be used as secondary video stream, be used as the secondary audio stream and be included in the secondary audio frequency (audio stream) that the son that is comprised in the subpath 2 plays in the segment AV stream file-1 (sub-segment AV stream file) that (SPI) quote.In this case, in the stream_entry () corresponding, set type=2 with video_stream_id2 and audio_stream_id2.In the example in Figure 43, the secondary video and the secondary audio frequency that are included in the disconnected AV stream file-1 of main leaf are respectively secondary video stream 313 and secondary audio stream 314.Playback secondary video stream 313 in sub-screen 302, simultaneously, (output) secondary audio stream 314 of resetting.

As mentioned above, in full screen 301, reset to be included in the audio frequency in the disconnected AV stream file-0 of main leaf and in sub-screen 302, to reset and be included in secondary audio frequency in the sub-segment AV stream file-1 and mean and these two audio streams are mixed and reset.

As mentioned above, in the example in Figure 48, the example shown in Figure 11 is used as SubPath_type, and the result utilizes main path, subpath 1 and subpath 2 to realize picture-in-picture techniques.

In the example in Figure 48, even secondary video stream and the secondary audio stream reset simultaneously with a video flowing in being included in the disconnected AV stream file-0 of main leaf are comprised in the identical segment AV stream file-1, also by different subpaths, promptly subpath 1 and subpath 2 define them.This be because, in Figure 11, only prepared the sub paths types that each subpath of expression can only be quoted ES (basic stream).That is, among the SubPath_type in Figure 11, distribute a subpath for each ES among a plurality of ES such as audio frequency, IG, text and the video ES, no matter and whether they are comprised in the identical segment AV stream file.

Such way is not limited to the example among Figure 48.Utilize the SubPath_type shown in Figure 11,, then these ES are quoted, that is, they are defined as different sons play item by different subpaths if there are two or more ES to be reset.

In this case, these two or more ES should define some information apart from each other, as SubPlayItem_IN_time and SubPlayItem_OUT_time, even these information are identical, because they are comprised in the identical segment AV stream file.Therefore, these information as SubPlayItem_IN_time and SubPlayItem_OUT_time, become unnecessary (first problem).

In addition, should be each elementary path that will reset definition subpath, this makes the complex structure (second problem) of playlist.

Second problem has caused the 3rd following problem again.

In addition, in the present embodiment, there is a restriction to force on reproducing device (reproducing device 401 shown in the reproducing device 141 shown in Figure 36 or Figure 53), makes it can only read two TS (that is, being included in two TS in the segment) simultaneously.Under this restriction, when playback had the playlist of labyrinth, which subpath reproducing device can not determine to make up with the main path that defines in playlist at once.In other words, in order to determine the combination of main path and subpath, handle become complicated (the 3rd problem).

Therefore, in order to solve above-mentioned first to the 3rd problem, the inventor has invented following technology.As SubPath_type, added allowing a plurality of ES are handled, promptly allow to quote simultaneously the sub paths types of a plurality of ES.Figure 49 illustrates second example of such SubPath_type.

That is, Figure 49 shows second example of SubPath_type, and it is different with the example shown in Figure 11.That is, added the sub paths types that can solve first to the 3rd above-mentioned problem.In other words, in order to solve first to the 3rd problem, used the 2nd SubPath_type shown in Figure 49.

In Figure 49, therefore identical among Sub Path_type=0 to 4 and Figure 11 omitted the explanation to them.

But, in Figure 49, in the implication of Sub Path_type=0 to 4, be included in " out-of-mux " that do not explain among Figure 11.The implication of " out-of-mux " is, the TS that comprises the ES that is quoted by subpath is different with the TS that comprises the ES that is quoted by main path, that is, the ES that is quoted by subpath is not multiplexed among the TS that is included in the broadcast item of being quoted by main path.Such sub paths types is called as " the non-multiplexed type of main path-TS ".

With identical in SubPath_type=2 or 3, when the ES that is quoted by main path is asynchronous with the ES that is quoted by subpath, below this sub paths types is called " AV non-synchronous type ".On the other hand, with identical in SubPath_type=4 or 5, when ES that is quoted by main path and the ES that is quoted by subpath are synchronous, below this sub paths types is called " synchronized model ".

SubPath_type=5 represents " out-of-mux of one or more basic flow paths and AV synchronized model (an audio frequency/PG/IG/ secondary audio path) " and " picture-in-picture that comprises one or more basic flow paths presents the out-of-mux and the AV synchronized model in path ".That is, SubPath_type=5 is that the synchronized model or the picture-in-picture of the non-multiplexed type of main path transport stream and at least one basic flow path (an audio frequency/PG/IG/ secondary audio path) presents the path.

Promptly, SubPath_type=5 has comprised the type of being represented by SubPath_type=5 shown in Figure 11 and SubPath_type=6, therefore, comprise that the secondary audio frequency presents path (being used to quote the path of secondary audio stream) and secondary video presents path (being used to quote the path of secondary video stream).

In above-mentioned picture-in-picture techniques (Figure 43), picture-in-picture presents the path and comprises at least one path to quoting with an audio stream, secondary audio stream and the caption stream of predetermined video flowing (video flowing of being quoted by main path) combination.

SubPath_type=6 represents " out-of-mux and the AV non-synchronous type picture-in-picture that comprise one or more basic flow paths present the path ".That is, SubPath_type=6 is that non-multiplexed type of (comprising at least one ES) main path transport stream and non-synchronous type picture-in-picture present the path.

SubPath_type=7 represents " the in-mux type and the AV synchronized model picture-in-picture that comprise one or more basic flow paths present the path ".

In this case, to comprise the type of subpath of TS of the ES that is quoted by subpath identical with the TS that comprises at least one ES that is quoted by main path in " in-mux " expression.In other words, in being included in the main TS of main leaf in disconnected, comprising disconnected AV stream of main leaf and sub-segment AV and flow.This type is called as " the multiplexed type of main path transport stream ".

That is, SubPath_type=7 is multiplexed type of (comprising at least one ES) main path transport stream and synchronized model picture-in-picture path.

SubPath_type=8 to 255 keeps.

Among the SubPath_type shown in Figure 49, can use new type, i.e. SubPath_type=5,6 and 7.In SubPath_type=7, be played the main TS that item is quoted, that is, the disconnected AV stream of main leaf comprises the sub-TS that is quoted by subpath.Therefore, replace the stream_entry () that discusses with reference to Figure 17, defined the 3rd stream_entry () shown in Figure 50, wherein, it is different with the type=3 that defines among the stream_entry () in Figure 15 for type=3).

The type=3 of definition is used to discern and is quoted by subpath and the basic stream of the main leaf when being comprised in SubPath_type=7 in disconnected in the 3rd stream_entry ().

In Figure 50, the part similar to the part among Figure 17 do not described.

When type=3, subpath is quoted the identical segment of quoting with main path of segment, in other words, a plurality of basic streams be multiplexed into main leaf disconnected in, and main path and subpath are all quoted these in flowing substantially.In this case, when SubPath_type=7,, specify the disconnected packet ID (PID) of main leaf by ref_to_stream_PID_MainClip for the basic stream of from be multiplexed into a plurality of basic stream of main leaf disconnected, specifying the quilt path to quote.Then, specify SubPath_id by ref_to_SubPath_id, and, specify the subpath that defines among the PlayList () shown in Figure 9 by SubPath_id.From subpath, access corresponding son and play (Figure 10), thereby the playback duration (IN_time and OUT_time) that can specify basic stream (Figure 12).

As discussed above, by (three types of types of service, promptly, Class1 to 3), when providing one to play and when playing at least one subpath that item resets explicitly with this, even when the segment of being quoted by this broadcast item is also quoted by subpath, also can from the segment of being quoted by this broadcast item, specify a basic stream.

By using the SubPath_type shown in Figure 49, promptly, except use is included in SubPath_type=1 to 4 among the SubPath_type among Figure 11, also use the SubPath_type5,6 and 7 that can handle at least one new basic stream, can set up the simple playlist shown in Figure 51, and can replace the playlist of complexity as shown in figure 48 with it, so that realize picture-in-picture techniques (seeing Figure 43).

In the example in Figure 51, the video and the audio frequency that are included in the segment AV stream file of being quoted by the broadcast item 1 that is included in the main path-0 are used as a video flowing and an audio stream respectively.In the example in Figure 43, the video and the audio frequency that are included in the segment AV stream file-0 are corresponding with a video flowing 311 and an audio stream 312 respectively.Video flowing 311 of playback in full screen 301, (output) audio stream 312 of resetting simultaneously.

In STN_table (), define stream_entry () in each in video_stream_id, audio_stream_id, video_stream_id2 and audio_stream_id2.Then, among the stream_entry () in Figure 50, defined type=1, type=2 and type=3, wherein: in type=1, basic stream be comprised in main leaf disconnected in, and specify by main path; In type=2, basic stream is comprised in the sub-segment, and is specified by subpath; In type=3, basic stream be comprised in main leaf disconnected in, and specify by subpath.Therefore, can specify audio stream (audio stream of representing by audio_stream_id) by subpath.Similarly, can specify video flowing (video flowing of representing by video_stream_id) by subpath.But one time video flowing is considered to main AV data, and it is specified by main path.If by video flowing of subpath definition, then only need change or interpolation definition to SubPath_type.

With identical in the example among Figure 48, in the example in Figure 51, secondary video stream and the secondary audio stream reset simultaneously with a video flowing in the segment AV stream file-0 are comprised in the same segment AV stream file-1.

In the example in Figure 51,, used SubPath_type=5, more particularly, used non-multiplexed type of main path transport stream and synchronized model picture-in-picture to present the path as subpath A (SubPath-A) type.Therefore, the son of being quoted by subpath A (SubPath-A) is play (SPI) and can be quoted secondary video stream and the secondary audio stream that is included in the segment AV stream file-1 simultaneously.In the example in Figure 43, the secondary video and the secondary audio frequency that only are included in the segment AV stream file of being quoted by subpath A (SubPath-A)-1 are corresponding with secondary video stream 313 and secondary audio stream 314 respectively.So, playback secondary video stream 313 in sub-screen 302, (output) secondary audio stream 314 of resetting simultaneously.

In this case, if SubPath_type=5 is used as subpath A (SubPath-A), then with secondary video stream 313 and secondary audio stream 314 and video flowing 311 synchronized playback.

In other words, if wish or need secondary video stream 313 and secondary audio stream 314 and video flowing 311 asynchronous playbacks, SubPath_type=6 then, that is, non-multiplexed type of main path transport stream and non-synchronous type picture-in-picture present path (comprising at least one ES) and are selected as subpath A (SubPath-A).

As discussed above, in the example in Figure 51,, only just can realize picture-in-picture techniques with a main path and a subpath (for example, the subpath A among Figure 50) by using the SubPath_type among Figure 49.

More particularly, in order to realize to be included in the picture-in-picture techniques that secondary video in the same segment AV stream file-1 and secondary audio frequency are used separately as secondary video stream 313 and secondary audio stream 314, quote secondary video stream 313 and secondary audio stream 314 by two different subpaths in utilizing the playlist that generate, shown in Figure 48 of the SubPath_type shown in Figure 11.On the contrary, according to utilizing the playlist that generate, shown in Figure 51 of the SubPath_type shown in Figure 49, the secondary video and the secondary audio frequency that are included in the same segment AV stream file-1 can be quoted by a subpath.

Therefore, secondary video can be shared identical information with the secondary audio frequency, as SubPlayItem_IN_time and SubPlayItem_OUT_time.Therefore, can solve the first above-mentioned problem.

In addition, when the playlist among Figure 51 and the playlist among Figure 48 were compared, discovery can be simplified the structure of playlist.Therefore, can solve the second and the 3rd above-mentioned problem.

By using the SubPath_type=7 in the middle of the SubPath_type classification shown in Figure 49, that is, multiplexed type of (comprising at least one ES's) main path transport stream and synchronized model picture-in-picture present the path, can generate playlist shown in Figure 52.Therefore, can realize using the picture-in-picture techniques of the playlist shown in Figure 52 easily.

In the playlist shown in Figure 52, segment AV stream file-0 (it is different with segment AV stream file-0 shown in Figure 51) is comprised among the main TS that is quoted by the broadcast item 1 (PlayItem1) that is included in the main path.Segment AV stream file-0 comprises by playing 1 a main ST who quotes and playing the sub-ST that item is quoted by son.The video (video flowing) and the audio frequency (audio stream) that are included in the main flow are used separately as a video flowing and an audio stream.In the example in Figure 43, the video and the audio frequency that are included in the main ST in the segment AV stream file-0 are corresponding with a video flowing 311 and an audio stream 312 respectively.One time video flowing 311 is reset in full screen 301, (output) audio stream 312 of resetting simultaneously.

In the playlist shown in Figure 52, be included in secondary video and secondary audio frequency in the segment AV stream file-0 among the same main TS respectively with the secondary video reset simultaneously as a video video flowing, main ST stream and secondary audio stream.

In this case, in order to set up playlist shown in Figure 52, SubPath_type=7 is used as the type of subpath A (SubPath-A).Therefore, also can play item and quote two ES in the segment AV stream file of being quoted by main path, be included in main TS-0, as secondary video stream and secondary audio stream by the son of subpath A (SubPath-A).In the example in Figure 43, secondary video and the secondary audio frequency quoted by subpath A (SubPath-A), be included in the segment AV stream file-0 are corresponding with secondary video stream 313 and secondary audio stream 314 respectively, and, secondary video stream 313 can be reset in sub-screen 302, (output) secondary audio stream 314 of resetting simultaneously.That is, in the example in Figure 52, in being included in the main TS of main leaf in disconnected, comprise main flow and son stream.

In Figure 52, as with play 1 subpath that is associated, except subpath A (SubPath-A), also defined subpath B (SubPath-B), be used for quoting the segment AV stream file-1 that is included in the sub-TS different with the main TS that comprises segment AV stream file-0.As discussed above, the reproducing device of present embodiment can read two TS simultaneously.Therefore, this reproducing device can, for example, the video in being included in main TS, audio frequency, secondary video and secondary audio frequency read the PG that is included among the sub-TS.

The example of realizing the needed grammer of picture-in-picture techniques (seeing Figure 43) below has been discussed, that is, and the classification of the SubPath_type in the 7th STN_table () shown in Figure 44 and 45 and Figure 49.

In order to realize picture-in-picture techniques, need have the reproducing device of the function of reset simultaneously video flowing and secondary video stream, for example, reproducing device shown in Figure 53.

Below another example of having used reproducing device of the present invention is described.Reproducing device 401 shown in Figure 53 is similar substantially to the reproducing device 141 shown in Figure 36, has replaced the AV demoder of discussing with reference to Figure 36 151 except the AV demoder 403 shown in Figure 53.Figure 53 is the block diagram of example that shows the configuration of AV demoder 403.The reproducing device 401 that comprises AV demoder 403 can be realized picture-in-picture techniques as shown in figure 47, and, more particularly, reproducing device 401 can be reset in full screen 301 and the corresponding content of being quoted by main path of AV stream, as film, and, can in the sub-screen in being included in full screen 301 302, reset and another corresponding content of AV stream of being quoted by subpath, as director's comment about this film.

Reproducing device 401 shown in Figure 53 can be according to comprising above-mentioned main path and subpath and playlist (for example, the playlist shown in Figure 51 or 52) that realize picture-in-picture techniques carries out replay operations.

In Figure 53, indicate the key element corresponding with identical Reference numeral, and omitted explanation them with the key element among Figure 36.

Reproducing device 401 shown in Figure 53 is equipped with memory driver 22, switch 32 and controller 21, and its function is similar to reproducing device 141 shown in Figure 36 with configuration.But controller 21 has additional function.Below provide the details of additional function.Reproducing device 401 shown in Figure 53 also is equipped with the function AV demoder 403 different slightly with configuration and AV demoder 151.

AV demoder 403 shown in Figure 53 is equipped with the impact damper 51 that has with roughly the same function of AV demoder shown in Figure 36 151 and configuration to hybrid processor 101.In addition, pid filter 411, second Video Decoder 412, the second video plane maker 413 and the prestrain impact damper 414 of not providing for AV demoder 151 is provided AV demoder 403.

In " having function and the configuration roughly the same ", use the reason of term " roughly " as follows with AV demoder shown in Figure 36 151.The function of AV demoder 403 is different slightly with configuration with the function of the AV demoder 151 shown in Figure 36 with configuration, as, Video Decoder 72 and video plane maker 92 have been replaced respectively with first Video Decoder 72 and the first video plane maker 92, and the quantity of the output terminal of pid filter 56 Duos one than the respective filter of the AV demoder 151 shown in Figure 36.

Below only the part AV demoder 403 shown in Figure 53, that be different from the AV demoder 151 shown in Figure 36 is discussed.

More particularly, in order to realize picture-in-picture techniques, need decode to video flowing and secondary video stream.Having first Video Decoder 72 of similar function and configuration and second Video Decoder 412 decodes to video flowing and secondary video stream respectively.The first video plane maker 92 and the second video plane maker 413 that provide 412 that be associated with second Video Decoder respectively, have similar function and configuration with first Video Decoder 72.

Pid filter 411 receives respectively from video flowing pid filter 161, the disconnected AV stream of main leaf or from the video flowing of segment AV stream pid filter 56, child.Then, pid filter 411 is distributed to first Video Decoder 72 or second Video Decoder 412 according to PID (packet ID) with the video flowing of input.More particularly, if video flowing is provided one time, then pid filter 411 offers first Video Decoder 72 with them.If secondary video stream is provided, then pid filter 411 offers second Video Decoder 412 with them.

In the present embodiment, only the video flowing in the disconnected AV stream of main leaf is used as a video flowing, and the video flowing in sub-segment AV not being flowed is as a video flowing.But, consider in the future the video flowing in the sub-segment AV stream is used as a video flowing, pid filter 411 is configured to, make from the video flowing in the sub-segment AV stream of pid filter 56 and also can be provided for first Video Decoder 72.In this case, the audio stream in antithetical phrase segment or main leaf are disconnected carries out playback time, only reset to be included in video flowing in the sub-segment, and the video flowing of the main leaf of not resetting in disconnected.Therefore, pid filter 411 can be configured to, under the situation of not using main leaf disconnected (main path), only utilize sub-segment (subpath) playback of video stream and audio stream.

The interactive graphic stream that the 414 temporary transient storages of prestrain impact damper provide from interactive graphics (IG) demoder 74.As mentioned above, in the present embodiment, reproducing device 401 is limited, make it can only read two TS simultaneously.Therefore, reproducing device 401 has and obtains interactive graphic stream (prestrain they) in advance, so that the function that interactive graphic stream and other stream of prestrain are reset simultaneously.In order to realize this function, arranged prestrain impact damper 414 in the AV demoder 403 shown in Figure 53, so that the interactive graphic stream of storage prestrain, can be up to them by till video flowing or audio stream are reset.

Hereinafter with reference to the process flow diagram in Figure 54 and 55, example to the processing carried out according to picture-in-picture techniques by the reproducing device shown in Figure 53 401 is described, more particularly, to during video flowing of playback, the processing (being designated hereinafter simply as " secondary video stream hand-off process ") of the secondary video stream that switching will be reset is described.

Among the step S101 in Figure 54, controller 21 obtains the sequential list (can be ID) of secondary video stream number and the tabulation that can flow an audio stream, secondary audio stream and the caption stream of combination with secondary video from the 7th STN_table () shown in Figure 44 and 45.

Suppose now, after step S101, under the control of controller 21, according to the tabulation that obtains, generated stream number form as shown in figure 46, and, on display device, presented to the user with the stream number form or according to predetermined pattern user interface (GUI) image that the stream number form generates.Then, processing proceeds to step S102.

In step S102, controller 21 receives from the instruction user, that switch secondary video stream.

More particularly, in step S102, controller 21 is received as the instruction that secondary video stream is switched with reference to Figure 46 and 47 blocked operations that discuss, that undertaken by the user.

In step S103, controller 21 obtains the current combinations of numbers combinations of numbers afterwards of secondary video stream, audio stream, secondary audio stream and a caption stream.

More particularly, if the stream number form shown in Figure 46 is presented to the user, three kinds of combinations of three kinds of secondary video streams, audio stream, secondary audio stream and a caption stream are arranged then, i.e. first to the 3rd combination.First combination is the combination of video 2, audio frequency 2, audio frequency 4 and sprite 3.Second combination is the combination of video 1, audio frequency 1, audio frequency 4 and sprite 1.The 3rd combination is the combination of video 1, audio frequency 1, audio frequency 5 and sprite 1.Now hypothesis with 1,2-1 and 2-2 be as combinations of numbers, distributes to first, second and the 3rd combination respectively.Suppose that also controller 21 receives the instruction of selecting second combination shown in Figure 47.In this case, in step S103, controller 21 obtains 2-1 conduct combinations of numbers subsequently.

In step S104, controller 21 according to stream_attribute () (Figure 18), determine whether it has the function that a plurality of streams that are associated with the number that obtains (in step S104 first handle the number that obtains in step S103) are reset.

More particularly, with regard to the playback of audio stream, if controller 21 receives as instruction selection result in Figure 47, that select second combination, then in step S104, controller 21 determines whether it has the function that audio frequency 1 and audio frequency 4 are reset.

In step S104, can also to about whether providing the function that the stream such as the video flowing of other type are reset to determine.

If in step S104, determine not provide the function that a plurality of streams that are associated with the number that obtains are reset, then handle and proceed to step S105.In step S105, the combinations of numbers that controller 21 obtains subsequently.That is, skip current (not reset) combinations of numbers, and obtain number subsequently.Then, handle and turn back to step S104, and repeating step S104 and S105.That is, the cycling of repeating step S104 and S105 is till the combinations of numbers that obtains to have the audio stream that reproducing device 401 can reset.

If in step S104, determine to provide the function that a plurality of streams that are associated with the number that obtains (among the step S103 in first handles or the number that obtains) are reset in the second step S105 that handles, then handle and proceed to step S106.

In step S106, controller 21 is according to the type of stream_entry (), and the secondary video that is associated with the number that obtains flows to comprising, the segment of audio stream, secondary audio stream and a caption stream is checked.That is, whether each in the 21 pairs of secondary videos of controller stream, audio stream, secondary audio stream and the caption stream is included in the disconnected or sub-segment of main leaf and checks.

In step S107, controller 21 is specified the secondary video stream of wishing, audio stream, secondary audio stream and a caption stream.That is, in step S107, stream in or the sub-segment disconnected at main leaf, that be associated with the number that obtains, hope is specified.

In step S108, controller 21 demanded storage drivers 22 read the secondary video stream of appointment, audio stream, secondary audio stream and a caption stream from the segment that comprises these streams.Perhaps, 21 pairs of local memories 24 of controller send instruction, reading these stream, and they are offered AV demoder 403.If the target segment is recorded on the recording medium 11, then read the stream of appointment the target segment of memory driver 22 on being recorded in recording medium 11.More particularly, read in the stream of appointment among the step S107 the segment of controller 21 demanded storage drivers 22 on being recorded in recording medium 11.

Then, the stream that controller 21 will read offers AV demoder 403, and, also order 403 pairs of secondary video streams of AV demoder, audio stream, secondary audio stream and a caption stream to be reset.More particularly, 412 pairs of secondary video streams of controller 21 order second Video Decoders are decoded, the first audio decoder 75-1 decodes to an audio stream, and the second audio decoder 75-2 decodes to the secondary audio stream, presents 73 pairs of captions of graphic decoder and decodes.

In step S109,403 pairs of secondary video streams of AV demoder, audio stream, secondary audio stream and a caption stream are decoded, and will be through the stream output of decoding.Then, finish processing.

In this case, as mentioned above, for audio stream and secondary audio stream, will be by the audio signal output that audio stream and secondary audio stream are mixed and reset and generate.

As the result of secondary video hand-off process, realized the picture-in-picture techniques of discussing with reference to Figure 43.More particularly, in the example in Figure 43, the video corresponding with video flowing 311 be shown (playback) in full screen 311 simultaneously, in step S109, export, flow 313 corresponding videos with secondary video and be shown (playback) in sub-screen 302, in step S109, export, the captions corresponding with caption stream 315 are shown (playback) precalculated position at full screen 301, and from loudspeaker (not shown) output (playbacks) by audio stream 313 is mixed the sound of generation with secondary audio stream 314.

As discussed above, utilize at the 7th STN_table () shown in Figure 44 and 45, can realize picture-in-picture techniques.

In order to realize picture-in-picture techniques, can use the playlist (seeing Figure 48) of the SubPath_type generation that utilizes shown in Figure 11.But, as mentioned above, utilizing such playlist, the secondary video stream that is included in the same segment AV stream is quoted by different subpaths with the secondary audio stream, that is and, they are defined as different sons and play item.Therefore, as mentioned above, cause the problems referred to above, complicate as the structure of playlist.

As mentioned above, in order to address these problems, can use the SubPath_type classification, SubPath_type classification as shown in Figure 49, make and to quote two or more basic stream in same segment AV stream by a subpath, that is, the two or more ES in the same segment AV stream can be defined as a SPI.

But, viewpoint from play-list creation person (creator), even utilize the SubPath_type shown in Figure 45 to make the structure of playlist become simple, in order to realize picture-in-picture techniques, the founder must determine that still which stream combination may, which stream combination is impossible,, determines to comprise which subpath that is.Therefore, still need to set up simply playlist.

In response to such requirement, the inventor has invented a kind of technology, as, according to the type of playlist, utilize the SubPath_type shown in Figure 49, the subpath (being included in the playlist) that can set up is limited.This technology is called as " subpath restriction technologies ".

According to the subpath restriction technologies, the subpath that can be included in the playlist is limited, this makes which subpath the user can determine to comprise in the playlist, so that create playlist.

Below provide the details of subpath restriction technologies.

In the subpath restriction technologies, the number change of the TS that Limit Type can read simultaneously according to reproducing device.In the present embodiment, as mentioned above, the quantity of the TS that can be read simultaneously is two.Subpath restriction technologies when therefore, the quantity of the TS that can read simultaneously being two is described.

In the present embodiment, playlist roughly can be divided into two types, that is, but browsable slide shows (asynchronous) and motion picture type/time-based lantern slide (synchronous).The type of playlist can be determined according to the application_type among the clip_Information_type that is included in the segment that being played tabulates quotes.

Indicate among the ClipInfo () of application_type in the clip information file of segment.But, in order to simplify description, do not mention the grammer of ClipInfo () here, and, below with reference to Figure 56, only the application_type that indicates in ClipInfo () is discussed.

That is, Figure 56 shows the example of the classification of application_type.

In Figure 56, application_type=0 is retained.Application_type=1 is used to be used for the main TS of film applications.Main TS is a transport stream, the broadcast item of quoting as the main path that is played in the tabulation.Application_type=2 is used to be used for the main TS of time-based lantern slide, promptly is used for the main TS of image lantern slide.But application_type=3 is used to be used for the main TS of browsable slide shows, promptly is used for the main TS of video lantern slide.

But application_type=4 is used to be used for the subpath TS of browsable slide shows, it is indicated among the ClipInfo (), this ClipInfo () is used for, and for example, comprises the segment AV stream with BGM (sound) data of the asynchronous playback of application_type=3.Application_type=5 is used to be used for the subpath TS of interactive graphics (IG).Application_type=6 is used to be used for the subpath TS of text subtitle (text subtitle data).Application_type=7 is used to comprise the subpath TS of at least one ES (basic stream).Application_type=8 to 255 keeps.

From recording medium 11, perhaps, obtain the segment AV stream file to the application_type=6 representative by memory driver 22 by application_type=1 from local memory 24.On the contrary, only do not pass through the segment AV stream file that memory driver 22 obtains by the application_type=7 representative from recording medium 11 from local memory 24.

In the present embodiment, in the application_type among the ClipInfo () that is illustrated in the main TS that is quoted by playlist, during application_type=3, but playlist is classified as browsable slide shows (non-synchronous type).Among the application_type in being illustrated in ClipInfo (), PlayList=1 or 2 o'clock, playlist is classified as motion picture type/time-based lantern slide (synchronous).

In this case, according to the type (asynchronous or synchronous) of playlist, the subpath that can offer playlist is limited to the subpath shown in Figure 57.Such restriction is applied by the subpath restriction technologies.

The subpath number that the left side of Figure 57 is represented has indicated such subpath number, and the type of this subpath is indicated among the SubPath_type that provides for main TS.

The number of representing among the number of representing in SubPath_type (classification of SubPath_type) and the SubPath_type shown in Figure 49 is corresponding.

Shown in Figure 57, when the type of playlist is non-synchronous type, promptly when the type of playlist for having (main TS's) but during the browsable slide shows of application_type=3, only allow the subpath of (1) at least 0 SubPath_type=2 or the subpath of (2) at least 0 SubPath_type=3.In other words, forbid subpath outside above-mentioned (1) and (2) subpath.

In the combination of (2),, forbid that then such subpath (sees among Figure 57 if the main TS of application_type=3 comprises interactive graphic stream (IG) ^*2).Its reason is as follows.

From the viewpoint of IG, comprise that the playlist of IG is divided into the first kind and second type substantially.In first kind playlist, IG is multiplexed among the main TS, and IG resets simultaneously with the audio or video stream that is included among the main TS.In the second type playlist, IG is included in the subpath with SubPath_type=3, and IG is by prestrain (it is used to popup menu).For the second type playlist of resetting, as mentioned above, arrange prestrain impact damper 414 in the reproducing device 401 shown in Figure 53.

Owing to an IG demoder is provided only for the reproducing device of present embodiment, more particularly,, therefore, has applied following restriction owing to single IG demoder 74 is provided for reproducing device 401.In first kind playlist, when the IG demoder is decoded to the IG among the main TS, can not another IG of prestrain.In the second type playlist, when being imported into the IG demoder, second IG from another main TS can not be input in the IG demoder by first IG of prestrain.

For above-mentioned reasons, applied such restriction, made not allow to comprise that playlist STN_table (), that the IG that is multiplexed among the main TS is quoted has the subpath of SubPath_type=3.Under such restriction,, forbid that then such subpath (sees among Figure 57 if IG is comprised among the main TS of application_type=3 ^*2).

When the type of playlist is wheel synchronization type, promptly, when the type of playlist is the film types/time-based lantern slide of application_type=1 or 2, only allow subpath, the subpath of (4) at least 0 SubPath_type=4, the subpath of (5) at least 0 SubPath_type=5, the subpath of (6) at least 0 SubPath_type=6 or the subpath of (7) 0 or 1 SubPath_type=7 of (3) at least 0 SubPath_type=3.In other words, the subpath of forbidding SubPath_type=2.

In the combination of (3), if the main TS of application_type=3 comprises IG, perhaps, if the TS that is quoted by the subpath of SubPath_type=5 comprises IG, then such subpath is under an embargo and (sees among Figure 57 ^*1).This also is because above-mentioned restriction.

In addition, in the present embodiment, as mentioned above, can be played the quantity of the segment that tabulation quotes simultaneously, that is, the quantity of the TS that can be read simultaneously by reproducing device is two to the maximum.Therefore, in order to guarantee to be comprised in by the ES that same playlist is quoted simultaneously in maximum two segments, that is, the ES quilt that can be reset simultaneously two segment AV stream files is at the most quoted, utilize the subpath restriction technologies to apply such restriction, thereby meet the following conditions.

Apply by the subpath restriction technologies, to be used for condition that primary_video_stream, primary_audio_stream, the PG_textST_stream that is different from text subtitle stream, the IG_stream that is different from the IG that is used for popup menu, secondary_video_stream and the secondary_audio_stream that quoted by STN_table () are made up as follows.

In by the ES of primary_video_stream_number appointment, by the ES of primary_audio_stream_number appointment, by the ES of PG_textST_stream_number appointment, by the ES of IG_stream_number appointment, ES and the ES by the secondary_audio_stream_number appointment by the secondary_video_stream_number appointment, the combination of the stream that can be reset simultaneously should be stored in two segment AV stream files at the most of being quoted by playlist.

The ES that can quote by STN_table () by three or more segment AV stream file stores, still, the ES that can be reset simultaneously be stored in these segments AV stream file at the most in two.

The subpath restriction technologies has also applied such restriction, the combination of the quantity of make playing and the quantity of subpath be necessary for following combination (a) and (b) and (c) in one.Combination (a) is for having only one to play (top line among Figure 58), combination (b) is one and plays an item and a subpath (middle row among Figure 58), combination (c) is one and plays item, a subpath and a Sub Path=7, that is, play item and two subpaths (in the subpath should be Sub_Path=7) (bottom line among Figure 58) for one.

In one type subpath restriction technologies, the type (SubPath_type) of the subpath that can create according to the type of playlist is limited.

In other words, the subpath restriction technologies comprises such condition (restriction), as the type of playlist (in above-mentioned example, type by the application_type of main TS representative), the quantity (being two in above-mentioned example) of the TS that can be read simultaneously by reproducing device, and to whether be comprised among the ES that the subpath that is played tabulation quotes (in this example, whether subpath is SubPath_type=3) by the IG of prestrain.In order to satisfy these conditions, the subpath that is included in the playlist is determined the result creates the playlist that comprises these subpaths.

Following with reference to Figure 59 to 62, provide object lesson by the playlist of subpath restriction technologies establishment.

But Figure 59 shows the playlist (non-synchronous type) of the browsable slide shows that does not have SubPath_type=3,, comprises the playlist of the subpath 3 of subpath 1 to SubPath_type=2 that is.Because IG is comprised in by playing item 1 and playing in the 2 segment AV stream file-0 of quoting (that is, main TS), therefore, SubPath_type=3 is not included in the playlist., therefore, be included in the video flowing storing static image data in the segment AV stream file-0 because but the playlist in this example is the browsable slide shows that is shown a plurality of rest images by user's order.

Utilize following condition (restriction) to create the playlist shown in Figure 59, these restrictions are: only allow the subpath of the subpath of (1) at least 0 SubPath_type=2 or (2) at least 0 SubPath_type=3 and forbid the different subpath of subpath with (1) or (2); And,, forbid that then the subpath of SubPath_type=3 (is seen among Figure 57 if IG is comprised among the main TS of applicatio_type=3 ^*2).

Opposite with the example among Figure 59, but Figure 60 shows the playlist (non-synchronous type) of the browsable slide shows with SubPath_type=3, that is the playlist that, comprises the subpath 3 of the subpath 2 of subpath 1 and SubPath_type=2 and SubPath_type=3.Be not played item 1 and play 2 a segment AV stream file-0 of quoting (promptly because IG is included in, main TS) in, therefore, SubPath_type=3 is comprised in the playlist, and SubPath_type=3 is used to quote the IG that is included in the segment AV stream file-3 different with segment AV stream file-0.

The condition (restriction) that is used to create the playlist shown in Figure 60 is identical with the condition that is used to create the playlist shown in Figure 59 (restriction).

In other words, must be subjected to by among Figure 57 ^*2 expressions, promptly, the example of the playlist of the restriction of expression is the example among Figure 59 in " (2) subpath; if the main TS of applicatio_type=3 comprises IG; the subpath of then such SubPath_type=3 is under an embargo ", and the example that needn't be subjected to the playlist of this restriction is the example among Figure 60.

As mentioned above, but Figure 59 and 60 shows the example (non-synchronous type) of the playlist of browsable slide shows.On the contrary, Figure 61 and 62 shows the example of the playlist of motion picture type/time-based lantern slide (synchronized model).

More particularly, Figure 61 shows a kind of synchronized model playlist, wherein, secondary video stream and secondary audio stream are not multiplexed into main TS (promptly, segment AV stream file-0) in, that is, comprises the playlist of the subpath 2 of subpath 1 and SubPath_type=5.

It below is the restriction (condition) that is used to create the playlist shown in Figure 61.That is, utilize the condition of in Figure 57, describing, (6) " allow the subpath of at least 0 SubPath_type=6 " (restriction), create the playlist shown in Figure 61.

Opposite with the example among Figure 61, Figure 62 shows a kind of synchronized model playlist, wherein, be played the main TS that tabulation is quoted, promptly, segment AV stream file-0 comprises main ST and sub-ST, and secondary video stream (secondary video) and secondary audio stream (secondary audio frequency) are multiplexed in the segment AV stream file-0 that constitutes main TS.Therefore, playlist comprises the subpath 1 of SubPath_type=7 and subpath 2 and the subpath 3 of SubPath_type=5.

It below is the restriction (condition) that is used for creating the playlist shown in the example of Figure 62.That is, utilize condition: (5) " allow the subpath of at least 0 SubPath_type=5 " and (7) " allow the subpath of 0 and one SubPath_type=7 ", create the playlist shown in Figure 62.

Also can reset by the playlist that above-mentioned subpath restriction technologies is created by the reproducing device shown in Figure 53 401.

For example, the reproducing device 401 non-synchronous type playlist of resetting as follows, that is, but the playlist with browsable slide shows of applicatio_type=3.If playlist is quoted the subpath (interactive graphics (IG) presents menu) of at least one SubPath_type=3, then before this playlist of resetting, reproducing device 401 is with the segment AV stream of SubPath_type=3, promptly, interactive graphic stream is pre-loaded in the prestrain impact damper 414.If playlist is quoted the subpath of at least one SubPath_type=2, then only can be quoted one by one owing to subpath, therefore, reproducing device 401 is quoted predetermined subpath (SubPath_type=2) and is reset its (quantity of the TS that can be read simultaneously is two, and a main TS who is quoted by main TS in them).

Interactive graphics (IG) presents menu and comprises two menus, that is, can by user ON/OFF operation show or the popup menu wiped and be shown always often open (always-on) menu.Following process flow diagram with reference to Figure 63 and 64 provides the example of the details that the playback of the playlist that is used for applicatio_type=3 handles.

Reproducing device 401 to the playlist of synchronized model, that is, has the playlist of the motion picture type/time-based lantern slide of the segment of applicatio_type=1 or 2 as follows, resets.If playlist is quoted the subpath of at least one SubPath_type=3 or 4, promptly, interactive graphic stream or text subtitle stream, before this playlist of resetting, reproducing device 401 flows segment AV, that is, SubPath_type=3 or 4 interactive graphic stream or text subtitle stream are pre-loaded in prestrain impact damper 414 or the impact damper 54.If playlist is quoted the subpath of at least one SubPath_type=5 or 6, then only can be quoted one by one owing to subpath, therefore, reproducing device 401 is quoted predetermined subpath (SubPath_type=5 or 6) and is reset its (quantity of the TS that can be quoted simultaneously is two, and a main TS who is quoted by main path in them).But, if be included in the subpath that subpath in the playlist comprises at least one SubPath_type=7, then because the subpath of SubPath_type=7 is quoted the ES that is included among the main TS, therefore, reproducing device 401 can be quoted the subpath of a SubPath_type=7 and reset it in the subpath of a SubPath_type=5 or 6 of resetting.

Following with reference to Figure 65 to 68, provide the example of the details that the playback of the playlist that is used for applicatio_type=1 or 2 handles.

Following with reference to Figure 63 and 64, the example that the playback of the playlist of the segment that is used to comprise applicatio_type=3 is handled is described.

Applicatio_type among the ClipInfo () that is included in Clip_information that 21 pairs of controllers shown in Figure 53 are quoted by the main path of playlist checks, and, if find applicatio_type=3, then begin the processing of resetting of the playlist of applicatio_type=3.

Among the step S121 in Figure 63, controller 21 determines whether main TS comprises IG (interactive graphic stream).

If determine that in step S121 main TS does not comprise IG, then handle the step S126 that proceeds among Figure 64.The back is described step S126 and step subsequently.

If determine that in step S121 main TS comprises IG, then handle proceeding to step S122.

In step S122, determine whether the subpath of any SubPath_type=3.

If in step S122, determine not have the subpath of SubPath_type=3, then handle and proceed to step S126.The back is described for step S126 and step subsequently.

If in step S122, define the subpath of SubPath_type=3, then handle and proceed to step S123.In step S123,21 pairs of segments of being quoted by selecteed subpath (subpath of SubPath_type=3) of controller are checked.

Then, controller 21 demanded storage drivers 22 read the stream by the subpath appointment from segment, that is, and and IG.In response to this instruction, memory driver 22 reads IG.Perhaps, controller 21 reads IG from local memory 24.Then, 74 couples of IG of controller 21 command interaction graphic decoders decode.Then, processing proceeds to step S124.

Then, in step S124,74 couples of IG of interactive graphics (IG) demoder decode.Then, in step S125, interactive graphics (IG) demoder 74 will be stored in the prestrain impact damper 414 through the IG of decoding.

After step S125, perhaps,, then handle and proceed to step S126 if step S121 or S122 are output as NO.

In step S126, determine whether the subpath of any SubPath_type=2.

If in step S126, determine not have the subpath of SubPath_type=2, then handle and proceed to step S129.The back is described step subsequently.

If in step S126, define the subpath of SubPath_type=2, then handle and proceed to step S127.In step S127,21 pairs of segments of being quoted by selecteed subpath (subpath of SubPath_type=2) of controller are checked.

Then, controller 21 demanded storage drivers 22 read the stream by the subpath appointment from segment, that is, and and audio stream.In response to this instruction, memory driver 22 reads audio stream.Perhaps, controller 21 reads audio stream from local memory 24.Then, the controller 21 orders second audio stream demoder 75-2 decodes to audio stream.Then, processing proceeds to step S128.

Then, in step S128, the second audio stream demoder 75-2 decodes to the audio stream that reads.

After step S128, perhaps,, handle proceeding to step S129 if step S126 is output as NO.

In step S129, the disconnected AV stream of 403 pairs of main leaves of AV demoder is decoded.The disconnected AV stream of main leaf comprises video flowing or the audio stream of being quoted by the main path of the playlist that will reset, and the disconnected AV stream of main leaf is comprised among the main TS.First Video Decoder 72 or the first audio decoder 75-1 execution in step S129.

In step S130, AV demoder 403 will flow the subpath stream of decoding with process through the disconnected AV of the main leaf of decoding and make up, and will export through the stream of combination.Decoded and in step S125, be stored in IG in the prestrain impact damper 414 in step S124 through the subpath stream of decoding, or decoded audio stream among the step S128 in Figure 64.

In step S131, controller 21 determines in the stream that output is made up, whether (user) has sent the instruction of the subpath that switches SubPath_type=2 in step S130.

If in step S131, determine to have sent the instruction of switching the subpath of SubPath_type=2, then handle and turn back to step S127, and repeating step S127 and step subsequently.That is, to switching with the audio stream of the disconnected AV stream of main leaf combination.

If in step S131, determine not send the instruction of the subpath that switches SubPath_type=2, then finish playback processing to the playlist of applicatio_type=3.

Following with reference to Figure 65 to 68, the example that the playback of the playlist of the segment that is used to comprise applicatio_type=1 or 2 is handled is described.

21 pairs of controllers shown in Figure 53 are checked by the applicatio_type of the segment that the main path of the playlist that will be reset is quoted, and, if finding it is applicatio_type=1 or 2, then controller 21 begins the processing of resetting of the playlist of applicatio_type=1 or 2.

Among the step S141 in Figure 65, controller 21 determines whether main TS comprises IG.

If determine that in step S141 main TS does not comprise IG, then handle proceeding to step S146.The back is described step S146 and step subsequently.

If determine that in step S141 main TS comprises IG, then handle proceeding to step S142.

In step S142, controller 21 determines whether the subpath of any SubPath_type=3.

If in step S142, determine not have the subpath of SubPath_type=3, then handle and proceed to step S146.The back is described for step S146 and step subsequently.

If in step S142, define the subpath of SubPath_type=3, then handle and proceed to step S143.In step S143,21 pairs of segments of being quoted by selecteed subpath (subpath of SubPath_type=3) of controller are checked.

Then, controller 21 demanded storage drivers 22 read the stream by the subpath appointment from segment, that is, and and IG.In response to this instruction, memory driver 22 reads IG.Perhaps, controller 21 reads IG from local memory 24.Then, 74 couples of IG of controller 21 command interaction graphic decoders decode.Then, processing proceeds to step S144.

In step S144,74 couples of IG of interactive graphics (IG) demoder decode.Then, in step S145, interactive graphics (IG) demoder 74 will be stored in the prestrain impact damper 414 through the IG of decoding.

After step S145, perhaps,, handle proceeding to step S146 if step S141 or S142 are output as NO.

Controller 21 determines whether the subpath of any SubPath_type=4.

If in step S146, determine not have the subpath of SubPath_type=4, then handle and proceed to step S149.The back is described step S149 and step subsequently.

If in step S146, define the subpath of SubPath_type=4, then handle and proceed to step S147.In step S147,21 pairs of segments of being quoted by selecteed subpath (subpath of SubPath_type=4) of controller are checked.

Then, controller 21 demanded storage drivers 22 read the stream by the subpath appointment, that is, and and text subtitle stream.In response to this instruction, memory driver 22 reads text subtitle stream.Perhaps, controller 21 reads text subtitle stream from local memory 24.Then, 76 pairs of text subtitle streams that read of controller 21 order text-ST compositors are decoded.Then, processing proceeds to step S148.

In step S148,76 pairs of text subtitle streams that read of text-ST compositor are decoded.

After step S148, perhaps,, handle the step S149 that proceeds among Figure 66 if step S146 is output as NO.

Then, controller 21 determines whether the subpath of any SubPath_type=7.

If in step S149, determine not have the subpath of SubPath_type=7, then handle and proceed to step S152.The back is described step S152 and step subsequently.

If in step S149, define the subpath of SubPath_type=7, then handle and proceed to step S150.In step S150,21 pairs of segments of being quoted by selecteed subpath (subpath of SubPath_type=7) of controller are checked.

Then, controller 21 demanded storage drivers 22 read the stream by the subpath appointment, that is, and and video/audio stream.In response to this instruction, memory driver 22 reads video/audio stream.Perhaps, controller 21 reads video/audio stream from local memory 24.Then, controller 21 order second Video Decoders 412 or the second audio decoder 75-2 decode to the video/audio stream that reads.Then, processing proceeds to step S151.

In step S151, second Video Decoder 412 or the second audio decoder 75-2 decode to the video/audio stream that reads.

After step S151, perhaps,, handle the step S152 that proceeds among Figure 67 if step S149 is output as NO.

Then, controller 21 determines whether the subpath of any SubPath_type=5.

If in step S152, determine not have the subpath of SubPath_type=5, then handle and proceed to step S156.The back is described step S156 and step subsequently.

If in step S152, define the subpath of SubPath_type=5, then handle and proceed to step S153.In step S153, the segment that 21 pairs of selecteed subpaths of controller (subpath of SubPath_type=5) are quoted is checked.

Then, in step S154, controller 21 is the stream_attributes () among Figure 18 by reference, determines whether to have the function that the audio stream that is included in the segment is reset.

If in step S154, determine not provide the function that audio stream is reset, then handle proceeding to step S156.The back is described step S156 and step subsequently.

If determine to provide the function that audio stream is reset in step S154, then controller 21 demanded storage drivers 22 read the stream by the subpath appointment from segment, that is, and and audio stream.In response to this instruction, memory driver 22 reads audio stream.Perhaps, controller 21 reads audio stream from local memory 24.Then, the controller 21 orders second audio decoder 75-2 decodes to the audio stream that reads.Then, processing proceeds to step S155.

In step S155, the second audio decoder 75-2 decodes to the audio stream that reads.

After step S155, perhaps,, handle proceeding to step S156 if step S152 or S154 are output as NO.

In step S156, controller 21 determines whether the subpath of any SubPath_type=6.

If in step S156, determine not have the subpath of SubPath_type=6, then handle and proceed to step S161.The back is described step S161 and step subsequently.

If in step S156, define the subpath of SubPath_type=6, then handle and proceed to step S157.In step S157,21 pairs of segments of being quoted by selecteed subpath (subpath of SubPath_type=6) of controller are checked.

In step S158, controller 21 is the stream_attributes among Figure 18 by reference, determines whether to have the function that the audio stream that is included in this segment is reset.

If determining in step S158 does not provide the function that this audio stream is reset, then controller 21 demanded storage drivers 22 read the video flowing by the correspondence of subpath appointment from segment.In response to this instruction, memory driver 22 reads video flowing from segment.Perhaps, controller 21 reads video flowing from local memory 24.In this case, controller 21 is forbidden audio stream is decoded, and, order 412 pairs of video flowings of second Video Decoder to be decoded.Then, processing proceeds to step S160.The back is described step S160 and step subsequently.

If determine to provide the function that the audio stream that is included in this segment is reset in step S158, then controller 21 demanded storage drivers 22 read the stream by the subpath appointment from segment, that is, and and video flowing and audio stream.In response to this instruction, memory driver 22 reads video flowing and audio stream.Then, the controller 21 orders second audio decoder 75-2 decodes to the audio stream that reads, and 412 pairs of video flowings that read of second Video Decoder are decoded.Then, processing proceeds to step S159.

In step S159, the second audio decoder 75-2 decodes to the audio stream that reads.

After step S159, perhaps,, handle proceeding to step S160 if step S158 is output as NO.

In step S160,412 pairs of video flowings that read of second Video Decoder are decoded.

After step S160, perhaps,, handle the step S161 that proceeds among Figure 68 if step S156 is output as NO.

In step S161, the disconnected AV stream of 403 pairs of main leaves of AV demoder is decoded.The disconnected AV stream of main leaf comprises video flowing or the audio stream of being quoted by the main path of the playlist that will be reset, and the disconnected AV stream of main leaf is comprised among the main TS.In picture-in-picture techniques, the disconnected AV stream of main leaf is a video flowing or an audio stream.That is, first Video Decoder 72 of AV demoder 403 or the first audio decoder 75-1 execution in step S161.

In step S162, AV demoder 403 will make up through the subpath stream that the disconnected AV of the main leaf of decoding flows and process is decoded, and exports the stream that process makes up.Be included among the step S144 among Figure 65 decoded and in step S145, be stored in IG in the prestrain impact damper 414 through the subpath stream of decoding, decoded text subtitle among the step S148 in Figure 65, decoded audio stream among the step S151 in Figure 66, decoded audio stream among the step S155 in Figure 67, among the step S159 in Figure 66 among decoded audio stream and the step S160 in Figure 66 in the middle of the decoded video flowing, at least 0 sub-path flow.

In step S163, controller 21 determines whether (user) has sent the instruction of switching subpath in the stream that output is made up in step S162.

If in step S163, determine the instruction do not switch subpath, then be used for the finishing dealing with of playlist of application_type=1 or 2.

If in step S163, determine to have sent the instruction of switching subpath, then handle and proceed to step S164.

In step S164,21 couples of SubPath_type by the subpath of switching command selection of controller check.More particularly, if from least one secondary_audio_stream (audio_stream_id2) or secondary_video_stream (video_stream_id2) of among STN_table, defining, specific secondary_audio_stream or secondary_video_stream have been selected, then controller 21 is checked the stream clauses and subclauses (stream entry) that are associated with the secondary_audio_stream or the secondary_video_stream of appointment according to STN_table ().Then, controller 21 bases are recorded in the ref_to_SubPath_id in the stream clauses and subclauses, SubPath_id is checked, and according to the subpath of PlayList () among SubPath_id appointment Fig. 9, and according to the acquisition of the SubPath () among Figure 10 SubPath_type.

In step S165, whether the result of controller 21 determining step S164 is SubPath_type=3.

If in step S165, determine SubPath_type=3, then handle the step S143 that turns back among Figure 65.That is, to switching with the disconnected AV stream of main leaf combined I G.

If the result of determining step S164 is not SubPath_type=3 in step S165, then handles and proceed to step S166.

In step S166, whether the result of controller 21 determining step S164 is SubPath_type=4.

If in step S166, determine SubPath_type=4, then handle turning back to step S147, and repeating step S147 and subsequent step.That is, to switching with the text subtitle of the disconnected AV stream of main leaf combination.

If the result of determining step S164 is not SubPath_type=4 in step S166, then handles and proceed to step S167.

In step S167, whether the result of controller 21 determining step S164 is SubPath_type=7.

If in step S167, determine SubPath_type=7, then handle turning back to step S150, and repeating step S150 and subsequent step.That is, to switching with the video/audio stream of the disconnected AV stream of main leaf combination.

If the result of determining step S164 is not SubPath_type=7 in step S167, then handles and proceed to step S168.

In step S168, whether the result of controller 21 determining step S164 is SubPath_type=5.

If in step S168, determine SubPath_type=5, then handle the step S153 that turns back among Figure 67 and repeating step S153 and subsequent step.That is, to switching with the audio stream of the disconnected AV stream of main leaf combination.

If the result of determining step S164 is not SubPath_type=5 in step S168, then handles and proceed to step S169.

In step S169, whether the result of controller 21 determining step S164 is SubPath_type=6.

If in step S169, determine SubPath_type=6, then handle the step S157 that turns back among Figure 67 and repeating step S157 and subsequent step.That is, to switching with the audio stream or the video flowing of the disconnected AV stream of main leaf combination.

If the result of determining step S164 is not SubPath_type=6 in step S169, then the playback processing to the playlist of application_type=1 or 2 finishes.

As discussed above, in order to realize utilizing the application of picture-in-picture techniques, need the combination of the stream that will reset with a video flowing be defined, that is, the combination of secondary video stream, audio stream, secondary audio stream and a caption stream is defined.

By multiple combination is defined, not only can switch a video flowing and audio stream of in full screen 301, resetting easily, and can switch secondary video stream, secondary audio stream or the caption stream of in sub-screen 302, resetting easily.

Hereinafter with reference to Figure 69 and 70, to with Figure 44 another example similar with the 7th STN_table () shown in 45, that be used for the STN_table () that the combination to the stream that can reset with a video flowing defines, that is, the 8th STN_table () discusses.

More particularly, Figure 69 and 70 shows the grammer of the 8th STN_table (), be used for the combination of secondary video stream, audio stream, secondary audio stream and a caption stream is defined, more particularly, combination, the secondary video stream that is used for a secondary audio stream and an audio stream defines with the combination that picture-in-picture application presents figure or text subtitle with the combination and the secondary video stream of secondary audio stream.The playback of the 8th STN_table () execution is handled also and can be carried out by the reproducing device shown in Figure 52 401 by reference.For fear of repetition, in Figure 69 and 70, not to describing to Figure 44 part similar with the part in 45.

8 number_of_audio_stream2_entries field list is shown in the number of the secondary audio stream of registration among the STN_table ().

By audio_stream2_number=audio_stream2_id+1, can determine the number of secondary audio stream.

8 number_of_video_stream2_entries field list is shown in the number of the secondary video stream of registration among the STN_table ().

By video_stream2_number=video_stream2_id+1, can determine the number of secondary video stream.

In the stream_entry of each video_stream2_id () piece, the type field should be set to 2.

8 number_of_PiP_PG_textST_stream_entries is illustrated in the PiP application PG of registration among the STN_table () or the number of text subtitle stream.

By PiP_PG_textST_stream_number=PiP_PG_textST_stream_id+1, can determine that PiP uses the number of PG (presenting figure) or text subtitle stream.

Comb_info_secondary_audio_primary_audio () piece is represented the combination of a secondary audio stream and an audio stream.

In comb_info_secondary_audio_primary_audio () piece, 8 number_of_audio_stream_ref_entries field represent can with the number of an audio stream of secondary audio stream combination.8 audio_stream_id_ref represent can with the ID of an audio stream of secondary audio stream combination.

Comb_info_secondary_video_secondary_audio () piece is represented the combination of secondary video stream and secondary audio stream.

In comb_info_secondary_video_secondary_audio () piece, 8 number_of_audio_stream2_ref_entries represents to flow with secondary video the number of the secondary audio stream of combination.8 audio_stream_id2_ref field represents to flow with secondary video the ID of the secondary audio stream of combination.

Comb_info_secondary_video_PiP_PG_textST () piece is represented the combination of secondary video stream and picture-in-picture application PG or text subtitle stream.

In comb_info_secondary_video_PiP_PG_textST () piece, 8 number_of_PiP_PG_textST_ref_entries field represents to use with the PiP of secondary video stream combination the number of PG or text subtitle stream.8 PiP_PG_textST_id_ref field represents to use with the PiP of secondary video stream combination the ID of PG or text subtitle stream.

With the same, can replace ID with corresponding number at the STN_table () shown in Figure 35,41,42,44 and 45.For example, can replace audio_stream_id with audio stream number (audio_stream_number), perhaps, 2 (audio_stream_number2) replace audio_stream_id2 with the audio stream number.Identical situation goes for video flowing and caption stream.

According to Figure 69 and 70, can to the combination of the combination of a secondary audio stream and an audio stream, secondary video stream and secondary audio stream and secondary video stream and PiP use PG or text subtitle stream combination define.

Therefore, except can flowing (#2 video flowing), an audio stream (#1 audio stream), secondary audio stream (#2 audio stream) and caption stream (PG TextST stream) with the secondary video that a video flowing (#1 video flowing) is reset simultaneously, inconsistent combination is not defined, as the combination that can make up with the picture-in-picture application PG/ text subtitle stream (PiP PGTextST stream) that a video flowing (#1 video flowing) is reset simultaneously.

In reproducing device 401, but in the part rewritable memory region of storer 23, arranged a plurality of registers, and, the processing of resetting carried out according to the value of in these registers, setting.

Do not change be set in some register, with reproducing device 401 the exclusive relevant value of function, for example, the value whether expression reproducing device 401 can playback of audio streams #2.On the contrary, in response to from user's operation input or the navigation command that generates by Navigator, change the value of in predetermined register, setting.

Navigation command and flow data can be recorded on recording medium or the built-in hard disk dividually, then, carry out prestrain by 401 pairs of navigation command of reproducing device, and offer controller 21.Perhaps, can navigation command be recorded on recording medium or the built-in hard disk, then, when the playback stream data, load by 401 pairs of navigation command of reproducing device, and offer controller 21 by navigation command is embedded in the flow data.

In register, stored and be used for reproducing device 401 and reset and handle the value of needed various settings.Best, comprise down column register: the register that the caption stream (PG TextST stream) of being reset by reproducing device 401 is defined, the register that the picture-in-picture application PG that reset by reproducing device 401 or text subtitle stream (PiP PG TextST stream) are defined, expression is by the register of the ID of the caption stream (PG TextST stream) of reproducing device 401 playbacks, expression is by the register of the language codes (or ID) of the caption stream of reproducing device 401 playbacks, the register of the code number (or ID) of the country that the register of the ID of expression initial setting language and expression are corresponding with the caption stream of being reset by reproducing device 401.

When the beginning picture-in-picture application, consider viewability (viewability), reproducing device 401 can only show in caption stream (PG TextST stream) or picture-in-picture application PG or the text subtitle stream (PiP PG TextST stream).Perhaps, reproducing device 401 can be with caption stream (PGTextST stream), and perhaps, picture-in-picture application PG or text subtitle stream (PiP PG TextST stream) show together.

Following with reference to Figure 71, the example of register is described.When beginning during picture-in-picture application, register is used to determine reproducing device 401 (demonstration) caption stream (PGTextST stream) (PG TextST stream is not used in picture-in-picture application) of whether resetting.This register can also be determined by reference, if playback PG TextST stream, which stream of resetting so.Another register is used to determine whether to reset picture-in-picture application PG or text subtitle stream (PiP PG TextST stream).This register can also be determined by reference, if playback picture-in-picture application PG or text subtitle stream, which stream of resetting so.

More particularly, the #1 register is the register of the id number of a PG TextST stream of expression.That is, the #1 register represents to be registered in PG TextST stream in the middle of the PG TextST stream among the current STN_table () who plays, that will be reset.

In the #1 register,,, then show PG TextST stream one time if disp_flag represents 1 if disp_flag (display_flag) expression 0 does not then show PG TextST stream one time.In the #1 register, PG TextST stream number is the id number that is registered in a PG TextST stream among the STN_table () of current PlayItem ().

Then, the #2 register is the register of the id number of expression picture-in-picture application PG TextST stream.

In the #2 register, if disp_flag represents 0, then do not show picture-in-picture application PGTextST stream, if disp_flag represents 1, then show picture-in-picture application PG TextST stream.Picture-in-picture application PG TextST stream number represents to be registered in the id number of the picture-in-picture application PG TextST stream among the STN_table () of current PlayItem ().When invalid_flag represented 0, the id number of PiP application PG TextST stream was effective, and when invalid_flag represented 1, the id number of picture-in-picture application PG TextST stream was invalid.

If 0xFF is registered in the PG TextST stream number, then PG TextST flows not selected or does not exist.If 0xFF is registered in PiP and uses in the PG TextST stream number, then picture-in-picture application PG TextST flows not selected or does not exist.

Even the value beyond the 0xFF is registered in PG TextST stream number or PiP uses in the PGTextST stream number,, can determine to show the validity of corresponding stream according to the combination of inValid_flag and disp_flag.That is, when the disp_flag of #1 or #2 register represents 0, that is, when showing that corresponding stream is invalid, always do not use the 0xFF that sets in the PG TextST stream number in PG TextST stream number or PiP.More particularly, when the disp_flag of #1 or #2 register represents 0, promptly, when showing that corresponding stream is invalid, the value (being different from 0xFF) that is registered in PG TextST stream number or the PiP application PG TextST stream number is left in the basket, and, do not show corresponding stream.

Be set in the value in these registers by reference, can in reproducing device 401, carry out the playback that is used for corresponding stream and handle.

For example, suppose that reproducing device 401 can only show in caption stream (PG TextST stream) or the picture-in-picture application PG TextST stream (PiP PG TextST stream) when the beginning picture-in-picture application.In this case, when not carrying out the PiP demonstration, more particularly, when the disp_flag of #1 register be 1 and the invalid_flag of #2 register be 1 or to the demonstration of secondary video when invalid, to be set in the #1 register in a PG TextST stream being associated of PG TextST stream number reset.When changing the value of #1 register, the replay operations state of a PG TextST stream changes immediately.

If the PG TextST stream number of #1 register be registered in PG TextST stream number among the STN_table () of PlayItem () when inconsistent, flow automatic option program by PG TextST, the PG TextST stream that selection will be reset.

According to automatic option program, at first the register of the language that can be shown by reproducing device 401 expression and the language that can not be shown by reproducing device 401 is checked, so that preferential the selection and can be by the language that reproducing device 401 shows corresponding stream.Then, the preferential selection and the corresponding stream of in reproducing device 401, setting of language codes, then, and according to ascending, the preferential number of selecting to be registered among the STN_table ().

When showing that secondary video is effective, when the disp_flag in the #2 register represents 1 and invalid_flag when representing 0, and the id number that the PiP in being deposited with the #2 register uses PGTextST stream is included in PiP among the STN_table () that is registered in current PlayItem () when using in the PG TextST stream, resets to use the relevant picture-in-picture application PG TextST stream of PG TextST stream number with the PiP that sets in the #2 register.

Even show that secondary video is effective, and, even the disp_flag of #2 register represent 1 and invalid_flag represent 0, if the number that is deposited with in the #2 register is inconsistent with the PiP application PG TextST stream among the STN_table () that is registered in PlayItem (), then use PG TextST and flow automatic option program, the picture-in-picture application PGTextST stream that selection will be reset by PiP.

According to automatic option program, at first the register of the language that can be shown by reproducing device 401 expression and the language that can not be shown by reproducing device 401 is checked, so that preferential the selection and can be by the language that reproducing device 401 shows corresponding stream, then, the preferential selection and the corresponding stream of in reproducing device 401, setting of language codes, then, according to ascending, the preferential number of selecting to be registered among the STN_table ().

Following with reference to Figure 72, the example that PGTextST stream is reset is described when execution picture-in-picture display operation.

In the state of not carrying out the picture-in-picture display operation (by " No PiP " in Figure 72 expression), if the disp_flag of #1 register is 1, no matter then the set condition of #2 register how, the PG TextST stream number that is set in the #1 register is checked, then, to the PG TextST stream with the PG TextST stream number=0x05 that is registered among the STN_table () reset (demonstration).

Then, in response to the navigation command of foundation Navigator or the scheduled operation of user's input, beginning picture-in-picture display operation (by " PiP on " in Figure 72 expression).In this case, even the user selects picture-in-picture application PG TextST stream is shown (even disp_flag=1), if according to (for example, the navigation command that is generated by Navigator), the invalid_flag of #2 register is 1, then PiP is not used PG TextST stream and shows.Promptly, even carry out picture-in-picture display operation (by " PiP enabled " in Figure 72 expression), still the PG TextST stream number that is set in the #1 register is checked, thereby to the PG TextST stream with PGTextST stream number=0x05 reset (demonstration).

For example, navigation command and flow data can be recorded on the recording medium dividually, then, carry out prestrain by 401 pairs of navigation command of reproducing device, and offer controller 21.Perhaps, best, can navigation command be recorded on the recording medium by navigation command is embedded in the flow data, and, when the playback stream data, navigation command is loaded, and navigation command is offered controller 21.This makes is convenient to the command execution sequential is controlled.

For example, generate the navigation command that to set invalid_flag as follows.For example, content creator can embed navigation command in the stream (for example, in the interactive graphic stream (IG stream)), makes invalid_flag to change automatically.Perhaps, the button information or the control information that will be used for changing invalid_flag are included in IG stream, and can show the button that can be operated by the user when playback IG flow.So, when the user pushes (selection) certain button, can change invalid_flag.

When the picture-in-picture display operation is finished (by " PiP off " in Figure 72 expression), thereby when having returned to the state that does not carry out the picture-in-picture display operation (by " No PiP " in Figure 72 expression), if the disp_flag of #1 register is 1, no matter then the set condition of #2 register how, the PG TextST stream number that is set in the #1 register is checked, and, to the PG TextST stream with PG TextST stream number=0x05 reset (demonstration).

Following with reference to Figure 73, to when carrying out the picture-in-picture display operation, the example that picture-in-picture application PGTextST stream is reset is described.

For example, in the state of not carrying out the picture-in-picture display operation (by " NoPiP " in Figure 73 expression), when the disp_flag of #1 register is 1, no matter then the set condition of #2 register how, all the PG TextST stream number that is set in the #1 register is checked, and, to being registered in PGTextST stream among the STN_table (), that have PG TextST stream number=0x05 reset (demonstration).

Then, in response to the navigation command (for example, the navigation command that in stream, embeds) of foundation Navigator or the scheduled operation of user's input, beginning picture-in-picture display operation (by " PiP on " in Figure 73 expression).In this case, if the invalid_flag of #2 register is 0 and disp_flag=1, then the PiP application PG TextST stream number that is set in the #2 register is checked, the PiP with PiP application PG TextST stream number=0x02 is used PG TextST stream show.If the user does not select picture-in-picture application PG TextST stream is shown (when the disp_flag=0), does not then show picture-in-picture application PG TextST stream.

When the picture-in-picture display operation is finished (by " PiP off " in Figure 73 expression), thereby when having returned to the state that does not carry out the picture-in-picture display operation (by " No PiP " in Figure 73 expression), if the disp_flag of #1 register is 1, no matter then the set condition of #2 register how, all the PG TextST stream number that is set in the #1 register is checked, and, to being registered in PG TextST stream among the STN_table (), that have PG TextST stream number=0x05 reset (demonstration).

If the PiP that 0xFF is registered in Figure 72 or 73 uses in the PG TextST stream number, then PG TextST flows not selected or does not exist.Even the value beyond the 0xFF is registered in PG TextST stream number or PiP uses in the PG TextST stream number,, can determine to show the validity of corresponding stream according to the combination of invalid_flag and disp_flag.That is, when invalid_flag represents 1, that is, when showing that corresponding stream is invalid, the value (being different from 0xFF) that is registered in PGTextST stream number or the PiP application PG TextST stream number is left in the basket, and, do not show corresponding stream.

In the example shown in Figure 72 or 73, two registers are provided, that is, be used for the #1 register and the #2 register that is used for secondary video (PiP) image (captions) information of a video image (captions) information.But, single register can only be provided.

In addition, disp_flag can be a sign.In this case, whether disp_flag represents to showing as the PG TextST stream of a video image (captions) stream or to the PiP PG_TextST stream as secondary video (PiP) image (captions) stream, that is, whether this sign represents displays image information.In this case, whether invalid_flag represents the image corresponding with video information or PiP image information shown.

Hereinafter with reference to the process flow diagram among Figure 74, the playback processing that is used for PiP (picture-in-picture) application PGTextST stream is described.

In step S301, according to the PG TextST stream number of in the #1 register, setting, be the PG TextST stream of correspondence, check the STN_table () of current PlayItem ().

In step S302, controller 21 is specified the PG TextST stream of wishing, reads PG TextST stream the segment on being recorded in recording medium 11 or local memory 24, and according to disp_flag, it is reset.

For example, if the disp_flag of #1 register is 1, then the PG TextST stream number that is set in the #1 register of 21 pairs of controllers is checked, reading the PG TextST stream with the PG TextST stream number that is registered among the STN_table (), and it is offered AV demoder 403.The PG TextST that is read stream by corresponding impact damper, pid filter and switch, is offered and presents graphics plane maker 93, thereby generate the graphics plane that presents, and it is offered video data processor 96 as rendering image.For example, in video processor 96, will present a graphics plane and a video flowing combination, and export with the voice data of correspondence.

In step S303, controller 21 beginning picture-in-picture display operations (PiP ON).

If it is synchronous that PiP shows with main path, then according to playing the SubPlayItem_IN_time of item and the schedule time of SubPlayItem_OUT_time representative by the son shown in Figure 12 respectively, carry out the beginning (PiP ON) of PiP display operation and finish (PiP OFF), wherein, son is play a video flowing that expression is reset by the PiP display operation.On the contrary, not synchronous if PiP shows with main path, then in response to user's input or navigation command, set the beginning (PiP ON) of PiP display operation and finish (PiP OFF).

In step S304, in response to the navigation command of navigation command in the embedding stream or prestrain after reading from the position different with this stream, if desired, controller 21 changes the invalid_flag that is set in the #2 register.

Then, in step S305, controller 21 determines whether invalid_flag is 0 (that is, whether PiP PG TextST display operation is effective).

If find that in step S305 invalid_flag is 0, then handle proceeding to step S306, determine whether disp_flag is 1 (that is, whether carrying out PiP PGTextST display operation) in the #2 register.More particularly, asynchronous with main path if picture-in-picture shows, then controller 21 determines in step S305 and S306 whether the user has sent the instruction of carrying out the picture-in-picture display operation, and whether the disp_flag that sets in the #2 register is 1.

The order of step S305 and S306 can be put upside down.

If determine that in step S306 the disp_flag in the #2 register is 1, then handle proceeding to step S307, in step S307, carry out the following PiP PG Text ST that discusses with reference to the process flow diagram among Figure 75 and handle.Then, processing proceeds to step S311.

If the disp_flag in the #1 register is 1, then a PG textST stream can be shown with picture-in-picture application PG textST stream.

If determining invalid_flag in step S305 is not 0 (promptly, invalid_flag is 1), perhaps, determine that in step S306 disp_flag is not 1 (being that disp_flag is 0), then handle and proceed to step S308, determine whether disp_flag is 1 (PGTextST demonstration) in the #1 register.

If determine that in step S308 disp_flag is 1 in the #1 register, then handle proceeding to step S309.In step S309, controller 21 for the PG TextST stream of correspondence, is checked the STN_table () of current PlayItem () according to the PG_textST stream number of setting in the #1 register, thereby specifies the PG textST stream that will reset, and shows the stream of appointment.Then, processing proceeds to step S311.Whether an expression is to PG TextST stream that flows as a video image (captions) or the sign that the PiP PG_TextST stream as PiP image (captions) stream is shown if disp_flag is, promptly, whether represent the sign of displays image information, then in step S306 or S308, identical disp_flag is checked.

For example, if disp_flag is 1 in the #1 register, then 21 pairs of the controllers value that is set in the PG TextST stream number in the #1 register is checked, flow to read PG TextST, and the PG TextST stream that reads is offered AV demoder 403 with the PG TextST stream number that is registered among the STN_table ().The PG TextST that is read stream by corresponding impact damper, pid filter and switch, is offered and presents graphics plane maker 93, and generate the graphics plane that presents, and it is offered video data processor 96 as rendering image.For example, will present a graphics plane and a video flowing combination, and export with the voice data of correspondence.

If determine that in step S308 disp_flag is not 1 (that is, disp_flag is 0), then handle proceeding to step S310.In step S310, controller 21 determines not show PGTextST stream (for example, not showing corresponding captions on full screen 301 or sub-screen 302).Then, processing proceeds to step S311.

After step S307, S309 or S310, handle proceeding to step S311 to determine whether picture-in-picture (PiP) display operation is finished.

As mentioned above, if picture-in-picture shows and main path is synchronous, no matter whether the input from the user is then arranged, the picture-in-picture display operation all begins (PiP ON) at the fixed time and finishes (PiPOFF).On the contrary, not synchronous if picture-in-picture shows with main path, then in response to user's input, set the beginning (PiP ON) of picture-in-picture display operation and finish (PiP OFF).

Do not finish if in step S311, determine picture-in-picture (PiP) display operation, then handle turning back to step S304, and repeating step S304 and later step.Finish if determine picture-in-picture (PiP) display operation in step S311, then processing finishes.

According to above-mentioned processing, when carrying out the operation of picture-in-picture display process, according to the value of in #1 register or #2 register, setting, the picture-in-picture application PG text subtitle stream (PiP PG TextST stream) that determines whether to show once (it is not used in PiP and uses) caption stream (PG TextST stream) or be used for picture-in-picture application.Which basically, also determine about the decision of the stream of will resetting by the setting of #1 register or #2 register.But, if the content of the setting of #1 or #2 register and STN_table () is inconsistent, then carry out above-mentioned automatic option program, with the stream of determining to reset.

Following with reference to the process flow diagram among Figure 75, the PiP PG TextST stream display process of carrying out among the step S307 in Figure 74 is discussed.

In step S351, controller 21 obtains to be deposited with the PiP PGTextST stream number in the #2 register.PiP PG TextST stream number is the stream number Tabulator Setting by reference, perhaps sets in response to the input from the user, perhaps sets according to above-mentioned navigation command.Perhaps, the value of setting in the previous picture-in-picture display operation can be used as PiP PG TextST stream number.

In step S352, controller 21 determines whether to be stored in the #2 register adding a value that obtains by the PiP_PG_textST_stream_id_ref with reference to Figure 69 and 70 the 8th STN_table () that discuss.

If in step S352, determine above-mentioned value (PiP_PG_textST_stream_id_ref+1) is stored in the #2 register, then handle proceeding to step S353.In step S353, controller 21 shows the PiP PG TextST stream corresponding with setting (storage) PiP PG TextST stream number in the #2 register.Processing turns back to the step S307 among Figure 74 and proceeds to step S311.

More particularly, controller 21 from recording medium 11, perhaps from local memory 24, reads the PiP PG TextST stream that is associated with the PiP PG TextST stream number of setting by memory driver 22 in the #2 register.Then, the PiP PG TextST that reads stream by corresponding impact damper, pid filter and switch, is offered and presents graphics plane maker 93, and generate the graphics plane that presents, and it is offered video processor 96 as rendering image.For example, will present the combination of graphics plane and video flowing or secondary video stream, and export with the voice data of correspondence.

If in step S352, determine above-mentioned value (PiP_PG_textST_stream_id_ref+1) not to be stored in the #2 register, then handle proceeding to step S354.In step S354, controller 21 is quoted stream_attribute () PG_language_code and the textST_language_code (Figure 18) of STN_table, and the register of the initial setting of referential expression language (this register is different with #1 register or #2 register), with the language of determining whether reproducing device 401 can be reset and set in this register, and determine whether to have defined this language by value (PiP_PG_textST_stream_id_ref+1).

The language of in this register initial setting and the PiP_PG_textST_stream_id_ref+1 by STN_table () have defined this language if determine to reset in step S354, and then processing proceeding to step S355.In step S355, controller 21 shows the PiP PG TextST stream that is associated with the language of initial setting.Then, handle the step S307 that turns back among Figure 74, and proceed to step S311.

More particularly, controller 21 from recording medium 11, perhaps from local memory 24, reads the PiP PGTextST stream that is associated with the value of setting by memory driver 22 in register.Then, the PiP PG TextST that reads stream by corresponding impact damper, pid filter and switch, is offered and presents graphics plane maker 93, and, generate the graphics plane that presents, and it is offered video processor 96 as rendering image.For example, will present a graphics plane and a video flowing combination, and export with the voice data of correspondence.

If the definite language that can not reset and set perhaps, does not have to define this language by the PiP_PG_textST_stream_id_ref+1 of the 8th STN_table () in step S354, then handle proceeding to step S356 in this register.In step S356, controller 21 is set at 0 (i=0) with i.I the stream (will determine whether reproducing device 401 can be reset) of i value representative PiP_PG_textST_stream_id_ref of definition in STN_table ().

Then, in step S357, controller 21 is by the register of referential expression language, to being checked by the language that reproducing device 401 is decoded, then, determine whether can to reset by i PiP_PG_textST_stream_id_ref being added the PiP PG TextST stream that a value that obtains is associated.

If determine in step S357 and can not convection current reset, then handle proceeding to step S358, in step S358, controller 21 is set at i+1 (i=i+1) with i.Then, handle and turn back to step S357, and repeating step S357 and step subsequently.That is, in step S357, determine whether and according to the order of the rising that is registered in the stream among the STN_table () PiP PG TextST stream to be reset.

If in step S357, determine and convection current to reset, then handle proceeding to step S359.In step S359, controller 21 shows the PiP PG TextST stream by i PiP_PG_textST_stream_id_ref+1 definition, and turns back to the step S307 among Figure 74, and proceeds to step S311.

More particularly, controller 21 passes through memory driver 22 from recording medium 11, perhaps from local memory 24, read by with by PiP_PG_textST_stream_id_ref is added the PiP PG textST stream (it is confirmed as and will be reset) of the corresponding PiP PG TextST stream definition of a value that obtains in step S357.Then, the PG TextST that reads stream by corresponding impact damper, pid filter and switch, is offered and presents graphics plane maker 93, thereby generate the graphics plane that presents, and it is offered video data processor 96 as rendering image.For example, in video data processor 96, will present a graphics plane and a video flowing combination, and export with the voice data of correspondence.

According to above-mentioned processing, if the PiP PG textST stream number of setting in the #2 register is consistent with the PiP PG textST stream number of registering in the STN_table of PlayItem (), then the PiP PG textST stream that is associated with PiP PG textST stream number is reset.If the PiP PG textST stream number in the #2 register is inconsistent with the PiP PG textST stream number of registration in the STN_table of PlayItem (), then flows automatic option program and select the picture-in-picture PG textST that will reset to flow by PiP PG TextST.

Hereinafter with reference to Figure 76 to 78, another example of the STN_table () that the combination that is used for the stream that can reset with a video flowing is defined, that is, the 9th STN_table () discusses.

In the 9th example (the 9th STN_table ()) of the grammer of the STN_table () shown in Figure 76 to 78, the secondary video stream that to reset with a video flowing, the combination of audio stream, secondary audio stream and a caption stream have been defined, specifically, defined audio stream of picture-in-picture application.More particularly, the combination of the combination of the combination, secondary video stream that has defined combination, the secondary video stream of a secondary audio stream and an audio stream and secondary audio stream and picture-in-picture application PG or text subtitle stream and secondary video stream and an audio stream of picture-in-picture application.

The playback of the 9th STN_table () execution is handled also and can be carried out by the reproducing device 401 that reference Figure 53 discusses by reference.In Figure 76 to 78, for fear of repetition, not to describing to Figure 69 part similar with the part in 70.

A new field, 8 number_of_PiP_primary_audio_stream_entries field represent to be registered in the number of the audio stream of picture-in-picture application among the STN_table ().The number of an audio stream of picture-in-picture application is determined according to PiP_primary_audio_stream_number=PiP_primary_audio_stream _ id+1.

Comb_info_Secondary_video_PiP_primary_audio () piece is represented the combination of a secondary video stream and an audio stream of picture-in-picture application.

In comb_info_Secondary_video_PiP_primary_audio () piece, 8 number_of_PiP_primary_audio_ref_entries_SV field represents to flow with secondary video the number of an audio stream of picture-in-picture application of combination.8 PiP_primary_audio_id_ref_SV field represents to flow with secondary video the ID of an audio stream of picture-in-picture application of combination.

Identical with the above-mentioned example of STN_table, can replace ID with corresponding number.For example, can replace audio_stream_id, and 2 (audio_stream_number2) replace audio_stream_id2 with the audio stream number with audio stream number (audio_stream_number).Identical situation can be applied to video flowing and caption stream.

According at the 9th STN_table () shown in Figure 76 to 78, the combination that the combination, secondary video stream that can define the combination, secondary video stream of a secondary audio stream and an audio stream and secondary audio stream and PiP use the combination of PG or text subtitle stream and secondary video stream and PiP uses an audio stream.

Therefore, except the incompatible combination of secondary video stream (#2 video flowing), an audio stream (#1 audio stream), secondary audio stream (#2 audio stream), caption stream (PG TextST stream) and the picture-in-picture PG/ text subtitle stream (PiP PG TextST stream) that can reset simultaneously with a video flowing (#1 video flowing) not being defined, also not to flowing with the secondary video that a video flowing (#1 video flowing) is reset simultaneously and the incompatible combination of an audio stream of picture-in-picture application defines.

As mentioned above, in reproducing device 141, but in the part rewritable memory region of storer 23, arranged a plurality of registers, and, the processing of resetting carried out according to the value of in these registers, setting.But in the part rewritable memory region of storer 23, except the register that reference Figure 70 discusses, also arranged the register that the audio stream that is used for when the beginning picture-in-picture application quilt being reset is set.When the 9th STN_table () shown in use Figure 76 to 78, these registers are checked.

Following with reference to Figure 79, the register exclusive to the 9th STN_table () (register that the audio stream that is used for when the beginning picture-in-picture application quilt being reset is set) discussed.

The #3 register is represented the id number of an audio stream, more particularly, and an audio stream that select, that will reset in the audio stream of expression from the STN_table that is registered in current PlayItem ().

When not carrying out the picture-in-picture display operation, reset to having the audio stream that is set in the id number in the #3 register.But, in the STN_table () of current PlayItem (), do not register if having the audio stream that is set in the id number in the #3 register, then an audio stream will being reset by an automatic option program selection of audio stream.

According to the content of in the #5 register, setting, have the audio stream that is set in the id number in the #3 register to when carrying out the picture-in-picture display operation, whether resetting and determine.Discuss to the object lesson of playback of audio streams when showing picture-in-picture application in the back.

The #4 register is represented the id number of secondary audio stream, or rather, and secondary audio stream that select, that will reset in the secondary audio stream of expression from the STN_table () that is registered in current PlayItem ().

When not carrying out the picture-in-picture display operation,,, reset to having the audio stream that is set in the id number in the #4 register perhaps according to various settings in response to input from the user.But, in the STN_table of current PlayItem () (), do not register if having the audio stream that is set in the id number in the #4 register, then the secondary audio stream that will be reset by the automatic option program selection of secondary audio stream.In some cases, when showing picture-in-picture application, reset to having the audio stream that is set in the id number in the #4 register.The back is to when carrying out the picture-in-picture display operation, discusses to having the object lesson that the audio stream that is set in the id number in the #4 register resets.

The #5 register is represented the id number of an audio stream of picture-in-picture application, or rather, and audio stream of picture-in-picture application that select, that will reset in expression audio stream of picture-in-picture demonstration from the STN_table () that is registered in current PlayItem ().If invalid_flag is 0 in the #5 register, then the id number of an audio stream of picture-in-picture application is effective.If in the #5 register, invalid_flag is 1, and then the id number of an audio stream of picture-in-picture application is invalid.

If have the audio stream that is set in the id number in the #5 register and be not can with audio stream of picture-in-picture application of secondary video stream combination among the STN_table () of current PlayItem (), then select the audio stream that will be reset by the automatic option program of audio stream of picture-in-picture application.

According to automatic option program, at first check the register of audio stream that expression reproducing device 141 can be reset and the audio stream that can not reset.Then, the audio stream that preferential selection can be reset, and the preferential language codes corresponding audio stream of selecting and setting in reproducing device 141 then, according to the ascending that is registered in the stream among the STN_table (), are preferentially selected audio stream.

If set 0xFF in secondary audio stream number, then this secondary audio stream is selected or do not exist.If set 0xFF in audio stream number of picture-in-picture application, then audio stream of this picture-in-picture application is selected or do not exist.

Even the value beyond the 0xFF is registered in audio stream number of PiP application,, can determine the validity of resetting corresponding audio stream according to invalid_flag.That is, when invalid_flag is 1, that is,, does not always use in an audio stream number and set 0xFF at PiP when replay operations when being invalid.For example, when invalid_flag was 1, even the value beyond the 0xFF is registered in audio stream of PiP application, the value that is registered in audio stream of PiP application was left in the basket, and, the corresponding audio of not resetting stream.

Be set in the value in these registers by reference, the playback processing that reproducing device 141 can be reset and be used for these streams.

Hereinafter with reference to Figure 80, the example of reset when carrying out the picture-in-picture display operation audio stream and secondary audio stream is described.In this case, in response to input from the user, perhaps, and according to various settings, playback secondary audio stream.

When not carrying out the picture-in-picture display operation (by " No PiP " in Figure 80 expression), an audio stream number that is set in the #3 register is checked, thereby an audio stream with the audio stream number=0x05 that is registered among the STN_table () is reset.

In this case, if be different from the secondary audio stream number that the value of 0xFF is deposited at the #4 register,, perhaps,, reset to having the audio stream that is set in the id number in the #4 register according to various settings then in response to input from the user.

Then, in response to the navigation command of foundation Navigator or from the input of user's scheduled operation, beginning PiP display operation (by " PiP on " in Figure 80 expression).Even the picture-in-picture display operation begins, for example,,, then audio stream of picture-in-picture application is not reset if the invalid_flag of #5 register is 1 according to the navigation command that generates by Navigator.More particularly, when carrying out the picture-in-picture display operation (by " PiP enabled " in Figure 80 expression), check being set in an audio stream in the #3 register and the secondary audio stream that is set in the #4 register, thereby the audio stream with the audio stream number=0x07 that is registered among the STN_table is reset, and, the audio stream that will have audio stream 2 numbers=0x01 mixes with the audio stream with audio stream number=0x07, and, in response to input from the user, perhaps, according to various settings, to resetting through the stream that mixes.

When the picture-in-picture display operation is finished (by " PiP off " in Figure 80 expression), thereby when having returned to the state that does not carry out the picture-in-picture display operation (by " No PiP " in Figure 80 expression), an audio stream number that is set in the #3 register is checked, thereby to the audio stream with audio stream number=0x05 is reset.

If be different from the secondary audio stream number that the value of 0xFF is deposited at the #4 register,, perhaps,, reset to having the audio stream that is set in the id number in the #4 register according to various settings then in response to input from the user.

Hereinafter with reference to Figure 81, the example of an audio stream of playback picture-in-picture application is described when carrying out the picture-in-picture display operation.

When not carrying out the picture-in-picture display operation (by " No PiP " in Figure 81 expression), an audio stream number that is set in the #3 register is checked, thereby an audio stream with the audio stream number=0x05 that is registered among the STN_table () is reset.

In this case, if be different from the secondary audio stream number that the value of 0xFF is deposited at the #4 register,, perhaps,, reset to having the audio stream that is set in the id number in the #4 register according to various settings then in response to input from the user.

Then, in response to the navigation command (for example, being embedded into the order in the stream) of foundation Navigator or from the input of user's scheduled operation, beginning PiP display operation (by " PiP on " in Figure 81 expression).If the invalid_flag of #5 register is 0, then the PiP in the #5 register is used an audio stream number and check, reset thereby the PiP with the audio stream number=0x07 of PiP application that is registered among the STN_table () is used an audio stream.

When the PiP display operation is finished (by " PiP off " in Figure 81 expression), thereby when having returned to the state that does not carry out the picture-in-picture display operation (by " No PiP " in Figure 81 expression), an audio stream number that is set in the #3 register is checked, thereby to the audio stream with audio stream number=0x05 is reset.

If be different from the secondary audio stream number that the value of 0xFF is deposited at the #4 register,, perhaps,, reset to having the audio stream that is set in the id number in the #4 register according to various settings then in response to input from the user.

If 0xFF is registered in the PiP of Figure 80 or 81 and uses in audio stream number, then audio stream of picture-in-picture application is selected or do not exist.Be registered in audio stream number of PiP application even be different from the value of 0xFF, set, can determine the validity of resetting corresponding stream according to invalid_flag.More particularly, when invalid_flag is 1, that is, when replay operations when being invalid, use in audio stream even the value beyond the 0xFF is registered in PiP, PiP uses an audio stream number and is left in the basket, and, the corresponding stream of not resetting.

Following with reference to the process flow diagram among Figure 82, the audio stream playback that is used for an audio stream of PiP (picture-in-picture) application is handled 1 be described.

In step S401, controller 21 is an audio stream of correspondence according to an audio stream number of setting in the #3 register, check the STN_table () of current PlayItem ().

In step S402, controller 21 is specified an audio stream of wishing, reads one time audio stream the segment on being recorded in recording medium 11 or local memory 24, and it is reset.

For example, controller 21 is set in an audio stream number in the #3 register by reference, reads an audio stream with audio stream number that is registered among the STN_table (), and an audio stream that will read offers AV demoder 403.An audio stream that is read is passed through corresponding impact damper, pid filter and switch, offer the first audio decoder 75-1, and, it is decoded and resets together with corresponding video data.

In step S403, controller 21 beginning picture-in-picture display operations (PiP is opened).

If it is synchronous that picture-in-picture shows with main path, no matter then from user's input how, the picture-in-picture display operation begins (PiP ON) and end (PiP OFF) to schedule.On the contrary, asynchronous if picture-in-picture shows with main path, then according to input, set the beginning (PiP ON) of PiP display operation and finish (PiP OFF) from the user.

In step S404, according to the navigation command of navigation command in the embedding stream or prestrain after reading from the position different with this stream, if desired, controller 21 changes the invalid_flag that sets in the #5 register.

In step S405, controller 21 determines whether the invalid_flag of #5 register is 0 (that is, whether audio stream of PiP is effective).

If find that in step S405 invalid_flag is 0, then handle proceeding to step S406.In step S406, to discuss as reference Figure 80, controller 21 is audio stream of picture-in-picture demonstration of correspondence according to audio stream number of picture-in-picture of setting in the #5 register, checks the current STN_table () that plays item.

As mentioned above, in step S407, controller 21 specifies the picture-in-picture that will be reset to show an audio stream, reads the stream of appointment from segment, and it is offered AV demoder 403, and order AV demoder 403 is decoded and it is reset it.Then, processing proceeds to step S409.

For example, the PiP that audio stream number of the PiP that sets in the #5 register by reference, controller 21 read an audio stream number of PiP that is registered among the STN_table shows an audio stream, and the stream that will read offers AV demoder 403.The picture-in-picture that is read is shown that an audio stream by corresponding impact damper, pid filter and switch, offers the first audio decoder 75-1, then this audio stream is reset together with corresponding video data.Be not registered among the STN_table () of current PlayItem () if having the audio stream that is set in the id number in the #5 register, then show the audio stream that an automatic option program selection of audio stream will be reset by picture-in-picture.

If determining invalid_flag in step S405 0 (that is, invalid_flag=1), then handles and proceeds to step S408.In step S408, controller 21 is according to an audio stream number of setting in the #3 register and the secondary audio stream number of setting in the #4 register, for correspondence once with the secondary audio stream, check the STN_table () of current PlayItem ().Then, controller 21 from segment, read appointment once with the secondary audio stream, they are offered AV demoder 403, and they are decoded, then,, they are reset by with them and the combination of corresponding stream.

For example, audio stream number that controller 21 is set in the #3 register by reference and the secondary audio stream number of in the #4 register, setting, read be registered among the STN_table () once with the secondary audio stream, and they are offered AV demoder 403.Then, what be read once passes through corresponding impact damper, pid filter and switch with the secondary audio stream, is offered the first audio decoder 75-1 and the second audio decoder 75-2 respectively, and decoded, then, they are exported together with corresponding video data.Be not registered among the STN_table () of current PlayItem () if having the audio stream that is set in the id number in #3 or the #4 register, then flow the audio stream that automatic option program selection will be reset by corresponding audio.

After step S407 or S408, controller 21 determines in step S409 whether picture-in-picture (PiP) display operation is finished.

If it is synchronous that picture-in-picture shows with main path, no matter then from user's input how whether, the picture-in-picture display operation all begins (PiP ON) and end (PiP OFF) at the fixed time.On the contrary, asynchronous if picture-in-picture shows with main path, then according to input, set the beginning (PiP ON) of PiP display operation and finish (PiP OFF) from the user.

Do not finish if in step S409, determine picture-in-picture (PiP) display operation, then handle turning back to step S404, and repeating step S404 and subsequent step.Finish if determine the PiP display operation in step S409, then processing finishes.

According to above-mentioned processing, when carrying out the picture-in-picture display operation,, determine the audio stream that to be reset according to the value of setting in the #5 register at the #3 register.If the content of the setting of register and STN_table () is inconsistent,, determine the stream that to be reset then according to above-mentioned automatic option program.

Hereinafter with reference to Figure 83 to 85, another example of the STN_table () that the combination that is used for the stream that can reset simultaneously with a video flowing is defined, that is, the tenth STN_table () discusses.

With identical in the 9th example, the tenth example of the grammer of the STN_table () shown in Figure 83 to 85 i.e. the tenth STN_table () defined and can flow with the secondary video that a video flowing is reset, an audio stream, the secondary audio stream, the combination of a caption stream and an audio stream of picture-in-picture application, more particularly, defined the combination of a secondary audio stream and an audio stream, the combination of secondary video stream and secondary audio stream, the combination that secondary video stream and PiP use PG or text subtitle stream, secondary video stream is used the combination of an audio stream and the combination of a secondary audio stream and an audio stream of PiP application with PiP.

The playback of the tenth STN_table () execution is handled also and can be carried out by the reproducing device 401 that reference Figure 52 discusses by reference.In Figure 83 to 85,, the part similar to the part among Figure 76 to 79 do not described for fear of repetition.

The exclusive piece of the tenth STN_table (), that is, comb_info_Secondary_audio_PiP_primary_audio () expression secondary video stream and picture-in-picture show the combination of an audio stream.

In comb_info_Secondary_audio_PiP_primary_audio () piece, 8 number_of_PiP_primary_audio_ref_entries_SA field represents to show with the picture-in-picture of secondary audio stream combination the number of an audio stream.8 PiP_primary_audio_id2_ref_SA field represents to show with the picture-in-picture of secondary audio stream combination the ID of an audio stream.

Identical with the above-mentioned example of STN_table (), can replace ID with corresponding number.For example, can replace audio_stream_id with audio stream number (audio_stream_number), 2 (audio_stream_number2) replace audio_stream_id2 with the audio stream number.Identical situation can be applied to video flowing and caption stream.

According at the tenth STN_table () shown in Figure 83 to 85, the combination of the combination, secondary video stream that can define the combination, secondary video stream of the combination, secondary video stream of a secondary audio stream and an audio stream and secondary audio stream and picture-in-picture application PG or text subtitle stream and the combination of an audio stream of picture-in-picture application and secondary audio stream and an audio stream of PiP application.

Therefore, except the incompatible combination that can flow (#2 video flowing), an audio stream (#1 audio stream), secondary audio stream (#2 audio stream), caption stream (PG TextST stream) and picture-in-picture PG/ text subtitle stream (PiP PG TextST stream) with the secondary video that a video flowing (#1 video flowing) is reset simultaneously not being defined, also not to showing that the incompatible combination of an audio stream defines with secondary audio stream and the picture-in-picture that a video flowing (#1 video flowing) is reset simultaneously.

In reproducing device 141, but in the part rewritable memory region of storer 23, arranged a plurality of registers, and, the processing of resetting carried out according to the value of in these registers, setting.Discuss as reference Figure 79, but in the part rewritable memory region of storer 23, except the register that reference Figure 71 discusses, also arranged the register that the audio stream that is used for when beginning PiP uses quilt being reset is set.When using, these registers are checked at the tenth STN_table () shown in Figure 83 to 85.

The processing of can convection current resetting of the value of in these registers, setting by reference, reproducing device 141.

When carrying out the picture-in-picture display operation, to similar with reference to Figure 79 discussion of the processing of once resetting with the secondary audio stream.

Following with reference to Figure 86, to when carrying out the picture-in-picture display operation, the example of a playback secondary audio stream and an audio stream of picture-in-picture application is described.

When not carrying out the picture-in-picture display operation (by " No PiP " in Figure 86 expression), an audio stream number that is set in the #3 register is checked, thereby an audio stream with the audio stream number=0x05 that is registered among the STN_table () is reset.

Then, the navigation command (for example, being embedded into the order in the stream) that generates in response to the foundation Navigator or from the input of user's scheduled operation, beginning picture-in-picture display operation (by " PiP on " in Figure 86 expression).If the invalid_flag in the #5 register is 0, then the secondary audio stream number of setting in the #4 register and audio stream number of the PiP that sets in the #5 register are checked, thereby the audio stream with the audio stream 2 numbers=0x01 that is registered among the STN_table is reset, and, the audio stream that will have an audio stream number=0x07 of PiP mixes with the audio stream with audio stream 2 numbers=0x01, and to resetting through the stream that mixes.

When the picture-in-picture display operation is finished (by " PiP off " in Figure 86 expression), thereby when having returned to the state that does not carry out the picture-in-picture display operation (by " No PiP " in Figure 86 expression), an audio stream number that is set in the #3 register is checked, thereby the audio stream with audio stream number=0x05 is reset.

If 0xFF is registered in the PiP of Figure 86 and uses in audio stream number, then audio stream of picture-in-picture application is selected or do not exist.Be registered in audio stream number of PiP application even be different from the value of 0xFF, set, can determine the validity of resetting corresponding stream according to invalid_flag.More particularly, when invalid_flag is 1, that is, when replay operations when being invalid, is registered in PiP and uses in audio stream number even be different from the value of 0xFF, PiP uses an audio stream number and also is left in the basket, and, the corresponding stream of not resetting.

Following with reference to the process flow diagram among Figure 87, the audio stream playback that is used for PiP (picture-in-picture) application audio stream is handled 2 be described.

Step S451 to S455 respectively to Figure 82 in step S401 to step S405 similar substantially.

In step S451, controller 21 is an audio stream of correspondence according to an audio stream number of setting in the #3 register, check the STN_table () of current PlayItem ().Controller 21 is specified an audio stream of wishing, reads one time audio stream the segment on being recorded in recording medium 11 or local memory 24, and it is reset.Then, controller 21 beginning picture-in-picture display operations.If it is synchronous that picture-in-picture shows with main path, no matter then from user's input how, the picture-in-picture display operation begins (PiP ON) and end (PiP OFF) to schedule.On the contrary, asynchronous if picture-in-picture shows with main path, then according to input, set the beginning (PiP ON) of PiP display operation and finish (PiP OFF) from the user.

According to the navigation command of navigation command in the embedding stream or prestrain after reading from the position different with this stream, if desired, controller 21 changes the invalid_flag that sets in the #5 register.Then, controller 21 determines whether the invalid_flag of #5 register is 0 (whether audio stream of PiP is effective).

If find that in step S455 invalid_flag is 0, then handle proceeding to step S456.In step S456, controller 21 is audio stream of picture-in-picture demonstration of correspondence according to audio stream number of PiP of setting in the #5 register, checks the current STN_table () that plays item.

In step S457, controller 21 is the secondary audio stream of correspondence according to the secondary audio stream number of setting in the #4 register, check the STN_table () of current PlayItem ().

As mentioned above, in step S458, controller 21 is specified audio stream of picture-in-picture demonstration and the secondary audio stream that will be reset, from segment, read the stream of appointment, it is offered AV demoder 403, instruction decoding device 403 is decoded to them, with they combinations (mixing), and they is reset.Then, handle and proceed to step S460, as described below.

For example, audio stream number of the PiP that in the #5 register, sets by reference and the secondary audio stream number of in the #4 register, setting, controller 21 reads the audio stream of picture-in-picture demonstration of an audio stream number of PiP that is registered among the STN_table and the secondary audio stream of secondary audio stream number, and the stream that will read offers AV demoder 403.The audio stream of picture-in-picture demonstration and the secondary audio stream that are read are passed through corresponding impact damper, pid filter and switch respectively, offer the first audio decoder 75-1 and the second audio decoder 75-2, and, they are decoded, then they are reset together with corresponding video data.Be not registered among the STN_table () of current PlayItem () if having the audio stream that is set in the id number in #5 register or the #4 register, then the audio stream that will reset by the automatic option program selection of correspondence.

If determining invalid_flag in step S455 0 (that is, invalid_flag=1), then handles and proceeds to step S459.In step S459, controller 21 is according to an audio stream number of setting in the #3 register and the secondary audio stream number of setting in the #4 register, for correspondence once with the secondary audio stream, check the STN_table () of current PlayItem ().Then, controller 21 from segment, read appointment once with the secondary audio stream, they are offered AV demoder 403, indication AV demoder 403 to they decode, with they combinations, and they are reset.

For example, audio stream number that controller 21 is set in the #3 register by reference and the secondary audio stream number of in the #4 register, setting, read be registered among the STN_table () once with the secondary audio stream, and they are offered AV demoder 403.Then, what be read once passes through corresponding impact damper, pid filter and switch with the secondary audio stream, is offered the first audio decoder 75-1 and the second audio decoder 75-2 respectively, and decoded, then, they are exported together with corresponding video data.Be not registered among the STN_table () of current PlayItem () if having the audio stream that is set in the id number in #3 or the #4 register, then flow the audio stream that automatic option program selection will be reset by corresponding audio.

After step S457 or S459, controller 21 determines in step S460 whether picture-in-picture (PiP) display operation is finished.

As discussed above, synchronous if picture-in-picture shows with main path, no matter then from user's input how, the picture-in-picture display operation all begins (PiP ON) and end (PiPOFF) at the fixed time.On the contrary, asynchronous if picture-in-picture shows with main path, then according to input, set the beginning (PiP ON) of PiP display operation and finish (PiP OFF) from the user.

Do not finish if in step S460, determine picture-in-picture (PiP) display operation, then handle turning back to step S454, and repeating step S454 and subsequent step.Finish if determine the PiP display operation in step S460, then processing finishes.

According to above-mentioned processing, when carrying out the picture-in-picture display operation,, determine the audio stream that to be reset according to the value of setting in the #5 register at the #3 register.If the content of the setting of register and STN_table () is inconsistent,, determine the stream that to be reset then according to above-mentioned automatic option program.

Following with reference to Figure 88 and 89, under the situation of disc-shape recoding medium, the manufacture method of recording medium 11 is discussed, on recording medium 11, having write down can be by reproducing device 1,141 and 401 data of resetting.

Shown in Figure 88, prepared original plate such as glass, then, recording materials such as photoresist are coated on glass, form the record original disc thus.

In the Software Production processor, shown in Figure 89, by scrambler (video encoder) coding, as being temporarily stored in impact damper by reproducing device 1,141 and 401 video datas of resetting.The voice data of being encoded by audio coder is temporarily stored in impact damper, and the stream data (for example, index, playlist, broadcast item etc.) in addition of being encoded by data encoder also are temporarily stored in impact damper.In multiplexer (MPX), to carry out multiplexed to the video data, voice data and stream data and the synchronizing signal in addition that are stored in the impact damper, and (error-correcting code ECC) provides error correcting code to them in the circuit in error correcting code.Then, in modulation circuit (MOD),, then, for example be recorded on the tape according to predetermined format to modulating through multiplexed data.As a result, produce and to be recorded on the recording medium 11 and softwares that will be reset by reproducing device 1,141 and 401.

If desired, software is edited (carry out pre-master control and handle (pre-mastering)), thereby generate the signal format that will be recorded on the CD.Then,, laser beam is modulated, and will act on photoresist on the original disc, thereby, photoresist is exposed to laser beam according to tracer signal through the laser beam of ovennodulation according to this tracer signal.

After this, original disc is developed, and on original disc, pit occurs.Then, original disc is handled, as, electroforming (electroforming), thus produce the metal original disc that has from the pit of original disc transfer printing (transfer).Then, produce metal stamping and pressing (metal stamper) according to the metal original disc.This metal stamping and pressing is used as metal pattern (metal mold).

Material such as PMMA or PC (polycarbonate, polycarbonate) are injected this metal stamping and pressing and setting.Perhaps, after being coated in 2P (ultraviolet curing resin) in the metal stamping and pressing, shining resin and make it curing with ultraviolet ray.This makes it possible to the pit in the metal stamping and pressing is transferred on the resin, forms duplicate thus.

Then, by deposition and sputter, on duplicate, form reflectance coating.Perhaps, by spin coating, on duplicate, form reflectance coating.

Then, carry out necessary processing, as to the internal diameter of the dish that obtains with external diameter is adjusted and two dishes are stacked.Then, label and core (hub) are attached on the dish, will coil then and insert tray salver.Thereby, finished the recording medium 11 of record by reproducing device 1,141 or 401 data of resetting.

Above-mentioned a series of processing operations can be carried out by hardware and software.In this case, can carry out the processing operation by the personal computer shown in Figure 90 500.

In Figure 90, CPU (CPU (central processing unit)) 501 carries out various processing operations according to being stored in the program among the ROM (ROM (read-only memory)) 502 or being loaded into program the RAM (random access memory) 503 from storage unit 508.In RAM 503, also stored CPU501 and carried out various processing and operate needed data.

CPU 501, ROM 502 and RAM 503 interconnect by internal bus 504.Input/output interface 505 also is connected to internal bus 504.

Input/output interface 505 is connected to: input block 506, as keyboard and mouse; Output unit 507, as display, for example, CRT and LCD; Storage unit 508 is as hard disk; And communication unit 509, as modulator-demodular unit or terminal adapter.Communication unit 509 communicates by the diverse network that comprises telephone line or CATV.

If desired, driver 510 is connected to input/output interface 505.Removable medium 521 is loaded into driver 510 as disk, CD, magneto-optic disk or semiconductor memory.The computer program that reads from removable medium 521 is loaded into storage unit 508.

If software is used to carry out this series of processes operation, then corresponding software program is installed from network or recording medium.

This recording medium can be made of package media, as the removable medium 521 of logging program thereon, removable medium 521 and computing machine is distributed to the user dividually.Perhaps, can the ROM 502 or the hard disk of the storage unit 508 of logging program constitute recording medium by forming thereon, when installing ROM 502 or hard disk on computers, it is distributed to the user.

In this manual, can carry out the step that constitutes computer program successively according to the order of describing in this manual.Perhaps, they can be carried out concurrently or individually.

Embodiments of the invention are not limited to the foregoing description, and, under the situation that does not break away from spirit of the present invention, can carry out various modifications.

Claims (18)

1. a reproducing device is used for convection current and resets, and described reproducing device comprises:

Deriving means is used to obtain playback management information, and described playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And selection information, be used for flowing, and be used for selecting by one of described at least one sub-playback path that quote, as will to be reset at least one class stream from least one class that the central selection of described at least one stream of being quoted by described main playback path will be reset;

Receiving trap is used for receiving the selection to the stream that will be reset according to the described selection information that is included in the described playback management information of being obtained by described deriving means;

Reading device, receive selection if be used for described receiving trap to the stream that will be reset, described by reference main playback path, read described at least one class stream of selecting in the middle of described at least one stream of being quoted by described main playback path and received by described receiving trap, and, be used for by reference corresponding described sub-playback path, read described at least one class stream of selecting in the middle of described at least one stream of being quoted by described at least one sub-playback path and received by described receiving trap; And

Composite set, be included in the described at least one class stream of quoting by described main playback path and read by described reading device if be used at least two streams of predetermined class, and be included in the described at least one class stream of quoting by the sub-playback path of correspondence and read by described reading device, then with described at least two stream combinations

Wherein, described selection information comprises the information of the first-class of predetermined class that expression is quoted by described main playback path and the combination of second stream of the predetermined class of being quoted by described corresponding sub-playback path,

Described receiving trap receives the selection to the stream that will be reset according to described selection information,

If described receiving trap receives the selection to described first-class and described second stream that will be reset, then described reading device reads the described first-class of the predetermined class quoted by described main playback path and described second stream of the predetermined class quoted by the sub-playback path of described correspondence, and

Described composite set makes up described first-class and described second stream of the predetermined class that described reading device read.

2. reproducing device as claimed in claim 1 also comprises:

Decoding device, be used for to the described at least one class stream quoted by described main playback path and read by described reading device and quoted by the sub-playback path of described correspondence and decoded by described at least one class stream that described reading device reads.

3. reproducing device as claimed in claim 1, wherein, the stream of the predetermined class that is made up by described composite set is audio stream or video flowing.

4. reproducing device as claimed in claim 1, wherein, the stream of the predetermined class of being quoted by described main playback path is first video flowing, and

Described selection information also comprises the information that first audio stream that is associated with described first video flowing and the combination that is different from second audio stream of described first audio stream are defined.

5. reproducing device as claimed in claim 1, wherein, described receiving trap receives the selection to the stream that will be reset in the middle of following stream:

By described main playback path quote described first-class;

By the sub-playback path of described correspondence quote described second stream;

The combination of described first-class and described second stream of being quoted by described main playback path of being quoted by described corresponding sub-playback path, described second stream is included in the file different with comprising described first file;

By the sub-playback path of described correspondence quote described second stream combination; With

The combination of described first-class and described second stream of being quoted by described main playback path of being quoted by described corresponding sub-playback path, described second stream is included in the file identical with comprising described first file.

6. reproducing device as claimed in claim 1, wherein, the described playback management information of being obtained by described deriving means also comprises the information about the combination of two streams of the predetermined class of being quoted by the sub-playback path of described correspondence,

If described receiving trap receives the selection to the combination of two streams of the predetermined class that will be reset, then described reading device reads two streams of the predetermined class of being quoted by the sub-playback path of described correspondence, and

Described composite set makes up two streams of the predetermined class that read by described reading device.

7. reproducing device as claimed in claim 1, wherein, described selection information comprises also whether expression imports the information of the stream that will be combined,

Whether described receiving trap imports the information of the stream that will be combined according to described expression, reception is to by the selection of the combination of at least one stream that quote, same item in the sub-playback path of described main playback path and described correspondence, perhaps, receive selection to the single stream of same item, and

Described reading device reads the stream of the input that is received by described receiving trap according to described selection information.

8. reproducing device as claimed in claim 1, wherein, the stream of the predetermined class of being quoted by described main playback path is first video flowing, and

Described selection information also comprises the information that the combination to second video flowing that is different from described first video flowing and second audio stream that is associated with described second video flowing defines.

9. reproducing device as claimed in claim 1, wherein, the stream of the predetermined class of being quoted by described main playback path is first video flowing, and

Described selection information also comprises the information that the combination to second video flowing that is different from described first video flowing and first image information that is associated with described second video flowing defines.

10. reproducing device as claimed in claim 9 also comprises:

First memory storage, the information that is used for whether storage representation shows second image information that is associated with described first video flowing or whether described first image information that is associated with described second video flowing is shown;

Second memory storage shows described second image information if be used for storage representation, then constitutes information described second image information, that can will be reset by which stream in the middle of the stream of described selection Information Selection;

The 3rd memory storage shows described first image information if be used for storage representation, then constitutes information described first image information, that can will be reset by which stream in the middle of the stream of described selection Information Selection;

The 4th memory storage, being used for storage representation still is the information that described second image information shows to described first image information,

Wherein, described reading device with reference to the information that is stored in described first memory storage, described second memory storage, described the 3rd memory storage and described the 4th memory storage, reads the stream that is associated with described first image information that will be shown or described second image information by further.

11. reproducing device as claimed in claim 1, wherein, the stream of the predetermined class of being quoted by described main playback path is first video flowing, and

Described selection information also comprises the information that the combination to second video flowing that is independent of described first video flowing and the text message that is associated with described second video flowing defines.

12. reproducing device as claimed in claim 1 wherein, according to the classification of the stream of being quoted by the sub-playback path of described correspondence, defines at least one type of described at least one sub-playback path, and

Be included in described at least one sub-playback path in the described playback management information and be classified as predefined type in the type of described at least one definition, and, be included in the described playback management information about the information of the classification type of described at least one sub-playback path.

13. reproducing device as claimed in claim 12, wherein, the type of described at least one definition comprises such type, and wherein, at least one class stream is quoted by the sub-playback path of described correspondence.

14. reproducing device as claimed in claim 13, wherein, the type of described at least one definition comprises such type, wherein, at least one class stream is quoted by the sub-playback path of described correspondence, and described at least one class stream is included in the file different with the file that comprises the stream of being quoted by described main playback path.

15. reproducing device as claimed in claim 13, wherein, the type of described at least one definition comprises such type, wherein, at least one class stream is quoted by the sub-playback path of described correspondence, and described at least one class stream is included in the file identical with the file that comprises the stream of being quoted by described main playback path.

16. reproducing device as claimed in claim 1 also comprises:

Display control unit, the demonstration that is used for the display screen of information that demonstration is used to help the user to carry out input operation is controlled,

Wherein, the stream of the predetermined class of being quoted by described main playback path is first video flowing,

If described receiving trap receive to be independent of described first video flowing, will with the selection of second video flowing of the described first video flowing synchronized playback, then described display control unit is controlled the tabulation of the stream that can reset explicitly with described second video flowing that is displayed on the described display screen, and

Described receiving trap is by with reference to the display screen that is shown by the control of described display control unit, receives selection to the stream that can reset explicitly with described second video flowing from the user.

17. a playback method that is used for the reproducing device that convection current resets, this method comprises the steps:

Obtaining step is used to obtain playback management information, and described playback management information comprises: main playback path, represent at least one stream position on time shaft; At least one sub-playback path represented at least one stream position on time shaft; And selection information, be used for flowing, and be used for selecting by one of described at least one sub-playback path that quote, as will to be reset at least one class stream from least one class that the central selection of described at least one stream of being quoted by described main playback path will be reset;

Receiving step is used for receiving the selection to the stream that will be reset according to the described selection information that is included in the described playback management information that is obtained by the processing of described obtaining step;

Read step, receive selection if be used for the processing of described receiving step to the stream that will be reset, described by reference main playback path, read from the central described at least one class stream selected of described at least one stream of being quoted by described main playback path, and, be used for corresponding by reference sub-playback path, read from the central described at least one class stream selected of described at least one stream of being quoted by described at least one sub-playback path; And

Combination step, if being used at least two streams of predetermined class is included in the described at least one class stream of being quoted by described main playback path and read by the processing of described read step, and be included in the described at least one class stream of quoting by the sub-playback path of described correspondence and read by the processing in the described read step, then with described at least two stream combinations

Wherein, described selection information comprises the information of the first-class of predetermined class that expression is quoted by described main playback path and the combination of second stream of the predetermined class of being quoted by described corresponding sub-playback path,

In the processing of described receiving step, according to described selection information, receive selection to the stream that will be reset,

In the processing of described read step, if the processing in the described receiving step receives the selection to described first-class and described second stream that will be reset, described second stream of the predetermined class that then reads the described first-class of the predetermined class quoted by described main playback path and quoted by the sub-playback path of described correspondence, and

In the processing of described combination step, described first-class and described second stream of the predetermined class that read by the processing in the described read step is made up.

18. a recording medium fabrication method has write down the data that can be reset by reproducing device on this recording medium, described manufacture method comprises the steps:

Generation has the data of the data structure that comprises playback management information, and described playback management information is used to manage the replay operations at least one stream, and the data that generate are recorded on the described recording medium,

Described playback management information comprises

Main playback path is represented described at least one stream position on time shaft;

At least one sub-playback path represented at least one stream position on time shaft; And

Selection information, be used for from the central stream of being quoted by described main playback path of selecting at least one class to be reset of described at least one stream, and be used for selecting by the stream that class that quote, at least one will be reset of described at least one sub-playback path the combination of second stream of the first-class and predetermined class of being quoted by described at least one sub-playback path of the predetermined class that described information representation is quoted by described main playback path.

Images