KR20070050440A - Method and apparatus of reproducing data recorded on recording medium and local storage - Google Patents

Abstract

An apparatus for reproducing data recorded on a recording medium, comprising a pickup section, a local storage and a decoder. The pickup section reads main data recorded on the recording medium, and the local storage stores sub data associated with the main data. The sub data includes an interactive graphic stream or a text subtitle stream. The decoder decodes the main data and the sub data using a playlist file including a main path and a sub path. The main path includes a playitem for reproducing the main data, and the subpath includes at least one subplayitem associated with a playitem for reproducing the sub data associated with the reproducing of the main data. The playlist file further includes subpath type information indicating whether at least one subplayitem included in the subpath is synchronized with the playitem.

Recording media, interactive graphic streams, text subtitle streams, playitems, playlist files

Description

TECHNICAL AND APPARATUS OF REPRODUCING DATA RECORDED ON RECORDING MEDIUM AND LOCAL STORAGE}

The present invention relates to a recording medium, and more particularly to a method and apparatus for reproducing data recorded on a recording medium and local storage.

Optical discs are widely used as recording media for recording large amounts of data. Currently, among a wide range of optical discs, new high density optical recording media such as Blu-ray discs (hereinafter referred to as 'BD') are used to record and store high density video data and high quality audio data for a long time. Recently developed. Global standard technical specifications for Blu-ray Discs (BDs), known as next-generation recording media technologies, are being developed as next-generation optical recording media that can store more data than conventional DVDs and a large number of other digital devices. Accordingly, an optical recording and reproducing apparatus employing a Blu-ray Disc BD is also under development. However, since the Blu-ray Disc (BD) standard is not yet complete, there are a number of difficulties in developing a complete optical disc recording and reproducing apparatus.

In particular, in the above-described optical recording and / or reproducing apparatus, not only a basic function of recording and / or playing back a Blu-ray disc BD, but also an additional function considering a combined use with an associated peripheral digital apparatus should be considered. Therefore, in general, the optical recording and / or reproducing apparatus should have a function of receiving an external input signal and displaying the received signal, or applying the external input signal to a built-in Blu-ray Disc (BD) reproduction signal for reproduction. . However, since an integrated standard for achieving the above-mentioned additional functions is not yet included in the current Blu-ray Disc (BD) standard, it is necessary to develop a full-scale Blu-ray Disc (BD) base optical recording and reproducing apparatus. There are many difficulties. More particularly, problems may arise when trying to reproduce both data existing outside the recording medium and data recorded in the recording medium (e.g., Blu-ray Disc BD) as a single reproduction unit.

Accordingly, the present invention is directed to a method and apparatus for reproducing data recorded on a recording medium and local storage that substantially solves one or more problems due to the limitations and disadvantages of the prior art.

One object of the present invention is to provide a method of constructing a reproduction management file for reproducing both data recorded in a high density recording medium and data stored in local storage.

Additional advantages, objects and features of the present invention will become apparent to those skilled in the art from the teachings of the present invention in the following description. The objects and other advantages of the present invention are realized and attained by the structure particularly pointed out in the accompanying drawings and claims and the description.

A method for recording data recorded on a recording medium for achieving these objects and other advantages, and also according to the object of the present invention, includes main data recorded on the recording medium and sub data stored in local storage. Playing by using a playlist file including a sub path, wherein the main path includes a playitem for playing the main data, and the sub path includes a sub associated with the play of the main data. And at least one subplayitem associated with a playitem for reproduction of data, wherein the playlist file further includes subpath type information indicating whether at least one subplayitem (SubPlayItem) included in the subpath is synchronized with the playitem. Include.

According to another aspect of the present invention, a method for reproducing data recorded on a recording medium includes main data recorded on the recording medium and sub data stored in the local storage, and a playlist file including the main path and the sub path. And playing back, wherein the main path includes a plurality of playitems for reproducing main data, and the subpath includes at least one subplay associated with a playitem for reproducing sub data associated with reproducing main data. The playlist file further includes sub-path type information indicating whether at least one sub-playitem included in the sub-path is synchronized with the playitem.

According to another aspect of the present invention, a method for reproducing data recorded on a recording medium includes main data of AV data and original auxiliary data recorded on the recording medium, and additional auxiliary data stored in local storage. Playing back using a playlist file including a path, an original subpath and at least one additional subpath, wherein the main path includes a plurality of playitems for reproduction of AV data, and the original subpath A subplayitem associated with a playitem for reproduction of the original supplementary data, wherein each additional subpath includes at least one subplayitem associated with a playitem for reproduction of the supplementary supplementary data, and the playlist file includes each supplementary sub-item; Whether at least one subplayitem included in the path is synchronized with the playitem. It also contains subpath type information indicating.

According to another aspect of the present invention, a method for reproducing data recorded on a recording medium includes a main path and a sub path of AV data and original auxiliary data recorded on the recording medium, and additional auxiliary data stored in the local storage. Playing the playlist file including a playlist file, wherein the main path includes a plurality of playitems for reproducing the AV data, and the subpath includes any of original and additional auxiliary data associated with the reproduction of the AV data. And at least one subplayitem associated with one playitem, and the playlist file further includes subpath type information indicating whether at least one subplayitem included in the subpath is synchronized with the playitem.

According to another aspect of the present invention, an apparatus for reproducing data recorded on a recording medium comprises: a pickup section for reading main data recorded on the recording medium, a local storage storing sub data associated with the main data; And a decoder for decoding the main data and the sub data using a playlist file including the main path and the sub path, wherein the main path includes a playitem for reproduction of the main data, and the sub path includes And at least one subplayitem associated with a playitem for reproduction of sub data associated with the play, wherein the playlist file includes subpath type information indicating whether at least one subplayitem included in the subpath is synchronized with the playitem. It includes more.

According to another aspect of the present invention, an apparatus for reproducing data recorded on a recording medium comprises: a pickup section for reading main data recorded on the recording medium, a local storage storing sub data associated with the main data; And a decoder for decoding the main data and the sub data using a playlist file including the main path and the sub path, wherein the main path includes a plurality of playitems for reproduction of the main data, and the sub path includes the main path. A subpath type that indicates whether at least one subplayitem included in the subpath is synchronized with the playitem, wherein the playlist file includes at least one subplayitem associated with a playitem for reproduction of the subdata associated with the reproduction of the data; It contains more information.

According to another aspect of the present invention, an apparatus for reproducing data recorded on a recording medium includes: a pickup section for reading AV data recorded on the recording medium, and original auxiliary data associated therewith, and an additional auxiliary associated with the AV data. A decoder for decoding AV data and one of original and additional auxiliary data using a local storage for storing data, and a playlist file including a main path, an original subpath and at least one additional subpath, The main path includes a plurality of playitems for reproducing AV data, the original subpath includes subplayitems associated with playitems for reproducing original auxiliary data, and each additional subpath includes a plurality of playitems for additional auxiliary data. At least one subplayitem associated with a playitem for playback, Further it includes a sub-path type information indicating that the at least one sub-play item and a play item included in the synchronization portion of each sub-path.

According to another aspect of the present invention, an apparatus for reproducing data recorded on a recording medium includes: a pickup section for reading AV data recorded on the recording medium, and original auxiliary data associated therewith, and an additional auxiliary associated with the AV data. A local storage for storing data, and a decoder for decoding any one of original and additional auxiliary data using a playlist file including a main path and a sub path, wherein the main path plays back the AV data. A plurality of playitems for the play, wherein the sub-path includes at least one subplayitem associated with at least one playitem of the original and additional auxiliary data associated with the reproduction of the AV data, and the playlist file Whether at least one subplayitem included in the path is synchronized with the playitem. That further includes a sub-path type information.

It is to be understood that the general description of the invention and the following detailed description are exemplary, intended to provide further explanation of the invention as claimed.

The accompanying drawings, which provide a further understanding of the invention and are incorporated as part of this specification, illustrate embodiments of the invention with descriptions that help explain the principles of the invention.

1 is a general view of the present invention.

2 shows an example of an AV stream and an interactive graphic stream provided on the same display screen according to the present invention.

3A and 3B show the structure and file structure of a playlist file as a reproduction management file for reproducing an interactive graphic stream according to the present invention.

3C shows a recording structure of data recorded on a recording medium according to the present invention.

4 shows an optical recording and / or reproducing apparatus according to the present invention.

5A and 5B illustrate a method and apparatus for reproducing data recorded on a recording medium and data stored in local storage according to the present invention.

6A-7H show an example of a method of generating (or organizing) a reproduction management file according to the present invention, in particular an example of a method of generating a playlist for playing an interactive graphics stream.

8 shows an example of an AV stream and a text subtitle stream provided on the same display screen according to the present invention.

9A and 9B show the structure and file structure of a playlist file as a reproduction management file for reproducing a text subtitle stream, according to the present invention.

10A-10E illustrate an example of a method of generating (or organizing) a reproduction management file according to the present invention, more particularly an example of a method of generating a playlist for playing a text subtitle stream.

11A-11G show the syntax of the reproduction management file according to the present invention.

Preferred embodiments of the invention are described in detail below, examples of which are illustrated with reference to the accompanying drawings. Like reference numerals are used to refer to like or similar parts throughout the drawings. In addition, although the terms used in the present invention are selected from generally known and common terms, some terms used in the description of the present invention are selected by the applicant for determination thereof, and the detailed description is provided in the related description. Described. Moreover, it is also required that the present invention be understood in the respective defined meanings rather than the terms actually used.

According to the present invention, " reproduction management file " refers to a management file for reproducing both data recorded on a recording medium and data stored in local storage. More particularly, in the Blu-ray Disc BD, the reproduction management file is referred to as "PlayList". A detailed description of the reproduction management file will be made with reference to the overall file structure with reference to FIGS. 2A and 2B. That is, although "PlayList" refers to a reproduction management file in the present invention, it is obvious that other terms used in Blu-ray Disc BD and other standard recording media can be interpreted. However, it is also obvious that the technical scope of other recording media does not depart from the spirit and scope of the present invention.

1 is a general view of the present invention. More particularly, FIG. 1 shows an example of the combination use of the optical recording and / or reproducing apparatus 10 with other peripheral devices. Thus, the "optical disc recording and / or reproducing apparatus 10" can record and / or reproduce data on / from optical discs of various standards. Depending on the design, the device can record / play back data on / from an optical disc dedicated to a particular standard (eg, Blu-ray Disc (BD)), or can only play data from the optical disc. However, the Blu-ray Disc (BD) standard is completed, and a Blu-ray Disc player (BD-player) or Blu-ray disc that plays back data recorded on a Blu-ray Disc (BD) and other peripheral devices, that is, a Blu-ray Disc (BD). In view of the fact that it is expected to be associated with a Blu-ray disc recorder (BD-recorder) for recording data on a ray disc BD, an example for the optical recording and / or reproducing apparatus 10 according to the present invention will be described. will be. It is also apparent that the "optical recording and / or reproducing apparatus 10" may be referred to as a "driver" which may be provided in a computer.

Apart from the function of recording and / or reproducing the optical disc, the optical recording and / or reproducing apparatus 10 according to the present invention receives an external input signal, processes the received signal and displays the processed signal on the display 20. It also has the capability to provide a signal to the viewer by transmitting on the screen via. In this case, there is no limitation on the external signal that can be input. Nevertheless, the most common external input signal is a digital broadcast program (DTV) or the Internet. More particularly, since the Internet can be easily accessed by the public, a user can download this data via the optical recording and / or reproducing apparatus 10 to use specific data provided on the Internet. The present invention provides the main data when the main data is loaded into the optical recording and / or reproducing apparatus 10 and recorded on the optical disc BD, and when the sub data associated with the main data is present in an external source such as the Internet. The data is reproduced efficiently by combining the sub data.

For the sake of simplicity of the description of the present invention, "main data" is referred to as a signal recorded in the optical disk, and "sub data" is referred to as a signal present in an external source external to the optical disk. However, the term is based only on the method of acquiring the data, and the main data and the sub data do not limit the data to only a specific type of data. Accordingly, the main data includes audio data, presentation graphic (PG) data, text subtitles, interactive graphic (IG) data, and the like. Further, the present invention is not limited to the above-described example, and other types existing in an external source associated with the main data may be used as the sub data. In the present invention, "IG" and "text subtitle" are given as examples of sub data to be reproduced.

More particularly, it is assumed that a specific film video / audio stream (AV stream) is recorded as main data on the optical disc. It is also assumed that an "IG stream" associated with the AV stream exists on the Internet as sub data. The user then wants to download the interactive graphics stream, which is sub data residing on the Internet, and wants to play the downloaded IG stream along with the AV stream included in the main data. In order to meet the needs of the user, an association between the AV stream in the optical disc and the interactive graphic stream downloaded and stored needs to be determined, and the user manages (or controls) and plays the desired data (ie AV stream and IG stream). There is also a need for a systematic way to do this.

2 shows an example of an interactive graphic stream and an AV stream displayed on the same screen. In general, an AV stream is displayed on the entire screen. In contrast, an interactive graphics stream is only displayed on a small area within the screen (also referred to as an "object"). The interactive graphic stream is provided from main data (eg, the main interactive graphic stream) recorded in the optical disc, or from sub data (eg, auxiliary interactive graphic stream) downloaded from an external source.

In order to meet the needs of the user, a file structure is required which associates the main data with the sub data (most commonly the auxiliary interactive graphics stream), which is described below with reference to FIGS. 3A-3C.

Referring to FIG. 3A, which shows a file structure for controlling information recorded in a disc, at least one BD directory BDMV is included in a root directory. Each BD directory contains " index.bdmv " and " MovieObject.bdmv ", which represents a general file structure used when talking to one or more users. Each BD directory contains four file directories containing data to be reproduced, and information required to reproduce the data. The file directory included in each BD directory is the auxiliary data directory AUXDATA, the stream directory STREAM, the clip information directory CLIPINF, and the playlist directory PLAYLIST.

The auxiliary data directory AUXDATA includes additional data files required for reproduction of the optical disc, such as a "Sound.bdmv" file, a "aaaaa.otf" file, and the like. The "Sound.bdmv" file provides sound when playing an interactive graphics (IG) stream, and the "aaaaa.otf" file provides font information when playing a disc. The stream directory STREAM includes an AV stream file and an interactive graphics stream file. More particularly, each stream may generally be in the form of MPEG2 transport packets. In the BD standard, each stream described above is referred to as a clip file. Referring to FIG. 3A, among the stream files, "01000.m2ts" is an AV stream multiplexed with an interactive graphic stream, and "02000.m2ts" represents an independent AV stream not multiplexed with any interactive graphic stream. , "10001.m2ts" represents an interactive stream.

Furthermore, the clip information directory CLIPINF includes clip information files (eg, 01000.clpi, 02000.clpi, 10001.clpi) having a one-to-one correspondence with each stream file (clip file) included in the stream directory. The clip information file (* .clpi) contains attribute information and timing information of the stream file (clip file). In the BD standard, each pair of AV streams (* .m2ts) and corresponding clip information files (* .clpi) have a one-to-one correspondence with each other and are designated as clips. Therefore, each of "01000.clpi", "02000.clpi", and "10001.clpi" included in the clip information directory (CLIPINFO) is "01000.m2ts", "02000.m2ts", and "10001. m2ts "includes attribute information and timing information corresponding to each. Thus, each pair of "01000.clpi" and "01000.m2ts", "02000.clpi" and "02000.m2ts", "10001.clpi" and "10001.m2ts" forms a clip.

More specifically, clips formed in "01000.clpi" and "01000.m2ts" pairs are referred to as "AV streams multiplexed with IG", and clips formed in "02000.clpi" and "02000.m2ts" pairs are referred to as "IG and Non-multiplexed AV clips. Moreover, clips formed in pairs "10001.clpi" and "10001.m2ts" represent clips formed only of "interactive graphic streams" without any AV streams. Such clips are referred to as "IG clips". Also, in the present invention, "main clip" refers to a clip associated with main data recorded on an optical disk, and "sub clip" refers to a clip associated with sub data downloaded and stored in local storage.

Referring to FIG. 3A, a playlist directory PLAYLIST includes one or more playlist files (* .mpls), each playlist file (* .mpls) having at least one playlist specifying a playback interval for a particular clip. Contains play items. More specifically, the playitem includes information specifying presentation start and presentation end time (In-Time, On-Time) for playback of a particular clip, which is designated as clip_Information_File_Name in the playitem. Thus, a playlist file (* .mpls) represents a playback section that plays back a predetermined clip from a combination of one or more playitems. The playlist also includes a subplayitem for reproducing data different from the data indicated by the playitem.

3B shows the relationship (or association) between the playlist file and the main clip. More particularly, the playlist file includes a main path having at least one playitem, and the playitem contains reproduction management information for playing a particular AV clip. Also, upon request, the playlist file includes a subpath that includes at least one subplayitem. Here, the subplayitem contains reproduction management information for reproducing at least one interactive graphic clip (IG # 1, IG # 2). For example, interactive graphic clip # 1 (IG # 1) provides menu information in English. In addition, interactive graphic clip # 2 (IG # 2) provides menu information composed in Korean. Therefore, when playing the playlist of Fig. 3B, the AV stream in the AV clip is played by the playitem. Accordingly, the interactive graphic stream corresponding to either of IG # 1 and IG # 2 selected by the sub playitem is not synchronized with the playitem. The AV stream whose reproduction is managed by the playitems is either multiplexed with the interactive graphics or not multiplexed with the interactive graphics. It may also be selectively applied by the author of the optical disc.

3C shows a general structure of information (or data) associated with a file structure recorded on an optical disc according to the present invention. More particularly, the disk volume starting from the inner circumference (or center) of the disk is divided between the file system information area occupying the innermost part of the disk volume, the stream area occupying the outermost part of the disk volume, and the file system information area and the stream data area. Contains the occupied database area. In the file system information area, system information for controlling the entire data file is recorded. In addition, main data such as audio / video / graphic data is recorded in the stream area. General files, playlist files, and clip information files are recorded in the database area of the disk volume. Thus, using the information in the database area, the user can select the stream to play, determine and use the appropriate playback method of the selected stream.

Thus, if the interactive graphics streams are multiplexed with the AV streams and these streams are recorded on the optical disc, the two streams are synchronized. However, if the interactive graphic stream recorded on the optical disc is not multiplexed with the AV stream, the interactive graphic stream and the AV stream are synchronized. Moreover, it is obvious that the interactive graphic stream is not multiplexed with the AV stream since the interactive graphic stream stored in the local storage is stored in a different location (location) than the AV stream recorded and stored on the optical disc. However, when the user wants to play an interactive graphic stream stored in local storage with an AV stream recorded on an optical disc, the user can play both of these streams synchronously and asynchronously, and also all of these streams asynchronously. The case of time must be taken into account. The present invention seeks a preferred method of creating a playlist, and a method and apparatus for reproducing data using a newly created playlist. Accordingly, playlists created in accordance with the present invention are referred to as "composite playlists". However, this term uses a newly created playlist to simply distinguish between existing playlists.

4 shows an optical recording and / or reproducing apparatus 10 according to the present invention. The optical recording and / or reproducing apparatus basically includes a pickup section 11 for reproducing control information including main data and file information recorded on an optical disc, and a servo 14 for controlling the operation of the pickup section 11. And a signal processor 13 for restoring a reproduction signal received from the pickup unit 11 to a predetermined signal value or for modulating data recorded as an optical disc recordable signal and transmitting the modulated data, and downloading from an external source. A local storage 15 for storing the sub data, and a microcomputer 16 for systematically controlling the above-described operation. In addition, the controller 12 downloads sub data existing in an external source according to a user command and stores the downloaded sub data in the local storage 15. The controller 12 generates a composite playlist for reproducing the main data recorded in the optical disc and the sub data stored in the local storage 15. Then, in accordance with the user command, the controller 12 reproduces the main data and the sub data using the composite playlist. The decoder 17 performs the final decoding of the output data (ie main data and / or sub data) under the control of the controller 12 and provides the decoded data to the user. Furthermore, in order to record the signal in the optical disc, the encoder 18 converts the input signal into a specific format signal (eg, MPEG2 transport stream) under the control of the controller 12, and converts the converted signal into the signal processor 13. To provide.

The local storage 15 for storing sub data can also be configured as an HDD (hard disk drive), for example. In addition, newly created composite playlists may be stored in local storage for future use or temporarily stored in separate dynamic memory for use. As an example of the present invention, the optical recording and / or reproducing apparatus separately creates a new composite playlist. In another example, when downloading sub data and storing the downloaded sub data, the composite playlist is also downloaded and stored. In this case, the optical recording and / or reproducing apparatus 10 is not required to generate another separate composite playlist. Moreover, if the user wishes to store the sub data and the composite playlist in the local storage 15 for future use, it is desirable to manage only the main data by giving priority to the playlist recorded in the optical disc.

Of the structure of the optical recording and / or reproducing apparatus 10 according to the present invention shown in FIG. 4, FIGS. 5A and 5B show an apparatus for reproducing data and a method of reproducing data, respectively. More particularly, when the optical disc having the disc identification (disc_id) of disc # 1, i.e. disc_id = # 1 is loaded, the controller 12 of the optical recording and / or reproducing apparatus 10 is connected to the pickup section 11 and the signal processor. (13) is used to verify the identification of the corresponding disk. Thereafter, the controller 12 verifies whether the set of sub data associated with "disc_id = # 1" exists among the sub data stored in the local storage 15 (S10).

For example, if three auxiliary interactive streams (Aux IG1, Aux IG2, Aux IG3) are present in the local storage for "disc_id = # 1", the controller 12 first plays the playback stream according to the user's request or system settings. Select (S20). That is, the controller 12 notifies the user that the auxiliary interactive graphic stream exists as sub data, and the controller 12 plays back only main data recorded on the disk or according to a user command or system setting, 15) Select and play a composite playlist containing auxiliary interactive graphics streams. Therefore, when the user combines and reproduces the main data recorded on the optical disk and the sub data stored in the local storage 15, the controller 12 generates a composite playlist file and uses the newly created composite playlist file. The data is reproduced (S202).

Accordingly, the newly created composite playlist file is stored in the local storage 15 and can be used again when reproducing sub data in a later process. FIG. 5A shows an example of a composite playlist already stored in the local storage 15 for reproducing the auxiliary audio stream which is the sub data for "disc_id = # 2". Thus, when an optical disc having a disc ID of "disc_id = # 2" is loaded into the optical recording and / or reproducing apparatus 10, a composite playlist already stored in the local storage 15 is used, and the use of data is It can be done immediately without having to create a new composite playlist. Moreover, as noted above, composite playlists can also be downloaded and used. Hereinafter, various methods for generating a composite playlist according to the present invention are described with reference to Figs. 6A-7H.

Common features are described below for all methods of creating a composite playlist according to the present invention. File information for reproducing a combination of main data and sub data is included in a playlist. Here, the main data is reproduced by at least one playitem included in the main path and a subplayitem included in the subpath in the playlist file. Also, the sub data is reproduced only by the sub play items included in the sub path in the playlist file.

In addition, the interactive graphics stream is provided as an example of sub data that can be applied to FIGS. 6A-7H. More particularly, the auxiliary interactive graphic stream stored in local storage is constructed in a language different from the main interactive graphic stream recorded in the main data. Alternatively, even if the sub data is configured in the same language as the main data, the sub data may be configured to have different attributes. These attributes include graphic properties, menu information represented by interactive graphic streams, and the like. That is, the auxiliary interactive graphic stream is used to replace the main interactive graphic stream existing in the optical disk or to attach a new interactive graphic stream. Alternatively, when the main interactive graphics stream is not present in the optical disc, the auxiliary interactive graphics stream can be used to additionally support interactive graphics.

Moreover, when the main interactive graphic stream included in the main data is multiplexed with the AV stream, the main interactive graphic stream is reproduced by the playitem. Conversely, when the main interactive graphic stream is not multiplexed with the AV stream, the main interactive stream is identified as a separate IG stream played back to the subplayitem. Thus, when playing auxiliary interactive graphic streams (e.g., AV streams and main interactive graphic streams) together with the main data, in all cases of the auxiliary IG stream synchronized with the main data and the auxiliary IG stream played asynchronously with the main data. Will be described later in the detailed description of the invention.

Moreover, file information used to reproduce the main data and sub data is linked in the playlist file. In particular, the supplemental interactive graphics stream consists of separate subpaths within the composite playlist. Here, at least one subplayitem is created in the subpath to manage the reproduction of the auxiliary interactive graphic stream. As a result, in order to create a composite playlist according to the present invention, the information associated with the composite playlist must be stored in the local storage 15 in advance. More particularly, the associated information must be prepared in advance by the author of the optical disc and downloaded from an external source along with the sub data. Referring to FIG. 5A, "Info" stored in local storage 15 represents information required for creating a composite playlist. Among the methods of creating a composite playlist according to the present invention, FIGS. 6A-6E show that when the "main interactive graphics stream" is configured as a separate stream that is not multiplexed with the AV stream, it also plays a main interactive graphics stream. For example, when there is a separate sub path, an example of generating another sub path for managing reproduction of the "secondary interactive graphic stream" is shown. In other words, the example shown in Figs. 6A-6E is most applicable when the "secondary interactive graphic stream" is not synchronized (unsynchronized) with the AV stream included in the main data. Here, the example shown in Figs. 6A-6E is not limited to only when the auxiliary interactive graphic stream is asynchronous with the AV stream included in the main data. Depending on the use applied, these examples may also be adopted when the auxiliary interactive graphic stream is synchronized with the AV stream included in the main data.

Referring to FIG. 6A, when generating (configuring) a sub path for an auxiliary interactive graphic stream, a sub path is generated for each of the auxiliary interactive graphic streams. For example, each of subpath # 2, subpath # 3, and subpath # 4 are secondary interactive graphics stream # 1, secondary interactive graphics stream # 2, and secondary interactive graphics stream # stored in local storage 15. It is formed to manage the reproduction of the three respectively. Accordingly, subpath # 1 manages reproduction of the main interactive graphic stream recorded on the optical disc. In addition, the method of managing the main IG stream using the sub path # 1 is the same as the method described with reference to FIG. 3B.

More particularly, in this example, as shown in FIG. 5A, when three auxiliary interactive graphic streams exist in local storage, a subpath is created for each of the three auxiliary interactive graphic streams, so that each auxiliary IG The stream is managed by the corresponding subplayitem, creating a structure of "1 = stream = 1 SubPlayItem = 1 subpath". Therefore, when playing the above-described composite playlist, any one of the interactive graphic streams designated by sub paths # 1 to subpath # 4 is included in the optical disc and optionally together with the main AV stream designated by the main path. Is played. In other words, one of the main interactive graphic stream recorded on the disc and the auxiliary interactive graphic stream stored in the local storage 15 is selectively reproduced. However, depending on the applied use, when there is an auxiliary interactive graphic stream, it is possible to prioritize any one of the auxiliary interactive graphic streams.

Referring to FIG. 6B, when generating (configuring) subpaths for the auxiliary interactive graphic streams, the plurality of auxiliary interactive graphic streams are integrated to be managed by a single subpath. For example, each of the auxiliary interactive graphic stream # 1, the auxiliary interactive graphic stream # 2, and the auxiliary interactive graphic stream # 3 are stored in the local storage 15, so that the sub-playitem # 2, the sub-playitem # 3, and the sub-interactive item # 3 are stored. Each item is designated as PlayItem # 4. Furthermore, subplayitem # 2, subplayitem # 3, and subplayitem # 4 are collectively designated by a single subpath (e.g., subpath # 2). Accordingly, subpath # 1 manages reproduction of the main interactive graphic stream recorded on the optical disc. In addition, the method of managing the main IG stream using the sub path # 1 is the same as the method disclosed in FIG. 3B.

More specifically, in this example, when three auxiliary interactive graphic streams exist in local storage as shown in FIG. 5A, each of the auxiliary interactive graphic streams is subplayitem # 2, subplayitem # 3, and subsubscriber. Each item is designated as PlayItem # 4. Here, the three playitems are integrated to generate a single subpath (eg, subpath # 2) to generate a structure of "1 stream = 1 SubPlayItems" which is a structure of "a multiple of SubPlayItems = 1 subpath". . Therefore, when playing back the above-described composite playlist, either one of the sub path # 1 and the sub path # 2 is selected to perform the playback. Then, one of the subplayitems designated by the selected subpath is included in the optical disc and selectively reproduced together with the main AV stream designated by the main path.

Referring to FIG. 6C, upon generating (or configuring) a subpath for the auxiliary interactive graphic stream, the plurality of auxiliary interactive graphic streams are integrated to generate a single subplayitem. For example, the auxiliary interactive graphic stream # 1, the auxiliary interactive graphic stream # 2, and the auxiliary interactive graphic stream # 3 stored in the local storage 15 are managed by a single subplayitem (eg, subplayitem # 2). Are integrated to have playback. Hereinafter, subplayitem # 2 is formed to be included in a single subpath (subpath # 2). Accordingly, subpath # 1 manages reproduction of the main interactive graphic stream recorded on the optical disc. In addition, the method of managing the main IG stream using the sub path # 1 is the same as the method disclosed in FIG. 3B.

More specifically, in this example, when three auxiliary interactive graphic streams exist in local storage as shown in FIG. 5A, each of the auxiliary interactive graphic streams is subplayitem # 2, subplayitem # 3, and subsubscriber. Each item is designated as PlayItem # 4. Here, three playitems are integrated to be generated by a single subplayitem (eg, subplayitem # 2). The subplayitem is then included in a single subpath (eg, subpath # 2) to create a structure of "a multiple of stream = 1 SubPlayItem = 1 sub path". Therefore, when playing back the above-described composite playlist, either one of the sub path # 1 and the sub path # 2 is selected to perform the playback. Then, one of the interactive graphic streams designated by the selected sub path is included in the optical disc and selectively reproduced together with the main AV stream designated by the main path.

Among the methods of creating a composite playlist according to the present invention, FIGS. 6D-6E illustrate a sub path managing a "main interactive graphic stream" and a sub path managing a "secondary interactive graphic stream" into a single sub path. An example of integrating is shown. Referring to FIG. 6D, a plurality of subplayitems are configured in a single subpath to manage playback of the main interactive graphic stream and the auxiliary interactive graphic stream. More specifically, within a single subpath, subplayitem # 1 specifies a plurality of main interactive graphics streams (main interactive graphics stream # 1, main interactive graphics stream # 2, and main interactive graphics stream # 3). To manage playback of the main interactive graphics stream. Within the same single subpath, subplayitems (subplayitem # 2, subplayitem # 3, and subplayitem # 4) are created for each secondary interactive graphics stream stored in local storage 15, Manages playback of auxiliary interactive graphics streams. In addition, each of the subplayitem # 2, the subplayitem # 3, and the subplayitem # 4 each separately supports the auxiliary interactive graphic stream # 1, the auxiliary interactive graphic stream # 2, and the auxiliary interactive graphic stream # 3. It is created to specify. In the following, the main interactive graphic stream is configured to be designated by subplayitem # 1. In other words, subplayitem # 2, subplayitem # 3, and subplayitem # 4 are configured in a single subpath.

Referring to FIG. 6E, a single subplayitem is configured in a single subpath to manage playback of the main interactive graphics stream and the auxiliary interactive graphics stream. More particularly, a single subplayitem (SubPlayItem # 1) incorporating the main interactive graphic stream and the auxiliary interactive graphic stream for reproduction management is included in a single subpath. Thus, SubPlayItem # 1 is a plurality of main interactive graphic streams (main interactive graphic stream # 1, main interactive graphic stream # 2, and main dialog) recorded on an optical disc in order to manage playback of the interactive graphic stream. Integrated graphics stream # 3) and a plurality of secondary interactive graphics streams (secondary interactive graphics stream # 1, secondary interactive graphics stream # 2, and secondary interactive graphics stream # 3) stored in the local storage 15. To create a structure of "all main / auxiliary interactive graphic streams = 1 SubPlayItem = 1 sub path".

Among the methods of creating a composite playlist according to the present invention, Figs. 7A-7H show that when the "main interactive graphic stream" is multiplexed with the AV stream or when the "main interactive graphic stream" is not recorded on the optical disc, An example of generating a sub path for managing reproduction of the "secondary interactive graphic stream" is shown. In other words, the example shown in Figs. 7A-7H is most applicable when the "secondary interactive graphic stream" is synchronized with the AV stream included in the main data. Furthermore, in order to synchronize the "secondary interactive graphic stream" with the AV stream included in the main data, it is obvious that sync information indicating at which position of the main AV stream is synchronized is required. Sync information should be provided from a subplayitem included in a subpath described below with reference to FIGS. 7A-7H. Hereinafter, the example shown in FIGS. 7A-7H is not limited to only when the auxiliary interactive graphic stream is synchronized with the AV stream included in the main data. Depending on the use applied, these examples also apply when the auxiliary interactive graphic stream is out of sync with the AV stream contained in the main data.

Referring to FIG. 7A, when generating (or constructing) a subpath for an auxiliary interactive graphic stream, a subplayitem is generated in a subpath, and a sub-one matching one-to-one correspondence with each playitem in a main path. Playitems are created (or configured) individually. More specifically, by specifying subplayitems corresponding to all playitems simultaneously in the playlist, the main interactive graphic stream contained in the main clip and designated by each playitem is contained in the subclip and corresponding subplayitems. Replaced with the auxiliary interactive graphics stream specified by each. This makes management of each playitem simple and easy. Thus, when playing an optical disc using the above-described composite playlist, the video / audio (AV) signal is provided by the main A / V stream recorded in the disc, and the main interactive graphic stream is stored in the local storage 15. Provided by the stored secondary interactive graphics stream. In other words, the main interactive graphic stream recorded in the optical disc is replaced with the auxiliary interactive graphic stream stored in the local storage 15.

Referring to FIG. 7B, when generating (or constructing) a subpath for the auxiliary interactive graphic stream, the subplayitems are individually generated (configured) for the subplayitems matching one-to-one correspondence with each playitem in the main path. )do. However, matching subplayitems are not present in all playitems. In other words, by specifying a subplayitem corresponding to a particular playitem in a playlist, only the sub-interactive graphic streams included in the main clip and designated by the particular playitem are included in the subclip and corresponding subplayitems. Replaced with the auxiliary interactive graphics stream specified by. Thus, upon playing the optical disc using the above-described composite playlist, the interactive graphic stream is provided by the auxiliary interactive graphic stream stored in the local storage 15. However, when no subplayitem is present, the interactive graphics stream is included in the main clip and provided by the main interactive graphics stream specified by the corresponding playitem. The A / V signal is provided by the main AV stream recorded on the optical disc.

Referring to FIG. 7C, when generating (or configuring) a subplayitem in a subpath for an auxiliary interactive graphic stream, subplayitems that are matched in a one-to-one correspondence with each playitem in the main path are individually generated (or Configuration). However, multiple matching subplayitems exist in a single playitem. In other words, in Figs. 7A and 7B, one matching subplayitem exists in each playitem. In contrast, in FIG. 7C, a plurality of matching subplayitems exist in one playitem. Hereinafter, FIG. 7C shows an example for only a single playitem (PlayItem # 1). However, it is obvious that this feature of the present invention is equally applicable to other PlayItems (PlayItem # 2, PlayItem # 3).

More specifically, by designating a plurality of subplayitems corresponding to a particular playitem in a playlist, the main interactive graphic stream included in the main clip and designated by the playitem is contained in the plurality of subclips and corresponding plurality of subplayitems. Replaced with the auxiliary interactive graphics stream specified by the subplayitem. For example, the main interactive graphics stream played with PlayItem # 1 is replaced with two secondary interactive graphics streams for each part, which streams have different attributes (eg language). Thus, upon playing the optical disc using the above-described composite playlist, the interactive graphic stream is provided by the auxiliary interactive graphic stream stored in the local storage 15. However, when no subplayitem exists, the interactive graphics stream is included in the main clip and provided by the main interactive graphics stream specified by the playitem. The AV signal is provided by the main AV stream recorded on the optical disc.

Referring to FIG. 7D, when generating (or configuring) a subplayitem in a subpath for an auxiliary interactive graphic stream, subplayitems that are matched in a one-to-one correspondence with each playitem in the main path are individually generated (or Configuration). However, the sub-playitem matching the playitem exists only in a part of the entire reproduction (or presentation) portions reproduced by the playitem. More particularly, in FIGS. 7A-7C, one or more playitems match one entire playitem portion. However, in FIG. 7D, the subplayitems corresponding to one playitem exist only in a part. In other words, by specifying a subplayitem corresponding to a particular playitem that is included in the playlist only during a portion, the main interactive graphics stream included in the main clip and specified by the playitem, and the subplay and subplay Each of the auxiliary interactive graphic streams specified by the item is selectively played during the entire playback portion played by the corresponding playitem.

Therefore, since the reproduction unit (or the presentation unit) of the sub playitem in the subpath needs to be the same as the playitem in the main path, the subplayitem can apply the auxiliary audio stream more variously. In this case, however, a boundary is created between the playback (or presentation) of the main clip and the playback (or presentation) of the subclip. Hereinafter, the main clip is played with a playitem (e.g., PlayItem # 1), and then the playback of the main clip is changed to the playback of the sub clip. In this regard, the system needs to be supported so that seamless presentations can be performed between interactive graphic streams even at boundaries.

Referring to FIG. 7E, when generating (or configuring) a subplayitem in a subpath for an auxiliary interactive graphic stream, the subplayitems that are matched in a one-to-one correspondence with each playitem in the main path are individually generated (or configured). )do. However, each subplayitem is matched with its respective playitem by a different method. More specifically, in Fig. 7E, the example of generating the subplayitems shown in Figs. 7A-7D can be applied to each playitem. For example, a method of replacing the entire part of PlayItem # 1 with the subplayitem (as shown in FIG. 7A or 7B), and a method of replacing the entire part of PlayItem # 2 with the plurality of subplayitems (as shown in FIG. 7C). And a method of replacing only a part of the entire portion of PlayItem # 3 with the subplayitem (as shown in FIG. 7D), all apply to FIG. 7E.

Referring to FIG. 7F, when generating (or configuring) a subplayitem in a subpath for the auxiliary interactive graphic stream, the subplayitems that match the entire presentation part of the playlist are generated (or configured) individually. More specifically, by specifying subplayitems corresponding to all playitems simultaneously in a playlist, the main interactive graphic stream contained in the main clip and designated by each playitem is contained in the subclip and corresponding single subplayitem. Replaced with the auxiliary interactive graphics stream specified by. This simplifies the system.

Referring to FIG. 7G, when generating (or configuring) a sub playitem in a subpath for the auxiliary interactive graphic stream, the subplayitems that match the entire presentation part of the playlist are generated (or configured) individually. Here, the presentation unit is defined in chronological order within the subplayitem, including information on the presentation start time (In-Time) and the presentation end time (On-Time) of the sub clip whose reproduction is managed. In the case of FIG. 7, the subplayitem includes In-Time and On-Time matching with In-Time and On-Time for playing (presenting) the main path included in the playlist. However, in the case of FIG. 7G, the subplayitem includes a plurality of In-Time and On-Time. Accordingly, each part defined as In-Time and On-Time is referred to as a "time slot". For example, FIG. 7G illustrates three time slots "Time slot # 1", "Time slot # 2", and "Time slot # 3" included in the subplayitem. The time slot is generated from the random part. However, time slots also match PlayItem # 1, PlayItem # 2, and PlayItem # 3.

Referring to FIG. 7H, when generating (or configuring) the subplayitems in the subpath for the auxiliary interactive graphic stream, the subplayitems matching only a part of the entire playlist part are separately generated (or configured). More particularly, in the case of FIG. 7F, a single subplayitem (ie, the presentation (or playback) portion of the playlist) with In-Time and On-Time that matches the entire portion of the playitem is generated. However, in FIG. 7H, a subplayitem (i.e., a presentation (or playback) portion of the playlist) having an In-Time and On-Time corresponding to a portion within the entire portion of the playitem is generated. Accordingly, it is apparent that the concept of "time slot" applied to FIG. 7G also applies equally to FIG. 7H.

In other words, a part of the entire main data presentation portion reproduced (or presented) by the playlist is replaced with the sub data. For example, part of the whole part played by the composite playlist plays the main interactive graphic stream, and part of the other part plays the auxiliary interactive graphic stream. Therefore, the subplayitem can apply the auxiliary interactive graphic stream more diversely because the playout (or presentation) of the subplayitem in the subpath does not require the same as the playitem in the main path. In this case, however, a boundary is created between the playback (or presentation) of the main clip and the playback (or presentation) of the subclip. Hereinafter, the main clip is changed to playback of the sub clip during playback of the main clip. In this regard, the system needs to be supported such that seamless seamless presentation can be performed between interactive audio streams even at the boundary.

As described above, FIGS. 7A-7H illustrate examples of creating a single subpath. It is also apparent that the method disclosed in FIGS. 6A-6C can be used when generating a plurality of subpaths. More particularly, when the "main interactive graphics stream" exists as a separate stream that is not multiplexed with the main AV stream, it is preferred to apply to one of the methods disclosed in FIGS. 6A-6E. Alternatively, when the "main interactive graphics stream" is multiplexed with the main AV stream, it is desirable to apply to one of the methods disclosed in FIGS. 7A-7H. On the other hand, when the "secondary interactive graphics stream" is not synchronized with the main AV stream, it is desirable to apply it to one of the methods disclosed in Figs. 6A-6E. Conversely, when the "secondary interactive graphics stream" is asynchronous with the main AV stream, it is desirable to apply it to one of the methods disclosed in Figures 7A-7H.

Hereinafter, a method of generating and playing a playlist for managing reproduction of a text subtitle stream as sub data together with main data will be described below with reference to FIGS. 8-10E. Accordingly, a text subtitle stream, which is a set of information provided in text form, is commonly used as the dialogue of a movie. Therefore, the text subtitle stream according to the present invention should be provided after being synchronized with the AV stream. This is different from the interactive graphics stream described above, including when the interactive graphics stream is synchronized with the AV stream and when the interactive graphics stream is not synchronized (ie, asynchronous) with the AV stream. Moreover, the text subtitle stream according to the present invention corresponds to the entire presentation part of the playlist. In other words, a text subtitle stream is provided for each playitem, and the reproduction of the text subtitle stream is managed by the subplayitem synchronized with the main path. This is different from the example of generating a subplayitem for each playitem when the interactive graphic stream is synchronized with the AV stream (shown in FIGS. 7A-7E).

8 shows an example of an AV stream and a text subtitle stream provided on a display screen. The text subtitle may be provided from the main data or may be provided by the sub data. 9A and 9B show the file structure according to the present invention and the structure of a playlist file as a reproduction management file for reproducing a text subtitle stream. More particularly, compared to FIG. 3A, the text subtitle stream shown in FIG. 9A is composed of a separate text subtitle clip that is not multiplexed with the AV stream. Furthermore, referring to FIG. 9B, the reproduction of the text subtitle clip is managed by the subplayitems included in the subpath.

10A-10E show examples of generating (or constructing) a reproduction management file according to the present invention. More particularly, FIGS. 10A-10E illustrate a method of generating a playlist that plays a text subtitle stream. Accordingly, the example shown in FIGS. 10A-10E has the same structure as each of the examples applied to the interactive graphics stream shown in FIGS. 6A-6E. However, since the text subtitle stream is reproduced after being synchronized with the main AV stream as described above, it is self-evident that each subplayitem provided in the example shown in FIGS. 10A-10E has a set of sync information synchronized with the AV stream. Do. Therefore, since the example shown in Figs. 10A-10E has the same structure as the example shown in Figs. 6A-6E, the description of the same parts is omitted.

11A-11G illustrate the syntax of a composite playlist file for reproducing sub data stored in local storage 15 by respective hierarchy. 11A shows the syntax of the header portion of the playlist file (xxxxx.mpls). Identification information, such as the "MPLS" character code, identifying the current file as a playlist file is recorded in the "type_indicator" field. Information indicating the version of the playlist file is recorded in the "version_number" field. Position information indicating at which position the "PlayList ()" field starts is recorded in the "PlayList_start_address" field, and positional information indicating at which position the "PlatListMark ()" field starts is recorded in the "PlayListMark_start_address" field. The playlist file (xxxxx.mpls) also includes a "AppInfoPlayList ()" field, a "PlayList ()" field and a "PlatListMark ()" field. The "AppInfoPlayList ()" field includes information on the playback method (ie, PlayList_playback_type). The " PlayList () " field contains playitem information and sub path information, and the " PlatListMark () " field contains a mark pointer used for a specific playback. Details of the "PlayList ()" field according to the present invention are described below.

11B shows the header syntax of the "PlayList ()" field included in the playlist file. Hereinafter, information on the size of the "PlayList ()" field is recorded in the "length" field. Information about the number of playitems included in the playlist file is recorded in the "number_of_PlayItem" field, and information about the number of subpaths recorded in the playlist file is recorded in the "number_of_SubPaths" field. Accordingly, the "PlayItem ()" field and the "SubPath ()" field are generated based on the aforementioned number information. The "PlayItem ()" field includes a "STN_table ()" field, where all stream information can be used in the corresponding playitem. The optical recording and / or reproducing apparatus 10 selects and reproduces the stream information defined in the "STN_table ()" field when reproducing the "PlayList ()" field and the "SubPath ()" field associated with it. Therefore, all of the above-described stream information (shown in Figs. 6A-10E) is recorded in the "STN_table ()" field.

Hereinafter, the syntax for the "STN_table ()" field in the "PlayItem ()" field will be described below with reference to FIGS. 11C-11E, and the syntax for the "SubPath ()" field will be described below with reference to FIG. 11F. In addition, the syntax for the "SubPlayItem ()" field will be described later with reference to FIG. 11G. 11C shows a header syntax of the "STN_table ()" field included in the "PlayItem ()" field. More particularly, the size information of the "STN_table ()" field is recorded in the "length" field. The number of playable video streams associated with the playitem is recorded in the "number_of_video_stream_entries" field, and the number of playable audio streams associated with the playitem is recorded in the "number_of_audio_stream_entries" field. The number of playable text subtitle streams associated with the playitem is recorded in the "number_of_PG_textST_stream_entries" field. In addition, the number of playable interactive graphic streams associated with the playitem is eventually recorded in the "number_of_IG_stream_entries" field. Stream information is recorded according to the above-mentioned number information for each corresponding field. However, each stream information is recorded in the "stream_entry ()" field and the "stream_attributes ()" field, respectively. Hereinafter, the stream type, the main clip information, and the sub clip information are recorded in the "stream_entry ()" field, and the attribute information of each stream is recorded in the "stream_attributes ()" field.

11D shows the syntax of the "stream_entry ()" field included in the "STN_table ()" field. More particularly, the size information of the "stream_entry ()" field is recorded in the "length" field, and the source information of the corresponding stream is recorded in the "type" field. For example, type "1" is included in the main clip and indicates the stream type specified by the playitem. Type "2" is designated by the sub path and indicates the type of stream recorded in the optical disc. Type "3" is specified by the subpath and indicates the stream type stored in the local storage 15. Therefore, when the type of the "stream_entry ()" field is "1", the packet ID (PID) information of the corresponding main clip is recorded in the "ref_to_stream_PID_of_mainclip" field. In addition, when the type of the current "stream_entry ()" field is "2" or "3", the packet ID (PID) information of the corresponding subclip is recorded in the "ref_to_stream_PID_of_subclip" field. Clearly, when a plurality of subpaths are included, the identification information of the corresponding subpath is recorded in the "ref_to_subPath_id" field, and the identification information of the corresponding subclip is recorded in the "ref_to_subclip_entry_id" field.

11E illustrates the syntax of the field "stream_attributes ()" included in the field "STN_table ()". More particularly, the size information of the "stream_attributes ()" field is recorded in the "length" field, and the information of the stream type is recorded in the "stream_coding_type" field. For example, "stream_coding_type = ox02" represents a video stream (more particularly, an MPEG2 video stream), and attribute information is recorded in the "frame_rate" field. In addition, "stream_coding_type = ox80 or ox81 or 0x82" represents an audio stream coded with various types. Hereinafter, the attribute information includes an "audio_presentation_type" in which information on the number of channels is recorded when playing (or presenting) an audio stream, and an "audio_language_code" field in which language information of the audio stream is recorded.

Moreover, "stream_coding_type = ox90" represents a presentation graphics stream. The attribute information includes "PG_language_code" in which information of the language used for the presentation graphic is recorded. Also, "stream_coding_type = ox91" represents an interactive graphic stream. The attribute information includes "IG_language_code" in which information of a language used for interactive graphics is recorded. Finally, "stream_coding_type = ox92" indicates a text subtitle stream. The attribute information includes "textST_language_code" in which information of a language used in a text subtitle is recorded, and "character_code" in which information of a character code used in the text subtitle is recorded. Accordingly, only a limited type of attribute information for each stream is shown in FIG. 11E. However, it is obvious that a wider range of attribute information may be included in each stream type.

11F shows the header syntax of the "SubPath ()" field included in the "PlayList ()" field. More specifically, the size information of the "SubPath ()" field is recorded in the "length" field, the information of the stream type is recorded in the "stream_coding_type" field, and the source information of the corresponding subpath is recorded in the "SubPath_Type" field. For example, SubPath_type "n" represents a subpath recorded in the optical disk, and SubPath_type "m" represents a subpath stored in the local storage 15.

According to an embodiment, a plurality of subpaths is configured for each stream attribute. In this case, the subpath type is described in more detail. More specifically, SubPath_type "n1" or "m1" represents an audio stream, SubPath_type "n2" or "m2" represents a text subtitle stream, and SubPath_type "n3" or "m3" is not interactive with the AV stream. Represents a graphics stream, SubPath_type "n4" or "m4" indicates a presentation graphics stream, and SubPath_type "n5" or "m5" indicates an interactive graphics stream that is synchronized with the AV stream. Further, flag information indicating whether the sub path presentation is repeated is recorded in the "is_repeat_SubPath" field. The number of subplayitems included in the subpath is recorded in the "number_of_SubPlayItem" field. Information corresponding to each subplayitem is recorded in the "SubPlayItem ()" field.

11G shows the syntax of the "SubPlayItem ()" field included in the "SubPath ()" field. More specifically, the size information of the "SubPlayItem ()" field is recorded in the "length" field, the sub clip name managed by the corresponding subplayitem is recorded in the "Clip_information_file_name" field, and the coding type of the corresponding clip is "Clip_codec_identifier". "Is recorded in the field. The STC_id of the designated sub clip is specified in the "ref_to_STC_id" field. In addition, the presentation start time (IN_Time) and presentation end time (OUT-Time) presented (or played) by the subplayitem are recorded in the "SubPlayItem_IN_time" field and the "SubPlayItem_OUT_time" field, respectively.

In addition, information identifying whether one or more clips are managed by the subplayitem is recorded in the "is_multi_clip_entries" field. Accordingly, the foregoing examples are examples where only one interactive graphic clip or text subtitle clip exists in the subplayitem, and examples where a plurality of interactive graphic clip or text subtitle clip exists within the subplayitem. It includes. Thus, when "is_multi_clip_entries = 0b", only one interactive graphic clip or text subtitle clip exists within the subplayitem. Also, when "is_multi_clip_entries = 1b", a plurality of interactive graphic clips or text subtitle clips are present in the subplayitems. Accordingly, when "is_multi_clip_entries = 1b" represents a plurality of interactive graphic clips or text subtitle clips existing in the subplayitem, the corresponding number information is recorded in the "number_of_clip_entries" field. In addition, information on each corresponding clip number is recorded in a "Clip_information_file_name" field, a "Clip_codec_identifier" field and a "ref_to_STC_id" field.

Moreover, in the above examples, when the interactive graphic clip or text subtitle clip requires synchronization with the main AV stream, the "sync_PlayItem_id" field and the "sync_start_RTS_of_PlayItem" field are used. More particularly, PlayItem identification information (eg, PlayItem # 1, PlayItem # 2, and PlayItem # 3) associated with the presentation start time of the subplayitem is recorded in the "sync_PlayItem_id" field. Also, during the presentation start time of the designated playitem, timing information indicating when synchronization is to be performed is recorded in the "sync_start_PTS_of_PlayItem" field. Therefore, based on the information recorded in the "sync_PlayItem_id" field and the "sync_start_PTS_of_PlayItem" field, when the presentation of the specified playitem reaches an arbitrary time position (ie, the time recorded in the "sync_start_PTS_of_PlayItem" field), the subplayitem The presentation of is started to match the synchronization of the playitem and the subplayitem.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

Claims (30)

A method of recording data recorded on a recording medium, Reproducing the main data recorded on the recording medium and the sub data stored in the local storage using a PlayList file including a main path and a sub path, The main path includes a PlayItem for playing the main data, and the sub path includes at least one SubPlayItem associated with a playitem for playing the sub data associated with playing the main data. Including; The playlist file further includes subpath type information indicating whether at least one subplayer item included in the subpath is synchronized with the playitem. The method of claim 1, wherein the subpath comprises a single subplayitem associated with the playitem. 3. The method of claim 2, wherein the playback interval of the subplayitem coincides with an entire portion of the playback interval of the playitem. 3. The method of claim 2, wherein the playback interval of the subplayitem coincides with a selected portion of the playback interval of the playitem. The method of claim 1, wherein the subpath comprises a plurality of subplayitems associated with the playitem. 6. The method of claim 5, wherein the playback interval of at least one of the plurality of subplayitems coincides with an entire portion of the playback interval of the playitem. 6. The method of claim 5, wherein the playback interval of at least one of the plurality of subplayitems coincides with a selected portion of the playback interval of the playitem. The method of claim 1, wherein the sub data stored in the local storage comprises an auxiliary interactive graphic stream. 9. The method of claim 8, wherein the playitem is further configured to play back an original interactive graphic stream recorded on the recording medium, wherein the auxiliary interactive graphic stream replaces the original interactive graphic stream. 10. The method of claim 8, wherein the playitem is further configured to reproduce an original interactive graphic stream recorded on the recording medium, and wherein the auxiliary interactive graphic stream is attached to the original interactive graphic stream. The method of claim 1, wherein the sub data stored in the local storage comprises an auxiliary text subtitle stream. The method of claim 1, wherein the playlist file further includes stream type information that distinguishes the main data and the sub data from each other. 2. The method of claim 1, wherein each subplayitem included in the subpath includes sync information indicating an identification of the playitem and a sink start time within a play interval of the playitem. A method of reproducing data recorded on a recording medium, Reproducing main data recorded on the recording medium and sub data stored in local storage using a playlist file including a main path and a sub path, The main path includes a plurality of playitems for reproducing the main data, the sub-path includes at least one subplayitem associated with a playitem for reproducing the sub data associated with the reproducing of the main data, The playlist file further includes subpath type information indicating whether at least one subplayitem included in the subpath is synchronized with the playitem. 15. The method of claim 14, wherein the sub data stored in the local storage comprises an auxiliary interactive graphic stream. 15. The method of claim 14, wherein the sub data stored in the local storage comprises an auxiliary text subtitle stream. The method of claim 14, wherein the playlist file further includes stream type information that distinguishes the main data and the sub data from each other. 16. The method of claim 15, wherein each subplayitem included in the subpath includes sync information indicating an identification of a selected one of the playitems, and a sink start time within a playback interval of the selected playitem. A method of reproducing data recorded on a recording medium, Reproducing the AV data and the original auxiliary data recorded on the recording medium and the additional auxiliary data stored in the local storage using a playlist file including a main path, an original subpath, and at least one additional subpath. Include, The main path includes a plurality of playitems for reproducing the AV data, The original sub-path includes a sub-playitem associated with a playitem for reproduction of the original auxiliary data, Each additional sub-path includes at least one sub-playitem associated with the playitem for reproduction of the additional auxiliary data; The playlist file further includes subpath type information indicating whether at least one subplayitem included in each additional subpath is synchronized with the playitem. 20. The method of claim 19, wherein the raw and additional auxiliary data comprises an interactive graphics stream. 20. The method of claim 19, wherein the original and additional auxiliary data comprises a text subtitle stream. 20. The method of claim 19, wherein each subplayitem included in each additional subpath includes sync information indicating an identification of a selected one of the playitems, and a sink start time within a playback interval of the selected playitem. A method of reproducing data recorded on a recording medium, Reproducing the AV data and the original auxiliary data recorded on the recording medium and the additional auxiliary data stored in the local storage using a playlist file including a main path and a sub path, The main path includes a plurality of playitems for reproducing the AV data, The sub-path includes at least one subplayitem associated with the playitem for reproduction of at least one of the original and additional auxiliary data associated with the reproduction of the AV data, The playlist file further includes subpath type information indicating whether at least one subplayitem included in the subpath is synchronized with the playitem. 24. The method of claim 23, wherein the raw and additional auxiliary data comprises an interactive graphics stream. 24. The method of claim 23, wherein the original and additional auxiliary data comprises a text subtitle stream. 24. The method of claim 23, wherein each subplayitem included in the subpath includes sync information indicating an identification of a selected one of the playitems, and a sink start time within a playback interval of the selected playitem. An apparatus for reproducing data recorded on a recording medium, A pickup section for reading main data recorded on the recording medium; Local storage storing sub data associated with the main data; A decoder for decoding the main data and the sub data using a playlist file including a main path and a sub path, The main path includes a playitem for reproducing the main data, The sub-path includes at least one sub-playitem associated with a playitem for reproduction of the sub-data associated with reproduction of the main data, The playlist file further includes subpath type information indicating whether at least one subplayitem included in the subpath is synchronized with the playitem. An apparatus for reproducing data recorded on a recording medium, A pickup section for reading main data recorded on the recording medium; Local storage storing sub data associated with the main data; A decoder for decoding the main data and the sub data using a playlist file including a main path and a sub path, The main path includes a plurality of playitems for reproducing the main data, The sub-path includes at least one sub-playitem associated with a playitem for reproduction of the sub-data associated with reproduction of the main data, The playlist file further includes subpath type information indicating whether at least one subplayitem included in the subpath is synchronized with the playitem. An apparatus for reproducing data recorded on a recording medium, A pickup section for reading AV data recorded on the recording medium, and raw auxiliary data associated therewith; Local storage for storing additional auxiliary data associated with the AV data; A decoder for decoding the AV data and at least one of the original and additional auxiliary data using a playlist file comprising a main path, an original subpath and at least one additional subpath, The main path includes a plurality of playitems for reproducing the AV data, The original sub-path includes a sub-playitem associated with a playitem for reproduction of the original auxiliary data, Each of the additional sub-paths includes at least one sub-playitem associated with a playitem for reproduction of the additional auxiliary data; The playlist file further includes subpath type information indicating whether at least one subplayitem included in each additional subpath is synchronized with the playitem. An apparatus for reproducing data recorded on a recording medium, A pickup section for reading AV data recorded on the recording medium, and raw auxiliary data associated therewith; Local storage for storing additional auxiliary data associated with the AV data; A decoder for decoding the AV data and at least one of the original and additional auxiliary data using a playlist file including a main path and a sub path, The main path includes a plurality of playitems for reproducing the AV data, The sub-path includes at least one sub-playitem associated with at least one playitem of the original and additional auxiliary data associated with the reproduction of the AV data, The playlist file further includes sub-path type information indicating whether at least one sub-item included in the sub-path is synchronized with the playitem.

Images