KR20070031218A - Method and Apparatus for Presenting Data and Recording Data and Recording Medium - Google Patents

Abstract

The present invention relates to a method and apparatus for reproducing data and a recording method, a recording apparatus and a recording medium.

The present invention relates to a method for playing back a first video and a second video included in data stored in a recording medium or storage, wherein the second video is played on the first video according to playback management data included in the data. In the case where a plurality of subpaths related to the second video are included, it is characterized in that a data reproduction method is provided, wherein only the second video related to one subpath is selected and played.

According to the present invention, a function of playing a secondary video together with a primary video is provided. In addition, according to the present invention the content provider can provide a variety of content, and the consumer provides an effect that can simultaneously view the various content provided. In addition, according to the present invention, it is possible to determine whether to play a new second video in a manner defined by a user or a recording medium or a player while playing the second video.

Optical disc, BD, second video, sync

Description

Data playback method and playback device and recording method, recording device and recording medium {Method and Apparatus for Presenting Data and Recording Data and Recording Medium}

1 is a diagram illustrating an embodiment of reproducing data in a storage medium and / or storage through an optical recording / reproducing apparatus;

2 shows a file structure recorded on an optical disc as a recording medium of the present invention;

3 illustrates a recording structure of an optical disc as a recording medium of the present invention;

4 is a diagram illustrating a playback aspect of a second video of the present invention;

5 is a block diagram schematically showing the overall configuration of the optical recording and reproducing apparatus of the present invention;

6 is a block diagram schematically illustrating a playback system according to an embodiment of the present invention;

7 illustrates a data reproducing apparatus utilizing a playback system according to an embodiment of the present invention;

8 illustrates an embodiment of second video metadata of the present invention;

9a to 9c illustrate a second video subpath type according to the present invention;

10A to 10C illustrate a second video timeline type according to the present invention;

11 is a diagram illustrating an embodiment of second video location information of the present invention;

12A to 12C illustrate an embodiment of a playback method when there are a plurality of second video playback competitions;

13 is a flowchart illustrating a process of reproducing data according to an embodiment of the present invention.

The present invention relates to a method and apparatus for reproducing data stored in a recording medium or storage, and to a method and apparatus for recording data and a recording medium. More particularly, the present invention relates to a method and apparatus for reproducing a plurality of video stream data, a method and apparatus for recording data, and a recording medium.

Recently, as a recording medium, an optical disk capable of recording a large amount of data has been widely used. In particular, as demand for high quality image data and high quality sound data increases, HDTV and MPEG2 have emerged. For example, if video data corresponding to one HDTV movie is stored on a disc in MPEG2 image quality, a new high density recording medium having a data storage capacity of 20 GByte or more is required.

In response to these demands, Blu-ray Discs (BDs) and High Definition Digital Versatile Discs (HD-DVDs) are being developed as next generation recording media. In addition, the development of the optical recording and reproducing apparatus applying the high-density recording medium standard is also being made.

The development of high-density recording media has increased the possibility of a technique for recording and reproducing two or more video stream data at the same time, but there is no known method for reproducing. Therefore, there is a growing need for a technology that enables two or more of these video stream data to be played simultaneously.

Further, when reproduction of different video stream data is required while simultaneously reproducing a plurality of video stream data, a reproduction process of video stream data of overlapping portions is required.

In order to meet the necessity as described above, it is an object of the present invention to provide a method and apparatus capable of simultaneously playing a plurality of videos.

It is also an object of the present invention to provide a method and apparatus for reproducing a video by clearly reproducing a relationship with another video that requires reproduction while simultaneously reproducing a plurality of videos.

It is also an object of the present invention to provide a method and apparatus for recording data and a recording medium for reproducing a video by clearly reproducing a relationship with other videos requiring reproduction while simultaneously reproducing a plurality of videos.

In order to achieve the object of the present invention as described above, the present invention provides a method for playing the first video and the second video included in the data stored in the recording medium or storage together, according to the reproduction management data contained in the data The second video is reproduced on the first video, and when a plurality of subpaths related to the second video is included, only the second video related to one subpath is selected and played. It is characterized by.

In addition, the present invention provides a method for playing back a first video and a second video included in data stored in a recording medium or storage, wherein the second video is over the first video according to the reproduction management data included in the data. Playback, but if playback of the second video associated with a subpath different from the second video being played back is required, and the value of the second video switching permission flag recorded on the recording medium is determined to indicate the permission, the second video being played is And stopping and playing back the second video associated with the other subpaths.

The present invention also provides a data reproducing apparatus for reproducing data stored in a recording medium and / or storage, comprising: a first video decoder for decoding a first video and a second video decoder for decoding a second video; And a controller configured to play the second video on the first video, and control to select, decode, and display only the second video related to one subpath when a plurality of subpaths related to the second video are included. It is a feature to provide a data reproducing apparatus characterized by the above-mentioned.

The present invention also provides a data reproducing apparatus for reproducing data stored in a recording medium and / or storage, comprising: a first video decoder for decoding a first video and a second video decoder for decoding a second video; And playing the second video on the first video, wherein playback of a second video associated with a subpath different from the second video being played is required and the value of the second video switching permission flag recorded on the recording medium is allowed. If it is determined that the present invention, and the control unit for stopping the second video that is being played and to decode and display the second video associated with the other subpaths to provide a data reproduction apparatus.

The present invention also includes a stream area in which stream data including a first video and a second video are stored, and a management area in which reproduction management data for managing reproduction of the second video is stored, wherein the reproduction management data is stored in the above-mentioned. And information indicating whether or not to allow second video switching to play only the second video associated with one subpath when the plurality of subpaths are included. It is characterized by providing.

The present invention also provides a method for recording a first video and a second video on a recording medium, the method comprising: generating stream data including the first video and the second video, and information on a subpath type related to the second video. And playback for managing playback of the second video including information indicating whether to allow switching of the second video to play only the second video associated with one subpath when a plurality of subpaths related to the second video are included. It is characterized in that a data recording method is generated which generates management data and records the stream data and the reproduction management data on the recording medium.

The present invention also provides an apparatus for recording a first video and a second video on a recording medium, comprising: a recording unit for recording the recording medium data; And generating stream data including a first video and a second video, and including information on a subpath type associated with the second video and a plurality of subpaths related to the second video. Generate reproduction management data for managing reproduction of the second video including information indicating whether to allow the second video switching to reproduce only the second video, and to record the stream data and the reproduction management data on the recording medium; It is a feature to provide a data recording apparatus comprising a control unit for controlling.

In the present invention, the plurality of subpath types may include a synchronous subpath synchronized with the main path associated with the first video or an asynchronous subpath not synchronized with the main path.

Further, in the embodiment of the present invention, the method of selecting only the second video of the one subpath type may not allow the asynchronous second video to be played when the synchronous second video is played.

Further, in another embodiment of the present invention, the method of selecting only the second video of the one subpath type may be to stop the playback of the synchronous second video and to play the asynchronous second video.

Further, in another embodiment of the present invention, the method of selecting only the second video of the one subpath type may not allow the synchronous second video to be played when the asynchronous second video is played.

Further, in another embodiment of the present invention, the method of selecting only the second video of the one subpath type may be to stop the playback of the asynchronous second video and play the synchronous second video.

Further, in the present invention, the reproduced synchronous second video may be reproduced as the timeline of the associated subpath progresses.

Further, in another embodiment of the present invention, the method of selecting only the second video of the one subpath type may be to stop playing the asynchronous second video and play the asynchronous second video.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First of all, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are used as much as possible even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

The recording medium used in the present invention is an optical disc, for example, "DVD", "Blu-ray Disc (BD)", "HD-DVD", "Near Field Recording (NFR) disc". And the like. Hereinafter, for convenience of description, the recording medium is referred to as a "Blu-ray Disc BD". It is obvious that the technical idea of the present invention is equally applicable to other recording media such as HD-DVD, but is not limited thereto.

The term " storage " used below is a kind of storage means provided in the optical recording / reproducing apparatus (FIG. 1), and means an element capable of arbitrarily storing and utilizing necessary information and data. Currently used storage may include, but are not limited to, a hard disk, a system memory, a flash memory, and the like.

In particular, in the context of the present invention, the "storage" is also used as a means for storing data associated with the recording medium, the data may be downloaded from the outside.

In this regard, it is also possible to read some permitted data directly from the recording medium or to generate system data (e.g. metadata) related to the reproduction of the data recorded on the recording medium and store it in the storage. Is self explanatory.

As used herein, the term " contents " means data provided by an author of a recording medium as a content constituting a title.

In relation to this, a person providing content as an external source is collectively called a "content provider (CP)".

"Original data" used below refers to data recorded in the recording medium, and "additional data" refers to data related to the recording medium among the data stored in the storage, and is generally outside the disc. Refers to existing data. Since each data is only distinguished according to the acquisition method, any attribute data existing outside the optical disk and associated with the original data can be referred to as the local data.

In addition, "Title" used below means the reproduction unit which forms an interface with a user. Each title is linked with a specific object, and a stream related to the title recorded in the disc is reproduced according to a command or a program in the object. In particular, in the present invention, for the convenience of description, titles that support seamless multi-angle, multi-story, language credits, director cuts, etc. among titles in which high-definition video data by MPEG compression method recorded in the disc are recorded. HDMV Title (Title). In addition, among the titles in which high-definition video data by MPEG compression method is recorded, data by a Java program that enables high interactivity that supports updating of titles in a recording medium or connectivity with a network. The title on which this is recorded is called "BD-J Title".

"PiP (Picture-in-Picture)" used hereinafter refers to a function of playing a second video on the first video screen while playing the first video.

The " playback management data " used below refers to information used to manage playback of a video stream or an audio stream. The " playback management data " includes a stream number table (STN table) including video stream entry information and audio stream entry information and metadata for managing second video playback. In addition, when the "playback management data" includes information on a subpath type related to the second video and a plurality of subpath types related to the second video, the second playback apparatus may reproduce only the second video of one subpath type. The video switching allow flag is included.

The "synchronous type" used hereinafter refers to a playback type in which an elementary stream used for a subpath is synchronized with a main path of a PlayItem by a predetermined timing defined in a playlist.

The " Asynchronous type " used below can start playback from a time when the elementary stream used by the subpath is not defined in the timeline of the main path of PlayItem, and once the subpath has been played, The playback of a path refers to a playback type that is synchronized with the main path.

The above terms are not limited to terms that indicate the same function.

1 is a diagram illustrating an embodiment of reproducing data in a storage medium and / or storage through an optical recording / reproducing apparatus.

In this regard, the "optical recording and reproducing apparatus 10" of the present invention is a device capable of recording or reproducing optical discs of various standards. Depending on the design, only an optical disc of a specific standard (e.g., BD) can be made available for recording and reproducing, and it is also possible to play back only without recording. However, in particular, in consideration of the linkage between the Blu-ray Disc BD and the peripheral device to be solved according to the present invention, a BD-Player or a Blu-ray Disc BD for playing back the Blu-ray Disc BD is recorded. A description will be given by using a recorder (BD-Recorder) as an example. In this regard, it is already well known that the "optical recording and reproducing apparatus 110" of the present invention can be a "drive" that can be embedded in a computer or the like.

In addition to the function of recording and reproducing the optical disk 30, the optical recording and reproducing apparatus 10 of the present invention receives an external input signal, processes the signal, and transmits the signal to the user through the external display unit 20. Have. In this case, there is no particular limitation on the inputtable external signal, but a signal received through digital multimedia broadcasting and the Internet will be a representative external input signal. In particular, in the case of the Internet, it is possible to download and use specific data on the Internet through the optical recording and reproducing apparatus 10 as a medium that anyone can easily access at present.

In relation to the original data and the specific data will be described in detail. For example, multiplexed AV streams for a particular title are recorded as the original data recorded in the optical disc, and audio streams different from the audio stream of the original data (for example, Korean) are used as the international data on the Internet. (Eg, English) may be provided. According to a user, there may be a request to download an audio stream (for example, English) which is an international data on the Internet, and play with an AV stream which is an original data, or to play only the partial data. In order to enable this, there is a need for a systematic method of defining an association between the original data and the local data and managing / reproducing the data according to a user's request.

In this regard, in order to realize the user's needs, it is essential to have a file structure associated with the original data and the international data, which can be used in the Blu-ray disc BD through FIGS. 2 and 3. The file structure and data recording structure will be described in detail as follows.

First, Fig. 2 shows a file structure recorded on an optical disc as a recording medium of the present invention, and shows a file structure for reproducing and managing original data recorded in the disc.

That is, in the file structure of the present invention, at least one BDMV directory (BDMV) exists under one root directory. In the BDMV directory (BDMV), an index file ("index") and an object file ("MovieObjet") exist as general file (parent file) information for ensuring interactivity with a user. In addition, as a directory having information on the data recorded on the physical disk and a method of playing the same, the playlist directory (PLAYLIST), clip information directory (CLIPINF), stream directory (STREAM), auxiliary directory (AUXDATA), BD-J object directory (BDJO), metadata directory (META) and backup directory (BACKUP). Hereinafter, the directory and the files included in the directory will be described in detail.

The metadata directory META includes a metadata file that is data about a data. The metadata file includes a search file, a metadata file for a disc library, and the like, and is used for efficient search or management of data when recording and reproducing the data.

The BD-J object directory (BDJO) contains a BD-J object file for playing a BD-J title.

The auxiliary directory AUXDATA contains additional data files required for disc reproduction. For example, there is a " Sound.bdmv " file that provides sound when executing interactive graphics, and a " 10111.otf " file that provides font information when playing a disc.

The stream directory STREAM contains files for an AV stream recorded in a specific format in the disc. Each stream is most commonly recorded as a transport packet of MPEG-2 scheme. Used as "* .m2ts" as the extension of stream files (01000.m2ts, 02000.m2ts). In particular, a stream in which all video / audio / graphic information is multiplexed in the stream is called an AV stream. A title is configured as at least one AV stream file.

The clip information directory (CLIPINF) is composed of clip information files (01000.clpi, 02000.clpi) corresponding to each stream file (* .m2ts). In particular, the clip information file (* .clpi) records attribute information and time information (timing information) of the corresponding stream file (* .m2ts). In this regard, a clip information file (* .clpi) corresponding to a stream file (* .m2ts) and a stream file (* .m2ts) in one-to-one correspondence is referred to as a "clip". That is, "clip" is data including both a stream file (* .m2ts) and a corresponding clip information file (* .clpi).

The playlist directory PLAYLIST includes playlist files (* .mpls). A playlist is a combination of playing intervals at which clips are played. The time to be played is referred to as a PlayItem. Each playlist file (* .mpls) includes at least one playitem and a subplayitem (SubPlayItem). The playitem and subplayitem have information on a play start time (IN-Time) and a play end time (OUT-Time) of a specific clip to be played. Thus, a playlist may be referred to as a combination of playitems. Also included in the playlist file is metadata for managing the second video playback. The metadata includes information regarding the second video playback timing, the second video playback position, and the size with respect to the playback of the second video.

In this regard, a process played by the at least one playitem in a playlist file is referred to as a "main path", and a process played by each subplayitem is referred to as a "subpath". It is defined as The main pass provides master presentation of the playlist, and the subpath provides auxiliary presentations related to the master presentation. The main path must exist in a playlist file, and the subpath exists at least one or more depending on the existence of the subplayitem. As a result, the playlist file becomes a basic reproduction management file unit in the entire reproduction management file structure for reproducing a desired clip by combining at least one playitem.

In connection with the present invention, video data reproduced by the main pass is called primary video and video data reproduced by subpath is called second video. The function of the optical recording / reproducing apparatus playing back the first video and the second video together is referred to as " PiP (Picture In Picture) " as described above.

Furthermore, among the subpaths reproduced together with the main path, subpath types related to the present invention may be classified into three types.

The first type is the elementary streams used by the subpath, ie the second video streams, are multiplexed separately from the clip used by the associated playitem. This is also known as 'out-of-mux'. The playback path by the first type is synchronized with the main path using the playitems in the running playlist.

The second type is the same as the first type in that the second video streams used by the subpath are multiplexed separately from the clip used by the associated playitem, but the presentation of the subpath is the time of the mainpath. The difference is that you can start at any time on the line. In other words, the subpath is not synchronized with the main path.

The third type is that the second video streams used by the subpath are multiplexed into the same clip as the clip used by the associated playitem. This is also called 'in-mux'. The playback path using the third type subpath differs from the second type subpath in that it is synchronized with the main path.

The backup directory BACKUP includes an index file, an object file (Movie Object, BD-J Object), a unit key file, and a play, in which information related to playback of a disk, among data on the file structure, is recorded. All playlist files (* .mpls) in the list directory (PLAYLIST) and copy files for all clip information files (* .clpi) in the clip information directory (CLIPINF) are stored. This is to separately store for backup in consideration of the fatality of the disc playback when the files are lost.

In this regard, it will be apparent that the file structure of the present invention is not limited to the names and locations described above. In other words, the directories and files should be understood by their meaning and not by name and location.

3 is a diagram illustrating a recording structure of an optical disc as a recording medium of the present invention, in which information related to the above-described file structure is recorded in the disc. As seen from the inner periphery of the disc, the file system information area (File System Information area) as the system information for managing the entire file, the index file, the object file, the playlist file, for playing back the recorded stream (* .m2ts), It can be seen that there is an area in which clip information files and metadata files are recorded (also called "database area"), and a stream area in which a stream or JAR file composed of audio / video / graphics or the like is recorded. .

In addition, an area for recording file information and the like for reproducing contents in the stream area is called a "management area", and the file system information area and database area correspond to this. In this case, in some cases, the reproduction information of the stream may be recorded in the header of the stream in the stream area. In this case, the header may also be referred to as a management area. Therefore, information related to reproduction management may be recorded in the "management area". For example, when the management area includes information on a subpath type related to the second video and a plurality of subpath types related to the second video, only the second video of one subpath type is played. A second video switching allowance flag is included.

However, each region of FIG. 3 is provided as an example, and it will be apparent that the present invention is not limited to the arrangement structure of each region as shown in FIG. 3.

4 is a diagram illustrating a playback aspect of a second video of the present invention. An embodiment in which a second video is played on a first video screen during a first video playback will be described with reference to FIG. 4.

There is a case where other video data related to the first video 410 is required to be output to the same display unit 20 while the first video is playing. For example, if during playback of a movie or documentary, you wish to provide a user with a director's comment or episode about the shooting process, the video showing the comment or episode is referred to as a second video 420 along with the first video. You can also play. In this case, the second video 420 may be played from the beginning along with the playback of the first video 410.

In some cases, playback of the second video 420 may be started in the middle of the playback of the first video 410. In addition, it may be displayed at a different position or different size on the screen depending on the playback process. It is also possible that the second video 420 is configured in plural so that playback can be started or ended separately according to playback of the first video. The first video may be played with the associated audio 410a and the second video may be played with the associated audio 420b.

In this regard, in order to play the second video, information on a playback time, a playback position, a size, and a stream constituting the second video is required. This information is included in the metadata included in the reproduction management data. There is also a need for information defining an audio stream played with the second video and a presentation graphics or text subtitle stream (eg PiP PG textST stream) and information defining possible playback combinations of the streams. In addition, it is necessary for the optical recording / reproducing apparatus to be provided with a memory unit (for example, a PSR) for storing information representing the reproduction state and the reproduction environment of the second video. In addition, in relation to the present invention, when a second video is being played, when a second video is required to be played through another subpath, a relation between a second video that is being played first and a second video that is to be played is required. Justice is needed.

The present invention solves the above problems and provides a preferred method of efficiently playing the second video with the first video. Hereinafter, the present invention will be described in detail with reference to FIG. 5.

5 shows one embodiment of the overall configuration of the optical recording and reproducing apparatus 10 of the present invention.

First, the pickup 11 for reproducing the reproduction management data including the original data recorded on the optical disc and the reproduction management file information, the servo 14 for controlling the operation of the pickup 11, and the reproduction received from the pickup 11 A signal processor 13 for restoring a signal to a desired signal value, or modulating and transmitting the signal to be recorded to a signal recorded on an optical disk and a microcomputer 16 for controlling the operation are basically configured.

The control unit 12 according to the embodiment for reproducing downloads and stores the local data existing in addition to the optical disk in the storage 15 by a user command or the like, and also stores the local data and / or the optical disk in the storage 15. My original data will be played back at the user's request.

The playback system 17 finally decodes the data under the control of the controller 12 and provides it to the user. The playback system 17 specifically analyzes the AV decoder 17b for decoding the AV signal, the object command or application relating to the reproduction of the specific title described above, and the user command input through the control unit 12 to determine the playback direction. It consists of the player model 17a which determines. In some embodiments, the player model 17a may be used to include the AV decoder 17a. In this case, the playback system 17 of the present invention becomes a player model.

In this regard, the AV decoder may comprise a plurality of decoders. 6 is a block diagram schematically illustrating a playback system according to an embodiment of the present invention. Referring to FIG. 6, the decoder 17b of the present invention uses a first video decoder 610a for decoding a first video and a second video decoder 610b for decoding a second video. It is configured to include. The first video decoded through different decoders is output through the first video plane 620a and the second video is output through the second video plane 620b to be provided to the user. In particular, in connection with the present invention, the control unit 12 checks the reproduction management data of the second video and identifies the second video at a specific time according to the metadata for managing the reproduction of the second video included in the reproduction management data. The second video decoder 610b is controlled to be decoded in position and size. The first video and / or second video stream data may be recorded on the recording medium 30 or may be downloaded to the storage 15 from outside the recording medium. The AV decoder according to the embodiment of the present invention includes a first video decoder 610a and a second video decoder 610b as shown in FIG. 6, and in particular, one decoder associated with the second video is included. Therefore, since only one playback path of the playable second video is possible, a processing method is required when the playback of another second video is required during the playback of the second video.

Accordingly, in relation to the present invention, the controller 12 may control to select, decode and display only the second video of one subpath type when a plurality of subpath types related to the second video are included. For example, if the asynchronous second video is required to play another synchronous second video during playback, the controller 12 may continue to play the second video that was being played first. Alternatively, playback of the asynchronous second video being played may be stopped, and the second video that is required for playback may be decoded and displayed by the second video decoder 610b. In some cases, the user may be provided with a selection menu on whether to play the synchronous second video required to be played back to play the second video required to be played only when the user selects the play. The above-described playback scheme is applicable even when asynchronous second video playback is required during asynchronous second video playback or asynchronous second video playback is required during synchronous second video playback.

The optical recording and reproducing apparatus 10 of the present invention includes an AV encoder 18. The AV encoder 18 converts an input signal into a signal of a specific format, for example, an MPEG2 transport stream, under the control of the control unit 12 to perform a function of recording a signal on an optical disc, and then sends the signal to the signal processing unit 13. Will be provided. Like the AV decoder 17b, the AV encoder 18 may include a plurality of encoders. The control unit 12 may control to record the first video and second video streams, the first audio and second audio streams, the reproduction management data, and the like, which are converted through each encoder and provided to the signal processing unit 13. .

In connection with the present invention, the control unit 12 controls to record, on the optical disc, stream data including the first video and the second video converted through each encoder, and reproduction management data for managing the reproduction of the second video. Can be. In this case, the reproduction management data may include information on a subpath type related to the second video. In addition, the reproduction management data may include a second video switching permission flag to play only the second video of one subpath type when a plurality of subpath types related to the second video are included.

FIG. 7 is a diagram illustrating a data reproducing apparatus utilizing a playback system according to an exemplary embodiment of the present invention, and the reproducing system according to the exemplary embodiment of the present invention plays the second video and the first video together.

The term " playback system " refers to collective playback processing means composed of a program (software) and / or hardware provided in the optical recorder. A system for reproducing a recording medium loaded in an optical record player, as well as playing and managing data stored in storage (eg, downloaded from the outside) in association with the recording medium together.

In particular, the playback system 17 includes "User Event Manager 171", "Module Manager 172", "HDMV Module 174", "BD-J Module 175", "Playback control engine 176). "," Presentation engine (177) "and" Virtual File System (40) "is configured, and will be described in detail as follows.

First, as separate playback processing management means for reproducing the HDMV title and the BD-J title, "HDMV Module 174" for the HDMV title and "BD-J Module 175" for the BD-J title, respectively. It is configured independently. The "HDMV Module 174" and the "BD-J Module 175" particularly have a control function for receiving a command or a program in the above-described object (Movie Object or BD-J Object) and processing the same. Have &Quot; Metadata Manager 173 " can perform title selection at any time under the user's control and provide the user with record media and title metadata. The " HDMV Module 174 " and " BD-J Module 175 " separate commands or applications from the hardware configuration of the playback system, thereby enabling portability of the commands or applications. As a means for receiving and processing the command or application, the "Command processor 174a" in the "HDMV Module 174" and the "Java VM 175a" in the "BD-J Module 175". ) "And" Application manager 175b "are provided, respectively.

"Java VM 175a" is a "Virtual Machine" in which the application is executed. "Application manager 175b" includes an application management function that manages the lifecycle of the application.

In addition, the user command is transmitted to the "HDMV Module 174" and the "BD-J Module 175" as well as the operations of the "HDMV Module 174" and the "BD-J Module 175" are controlled. "Module Manager 172" is provided.

The "Playback Control Engine 176" which interprets the playlist file information recorded in the actual disc and performs the playback function according to the playback commands of the "HDMV Module 174" and the "BD-J Module 175". Is provided. In addition, a "Presentation Engine 177" is provided to decode a specific stream managed by the "Playback Control Engine 176" and display it on the screen. In particular, the " Playback Control Engine 176 " includes " Playback Control Functions 176a " that manages the actual playback, " Player status registers (PSR) " ) ") To" Player Registers (176b) ". In some cases, "Playback Control Functions (176a)" may mean "Playback Control Engine (176)". In the present invention, the " Player Registers 176b " is a storage unit indicating a playback state of the second video.

In detail, the optical recording and reproducing apparatus 10 is provided with "Player Registers" 176b as a kind of memory units for storing information on the recording and reproducing state and the recording and reproducing environment of the player. The "Player Registers" 176b may be divided into "General Purpose Registers (GPRs)" and "Player Status Registers (PSRs)". The " Player Status Registers (PSRs) " refers to playback status parameters (e.g., 'interactive graphics stream number' and 'primary audio stream number') and optical recording and playback device configuration parameters (e.g., For example, 'player capability for video'). In connection with the present invention, since the present invention reproduces the second video in addition to the first video, " Player Status Registers (PSRs) " that store the playback status of the second video are required.

The second video stream number may be stored in one of "Player Status Registers (PSRs)" (for example, PSR14). In addition, the second audio stream number associated with the second video may be stored in the PSR (hereinafter, PSR14). In addition, the PSR14 may store a flag indicating whether or not the second video can be displayed or information on a playback size of the second video.

In addition, information about 'PG TextST' (hereinafter, referred to as PiP PG TextST) for the second video may be stored in one of the "Player Status Registers (PSRs)" (eg, PSR2 and PSR30). For example, 'PiP PG TextST' stream number value or information related to the reproduction aspect of the text subtitle may be stored.

Furthermore, information about the playback position (title, chapter, playlist, playitem, and playback time), page, and select button is displayed in one of the "Player Status Registers (PSRs)" (e.g., PSR4 to PSR12). Can be stored.

In this regard, the HDMV title and the BD-J title each receive a user command of a separate method, and the method of performing the user command is independent of each other. A means for receiving a user command and delivering it to either the "HDMV Module 174" or the "BD-J Module 175" is required, which is in charge of the "User Event Manager 171a". Thus, for example, "User Event Manager 171a" transmits the received command to "Module Manager 172" or "UO Controller 171a" if the received command is a user command by "User Operation (UO)". If the received command is a user command by the "Key Event", the command is transmitted to the "Java VM 175a" in the "BD-J Module 175" for execution.

In addition, the playback system 17 of the present invention may include a "Metadata Manager 173", in which the "Metadata Manager 173" provides a user with a disc library and an enhanced search metadata application. application).

In the above-described playback system of the present invention, the "Module Manager 172", "HDMV Module 174", "BD-J Module 175", and "Playback Control Engine 176" are software-based. Processing is possible. Software processing is more useful in design than actual hardware configuration. However, the "Presentation Engine 177", the decoder 19, and the plane are generally designed in hardware. In particular, the components that are processed in software (for example, reference numerals 172, 174, 175, and 176) may be configured as one part of the control unit 12 described above. It is to be understood that the configuration of the present invention is to be understood as its meaning, and is not limited to the hardware configuration or the software configuration.

8 illustrates an embodiment of management data according to the present invention.

In order to reproduce the second video, management data including reproduction attribute information of the second video, for example, information on a reproduction time, a reproduction size and a position, for example, metadata about the second video is required. Hereinafter, the management data will be described using PiP metadata as an example.

The metadata may exist in a playlist which is a kind of reproduction management file. FIG. 8 illustrates a case in which a PiP metadata block exists in an 'ExtensionData' block included in a playlist managing a playback of a first video. PiP metadata may include at least one block header (block_header [k]: 810) block and block data (block_data [k]: 820) block according to a metadata block entry stored in the PiP metadata block. The block header 810 includes header information of an associated metadata block, and the block data 820 includes data information of an associated metadata block.

In this regard, the block header 810 block may include a field indicating an identifier for identifying a playitem (hereinafter, 'PlayItem_id' 810a) and an identifier for identifying a second video stream (hereinafter, 'secondary_video_stream_id [k]' 810b). )) And a field indicating a timeline type of the second video (hereinafter, 'pip_timeline_type' 810c).

'PlayItem_id [k]' 810a is an identifier indicating a playitem including an STN table in which a 'secondary video_stream_id' entry specified by 'secondary_video_stream_id [k]' 810b is listed. The value of 'PlayItem_id' 810a is given in the playlist block of the playlist file. Relatedly, entries of 'PlayItem_id' in the PiP metadata are sorted in ascending order with respect to 'PlayItem_id' recorded in the PiP metadata. The 'secondary_video_stream_id [k]' 810b is used to identify the subpath and the second video stream to which the associated block data 820 is applied.

That is, the stream entry corresponding to the 'secondary_video_stream_id [k]' can be known from the STN table of 'PlayItem' corresponding to the 'PlayItem_id [k]' value. Since the stream entry stores subpath identification information related to the second video, the optical recording / reproducing apparatus 10 can identify the subpath for reproducing the second video by the value. The playlist block includes a subpath block.

In this regard, the playback of the second video is a time defined in 'pip_timeline_type' 810c followed by a subpath type of a subpath that plays the second video and PiP metadata that manages the playback of the second video. It depends on the line type.

In the present invention, a flag (hereinafter, 'pip_switch_flag') regarding whether to allow the playback of another second video during the playback of the second video may be included in the playlist. As an example, as shown in FIG. 8, 'pip_switch_flag' 810d may be included in a block header block 'block_header' included in the playlist. The value of 'pip_switch_flag' accepts a playback request if playback of another second video is required during playback of the second video, and allows the user to stop playback of the second video that was playing and to play another second video that was requested to play. Indicates whether or not. For example, if the value of 'pip_switch_flag' 810d indicates an allowance ('1'), the second video selection model was first played when another second video was required while playing the second video. The playback of the second video can be stopped, and the second video requiring new playback can be played back. On the other hand, if the value of 'pip_switch_flag' 810d indicates disallowed ('0'), the second video selection model ignores the second video even though the second video selection model is required to play the second video. 2 Can keep video playing. However, when the user is required to play another second video, the second video that is being played may be stopped and the second video required to be played may be allowed.

Figures 9a to 9c are shown to help understand the subpath type according to the present invention.

The PiP application model according to the present invention can be classified into three types according to the type of the stream in which the second video is multiplexed and whether the subpath for playing the second video is synchronized with the associated main path. Therefore, in the present invention, the type of subpath that reproduces the second video, that is, the subpath type, is determined in consideration of the above three models.

The subpath type shown in FIG. 9A is a case where the second video is encoded into a different stream from the first video and the subpath is synchronized with the main path. As described above, the case where the second video is multiplexed into a separate stream from the first video is referred to as 'out-of-mux'.

Referring to FIG. 9A, a playlist managing playback of a first video and a second video includes one main path for playing the first video and one subpath for playing the second video. The main path includes four playitems (PlayItem_id = 0, 1, 2, and 3), and the subpath includes a plurality of subplayitems. The subpath is synchronized with the main path. Specifically, the second video may include information (eg, 'sync_PlayItem_id') identifying a playitem associated with a subplayitem and presentation time stamp information (eg, presentation time stamp) at the playitem of the subplayitem. For example, 'sync_start_PTS_of_PlayItem') is synchronized with the main path. That is, when the playback point of the playitem reaches the value designated by the expression time designation information, the playback of the subplayitem is started, and the playback of the subpath is started at the designated time during the playback process of the mainpath.

Since the second video is not multiplexed with the same stream as the first video, the playitem and the subplayitem refer to different clips. The playitem and subplayitem have information on a play start time (IN-Time) and a play end time (OUT-Time) of a specific clip to be played. Thus, the clip designated by the playitem and subplayitem is provided to the AV decoder 17b.

The subpath type shown in FIG. 9B is a case where the second video is encoded into a stream different from the first video, and the subpath is not synchronized with the mainpath. In the subpath type of FIG. 9B, the second video streams used by the subpath are multiplexed separately from the clip used by the associated playitem as in FIG. 9A. However, it is different from FIG. 9A in that reproduction of the subpath can be started at any time on the timeline of the main path.

Referring to FIG. 9B, the playlist managing the playback of the first video and the second video includes one main path and one subpath. The main path consists of three play items (PlayItem_id = 0, 1, 2) and the sub path consists of one sub play item. The second video played by the subpath is not synchronized with the mainpath. Although the subplayitem includes information identifying a playitem associated with the subplayitem and presentation time stamp information in the playitem of the subplayitem, the information is provided in FIG. 9B. It is not valid for path types. Accordingly, the optical recording and reproducing apparatus 10 is not limited to the information used for synchronizing the main path and the subpath, and the user can start the reproduction of the second video at any time during the reproduction of the first video.

The subpath type of FIG. 9C is a case where the second video is encoded into the same stream as the first video and the subpath is synchronized with the mainpath. The subpath type of FIG. 9C differs from the subpath types of FIGS. 9A to 9B in that the second video is multiplexed onto the same AV stream as the first video. As described above, the case where the second video is multiplexed on the same stream as the first video is called 'In-mux'.

Referring to FIG. 9C, the playlist managing the playback of the first video and the second video includes one main path and one subpath. The main path includes four playitems (PlayItem_id = 0, 1, 2, and 3), and the subpath includes a plurality of subplayitems. The subplayitem constituting the subpath includes information for identifying a playitem associated with the subplayitem and presentation time stamp information at the playitem of the subplayitem. As described with reference to FIG. 9A, the information causes the subplayitem to be synchronized with the associated playitem so that the second video is synchronized with the first video.

In the subpath type of FIG. 9C, the playitem constituting the main path and the subplayitem constituting the subpath refer to the same clip. Thus, since the second video is encoded into a clip reproduced by the main pass, the second video is provided to the AV decoder 17b mainstream along with the first video.

Referring to FIG. 8, the block header 810 block may include information (hereinafter, PiP timeline type (pip_timeline_type)) indicating which timeline the associated PiP metadata follows. According to the PiP timeline type, the form in which the second video is provided to the user is changed. Hereinafter, the PiP timeline type according to the present invention will be described with reference to FIGS. 9A to 9C.

10A to 10C are shown to assist in understanding the second video timeline type of the present invention.

In relation to FIG. 8, the block data 820 of PiP metadata may include time designation information (hereinafter, 'pip_metadata_time_stamp') indicating a point at which PiP metadata is located. The value of 'pip_timeline_type [k]' is determined according to a timeline type referred to by the entries of 'pip_metadata_time_stamp [i]', that is, a timeline type followed by PiP metadata. Hereinafter, the description will be made based on the 'pip_timeline_type [k]' and 'pip_metadata_time_stamp [i]'.

FIG. 10A is a case where the PiP presentation path is synchronized with the main path and the 'pip_metadata_time_stamp' entries refer to the timeline of the playitem referenced by PiP metadata. In FIG. 10A 'pip_metadata_time_stamp' is the presentation time at intervals at which the associated subplayitem intervals are projected onto the timeline of the playitem specified by 'PlayItem_id [k]' 810a. (a presentation-time) is determined. In the timeline type of FIG. 10A, 'pip_metadata_time_stamp [0]' and 'pip_metadata_time_stamp [m]' indicate the starting point 101a of each interval where the subplayitem intervals associated with the second video playback are projected onto the timeline of the specified playitem. Preferably at 105a).

In this regard, the PiP metadata includes block data 820 and the block data 820 includes a second video composition information block (hereinafter, 'pip_composition_metadata') according to 'pip_metadata_time_stamp'. The 'i' th 'pip_compositon_metadata' is second video configuration information valid from 'pip_metadata_time_stamp [i]' 102a to 'pip_metadata_time_stamp [i + 1]' 103a. The last 'pip_composition_metadata' present in one block data 820 is valid until the presentation end time 104a of the subpath specified by 'secondary_video_stream_id' included in the PiP metadata.

In this regard, the second video configuration information is information indicating the playback position and size of the second video. Referring to FIG. 8, the configuration information may include location information and size information (hereinafter, pip_scale 821d) of the second video. The position information includes horizontal position information (hereinafter, 'pip_horizontal_position' 821b) of the second video and vertical position information (hereinafter, 'pip_vertical_position' 821c) of the second video. Referring to FIG. 11, FIG. 11 illustrates an embodiment of second video location information of the present invention. In FIG. 11, the 'pip_horizontal_position' 821b indicates a horizontal position 1101 at which a second video is displayed at a reference point of the screen, and the 'pip_vertical_position' 821c indicates a vertical position 1102 at which a second video is displayed at a reference point of the screen. Indicates. The location information 821b and 821c determine a location where the second video is played on the screen.

The size of the second video is a problem, which is determined by the 'pip_scale' 821d. The second video size may be scaled up to the first video size. In this regard, the second video size may be set to discrete values for efficient playback. In addition, the second video size may be displayed as a ratio with respect to the first video size, for example, '× 1', '× 1/2', '× 1/4', and '× 1.5'.

In this regard, the timeline type of FIG. 10A is a subpath for playing the second video, that is, the PiP playback path is synchronized with the main path, and thus, the subpath designated by 'secondary_video_stream_id [k]' is described with reference to FIG. 9A. And the subpath type described with reference to FIG. 9C.

In relation to this, in the case of the timeline type of Fig. 10A, since the second video is played in accordance with the playitems constituting the mainpath, the playback of the second video also follows the timeline of the mainpath. For example, if the playback point of the main pass playing the first video is between 'pip_metadata_time_stamp [i]' and 'pip_metadata_time_stamp [i + 1]', the 'pip_composition_metadata [i] corresponding to the' pip_metadata_time_stamp [i] ' 'Is applied so that the second video is displayed on the first video. In another example, when the first video is trick-played, if the playback point of the main path is at the point 'pip_metadata_time_stamp [i + 1]' 103a and the point 104a at which the sub playitem ends, the 'pip_metadata_time_stamp [i +' 1] 'corresponding to' pip_composition_metadata [i + 1] 'is applied so that the second video is displayed on the first video.

FIG. 10B illustrates a case in which the playback path of the PiP is not synchronized with the main path and 'pip_metadata_time_stamp' entries refer to the timeline of the subpath. In the embodiment of FIG. 10B, since the playback path of the PiP is not synchronized with the main path, the sub path designated by 'secondary_video_time_stamp_id [k]' described above may correspond to the sub path type described with reference to FIG. 9B. In the timeline type of FIG. 10B, 'pip_metadata_time_stamp' determines a presentation time in a subplayitem interval included in a subpath specified by 'secondary_video_stream_id [k]' included in PiP metadata. . Thus, in this timeline type, 'pip_metadata_time_stamp [0]' is preferably placed at the start point 101b of the subplayitem.

In the case of the timeline type of FIG. 10B, the second video will be played by the PiP metadata along the timeline of the subplayitem. will be. That is, even if the playback point of the main path is changed to a certain portion of the timeline of the playitem constituting the mainpath, the second video is played according to the PiP metadata defined in the subplayitem regardless of this. This is different from the timeline type of 10a. For example, if the first video is played a trick, the second video will be played by the PiP metadata defined along the timeline of the subplayitem while tricking the first video along the subplayitem at the rate at which the first video is trickled. .

FIG. 10C illustrates a case in which the playback path of the PiP is not synchronized with the main path and 'pip_metadata_time_stamp' entries refer to the timeline of the playitem specified by 'PlayItem_id [k]' included in the PiP metadata. As in FIG. 10A, since the timeline type of FIG. 10C also refers to the timeline of the playitem, the subplayitem in time SubPlayItem_IN_time is projected to the timeline of the playitem 102c. In the timeline type of FIG. 10C, 'pip_metadata_time_stamp' determines a presentation time in a playitem interval indicated by 'PlayItem_id [k]'. Since the timeline type of FIG. 10C follows the timeline of the playitem whose PiP metadata is specified by 'PlayItem_id [k]', 'pip_metadata_time_stamp [0]' is the playitem indicated by the 'PlayItem_id [k]'. It is preferably placed at the start point 110c of the interval.

In the case of the timeline type of FIG. 10C, since the subpath for playing the second video is not synchronized with the main path, unlike the timeline type of FIG. 10A, the time of the subpath in which the second video is not the main path of the first video is different. Can be played along the line. However, since the PiP metadata follows the timeline of the playitem, 'pip_composition_metadata' corresponding to the playback point of the main path is applied to the second video when the first video is played. Referring to FIG. 10C, for example, 'pip_composition_metadata [i + 1]' corresponding to 'pip_metadata_time_stamp [i + 1]' is applied to the second video, and the first video is played in the main path by reverse playback. Becomes 'pip_metadata_time_stamp [i]' from 'pip_metadata_time_stamp [i + 1]', the second video is played with 'pip_composition_metadata [i]' corresponding to 'pip_metadata_time_stamp [i]'.

Therefore, even if the same scene is viewed, when the PiP metadata corresponds to the timeline type of FIG. 10C, the playback path of the second video is not affected by the playback of the first video, but the second video window of the second video is output. The size, position or speed is affected by the direction or speed of playback of the first video. Therefore, even though the first video is being played, the stream constituting the second video is played as it is, but the size and position of the second video displayed to the user is changed.

In this regard, since the playback path of the PiP is not synchronized with the main path in the timeline type of FIG. 10C, the subpath specified by the aforementioned 'secondary_video_time_stamp_id [k]' should correspond to the subpath type described in 9b. will be.

In relation to the timeline type of FIG. 10C, since the PiP metadata defines a play time in a playitem interval specified by 'PlayItem_id [k]', 'pip_metadata_time_stamp [i + 1] is the current play. It is valid up to the out time 104c of an item. However, since the last 'pip_composition_metadata' present in one block data 820 is valid until the playback end time of the subpath specified by 'secondary_video_stream_id [k]', the second video is not included after the subplayitem out time 103c. It is not displayed.

In relation to the embodiment of FIG. 8, the play time information and the configuration information of the PiP exist in the playlist, but the above information may be present in the header of the second video stream implementing the PiP.

When there is contention contention of a plurality of second videos, since there is only one decoder capable of decoding the second video stream data, only one second video stream data may be decoded and displayed. In this case, therefore, it becomes a problem as to which second video is played. Hereinafter, an exemplary embodiment of how to process another second video during playback of the second video will be described with reference to FIGS. 12A through 12C.

12A to 12C are diagrams illustrating an embodiment of a playback method when there are a plurality of second video playback contentions.

In FIG. 12A, the playlist managing the playback of the first video and the second video includes one main path and two subpaths. Subpath 0 (SubPath_id = 0) is a type described in FIG. 9A or 9C when the second video is encoded into a different stream from the first video and the subpath is synchronized with the mainpath. On the other hand, subpath 1 (SubPath_id = 1) is a type described with reference to FIG. 9B when the second video is encoded into a different stream from the first video and the subpath is not synchronized with the main path. The second video is being reproduced in synchronization with the main path as in the subpath 0 as described above, and at any time 1210 when another second video is not synchronized with the first video as in the subpath 1 is required. There are two ways for the video to play.

There may be a method of ignoring the second video to be played later and continuing to play the second video being played first. On the other hand, in order to play the second video to be played later, the playback of the second video that was being played back may be stopped. After the interruption, the second video to be played is played. In this case, since the second video to be played later follows an Asynchronous Subpath that is not synchronized with the main path, the playback of the second video stream will start from the start time (SubPlayItem_IN_time), which is a subplay item that starts playback.

In another embodiment, the playlist managing the playback of the first video and the second video in FIG. 12B includes one main path and two subpaths. Subpath 0 (SubPath_id = 0) is a type described with reference to FIG. 9B when the second video is encoded into a stream different from the first video and the subpath is not synchronized with the main path. Subpath 1 (SubPath_id = 1) corresponds to a case where the second video is encoded into a different stream from the first video and the subpath is synchronized with the main path, and is the type described with reference to FIG. 9A or 9C. At a time 1220 when a second video (Asynchronous PiP) that is not synchronized to the main path is being played, such as subpath 0, playback of another second video synchronized to the first video, such as subpath 1, is required. There are two ways as to whether the second video is played.

There may be a method of ignoring the second video to be played later and continuing to play the second video being played first. On the other hand, in order to play the second video to be played later, the playback of the second video that was being played back may be stopped. After the interruption, the second video to be played is played. In this case, since the second video to be played later follows a synchronous subpath synchronized with the main path, if the elapsed time has passed since the start time (SubPlayItem_IN_time), which is the subplay item that starts playing, the time of the subpath has elapsed. A second video stream will be played along the line.

In another embodiment, the playlist managing the playback of the first video and the second video in FIG. 12C includes one main path and two subpaths. Subpath 0 (SubPath_id = 0) and subpath 1 (SubPath_id = 1) are the types described in FIG. 9B when the second video is encoded into a different stream from the first video and the subpath is not synchronized with the mainpath.

At a time 1230 when a second video (Asynchronous PiP) that is not synchronized to the main path is being played, such as subpath 0, playback of another second video that is not synchronized to the first video, such as subpath 1, is required. There are two ways of which second video is played.

In order to play the second video to be played back later, the playback of the second video that was being played back may be stopped. After the interruption, the second video to be played is played. In this case, since the second video to be played later follows an Asynchronous Subpath that is not synchronized with the main path, the playback of the second video stream will start from the start time (SubPlayItem_IN_time), which is a subplay item that starts playback. On the other hand, there may be a method of ignoring the second video to be played later and continuing to play the second video being played first.

Here, the information on whether to stop the playback of the second video being played and to play the second video that is required to be played may already be stored by default in the player. For example, if playback of another second video is required during playback of the second video, the playback player forcibly stops playback of the second video and starts playback of the second video requiring new playback.

Alternatively, as described above in FIG. 8, a value of 'pip_switch_flag' included in the playlist may be already stored in the disk. For example, when the value of 'pip_switch_flag' is allowed ('0'), playback of the second video that is being played back may be stopped, and the second video that requires new playback may be played back.

However, if the playback of the new second video is not required by the user, the player may provide a pop-up menu or a button interface so that the user can select whether to play the new second video.

13 is a flowchart illustrating a process of reproducing data according to an embodiment of the present invention. Hereinafter, a method of reproducing the second video during contention competition of the second video will be described with reference to FIG. 13.

First, the second video is played back in the first video (S1302). In this case, the second video may be a case in which the first video is reproduced in synchronization (hereinafter, referred to as 'synchronous PiP'). Alternatively, this may be the case where the first video is played without being synchronized with the first video (hereinafter, 'Asynchronous PiP').

 During the second video reproduction, the reproduction of another second video is required (S1304). In this case, another second video may be an asynchronous PiP when the second video that is already being played is a synchronous PiP. On the other hand, if the second video already being played is an Asynchronous PiP, the other second video may be a synchronous PiP or an Asynchronous PiP. The playback request may be made by an input key for requesting playback of the second video by the user in the case of Asynchronous PiP. Another playback request may be required in the case of a Synchronous PiP, where a second video recorded by a producer in synchronization with a corresponding first video to contain a director's comment or shot episode when the title is produced is required to be started.

It is determined whether to play another second video for which playback is required (S1306).

First, when the value of 'pip_switch_flag' included in the playlist is defined as described above with reference to FIG. 8, it is first determined whether the flag value is allowed ('1') or not ('0'). It may be determined whether to play the second video. Therefore, if the value of 'pip_switch_flag' is allowed ('1'), for example, if the other second video that needs to be played is an Asynchronous PiP, then the user is asked to play the new second video. It can be judged to reproduce. However, if another second video that needs to be played is a Synchronous PiP, it may be contrary to the user's intention to play the second video, so that the user may select it as described above. Alternatively, in some cases, the recording medium or the player may be forced to play a new second video that requires playback.

On the other hand, if the value of 'pip_switch_flag' is not allowed ('0'), even when another second video is required to be played, the second video that is being played may be ignored and maintained. However, when the user requests the reproduction of another second video, the second video may be played.

As another example, if the value of 'pip_switch_flag' included in the playlist is not defined, if the second video that needs to be played is an Asynchronous PiP, the user is requested to play the new second video. It can be judged to reproduce. However, if another second video that needs to be played is a Synchronous PiP, it may be contrary to the user's intention to play the second video, so that the user may select it as described above. Alternatively, in some cases, the recording medium or the player may be forced to play a new second video that requires playback.

Therefore, it is possible to determine whether to play according to these various cases in step S1306.

If it is determined in step S1306 that the second video that is to be played back is to be played back, playback of the second video being played first is stopped (S1308) and a new second video is played back (S1310). Here, if the new second video at which playback starts is a Synchronous PiP, if the start point of the sub-playitem has elapsed, the elapsed time is calculated and played along the timeline from the time thereafter.

If it is determined in step S1306 that no other second video is required to be played back, playback of the second video being played is maintained (S1312).

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

As described above, the present invention provides a function of reproducing a second video along with a primary video. In addition, according to the present invention the content provider can provide a variety of content, and the consumer provides an effect that can simultaneously view the various content provided. Further, according to the present invention, it is also possible to play a new second video in a manner defined by a user's selection or a recording medium or a player while playing the second video.

Claims (28)

A method of playing back a first video and a second video included in data stored in a recording medium or storage, the method comprising: The second video is reproduced on the first video according to the reproduction management data included in the data, And when a plurality of subpaths related to the second video is included, only the second video related to one subpath is selected and played. The method of claim 1, The type of the subpath includes a synchronous subpath synchronous with the main path associated with the first video or an asynchronous subpath not synchronous with the main path. The method of claim 2, The method of selecting only the second video associated with the one subpath does not allow the asynchronous second video to be played when the synchronous second video is played. The method of claim 2, And selecting only the second video associated with the one subpath stops playback of the synchronous second video and plays the asynchronous second video. The method of claim 2, And selecting only the second video associated with the one subpath does not allow the synchronous second video to be played when the asynchronous second video is played. The method of claim 2, And selecting only the second video associated with the one subpath stops playback of the asynchronous second video and plays back the synchronous second video. The method of claim 6, And the reproduced synchronous second video is reproduced in accordance with the progress of a timeline of an associated subpath. The method of claim 2, And selecting only the second video associated with the one subpath stops playback of the asynchronous second video and plays back the asynchronous second video. The method according to any one of claims 4, 6 and 8, And the selection method is limited to the case where it is determined that the value of the second video switching permission flag recorded on the recording medium indicates the permission. A method of playing back a first video and a second video included in data stored in a recording medium or storage, the method comprising: The second video is reproduced on the first video according to the reproduction management data included in the data, If playback of a second video associated with a subpath different from the second video being played back is required and the value of the second video switching allowance flag recorded on the recording medium is determined to indicate a permission, the second video being played is stopped and the Playing a second video associated with another subpath. The method of claim 10, The type of the subpath includes a synchronous subpath synchronous with the main path associated with the first video or an asynchronous subpath not synchronous with the main path. A data reproducing apparatus for reproducing data stored in a recording medium and / or storage, A first video decoder for decoding the first video and a second video decoder for decoding the second video; And And a controller configured to play the second video on the first video and to select, decode and display only the second video related to one subpath when the plurality of subpaths related to the second video are included. A data reproducing apparatus. The method of claim 12, And the subpath type includes a synchronous subpath synchronous with a main path associated with a first video or an asynchronous subpath synchronous with the main path. The method of claim 13, The method of selecting only the second video associated with the one subpath does not allow the asynchronous second video to be played when the synchronous second video is played. The method of claim 13, And selecting only the second video associated with the one subpath stops playback of the synchronous second video and plays the asynchronous second video. The method of claim 13, And selecting only the second video associated with the one subpath does not allow the synchronous second video to be played when the asynchronous second video is played. The method of claim 13, And selecting only the second video associated with the one subpath stops the playback of the asynchronous second video and plays the synchronous second video. The method of claim 17, And the reproduced synchronous second video is reproduced according to a timeline of an associated subpath. The method of claim 13, And selecting only the second video associated with the one subpath stops playback of the asynchronous second video and plays back the asynchronous second video. The method according to any one of claims 15, 17 and 19, And the selection method is limited to a case where it is determined that the value of the second video switching permission flag recorded on the recording medium indicates permission. A data reproducing apparatus for reproducing data stored in a recording medium and / or storage, A first video decoder for decoding the first video and a second video decoder for decoding the second video; And The second video is played back on the first video, but a second video associated with a subpath different from the second video being played is required to be played and the value of the second video switching allowance flag recorded on the recording medium indicates the permission. And if it is determined that the control unit stops the second video being played and controls to decode and display the second video related to the another subpath. The method of claim 21, The type of the subpath includes a synchronous subpath synchronous with the main path associated with the first video or an asynchronous subpath not synchronous with the main path. A stream area for storing stream data including a first video and a second video, and a management area for storing reproduction management data for managing reproduction of the second video, The reproduction management data includes information on subpaths related to the second video and information indicating whether to allow second video switching to play only the second video associated with one subpath when a plurality of subpaths are included. And a recording medium. The method of claim 23, The information indicating whether to allow the second video switching is stopped when the second video related to the subpath different from the second video is required during the playback of the second video. Recording medium indicating whether to allow playback of the second video associated with the subpath. A method for recording a first video and a second video on a recording medium, Generate stream data containing the first video and the second video, The information on the subpath type related to the second video and the information indicating whether to allow the second video switching to play only the second video related to one subpath when the plurality of subpaths related to the second video are included are included. Generate playback management data for managing playback of the included second video, And recording the stream data and the reproduction management data on the recording medium. The method of claim 25, The information indicating whether to allow the second video switching is stopped when the second video related to the subpath different from the second video is required during the playback of the second video. Indicating whether to allow playback of the second video associated with the subpath. An apparatus for recording a first video and a second video on a recording medium, A recording unit for recording the recording medium data; And Generating stream data including a first video and a second video, and including information on a subpath type associated with the second video and a plurality of subpaths associated with the second video when the stream data includes the first video and the second video. Control to generate playback management data for managing playback of the second video including information indicating whether or not to allow second video switching to play only the second video, and to record the stream data and the playback management data on the recording medium; Control unit Data recording apparatus comprising a. The method of claim 27, The information indicating whether to allow the second video switching is stopped when the second video related to the subpath different from the second video is required during the playback of the second video. And indicating whether to allow playback of the second video associated with the subpath.

Images