KR20080033433A - Method and apparatus for reproducing data, recording medium, and method and apparatus for recording data - Google Patents

Abstract

A method and an apparatus for reproducing data, a recording medium, and a method and an apparatus for recording data are provided to effectively reproduce a plurality of videos at the same time by separately decoding primary and secondary video streams. A method for decoding a picture-in-picture video data reproduced from a recording medium comprises the steps of: decoding a primary video stream in data reproduced from the recording medium by using a first video decoder(730a); decoding a secondary video stream in reproduced data which represents a picture-in-picture video data regarding the primary video stream by using a second video decoder(730b); and reproducing a main path data stream including the first and second video streams from a data file recorded on the recording medium by separating the primary video and the secondary video stream from the main path data stream based on packet identifiers in data packets of the main path data stream.

Description

Method and apparatus for reproducing data, recording medium, and method and apparatus for recording data

The present invention relates to a recording and reproducing method and apparatus, and to a recording medium.

As a recording medium, an optical disk capable of recording a large amount of data is widely used. Most recently, new high-density recording media, such as Blu-ray Discs (BDs) and high-density digital video discs (HD-DVDs), can record and store high-quality video data and high-quality audio data for a long time. High Definition Digital Versatile Disc) and the like are being developed.

High-density optical recording media, the next-generation recording media technology, are being considered as next-generation optical recording solutions that can store much more data than conventional DVDs. In recent years, development with other digital devices is in progress. In addition, development of an optical recording / reproducing apparatus using a high density recording medium standard is also started.

With the development of high density recording media and optical recording / reproducing apparatus, it is possible to simultaneously reproduce a plurality of videos. However, there is no way to efficiently record or play back multiple videos simultaneously. In addition, since the high density recording medium standard is not completely completed, it is true that there is a difficulty in developing a complete optical recording / reproducing apparatus based on the high density recording medium.

The present invention relates to a method of decoding picture-in-picture video data reproduced from a recording medium.

As one embodiment, the first video stream of data reproduced from the recording medium is decoded using the first decoder, and the second video stream of reproduced data is decoded using the second decoder. The second video stream represents picture-in-picture video data relating to the first video stream.

In one embodiment, the method further comprises playing back the main path data stream from the data file recorded on the recording medium. The main data stream includes first and second video streams. This embodiment will further comprise separating the first video stream from the main data stream and separating a second video stream from the main data stream.

As one embodiment, it is determined whether the second video stream is to be recorded in the same data file as the first video stream based on the type information recorded on the recording medium, and the he main data stream is reproduced based on the determining step. .

As another embodiment, the main path data stream is reproduced from the first data file recorded on the recording medium. The main pass data stream includes the first video stream. Further, the sub path data stream is reproduced from the second data file recorded on the recording medium. The second data file is separated from the first data file, and the sub pass data stream includes the second video stream. This embodiment will include separating a first video stream from the main pass data stream and a second video stream from the sub pass data stream.

As one embodiment, it is determined based on the type information recorded on the recording medium whether the second video stream is recorded in the same data file as the first video stream or whether the data file is separated from the first video stream.

However, another embodiment further includes displaying the second video stream in synchronization with the first video stream based on the type information recorded on the recording medium.

Another embodiment includes asynchronously displaying the second video stream with the first video stream based on the type information recorded on the recording medium.

In one embodiment, the sum of the bit rates of the first or second video streams is equal to or less than the set value.

In another embodiment, the second video stream has the same scan type as the first video stream.

Yet another embodiment of a method of decoding picture-in-picture video data includes decoding a first video stream of data reproduced from a recording medium using a first decoder. The method includes receiving the subpath data stream from an external input source than the recording medium, storing the subpath data stream including at least one second video stream, and decoding the second video stream with a second decoder. More to do. The second video stream is predetermined to provide as picture-in-picture data for the first video stream.

The present invention also relates to a method of processing picture-in-picture video data reproduced from a recording medium. One embodiment by this method includes separating a first video stream from a main pass data stream reproduced from the recording medium and providing the first video stream to a first decoder. The embodiment further comprises separating the second video stream from one of the main pass data stream and the sub pass data stream reproduced from the recording medium, and providing the second video stream to a second decoder.

The present invention relates to a method and apparatus for recording picture-in-picture video data on a recording medium, and to picture-in-picture video data reproduced from a recording medium. An apparatus for decoding and further relates to the recording medium.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which provide an understanding of the present invention and which are incorporated in and constitute a part of this application, describe in detail the present invention and other drawings that relate to the present invention. In the drawing:

1 shows an embodiment of the integrated use of the optical recording / reproducing apparatus of the present invention and the peripheral period.

Fig. 2 shows a file structure recorded on an optical disc as a recording medium of the present invention.

3 shows a data recording structure of an optical disc as a recording medium of the present invention.

4 is shown to help conceptual understanding of the second video of the present invention.

5 shows the overall configuration of the optical recording / reproducing apparatus of the present invention.

6 is a diagram illustrating the playback system of the present invention.

7 schematically illustrates an AV decoder of the present invention.

8A shows a first embodiment of a second video encoding type according to the present invention.

8B shows a second embodiment of a second video encoding type in accordance with the present invention.

9A-9C illustrate various playback path types of a second video according to the present invention.

10 shows an embodiment of a data reproduction method according to the present invention.

Reference will be made in detail to the embodiments set forth in the accompanying drawings in order to illustrate embodiments of the invention. Wherever possible, the same reference numbers will be used for the same or similar parts in the figures. Hereinafter, the present invention will be described an optical disc as a recording medium for convenience of explanation. In particular, a "Blu-ray Disc (BD)" will be described as an example of a recording medium, but the technical concept of the present invention will be apparently applicable to other recording media such as HD-DVD.

In this context, "storage" in the present invention is a kind of storage means provided in the optical recording / reproducing apparatus 10 (FIG.1). Storage refers to an element that a user can freely store necessary information and data. That is, the storage currently used generally may be a "hard disk", "system memory (system memory)", "flash memory" and the like, but the present invention is not necessarily limited thereto. no.

In particular, in the context of the present invention, "storage" is also utilized as a means for storing data associated with a record carrier (e.g. a Blu-ray disc), and data stored in storage associated with the record carrier. In general, data downloaded from the outside is downloaded.

In this regard, data which are partly permitted to be read directly from the recording medium, or system data produced in connection with recording / reproducing of the recording medium (e.g. metadata) may be stored in storage. Do.

In this regard, in the present invention, for convenience of description, data recorded in the recording medium is referred to as " original data ", and data stored in storage in association with the recording medium is " additional data " I want to name it ".

In addition, in the present invention, the term "Title" refers to a playback unit that forms an interface with a user. Titles are linked relative to specific Objects. Therefore, streams recorded in the disc in association with the title are reproduced in association with the command or program in the object associated with the title. In particular, in the present invention, for the convenience of description, among the titles including video data according to MPEG compression, seamless multi-angle and multi story, language credits ), Director's cuts, and trilogy collections are specifically referred to as "HDMV (Title Definition Movie) Titles". Among the titles containing video data according to MPEG compression, titles that provide a fully programmed application environment with network connectivity to allow the content provider to create high interactivity are referred to as "BD-J titles." (BD-J Title).

1 shows an embodiment of the integrated use of the optical recording / reproducing apparatus of the present invention and the peripheral period.

In this regard, the "optical recording / reproducing apparatus 10" of the present invention is a device capable of recording or reproducing data on / from an optical disc of various standards. Depending on the design, the optical recording / reproducing apparatus 10 may only record and reproduce optical discs (e.g., BDs) of a special standard, and may also allow reproduction except recording. However, in particular, the BD-Player or Blu-ray Disc (BD) which plays back the Blu-ray Disc (BD) in consideration of the linkage between the Blu-ray Disc (BD) and the peripheral device to be solved according to the present invention is recorded / played back. The recorder BD-Recorder will be described as an example. In this regard, it is already well known that the optical recording / reproducing apparatus 10 of the present invention can be a "drive" that can be embedded in a computer or the like.

In addition to the function of recording / reproducing the optical disc 30, the optical recording / reproducing apparatus 10 of the present invention receives an external input signal, processes the signal, and then visualizes the processed signal through the external display 20. It has the function of delivering to the user in the form of an image. In this case, there is no particular limitation on the inputtable external signal, but signals based on digital multimedia broadcasting and signals based on the Internet will be representative external input signals. In particular, regarding the signals based on the Internet, since the Internet is a medium that anyone can easily access, the optical recording / reproducing apparatus 10 downloads and utilizes specific data on the Internet. It becomes possible.

In relation to this, a person providing content as an external source is collectively called a "content provider (CP)".

In addition, in the present invention, content refers to data constituting a title, and means data provided by an author of an associated recording medium.

The original data and the local data will be described in detail as follows. For example, the multiplexed AV stream of specific titles recorded on the optical disc would be the original data of the optical disc. In this case, an audio stream (e.g., a Korean audio stream) different from the audio stream of the original data (e.g., English) will be provided as local data via the Internet. Some users have a requirement to download audio streams (eg, Korean audio streams) corresponding to local data on the Internet and play them along with AV streams corresponding to the original data, or to play only partial data. will be. In order to enable this, there is a need for a systematic method of defining an association between the original data and the locational data and managing / reproducing the original data and the locational data according to a user's request.

For convenience of explanation, the signals recorded in the disk are referred to as original data, and signals existing outside the disk are referred to as local data. However, this depends only on the method of acquiring the respective data, and the original data and the positional data are not necessarily limited to the specific data. Therefore, as long as it exists outside of the optical disc and is recorded together with the original data and is related to the original data, data of any attribute can be also localized data.

In this regard, it is essential to have a file structure associated with the original data and the international data in order to make the user's request feasible. Hereinafter, a file structure and a data recording structure usable in a Blu-ray disc BD will be described in detail with reference to FIGS. 2 and 3.

First, FIG. 2 shows a file structure for reproducing and managing original data recorded in a BD.

That is, the file structure of the present invention includes a root directory and at least one BDMV directory (BDMV) under the root directory. In the BDMV directory (BDMV), an index file ("index.bdmv") and an object file ("MovieObjet.bdmv") are general files (parent files) having information for guaranteeing interactivity with a user. This exists. In addition, as a directory having information on the data recorded on the physical disk and a method of playing the same, the playlist directory (PLAYLIST), clip information directory (CLIPINF), stream directory (STREAM), auxiliary directory (AUXDATA), A BD-J directory (BDJO), a metadata directory (META), a backup directory (BACKUP) and a JAR directory are provided. Hereinafter, the directory and the files included in the directory will be described in detail.

The JAR directory contains JAVA program files.

The metadata directory META includes a metadata file that is data about a data. The metadata file may include a search file, a metadata file for a disc library, and the like. When recording / reproducing data, it is used for efficient search and management of data.

The BD-J directory (BDJO) contains a BD-J object file for playing a BD-J title.

The auxiliary directory AUXDATA contains additional data files required for disc reproduction. For example, a "Sound.bdmv" file that provides sound when the interactive graphic function is executed, and a "11111.otf" and "99999.otf" file that provide font information when playing a disc. Etc.

The stream directory STREAM contains files for an AV stream recorded in a specific format in a disc. Each stream is most commonly recorded as a transport packet of MPEG-2 scheme. Stream STREAM, which is a stream directory, uses "* .m2ts" as an extension of stream files (for example, 01000.m2ts, 02000.m2ts ..). In particular, a stream in which video / audio / graphic information is multiplexed is called an AV stream. A title consists of at least one AV stream file.

The clip information directory CLIPINF includes a stream information file ("* .m2ts") included in the stream directory STREAM and a clip information file (01000.clpi, 02000.clpi) that have a one-to-one correspondence. In particular, the clip information file ("* .clpi") records attribute information and time information (timing information) of the corresponding stream file ("* .m2ts"). Relatedly, each clipinfo file ("* .clpi") and a stream file ("* .m2ts") corresponding to each clipinfo file are bundled and named "clip". That is, "clip" becomes a data indicator including both one stream file ("* .m2ts") and one clip information file ("* .clpi") corresponding to one stream file.

The playlist directory PLAYLIST includes a plurality of playlist files ("* .mpls"). A playlist is a combination of playing intervals of clips. Each play interval is called a PlayItem. Each playlist file ("* .mpls") contains at least one playitem and subplayitem. The playitem and subplayitem include information on a play start time (IN-Time) and a play end time (OUT-Time) of a specific clip to be played. Thus, a playlist may be referred to as a combination of playitems.

In this regard, a process played by the at least one playitem in a playlist file is referred to as a "main path", and a process played by each subplayitem is called a "sub path". It is defined as The main pass provides master presentation of the associated playlist and the subpath provides auxiliary presentations related to the master play. Each playlist file must contain one main path. Each playlist file includes at least one subpath, and the number of subpaths is determined by the appearance and absence of subplayitems. As a result, the playlist file becomes a basic reproduction / management file unit in the entire reproduction management file structure for performing reproduction of a desired clip by combining at least one playitem.

In the context of the present invention, the video data played back by the main pass is called primary video and the video data played back by the subpath is called secondary video. The function of the optical recording / reproducing apparatus playing back the first video and the second video together is also called " PiP (Picture In Picture) ". In this regard, among the subpaths reproduced together with the main pass, subpath types related to the present invention may be classified into three types. This will be described in detail with reference to FIGS. 9A to 9C.

The backup directory BACKUP includes an index file ("index.bdmv"), an object file ("MovieObject.bdmv"), which is an example of a copy of the files in the file structure, in particular information related to disc playback. "BD-JObject.bdmv", unit key files, all playlist files ("* .mpls") in the playlist directory (PLAYLIST) and all clipinfo files ("CLIPINF") in the clipinfo directory (CLIPINF). * .clpi ") will save a copy file. This is to separately store for a backup in consideration of the fatal to the disc playback when the files are lost.

In this regard, it will be apparent that the file structure of the present invention is not limited to the names and locations described above. In other words, the directories and files should be understood by their meaning and not by name and location.

3 shows a data recording structure recorded on an optical disc according to the present invention. 3 shows a form in which information related to the above-described file structure is recorded in a disc. The disc is a file system information area for managing the entire file, and an index file, an object file, a playlist file, a clip information file, and meta files (" * .m2ts "), a stream area composed of audio / video / graphics or the like, or a stream area recorded in stream files, and a JAR area in which JAVA program files are recorded. The above description is in the order seen from the inner peripheral area of the disc.

There is an area in the disc for recording file information and the like for reproducing content included in the stream area. This area is called "management area". The file system information area and database area are included in the management area.

However, each area of FIG. 3 is provided as an example. It will be apparent that the present invention is not limited to the arrangement structure of each region as shown in FIG.

In the context of the present invention, the stream area stores stream data comprising a first video and / or a second video. In the present invention the second video may be encoded in the same stream as the first video (referred to as in-mux) or may be encoded in another stream (referred to as out-mux of out-of-mux). . Information indicating the type of the stream in which the second video is encoded, that is, encoding type information (out-mux and in-mux) of the second video may be recorded in the management area.

4 is shown to help conceptual understanding of the second video of the present invention.

It is an object of the present invention to provide a method of playing secondary video data together with primary video. That is, in the optical recording / reproducing apparatus, the present invention enables the PiP application and efficiently executes the PiP application.

Referring to FIG. 4, while the first video 410 is playing, there may be a request to output another video data related to the first video 410 to the same display 20. Such PiP applications can be made in connection with the present invention. For example, during the playback of a movie or documentary, it is possible to provide the user with a director's comment or episode about the shooting process. The video showing the comment or episode becomes the second video 420. The second video 420 may be played simultaneously with the first video 410 and may be played from the start of the playback of the first video 410.

Playback of the second video 420 may begin in the middle of playback of the first video 410. In addition, the second video 420 may be displayed at a different position or different size on the screen according to the playback process. The second video 420 may be configured in plural. In this case, the second video 420 may be separately played according to the playback of the first video 410. The first video 410 may be played together with the audio 410a associated with the first video 410. Of course, the second video 420 can be played with the audio 420a associated with the second video 420.

In this regard, in order to play the second video, it is necessary to distinguish the AV stream multiplexed with the second video, and to distinguish the second video from the AV stream for decoding of the second video. Thus, information is needed on how and in which stream the second video is encoded. In addition, there is a need for information on whether the first video and the second video should be synchronized. This reproduction path type information (synchronized or asynchronous) will be provided as part of the encoding type information. In addition, a new decoder model needs to be defined to simultaneously reproduce the first video with the second video. The present invention solves the above problems and provides a preferred method of efficiently playing the second video with the first video. Hereinafter, the present invention will be described in detail with reference to FIG.

5 shows one embodiment of the overall configuration of the optical recording / reproducing apparatus 10 of the present invention.

According to FIG. 5, the optical recording / reproducing apparatus 10 of the present invention may include a pickup 11, a servo 14, a signal processor 13, and a microprocessor 16.

The pickup 11 reproduces original data and management data recorded on the optical disc. The management data includes reproduction management file information. The servo 14 controls the operation of the pickup 11. The signal processor 13 receives a playback signal from the pickup 11 and restores the received playback signal to a desired signal value. The signal processing unit 13 also modulates the signals to be recorded, for example, the first video and the second video into signals recorded on the optical disk. The microprocessor 16 controls the functions of the pickup 11, the servo 14, and the signal processor 13. The pickup 11, the servo 14, the signal processor 13, and the microprocessor 16 collectively. Also called "recording / reproducing section". In the present invention, the recording / reproducing unit reads data from the optical disc 30 or the storage 15 under the control of the control unit 12 and provides it to the AV decoder 17b. In addition, the recording / reproducing unit may receive the signal encoded by the AV encoder 18 and record the received signal on the optical disc 30. Therefore, the recording / reproducing section can record the video and audio data on the optical disc 30.

The control unit 12 downloads the local data existing in addition to the optical disk by a user command or the like and stores it in the storage 15. The control unit 12 also reproduces the local data in the storage 15 and / or the original data in the optical disk 30 according to the user's request. In addition, in the present invention, the control unit 12 generates encoding type information according to the type of the stream in which the second video is encoded, and records / plays the recording / reproducing unit to record the encoding type information together with the video data on the optical disc 30. To control. The encoding type of the second video is described in detail with reference to FIGS. 8A to 8C.

The optical recording / reproducing apparatus 10 consequently further includes a reproducing system 17 for decoding the data and providing the decoded data to the user under the control of the control unit 12. The playback system 17 includes an AV decoder 17b for decoding the AV signal. The playback system 17 also analyzes the user command input through the control unit 12 to analyze the object command or the application in connection with the playback of the specific title described above, and to determine the playback direction according to the analysis result. Player model 17a. In some embodiments, the player model 17a may be used to include the AV decoder 17a. In this case, the playback system 17 of the present invention becomes a player model. The AV decoder 18 is included in the optical recording / reproducing apparatus 10 of the present invention, so that the input signal can be recorded in a specific format, for example MPEG2 transformer, in order to enable recording of the input signal on the optical disc 30. The signal is converted into a port stream and provided to the signal processor 13.

6 is a diagram illustrating a playback system of the present invention. According to the present invention, the second video and the first video are played together.

The term " playback system " refers to collective playback processing means composed of a program (software) and / or hardware provided in the optical recorder / player. That is, the reproduction system not only reproduces the recording medium loaded in the optical recording / reproducing apparatus 10, but also reproduces the data stored in the storage related to the recording medium (for example, downloaded from the outside of the recording medium). And a system for managing.

In particular, playback system 17 includes " User Event Manager 171 ", " Module Manager 172 ", " Metadata Manager 173 " 174), "BD-J Module 175", "Playback Control Engine 176", "Presentation Engine 177", and "Virtual File System 40 ", which will be described in detail as follows.

First, as separate playback processing management means for reproducing the HDMV title and the BD-J title, "HDMV Module 174" for the HDMV title and "BD-J Module 175" for the BD-J title, respectively. It is configured independently. The "HDMV Module 174" and the "BD-J Module 175" particularly have a control function for receiving a command or a program in the above-described object (Movie Object or BD-J Object) and processing the same. Have The " HDMV Module 174 " and the " BD-J Module 175 " separate commands or applications from the hardware configuration of the playback system, thereby enabling portability of the commands or applications. For receiving and processing commands, the HDMV Module 174 can include a Command Processor 174a. The "BD-J Module 175" may include "Java Virutal Machine (VM) 175a" and "Application manager 175b" for accommodating and processing an application.

"Java VM 175a" is a "Virtual Machine" in which the application is executed. "Application manager 175b" includes an application management function that manages a lifecycle of an application processed by the BD-J Module 175.

In addition, the user command is transmitted to the "HDMV Module 174" and the "BD-J Module 175" as well as the operations of the "HDMV Module 174" and the "BD-J Module 175" are controlled. "Module Manager (172)" is provided. The "Playback Control Engine 176" which interprets the playlist file information recorded in the actual disc and performs the playback function according to the playback command of the "HDMV Module 174" or the "BD-J Module 175". Is provided. In addition, a "Presentation Engine" 177 is provided for decoding and displaying in a screen a specific stream managed by the "Playback Control Engine 176". In particular, the " Playback Control Engine 176 " includes " playback control functions 176a " that manages virtually all playbacks, " Player status registers (PSRs) " General purpose register (GPR) ", which is stored in " Player Registers " In some cases, "playback control functions" 176a may mean "playback control engine 176".

In this regard, HDMV Module 174 and BD-J Module 175 receive user instructions in a separate manner. The user instruction processing methods of the HDMV Module 174 and the BD-J Module 175 are also independent of each other. A means for receiving a user command and delivering it to either the "HDMV Module 174" or the "BD-J Module 175" is required. Separate transmission means should be used. In the present invention this function is in charge of "User Event Manager (171)". Thus, for example, the "User Event Manager 171" may refer to the "Module Manager" 172 if the received command is a user command by the "User Operation (UO) 171a". ) "Or" UO Controller 171a "to perform. If the received command is a user command by "Key Event", it is transmitted to "Java VM 175a" in the "BD-J Module 175" for execution.

In addition, the playback system 17 of the present invention may include a "Metadata Manager 173", in which the "Metadata Manager 173" provides the user with a disc library and an enhanced search. Provides a Disc Library and Enhanced Search Metadata application.

In the above-described playback system of the present invention, the "Module Manager 172", "HDMV Module 174", "BD-J Module 175", "Playback Control Engine 176" "Is a software process. Software processing is more useful in design than actual hardware configuration. However, the "Presentation Engine 177", the decoder 19, and the plane are generally designed in hardware. In particular, the components that are processed in software (for example, reference numerals 172, 174, 175, and 176) may be configured as one part of the control unit 12 described above. It is to be understood that the configuration of the present invention is to be understood as its meaning, and is not limited to the hardware configuration or the software configuration. In this regard, a plane is a conceptual model for explaining an overlaid process of a first video, a second video, presentation graphics (PG), interactive graphics (IG), and text subtitles. In the present invention, the second video plane is placed in front of the first video plane. Thus, the second video decoded and output is displayed on the second video plane.

Fig. 7 schematically shows the AV decoder 17b of the present invention.

The AV decoder 17b of the present invention includes a second video decoder 730b for playing back the first video and the second video together, that is, for implementing a PiP application. The second video decoder 730b decodes the second video. The second video is included in the AV stream and recorded on the recording medium 30 and provided to the user. The second video is also downloaded from outside the record carrier and provided to the user. The AV stream is provided to the AV decoder 17b in the form of a transport stream (TS).

Relatedly, in the present invention, the AV stream reproduced by the main path is referred to as a main transport stream (hereinafter, referred to as a main stream), and other AV streams are referred to as a subtransport stream or a sub TS (hereinafter referred to as a substream). .

In the AV decoder 17b, the main stream from the optical disc 30 transmits the switching element to the buffer RB1, which is depacketized by the source depacketizer 710a. The data contained in the depacketized AV stream is provided to the corresponding decoders 730a to 730g after being separated from the depacketized AV stream in the PID (Packet IDentifier) filter-1 720a according to the data packet type. . That is, when the second video is included in the mainstream, the second video is separated from other data packets by the PID filter 1 720a and provided to the second video decoder 730b. As shown, packets from PID filter 1 720a will send other switching elements prior to receipt by decoders 730a through 730g.

In this regard, FIG. 8A shows a first embodiment of a method in which a second video is encoded, where the second video is encoded with the first video. As such, the encoding type in which the second video is encoded into the first video, that is, the same stream as the main stream, is referred to as "in-mux". In the embodiment of Figure 8A, the playlist includes one main path and three subpaths. The main path is a playback path of the main video / audio, and the subpaths are a playback path of video / audio added to the main video / audio. The playitems ('PlayItem-1' and 'PlayItem-2') constituting the main path designate a clip to be played and a playing interval of the clip. The STN table of the playitem defines the elementary streams that can be selected by the optical recording / reproducing apparatus of the present invention during the presentation of the playitem. PlayItem-1 (PlayItem-1) and PlayItem-2 specify Clip-0. Accordingly, clip-0 is played during the playing interval between the playitem-1 and the playitem-2. The clip-0 is reproduced by the main pass, and thus is provided to the AV decoder 17b as the main stream.

Subpaths related to the main path (subpaths 1, 2, and 3) are composed of one subplayitem, and the subplayitem specifies a clip to be played. Subpath-1 designates clip-0, subpath-2 designates clip-1, and subpath-3 designates clip-2. That is, subpath-1 uses the second video and audio stream in clip-0. Subpath-2 and subpath-3 use the audio, PG, and IG streams of the clip specified by each subplayitem.

In the embodiment of Figure 8A, the second video is encoded with clip-0, which is played by the main pass. Therefore, the second video is provided to the AV decoder 17b in mainstream along with the first video. In the AV decoder 17b, the second video is provided to the second video decoder 730b via the PID filter-1, and decoded by the second video decoder 730b. In relation to this, the first video of the clip-0 is the first video decoder (Decoder: 730a), the first audio is the first audio decoder (Decoder: 730e), PG is In the PG decoder 730c, IG is decoded in the IG decoder 730d, and the second audio is decoded in the Secondary Audio Decoder (Decoder) 730f, respectively.

8B shows a second embodiment of how the second video is encoded. In the present embodiment, the second video is encoded into a different stream than the first video.

The playlist of FIG. 8B consists of one main path and two subpaths SubPath-1 and SubPath-2. PlayItem-1 and PlayItem-2 play the elementary streams contained in Clip-0. Subpath-1 and subpath-2 each consist of one subplayitem, and the subplayitems designate clip-1 and clip-2, respectively. When subpath-1 is played along with the main path, the second video included in the subpath-1 is played together with the video (first video) included in the main path. When subpath-2 is played with the main path, the second video included in the subpath-2 is played with the first video.

In the embodiment of Fig. 8B, since the second video is included in a stream that is not played in the main pass, the stream in which the second video is encoded, that is, the clip-1 or the clip-2, is a substream. Is provided. As described above, the case where the second video is encoded in a different stream from the first video is called an 'out-of-mux' type.

In the AV decoder 17b, the optical disc 30 or local storage 15 provides a switching element to the buffer RB2, and the buffered substream is depacketized in the source depacketizer 710b. do. Data included in the depacketized AV stream is separated according to the data packet type in the PID (Packet IDentifier) filter 2 720b and provided to the corresponding decoders 730a to 730g. Packets from Packet IDentifier (PID) filter 2 720b will send another switching element prior to receipt by decoders 730b-730f. For example, when subpath-1 is played along with the main path, the second video included in clip-1 is provided to the second video decoder 730b and decoded separately from the second audio packet. The second audio will be provided to a second audio decoder 730f and decoded. The decoded second video is displayed above the first video being decoded and displayed at the first video decoder 730a. Thus, the user can view the first video and the second video together on the display 20.

According to the present invention described above with reference to FIGS. 7 to 8B, the playback path of the second video varies according to the encoding method of the second video. Therefore, considering whether the second video is synchronized with the first video, the second video playback path type of the present invention can be largely classified into three types. Hereinafter, a second video playback path type according to the present invention will be described with reference to FIGS. 9A to 9C.

FIG. 9A illustrates a case where the encoding type of the second video is an 'out-of-mux' type, and the second video is synchronized with the first video.

Referring to FIG. 9A, the playlist managing the playback of the first video and the second video includes one main path and one subpath. The main path consists of four playitems (PlayItem_id = 0, 1, 2, 3), and the subpath consists of a plurality of subplayitems. The second video played by the subpath is synchronized with the main path. Specifically, the second video may include information (eg, 'sync_PlayItem_id') identifying a playitem associated with a subplayitem and presentation time stamp information (eg, presentation time stamp) at the playitem of the subplayitem. For example, 'sync_start_PTS_of_PlayITem') is synchronized with the main path. That is, when the playback point of the playitem reaches the value specified by the presentation time designation information, playback of the subplayitem is started, so that playback of the second video through one subpath is performed through the first path through the main path. It starts during video playback.

In this regard, the playitem and the subplayitem refer to different clips. The clip referenced by the playitem is provided to the AV decoder 17b as a main stream, and the clip referred to by the subplayitem is provided to the AV decoder 17b as a substream. The first video included in the mainstream is decoded by the first video decoder 730a through the depacketizer 710a and the PID filter 1 720a, and the second video included in the substream is depacketizer. Decoded by the second video decoder 730b via 710b and PID filter 2 720b.

FIG. 9B illustrates a case where the encoding type of the second video is 'Out-of-mux' type, and the second video is not synchronized with the first video. The playback path type of Fig. 9B is, like the playback path type of Fig. 9A, the second video streams used by the subpath are multiplexed separately from the clip used by the associated playitem. However, the playback path type of FIG. 9B differs from the playback path type of FIG. 9A in that playback of the subpath can be started at any time on the timeline of the main path.

Referring to FIG. 9B, the playlist managing the playback of the first video and the second video includes one main path and one subpath. The main path consists of three playitems (PlayItem_id = 0, 1, 2), and the subpath consists of one subplayitem. The second video played by the subpath is not synchronized with the main path. Although the subplayitem includes information identifying a playitem associated with the subplayitem and presentation time stamp information in the playitem of the subplayitem, the information is reproduced in FIG. 9B. It is not valid for path types. That is, the user can start playing the second video at any time while the first video is playing.

In this regard, since the encoding type of the second video is an 'Out-of-mux' type, as described in FIG. 9A, the first video is provided to the AV decoder 17b as a mainstream and the second video is sent to a substream. To the AV decoder 17b.

FIG. 9C illustrates a case where the encoding type of the second video is an 'In-mux' type, and the second video and the first video are synchronized. The playback path type of FIG. 9C differs from the playback path types of FIGS. 9A-9B in that the second video is multiplexed onto the same AV stream as the first video.

Referring to FIG. 9C, the playlist managing the playback of the first video and the second video includes one main path and one subpath. The main path consists of four playitems (PlayItem_id = 0, 1, 2, 3), and the subpath consists of a plurality of subplayitems. The subplayitem constituting the subpath includes information for identifying a playitem associated with the subplayitem and presentation time stamp information in the playitem of the subplayitem. As described with reference to FIG. 9A, the information causes the subplayitem to be synchronized with the associated playitem, so that the second video is synchronized with the first video.

In the reproduction path type of FIG. 9C, the playitem constituting the main path and the subplayitem constituting the subpath refer to the same clip. That is, the subpath is represented using the stream included in the clip managed by the main path. Since the clip is managed in the main path, the clip is provided to the AV decoder 17b in the mainstream. The main stream, the packetized data comprising the first video and the second video, is in turn sent to the depacketizer 710 and depackets the packetized data. The depacketized first video and second video are provided and decoded to the first video decoder 730a and the second video decoder 730b according to the information identifying each packet in the PID filter 1 720a.

In this regard, the mainstream or the substream may be provided to the AV decoder 17b from the recording medium 30 or the storage 15. When the first video and the second video are stored in different clips, the first video is recorded on the recording medium 30 and provided to the user, and the second video may be downloaded from the outside of the recording medium 30 to the storage 15. have. The reverse is also possible. However, when both the first video and the second video are recorded on the recording medium 30, in order to play the first video and the second video together, one of the two videos must be copied to the storage 15 and then the playback starts. something to do. When the first video and the second video are stored in the same clip, both the first video and the second video are recorded and provided on the recording medium 30, but both will be downloaded from the outside of the recording medium 30.

In this regard, the optical recording / reproducing apparatus 10 of the present invention has a maximum transport stream bit rate pre-determined to a specific value (for example, 48 Mbps). Thus, the bit rate of the transport stream to be decoded cannot exceed the predetermined value. When a second video is provided from storage 15 and played out of sync with the first video, the predetermined value is applied to the stream containing the first video and the stream including the second video. For example, if the predetermined value is 48 Mbps, the first video is a stream of 40 Mbps, and the second video downloaded from the network is 30 Mbps, the total bit rate will be 70 Mbps, exceeding the predetermined 48 Mbps. In this case, it is limited by the predetermined bit rate so that the second video cannot be reproduced harmoniously with the first video. Accordingly, the present invention does not allow the total bit rate of the transport stream to be decoded simultaneously to exceed the predetermined bit rate. When the second video is synchronized with the first video, the content provider should provide the content in consideration of the combination of bit rates of the first video and the second video. The predetermined bit rate should be taken into account even when the playback path of the second video is not synchronized with the first 12 videos.

In this regard, the first video and the second video may be encoded in a high definition (HD) grade or a standard definition (SD) grade. With respect to the predetermined bit rate, it is possible to set a bit rate restriction according to the HD and SD combination. For example, the maximum bit rate may be set to 20 Mbps or less for the first video of the HD grade and the second video of the HD grade, respectively. On the other hand, the maximum bit rates may be set to 30 Mbps and 15 Mbps or less for the first video of the HD grade and the second video of the SD grade, respectively. Similar limitations may be imposed on the first video combination of the SD grade and the second video combination of the HD grade, and the first video of the SD grade and the second video combination of the SD grade.

In addition, the second video should have the same scan type (e.g progressive or interlaced) as the first video.

10 shows an embodiment of a data reproduction method of the present invention.

Regarding the data reproduction method, when a playlist is executed, reproduction of the main path and the subpath included in the playlist starts. In order for the second video to be displayed over the first video according to the invention, the subpath for playing the second video must be played like the main path for playing the first video. Accordingly, the controller 12 checks whether the second video is encoded into the main stream from the encoding type information of the second video (S10). For example, as discussed, the encoding type information may be provided to indicate the type of subpath (e.g. out-of-mux or in-mux). Alternatively, the type of subpath is determined based on whether the subplayitem associated with the subpath identifies the same clip as the playitem in the main path. When the second video is encoded in the mainstream, that is, when the encoding type of the second video is 'In-mux' type, the second video is separated from the mainstream and provided to the second video decoder 730b ( S20). On the other hand, when the second video is encoded into the substream, that is, when the encoding type of the second video is 'Out-of-mux' type, the second video decoder 730b is separated from the substream. To be provided (S30). The second video is decoded by the second video decoder 730b (S40) and displayed on the first video being displayed on the display 20 (S50).

In relation to this, when the playback path type of the second video corresponds to the playback path type described in FIG. 9A, the controller 12 controls the AV decoder 17b so that the second video is decoded in synchronization with the first video. do. On the other hand, when the playback path type of the second video corresponds to the playback path type described with reference to FIG. 9B, the controller 12 may generate a second video at any time during playback of the first video, for example, in response to a user input. The AV decoder 17b can be controlled so that two videos are decoded.

In this regard, when the first video is displayed on the display 20, it may be scanned in an interlaced or progressive manner. In the present invention, the second video uses the same scan type (scanning method) as the first video. In other words, if the first video is scanned in a progressive type, the second video is also scanned in the display 20 in a progressive manner. On the other hand, if the first video is scanned in the interlaced type, the second video is also scanned in the display 20 in the interlaced type.

As described above, in the data reproducing method and apparatus according to the present invention and the data recording method and apparatus in connection with the recording medium, it becomes possible to reproduce the second video simultaneously with the first video. In addition, it becomes possible to efficiently reproduce. Therefore, there is also an advantage that a content provider can create more diverse content so that a user can experience more diverse content.

It will be apparent to those skilled in the art that various modifications or variations can be made in the present invention without departing from the spirit or scope of the invention. Therefore, the present invention aims to cover modifications and variations of the present invention.

Claims (41)

Decode the first video stream in the data reproduced from the recording medium using the first decoder; A picture-in-picture reproduced from a recording medium which decodes by using a second video decoder a second video stream in reproduction data representing picture-in-picture video data relating to the first video stream ( picture-in-picture) Video data decoding method. The method of claim 1, And reproducing a main pass data stream comprising a first video and a second video stream from a data file recorded on a recording medium. The method of claim 2, Separate the first video stream from the main pass data stream based on the packet identifiers in the data packet of the main pass data stream; Separate the second video stream from the main pass data stream based on the packet identifiers in the data packet of the main pass data stream; The decoded first video stream step decodes the separated first video stream; And And wherein said decoded second video stream step further comprises decoding said separated second video stream. The method of claim 2, Determining whether the second video stream is recorded in the same data file as the first video stream based on the type information recorded on the recording medium, and the reproducing step further includes reproducing the main pass data stream by the determining step. Way. The method of claim 2, And displaying the second video stream in synchronization with the first video stream based on the type information recorded on the recording medium. The method of claim 5, If the type information indicates that the second video stream is to be presented in synchronization with the first video stream, determine to play the second video stream with the playitem of the first video stream based on the identifier recorded on the recording medium; ; And said displaying step further comprises displaying a second video stream in synchronization with a first video stream based on said type information and identifier. The method of claim 1, Reproduce the main path data stream including the first video stream from the first data file recorded on the recording medium, And reproducing a sub-pass data stream comprising a second video stream from a second data file recorded separately on the recording medium from the first data file. The method of claim 7, wherein Separate a first video stream from the main pass data stream based on packet identifiers in a data packet of a main pass data stream; Distinguish the second video stream from the subpath data stream based on the packet identifiers in the data packet of the subpath data stream; Decoding the first video stream comprises: decoding the separated first video stream; Decoding the second video stream further comprises decoding the separated second video stream. The method of claim 7, wherein Determine whether to record the second video stream in the same data file as the first video stream based on the type information recorded on the recording medium; Reproducing the main path data stream may include reproducing the main path data stream based on the determining step; Playing the sub pass data stream further comprises playing the sub pass data stream based on the determining step. The method of claim 7, wherein And displaying the second video stream in synchronization with the first video stream based on the type information recorded on the recording medium. The method of claim 10, If the type information indicates that the second video stream is to be presented in synchronization with the first video stream, determine to play the second video stream with the playitem of the first video stream based on the identifier recorded on the recording medium; ; And said displaying step further comprises displaying a second video stream in synchronization with a first video stream based on said type information and identifier. The method of claim 11, Determining the presentation timing of the second video stream based on the presentation timing information recorded on the recording medium when the type information indicates that the second video stream is to be played in synchronization with the first video stream. and, And said displaying step further comprises synchronizing and displaying a second video stream with a first video stream based on said type information, said identifier and said presentation timing information. The method of claim 10, Determining the presentation timing of the second video stream based on the presentation timing information recorded on the recording medium when the type information indicates that the second video stream is to be played in synchronization with the first video stream. and, And said displaying step further comprises displaying a second video stream in synchronization with a first video stream based on said type information and said presentation timing information. The method of claim 7, wherein And asynchronously displaying the second video stream with the first video stream based on the type information recorded on the recording medium. The method of claim 1, The sum of the bit rates of the first or second video stream is equal to or less than the set value. The method of claim 1, And the second video stream has the same scan type as the first video stream. Decode a first video stream of data reproduced from a recording medium using a first decoder; Receive the subpath data stream from a source other than a record carrier; Store a sub-pass data stream comprising at least one second video stream predetermined to be provided as picture-in-picture data relating to the first video stream, A method of decoding picture-in-picture video data that decodes a second video stream using a second decoder. Distinguish the first video stream from the main path data stream reproduced from the recording medium; Provide the first video stream to a first decoder; Distinguish a second video stream representing picture-in-picture video data relating to a first video stream from one of the main pass data stream and the sub pass data stream reproduced from a recording medium; And picture-in-picture video data reproduced from a recording medium providing the second video stream to a second decoder. A data area for storing a first video stream and a second video stream representing picture-in-picture video data relating to the first video stream; And Picture-in stored on a recording medium comprising a management area storing management information for managing reproduction of the first and second video streams using a decoder different from the decoder from which the second video stream decodes the first video stream. A recording medium having a data structure for managing decoding of picture-in-picture video data. The method of claim 19, And the management area includes type information indicating whether the first and second video streams are stored in the same data file. The method of claim 20, The type information indicating whether to display a second video stream in synchronization with the first video stream. The method of claim 19, Wherein said management information includes type information indicating whether to display a second video stream synchronized or asynchronously with the first video stream. A first decoder for decoding the first video stream of data reproduced from the recording medium; And A picture reproduced from a recording medium comprising a second decoder which decodes a second video stream of reproduced data representing picture-in-picture video data relating to the first video stream. -in-picture) Apparatus for decoding video data. The method of claim 23, wherein A filter for separating the first video stream from the main pass data steam and for separating the second video stream from the main pass data steam; The first decoder decodes the separated first video stream; And the second decoder further decodes the separated second video stream. The method of claim 24, And the filter separates the first and second video streams based on packet identifiers in the data packet of the main pass data steam. The method of claim 24, A control unit for determining whether the second video stream has been recorded in the same data file as the first video stream based on the type information recorded on the recording medium, and controlling the reproduction of the main pass data steam based on the determination. The device further includes. 25. The apparatus of claim 24, wherein the second decoder decodes a second video stream so that the second video stream is displayed in synchronization with the first video stream based on type information recorded on a recording medium. The method of claim 23, wherein A first filter separating the first video stream from the main pass data stream; And A second filter separating the second video stream from the sub pass data stream; And The first decoder decodes the separated first video stream; The second decoder further comprises decoding the separated second video stream. The method of claim 28, The first filter separates a first video stream based on packet identifiers of data packets of the main pass data stream;  And the second filter separates a second video stream based on packet identifiers of data packets of the sub pass data stream. The method of claim 28, A control unit for determining whether the second video stream is recorded in the same data file as the first video stream based on the type information recorded on the recording medium, and further controlling the reproduction of the main and sub path data streams based on the determination. Containing device. The method of claim 28, And the second decoder decodes a second video stream so that the second video stream is displayed in synchronization with the first video stream based on type information recorded on a recording medium. A first decoder for decoding the first video stream of data reproduced from the recording medium; At least one second video stream predetermined to receive the sub pass data stream from an external device rather than a recording medium and to provide picture-in-picture data with respect to the first video stream. Local storage for storing the sub path data stream; And And picture-in-picture video data comprising a second decoder to decode the second video stream. The method of claim 32, A first filter separating the first video stream from the main pass data stream; And A second filter separating a second video stream from the stored sub pass data stream; And The first decoder decodes the separated first video stream; The second decoder further comprises decoding the separated second video stream. The method of claim 33, The first filter separates a first video stream based on packet identifiers of data packets of the main pass data stream;  And the second filter separates a second video stream based on packet identifiers of data packets of the sub pass data stream. Record on the recording medium a first video stream and a second video stream representing picture-in-picture video data relating to the first video stream; Recording management information for managing reproduction of the first and second video streams on the recording medium such that the second video stream is decoded using a decoder different from the decoder used to decode the first video stream. A method for recording picture-in-picture video data on a medium. The method of claim 35, wherein The management information includes type information indicating whether the first and second video streams are stored in the same data file. The method of claim 35, wherein The management information includes type information indicating whether to display a second video stream in synchronization with the first video stream. A driver for causing the recording device to record data on the recording medium; A control unit for controlling the driver to record a first video stream on the recording medium and a second video stream representing picture-in-picture video data relating to the first video stream; And, And said control unit for recording management information for managing reproduction of the first and second video streams for a recording medium so that said second video stream is decoded using a decoder different from the decoder used to decode the first video stream. An apparatus for recording picture-in-picture video data in a recording medium. The method of claim 38, The management information includes type information indicating whether to display a second video stream in synchronization with the first video stream. The method of claim 38, The management information comprises type information indicating whether the first and second video streams are to be stored as separate data files. The method of claim 40, The type information includes type information indicating whether to display a second video stream in synchronization with or asynchronously with the first video stream.

Images