EP1652181A1

EP1652181A1 - Information storage medium, and apparatus and method of reproducing information from the same

Info

Publication number: EP1652181A1
Application number: EP04774255A
Authority: EP
Inventors: Hyun-Kwon Chung; Seong-jin 436-502 Cheongmyung Maeul Moon; Sung-Wook Park; Kil-Soo 104-1401 Namsuwon Doosan JUNG
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2003-08-05
Filing date: 2004-08-03
Publication date: 2006-05-03
Also published as: JP2007501485A; WO2005013275A1

Abstract

An information storage medium and method allowing video object data to be reproduced with corresponding audio data obtained from a source external of the information storage medium, the apparatus includes a reader reading video object data from an information storage medium, audio data from the source external of the information storage medium, and audio mapping data; a mapping processor processing mapping data regarding a mapping relationship between the video object data and the audio data, and providing a relationship between the audio data and the video object data, the mapping data being included in the audio mapping data; a decoder decoding the video object data and the audio data; and a data output unit outputting the decoded video object data with the decoded audio data corresponding to the video object data, based on the audio mapping data.

Description

Description INFORMATION STORAGE MEDIUM, AND APPARATUS AND METHOD OF REPRODUCING INFORMATION FROM THE SAME Technical Field

[1] The present invention relates to an information storage medium that allows audio data obtained from a source external of the information storage medium, such as, via the Internet to be reproduced with corresponding video object data, and an apparatus and method of reproducing the audio data with the video object data. Background Art

[2] Video object data and audio data are stored together in a conventional information storage medium such as a Digital Versatile Disc (DVD), so that the video object data can be reproduced together with the audio data. However, the audio data stored with the video object data cannot be replaced with another audio data.

[3] FIG. 1 is a conceptual diagram illustrating a unit of video object data linked to a plurality of audio data, stored in a DVD. In order to reproduce the video object data generated and stored in a plurality of languages such as English, Korean, and Spanish, the video object data must be stored with the audio data in the plurality of languages in an information storage medium. There is a case where after manufacturing and selling an information storage medium storing the video object data, the video object data must be reproduced with audio data in a different language from the original language of the audio data recorded in the information storage medium. Also, there is a case where a director's commentary audio containing comments by a movie manufacturer, a movie director, and a movie photographer are separately provided to those who purchase the information storage medium containing the video object data.

[4] However, in these cases, it is difficult to reproduce and associate the video object data stored in the information storage medium with the audio data stored outside the information storage medium. Disclosure of Invention Technical Solution

[5] According to an aspect of the present invention, there is provided an information storage medium that allows video object data to be reproduced together with corresponding audio data obtained from a source external of the information storage medium such as via the Internet. [6] According to another aspect of the present invention, there is provided an apparatus and method of reproducing video object data stored in an information storage medium, with corresponding audio data obtained from a source external of the information storage medium such as via the Internet. Advantageous Effects

[7] According to the present invention, it is possible to map audio data obtained via the Internet to video object data stored in the information storage medium and reproduce the audio data with the video object data, using audio mapping data. Also, use of an audio list allows a user to select audio data according to a language and application of the audio data. Accordingly, it is possible to provide the user with audio data that is not recorded in the information storage medium, and further, allow the user to select one of audio data described in languages of various countries according to various applications. Description of Drawings

[8] FIG. 1 is a diagram of a unit of video object data linked to a plurality of audio data, stored in a Digital Versatile Disc (DVD);

[9] FIG. 2 is a schematic block diagram of a reproducing apparatus according to an embodiment of the present invention;

[10] FIG. 3 is a block diagram of the reproducing apparatus of FIG. 2;

[11] FIG. 4 illustrates a logical structure of a DVD directory;

[12] FIG. 5 illustrates a logical structure of a video object set;

[13] FIG. 6 illustrates structures of Video ManaGer Information (VMGI) and Video Title Set Information (VTSI);

[14] FIG. 7 is a diagram of Internet audio streaming;

[15] FIG. 8 is a flowchart illustrating a method of reproducing information according to an embodiment of the present invention;

[16] FIG. 9 is a flowchart illustrating a method of reading audio mapping data via the Internet according to an embodiment of the present invention;

[17] FIG. 10 is a flowchart illustrating a method of reading audio mapping data via the Internet by executing a command stored in an information storage medium, according to an embodiment of the present invention;

[18] FIG. 11 is a diagram of a structure of audio mapping data according to an embodiment of the present invention;

[19] FIG. 12 illustrates a structure of video object data stored in units of video clips;

[20] FIG. 13 is a diagram illustrating a method of selecting audio data from an audio list according to a language or an application of audio data and reproducing the selected audio data with related video object data, according to an embodiment of the present invention;

[21] FIG. 14 illustrates a structure of information listed in an audio list that allows a user to select audio data in a desired language, according to an embodiment of the present invention; and

[22] FIG. 15 illustrates a structure of information listed in an audio list that allows a user to select audio data of a desired application, according to another embodiment of the present invention. Best Mode

[23] According to one aspect of the present invention, there is provided an information storage medium including video object data; and audio mapping data specifying a mapping relation between the video object data and audio data obtained via the Internet, wherein the audio data is reproduced together with a corresponding part of the video object data based on the audio mapping data.

[24] According to another aspect of the present invention, there is provided a reproducing apparatus including a reader reading video object data from an information storage medium, audio data via the Internet, and audio mapping data; a mapping processor processing information regarding a mapping relationship between the video object data and the audio data, and providing a relationship between the audio data and the video object data based on a result of the processing, the information being included in the audio mapping data; a decoder decoding the video object data and the audio data; and a data output unit outputting the decoded video object data with the decoded corresponding audio data, based on the audio mapping data.

[25] According to yet another aspect of the present invention, there is provided a method of reproducing information, the method including reading video object data from an information storage medium, reading audio mapping data that specifies a mapping relationship between the video object data and audio data obtained via the Internet, reading the audio data mapped to the video object data via the Internet, based on the audio mapping data, and reproducing the video object data with corresponding audio data based on the audio mapping data. Mode for Invention

[26] Reference will now be made in detail to the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. The embodiments are described below to explain the present invention by referring to the figures.

[27] A conventional information storage medium such as a Digital Versatile Disc (DVD) does not allow video data stored therein to be reproduced together with audio data that is not stored in the information storage medium. To solve this andor other problems, the present invention suggests an information storage medium allowing video data stored therein to be reproduced together with corresponding audio data that is not stored in the information storage medium, and an apparatus and method therefor.

[28] FIG. 2 is a schematic block diagram of a reproducing apparatus according to an embodiment of the present invention. The apparatus of FIG. 2 includes a reader 10Q a data decoder 12Q a data output unit 14Q a mapping processor 16Q and a markup language parser 180.

[29] The reader 100 reads video object data and audio data 2 and various data required for reproduction of the video object data and audio data 2 from an information storage medium or from a source external of the information storage medium such as via the Internet.

[30] The data decoder 120 decodes the video object data and audio data 2 read by the reader 100.

[31] The data output unit 143 outputs video object data and audio data 20 decoded by the data decoder 120.

[32] The mapping processor 160 processes audio mapping data 4 and provides the reader 100 with a command 31 that instructs the audio data 2 to be read by the reader 10Q and sends the data output unit 140 the audio mapping data 30 that defines the relationship between the video object data and audio data 2. In general, audio data must be mapped to video object data so that it can be reproduced with the audio data. In a conventional DVD, video object data and audio data are multiplexed and recorded in a file such that they have one to one correspondence. Also, reproduction of audio data obtained from the source external of the information storage medium such as the Internet with video object data stored in an information storage medium, requires information regarding a mapping relation between the audio data and the video object data. The present invention adopts audio mapping data that represents the mapping relation between video object data and audio data. The audio mapping data may be either stored in the information storage medium containing the video object data or distributed via the Internet after manufacture of the information storage medium.

[33] If the audio mapping data 10 read by the reader 100 is made in a format of a markup language document, the markup language parser 180 parses it, and sends in- formation 41 regarding the address of the audio mapping data 4 to the reader 100 or sends mapping information 40 to the mapping processor 160. The markup language document generally names documents that are linked to a source made in a markup language or to which such a source is inserted, such as a HyperText Markup Language (HTML) and an extensible Markup Language (XML), a script language, and a Java language. Further, the markup language document includes a file linked to a document made in a markup language.

[34] FIG. 3 is a detailed block diagram of the reproducing apparatus of FIG. 2. Referring to FIG. 3, data read by the reader 100 includes video object data, audio data, audio mapping data, audio list data, and a markup language document. In FIG. 3, DVD data is illustrated as the video object data for convenience. The DVD data is stored in a DVD in a particular format.

[35] Data read by the reader 100 is classified according to types and temporarily stored in a buffer 190. As described above, the mapping processor 160 processes audio mapping data 4. In particular, the audio list data is processed by an audio list data processor 164 to provide a menu from which a user can select a desired language in which audio is reproduced.

[36] FIG. 4 illustrates a logical structure of a DVD directory. Referring to FIG. 4, a DVD stores a Video ManaGer (VMG) containing header information regarding all video titles, and three Video Title Set (VTS) VTS #1, #2, and #3. The VMG includes a Video ManaGer Information (VMGI) containing control data, a Video Object Set (VMGM0VOBS) area for a video manage menu that is linked to the VMG, and a VMGI BackUP (BUP). The VMGM_VOBS area may not be included in the VMG. The VTS area includes a Video Title Set Information (VTSI) containing the header information, a VOBS (VTSVLVOBS) for displaying a menu screen, a VTSTT_VOBS constituting a video title, and backup data of the VTSI area. Inclusion of the VTSM_VOBS in the VTS area is optional.

[37] FIG. 5 illustrates a logical structure of a video object set. Each of video OBject Sets (VOBSs) constituting video data includes K VOBs. A VOB has M cells. Each cell has L Video Object Units (VOBUs). Each VOBU includes a navigation pack NV_PCK required to reproduce or search for a VOBU. Also, an audio pack A_PCK, a video pack V_PCK, and a sub picture pack SP_PCK are multiplexed and recorded in the VOBU according to the ISO-13818 Motion Picture Expert Group (MPEG).

[38] FIG. 6 illustrates structures of VMGI and VTSI. Referring to FIG. 6, the VMGI and the VTSI contain user access information regarding a title, a chapter, or a Part-d-Title (PTT) of information stored in a DVD, and reproduction information for presentation thereof. The VMGI and the VTSI allow a user to access a desired title and a chapter or a PTT of the accessed title. To reproduce the accessed title, a reproducing apparatus detects a ProGram Chain (PGC) and a ProGram (PG), which are reproduction units, and detects and reproduces a cell linked to the PGC or PG. When reproducing respective cells that correspond to cells that are logical units in which information is stored in the DVD, VOBUs indicated by the cells that are logical units are reproduced.

[39] Audio data may be read via the Internet at a time or read when corresponding video object data is reproduced using an audio streaming service.

[40] FIG. 7 is a diagram of Internet audio streaming. Internet audio streaming services that transmit audio data via the Internet have been developed. The audio streaming services allow a user to download audio data via the Internet and evaluate a piece of music.

[41] FIG. 8 is a flowchart illustrating a method of reproducing information according to an embodiment of the present invention. Referring to FIG. 8, video object data is read from an information storage medium to reproduce the video object data together with audio data obtained via the Internet (S500). Next, audio mapping data is read (S510). The audio data mapped to the read video object data is read via the Internet based on the audio mapping data (S520). Next, the video object data is reproduced together with the corresponding audio data (S530). The sequence of S500 and S510 may be switched and the read audio mapping data is applicable to a plurality of other video object data. If audio data is read through an audio streaming service, S520 and S530 can be simultaneously performed.

[42] The audio mapping data may be read from the information storage medium, from another information storage medium, from a remote location, from another source, or via the Internet. The sources where the audio mapping data is read from are not limited to those described above and may encompass a plurality of other sources.

[43] FIG. 9 is a flowchart illustrating a method of reproducing audio mapping data obtained via the Internet according to an embodiment of the present invention. Referring to FIG. 9, audio mapping data is read from an address set in a reproducing apparatus or stored in an information storage medium (S600). Next, the read audio mapping data is parsed (S610). Next, DVD video is reproduced together with audio data mapped to a part of the DVD video being reproduced, based on a result of parsing the audio mapping data (S620). The address of the audio mapping data is input directly from a user or has been read from the information storage medium. [44] FIG. 10 is a flowchart illustrating a method of reading audio mapping data by executing a command recorded in an information storage medium. Predetermined commands may be stored in a format of a markup language document in the information storage medium. The reproducing apparatus reads the markup language document, parses it using the markup language parser 180 of FIG. 2, and executes the command included in the markup language document. The command is made in a format such as 'LoadAudioMap(url)', and executed to read audio mapping data recorded at an address of a site on the Internet, indicated by the parameter 'url' (S700). Then, the read audio mapping data is parsed (S710), and DVD video is reproduced together with audio data mapped to a part of the DVD video being reproduced (S720).

[45] FIG. 11 is a diagram of a structure of audio mapping data according to an embodiment of the present invention. Referring to FIG. 11, the audio mapping data contains information regarding a language and application of the audio data, in addition to information regarding the corresponding audio data and video object data. As shown in FIG. 4, DVD-video has a VMG and a plurality cf VTSs. The VMG includes a VMGM_VOBS, and the VTS includes a VTSM_VOBS and a plurality of VTSTT0VOBS. Each VOBS includes a group of cells that are logical units in which information is recorded in an information storage medium. The audio mapping data of FIG. 11 maps the respective VOBSs that are groups of cells to respective audio data. The audio mapping data can allow the audio data to be linked to the respective groups of cells or the respective cells. According to the present invention, an audio data structure maps the respective VOBSs directly to audio data as shown in FIG. 11 or maps the respective VOBSs to audio Meta data that specifies locations and types of the respective audio data.

[46] The audio mapping data is either a markup language or an XML. For instance, a part of the audio mapping data of FIG. 11 can be described in the XML format as follows:

[47] <audio-mapping-data type=dvd-video lang=xx caption=yy>

[48] <dvd-video>

[49] <vmg>

[50] <vmgm_vobs>

[51] <audio vob_idn=l href=http://movie_audio.com/a.acp />

[52] </v'mgm_vobs>

[53] </vmg>

[54] <vts> [55] <vts idn=l>

[56] <vtsm_vobs>

[57] <audio vob_idn=l href=http://movie_audio.com/b.acp />

[58] </vtsm_vobs>

[59] </vts>

[60] </dvd-video>

[61] </audio-mapping-data>

[62] Video object data may be stored in cell units or video clip units. FIG. 12 illustrates a structure of video object data stored in units of video clips. A video clip is a recording unit in which video object data is continuously recorded in the same area. The video clip is stored in a format of an Audio/Video (AN) stream obtained by compressing video object data. To reproduce the AV stream, information regarding characteristics of the compressed video object data is recorded as clip information with the video clip. The clip information specifies the attributes of video object data of the respective clips and includes an entry point map that describes the location of an entry point allowing random access in predetermined units. In the case of an MPEG standard that is mainly used to compress moving images, the entry point becomes the location of an I picture where compression of an intra image starts, and the entry point map is mainly used for time-based search that detects the position of data in a time zone a predetermined length of time after starting of data reproduction. When video object data is stored in units of video clips, there is a need of reproducing audio data corresponding to a part of the video object data.

[63] FIG. 12 illustrates structures of PlayLists and Playltems that are reproduction units of video object data stored in units of clips. The PlayList is a basic reproduction unit. A plurality of PlayLists are stored in an information storage medium. Each PlayList is linked to a plurality of Playltems. A Play Item corresponds to the entire clip or a part thereof and indicates starting and finishing times of reproduction of the clip. Accordingly, when reproducing a PlayList, a plurality of clips may be continuously reproduced or a part of a clip may be reproduced. When audio data is mapped to the PlayList, the audio data can be reproduced with the part of the clip or the plurality of clips linked to the PlayList.

[64] Audio mapping data that maps audio data to video object data in units of PlayLists may be described in the XML format as follow:

[65] <audio-mapping-data type=dvd-video lang=xx caption=yy>

[66] <dvd-video> [67] <audio playlist=l playitem=l href=http://movie.com/c.acp />

[68] <audio playlist=l playitem=l-9 href=http://movie.com/d.acp />

[69] </dvd-video>

[10] </audio-mapping-data>

[71] FIG. 13 is a diagram illustrating a method allowing a user to select audio data from an audio list according to a desired language and application of the audio data, and reproduce the audio data with video object data. More specifically, when respective video object data corresponds to a plurality of audio data recorded in languages of various countries, the method enables the user to select audio data recorded in a desired language. Also, when the user views a movie, the method allows the user to determine whether he/she will listen to the audio of the movie or a director's commentary audio regarding the making of the movie while reproducing a moving image.

[72] FIG. 14 illustrates a data structure of an audio list allowing a user to select a language in which audio data will be reproduced according to an embodiment of the present invention. The audio list lists the addresses of respective audio mapping data that are classified by the types of languages. Thus, when the user selects a language, a reproducing apparatus is capable of reading audio mapping data corresponding to the selected language.

[73] FIG. 15 illustrates a data structure of an audio list allowing a user to select audio data according to an application, according to an embodiment of the present invention. For instance, the audio list is configured such that the user can select one of audio of dialogues of a movie or commentary audio and can access audio mapping data for the selected application.

[74] Use of the audio list makes it possible to reproduce audio data recorded in languages of various countries and provide a user with audio tracks classified according to various applications.

[75] The audio list may be recorded in a markup language in an information storage medium, and parsed and executed by a markup language parser 180 of FIG. 3.

[76] Although a few embodiments of the present invention have been shown and described, it would be appreciated by those skilled in the art that changes may be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the claims and their equivalents.

Claims

[1] 1. An information storage medium comprising: video object data; and audio mapping data specifying a mapping relation between the video object data and audio data that is obtained from a source external of the information storage medium, wherein the audio data is reproduced with a corresponding part of the video object data based on the audio mapping data.

[2] 2. The information storage medium of claim 1, wherein the video object data is stored in a plurality of cell units that are logical units in which information is stored in the information storage medium, and the audio mapping data allows the audio data to correspond to the video object data stored in the cell units.

[3] 3. The information storage medium of claim 1, wherein the video object data is stored in a plurality of cell units that are logical units in which information is stored in the information storage medium, and the audio mapping data allows the audio data to correspond to the video object data in groups of cells units.

[4] 4. The information storage medium of claim 1, wherein the video object data is stored in units of video clips, and the audio mapping data allows the audio data to correspond to the video object data stored in the units of video clips.

[5] 5. The information storage medium of claim 1, wherein the video object data is stored in units of video clips, and the audio mapping data allows the audio data to be mapped to a part of a clip of the video object data.

[6] 6. The information storage medium of claim 1, wherein the video object data is stored in units of video clips, and the audio mapping data allows the audio data to be mapped to a playlist corresponding to a part of a clip or a plurality of clips of the video object data.

[7] 7. The information storage medium of claim 1, wherein the audio mapping data specifies the video object data and an address of a site on the source external of the information storage medium in which corresponding audio data is stored, using a markup language.

[8] 8. A reproducing apparatus comprising: a reader reading video object data from an information storage medium, audio data from a source external of the information storage medium, and audio mapping data; a mapping processor processing mapping data regarding a mapping relationship between the video object data and the audio data, and providing a relationship between the audio data and the video object data, the mapping data being included in the audio mapping data; a decoder decoding the video object data and the audio data; and a data output unit outputting the decoded video object data with the decoded audio data, based on the audio mapping data.

[9] 9. The reproducing apparatus of claim 8, wherein the reader reads the audio mapping data from the source external of the information storage medium, using an address of the audio mapping data input by a user.

[10] 10. The reproducing apparatus of claim 8, wherein the reader reads the audio mapping data from a source external of the information storage medium, using an address of the audio mapping data stored in the information storage medium.

[11] 11. The reproducing apparatus of claim 8, wherein the reader further reads a markup language document from the information storage medium, the reproducing apparatus further comprising a markup language parser parsing a command defined in the markup language document, providing an address of the audio mapping data to the reader, or providing the audio mapping data to the mapping processor.

[12] 12. The reproducing apparatus of claim 8, wherein the reader reads the audio mapping data from the information storage medium.

[13] 13. A method of reproducing information, comprising: reading video object data from an information storage medium; reading audio mapping data that specifies a mapping relationship between the video object data and audio data obtained from the source external of the information storage medium; reading the audio data mapped to the video object data from a source external of the information storage medium, based on the audio mapping data; and reproducing the video object data with the mapped audio data based on the audio mapping data.

[14] 14. The method of claim 13, wherein during the reading of the audio mapping data, the audio mapping data is read from the source external of the information storage medium, using an address of the audio mapping data input by a user.

[15] 15. The method of claim 13, wherein during the reading of the audio mapping data, the audio mapping data is read from the source external of the information storage medium, using an address of the audio mapping data stored in the information storage medium.

[16] 16. The method of claim 13, wherein the reading of the audio mapping data comprises: reading a markup language document from the information storage medium; and reading the audio mapping data by executing a command defined in the markup language document.

[17] 17. The method of claim 13, wherein the reading of the audio mapping data comprises: reading information regarding audio lists including a plurality of option items from the source external of the information storage medium, and allowing a user to select one of the audio lists; reading the audio mapping data corresponding to the selected one of the audio lists.

[18] 18. The method of claim 17, wherein during the reading of the information, the user is allowed to select an audio list corresponding to audio data in a desired language from the audio lists classified according to a plurality of languages of audio data; during the reading of the audio mapping data, the audio mapping data corresponding to a selected language is read; and during the reading of the audio data mapped to the video object data, the audio data recorded in the selected language is read.

[19] 19. The method of claim 17, wherein during the reading of the information regarding the audio lists, the user is allowed to select an audio list of a desired application from the audio lists classified according to applications of audio data, during the reading of the audio mapping data corresponding to the selected one of the audio lists, the audio mapping data corresponding to a selected application is read, and during the reading of the audio data mapped to the video object data, the audio data corresponding to the selected application is read.

[20] 20. The method of claim 19, wherein during the reading of the information regarding the audio lists, the user selects whether to listen to the audio data corresponding to the video object data or the audio data containing a commentary of a manufacturer of the video object data, during reproduction of the video object data.

[21] 21. The method of claim 17, wherein the reading of the information regarding the audio lists comprises: reading a markup language document from the information storage medium; and reading the audio lists by executing a command defined in the markup language document.

[22] 22. The method of claim 13, wherein the audio data is audio stream data read using an audio streaming service, and the reading of the audio data mapped to the video object data and the reproducing the video object data are simultaneously performed.

[23] 23. The method of claim 13, wherein during the reading of the audio mapping data, the audio mapping data is read from the information storage medium.

[24] 24. The information storage medium of claim 1, wherein the source external of the information storage medium is the Internet.

[25] 25. The apparatus of claim 8, wherein the source external of the information storage medium is the Internet.

[26] 26. The method of claim 13, wherein the source external of the information storage medium is the Internet.

[27] 27. A method of reproducing information, comprising: mapping audio data, obtained from a remote location, to video object data stored in an information storage medium; and reproducing the audio data with the video object data, using audio mapping data.

[28] 28. The method of claim 27, wherein the audio mapping data is stored in the information storage medium containing the video object data.

[29] 29. The method of claim 27, wherein the audio mapping data is distributed via Internet after the information storage medium has been manufactured.

[30] 30. The method of claim 27, wherein the remote location where the mapping audio data is obtained from is the Internet.

[31] 31. A reproducing apparatus , comprising : a reader reading data from an information storage medium and from a remote location, and outputting video object data, audio data and mapping data; a mapping processor processing the mapping data and outputting audio mapping data; a decoder decoding the video object data and the audio data; and a data output unit reproducing the audio data with the video object data, using the output mapping data.

[32] 32. The apparatus of claim 31, wherein the reader reads the mapping data using an address input by a user.

[33] 33. The apparatus of claim 31, wherein the reader reads the mapping data using an address stored in the information storage medium.

[34] 34. The apparatus of claim 31, further comprising a markup language parser parsing a command defined in a markup language document from the information storage medium, and provides an address of the mapping data to the reader.

[35] 35. The apparatus of claim 31, further comprising a markup language parser parsing a command defined in a markup language document from the information storage medium, and provides the mapping data to the mapping processor.

[36] 36. The apparatus of claim 31, wherein the remote location where the data is read from is the Internet.