JP2011035922A - Recording medium and apparatus for reproducing data from recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a storage medium recording a text-based subtitle stream and a reproducing apparatus. <P>SOLUTION: The present invention relates to a recording medium, including moving video data and text-based subtitle data for providing a caption of the moving video data. The text-based subtitle data include a plurality of in-line presentation units and an in-line style unit defining a set of output styles to be applied to the plurality of in-line presentation units; each in-line presentation unit includes: in-line text information; time information representing a time to output the in-line text information; pallet information defining a hue to be applied to the in-line text information; and a hue update flag, representing whether only the pallet information is modified relative to a graphic constitution of a previous in-line presentation unit. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to reproduction of multimedia video, and more particularly, a recording medium on which a multimedia video stream and a text-based subtitle stream are recorded, and a multimedia video stream and a text-based subtitle stream recorded on the recording medium. And a reproducing method thereof.

  Currently, AV (Audio-visual) data recorded on a recording medium for providing multimedia video of HD-class high image quality includes a video stream, an audio stream, a presentation graphic stream for providing a subtitle, and a user. An interactive graphics stream for providing buttons or menus for the interaction is multiplexed with the main stream. In particular, a presentation graphic stream for providing a subtitle provides a bitmap-based image for displaying subtitles.

  Such bitmap-based caption data is not only large in size, but also multiplexed with other streams such as video, audio, interactive graphics, etc., so that caption data can be produced and edited. There is a problem that it is very difficult. Furthermore, there is a problem that the output style of subtitle data cannot be changed in various ways. That is, one subtitle output style cannot be changed to another style.

  In order to solve the above problems, an object of the present invention is to provide a recording medium on which a text-based subtitle stream is recorded, and a playback device.

  To achieve this object, the present invention includes moving image data and text-based subtitle data for providing subtitles of the moving image data. The text-based subtitle data includes a plurality of dialogue presentation units and the plurality of dialogues. It includes dialogue style units that define a set of output styles to be applied to presentation units, and each dialogue presentation unit is applied to dialogue text information, time information representing the time when the dialogue text information is output, and dialogue text information. Palette information that defines the hue to be displayed, and a hue update flag that indicates whether only the palette information has been changed as compared with the graphic configuration in the previous dialogue presentation unit.

  When the hue update flag is 1, palette information may be applied to previous dialogue text information output by the previous dialogue presentation unit.

  Further, when the hue update flag is 0, palette information may be applied to the dialogue text information output by the current dialogue presentation unit.

In addition, in an apparatus for reproducing data from a recording medium storing moving image data and text-based subtitle data for providing subtitles of the moving image data, a decoder for decoding the moving image data, and a plurality of dialogues Receiving the text-based subtitle data including a presentation unit and a dialogue style unit defining a set of output styles applied to the plurality of dialogue presentation units, and referring to the dialogue style unit, the plurality of dialogue presentations A subtitle decoder that converts text information for dialogue included in the unit into a bitmap image and outputs the converted bitmap image in synchronization with the decoded video data; each dialogue presentation unit includes: , The dialogue List information, time information indicating the time when the dialogue text information is output, palette information that defines the hue applied to the dialogue text information, and whether only palette information has been changed compared to the previous graph presentation structure of dialogue presentation units. It includes a hue update flag indicating whether or not.

  In addition, when the hue update flag is 1, the subtitle decoder may apply palette information to previous dialogue text information output by the previous dialogue presentation unit.

  In addition, when the hue update flag is 0, the subtitle decoder may apply the palette information to the dialogue text information output by the current dialogue presentation unit.

  Production of subtitle data by providing a recording medium on which a text-based subtitle data stream separated from video data is recorded, a playback device for playing back the text-based subtitle data stream, and a playback method thereof It is easy to edit the produced subtitle data. It is also possible to provide subtitles in a plurality of languages without limitation on the number of subtitle data.

  In addition, subtitles can be continuously played back using a plurality of adjacent presentation information, and effects such as fade-in / out can be easily realized by applying this.

FIG. 3 is a diagram illustrating a multimedia data structure recorded on a recording medium according to an exemplary embodiment of the present invention. FIG. 2 is a diagram illustrating a structure of a clip AV stream shown in FIG. 1 and a text-based subtitle stream according to the present invention. FIG. 6 is a diagram illustrating a data structure of a text-based subtitle stream according to the present invention. FIG. 4 is a diagram illustrating an embodiment in which a text-based subtitle stream having the data structure illustrated in FIG. 3 is implemented. FIG. 4 is a diagram illustrating an embodiment embodying the dialogue style unit illustrated in FIG. 3. It is a figure for demonstrating an example of the data structure of a dialog style unit as one Embodiment of this invention. It is a figure for demonstrating an example of the data structure of the dialogue style unit by other embodiment of this invention. FIG. 8 is a diagram illustrating an embodiment in which the dialogue style unit illustrated in FIG. 6 or 7 is implemented. FIG. 9 is a diagram illustrating an embodiment of a clip information file including a plurality of font sets referred to by the font information of FIG. 8. FIG. 9 is a diagram illustrating an embodiment of a clip information file including a plurality of font sets referred to by the font information of FIG. 8. 9A and 9B are diagrams for showing positions of a plurality of font files referred to by font file information in FIGS. 9A and 9B. FIG. FIG. 4 is a diagram for explaining an embodiment of a data structure of a dialogue presentation unit shown in FIG. 3. It is a figure for demonstrating other embodiment of the data structure of the dialogue presentation unit shown by FIG. It is a figure for demonstrating other embodiment of the data structure of the dialogue presentation unit shown by FIG. FIG. 13 is a diagram illustrating an embodiment in which the dialogue presentation units illustrated in FIGS. 11, 12A, and 12B are implemented. It is a figure for demonstrating the data structure of dialogue text information shown by FIG. It is a figure which shows one Embodiment which embodied dialogue text information of FIG. It is a figure for demonstrating the restriction | limiting matter for reproducing | regenerating continuously a continuous speech presentation unit (DPU). FIG. 3 is a diagram illustrating a structure of a playback device for playing back a text-based subtitle stream according to the present invention. FIG. 6 is a diagram for explaining a preloading process of a text-based subtitle stream in the playback apparatus according to the present invention. FIG. 10 is a diagram for explaining a process in which a dialogue presentation unit (DPU) is played in the playback device according to the present invention. FIG. 6 is a diagram illustrating a process in which a text-based subtitle stream is output in synchronization with moving image data in the playback apparatus according to the present invention. FIG. 6 is a diagram for explaining a process of outputting a text-based subtitle stream on a screen in the playback apparatus according to the present invention. FIG. 10 is a diagram illustrating a process of rendering a text-based subtitle stream in the playback apparatus according to the present invention. FIG. 6 is a diagram illustrating a playback device status register provided in a playback device for playing back a text-based subtitle stream according to the present invention. 3 is a flowchart illustrating a method for reproducing a text-based subtitle stream according to the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a view illustrating a multimedia data structure recorded on a recording medium (for example, a medium 230 as shown in FIG. 2) according to an embodiment of the present invention. Referring to FIG. 1, the recording medium according to the present invention has a plurality of layer structures in order to manage the multimedia data structure 100 of the multimedia video stream. The multimedia data structure 100 includes a clip 110 that is a recording unit of multimedia video, a playlist 120 that is a playback unit of multimedia video, a movie object 130 that includes navigation commands for playing back the multimedia video, and It includes an index table 140 for designating the movie object to be reproduced and each title of the movie object 130.

  The clip 110 embodies an AV data stream for a high-quality movie and an attribute of the corresponding AV data stream as one object. The AV data stream is called a clip AV stream 112, and the attribute information of the AV data stream is called clip information 114. For example, the AV data stream may be compressed according to a standard such as MPEG (Motion Picture Experts group). However, such a clip 110 does not necessarily require a compressed AV data stream 112. Further, the clip information 114 may include an audio / video characteristic of the AV data stream 112, an entry point map in which position information of randomly accessible entry points is recorded, and the like.

  The playlist 120 is a set of playback sections of the clip 110, and each playback section is called a play item 122. The movie object 130 is composed of a navigation instruction word program, and such navigation instruction word starts reproduction of the playlist 120 or manages reproduction of the playlist 120 by switching between the movie objects 130 or by user preference. .

  The index table 140 is a top-level table for defining a plurality of titles and menus. The index table 140 includes start position information for all titles and menus. Play titles and menus selected through input. It also includes start position information of a title or menu that is played first when the recording medium is inserted into the playback device.

  Among these, the structure of a clip AV stream in which multimedia video is compression-encoded will be described with reference to FIG. FIG. 2 is a diagram illustrating the structure of the AV data stream 210 shown in FIG. 1 and the text-based subtitle stream 220 according to the present invention. Referring to FIG. 2, a text-based subtitle stream 220 according to the present invention is provided in order to solve the problem of the bitmap-based caption data as described above, which is separately from the AV data stream 210. It is separated and stored in a recording medium 230 such as a DVD. The AV data stream 210 includes a video stream 202, an audio stream 204, a presentation graphic stream 206 for providing subtitle data, and an interactive graphic stream 208 for providing buttons and menus for user interaction. Are multiplexed on a moving picture main stream known as an AV data stream and recorded on the recording medium 230.

  The text-based subtitle data 220 according to the present invention refers to data for providing a subtitle or subtitle of a multimedia video recorded on the recording medium 230, and uses a markup language such as XML (eXtended Markup Language). Can be implemented. However, subtitles or subtitles of multimedia video may be provided using binary data. In the following, text-based subtitle data that provides subtitles for multimedia video using binary data is abbreviated as “text-based subtitle stream”. The presentation graphic stream 206 for providing subtitle data or subtitle data also provides bitmap-based subtitle data in order to display the subtitle (or subtitle) on the screen.

  Since the text-based subtitle data stream 220 is recorded separately from the AV data stream 210 and is not multiplexed with the AV data stream 210, the size of the text-based subtitle data stream 220 is not limited. As a result, subtitles or subtitles using a plurality of languages can be provided. Also, the text-based subtitle data stream 220 can be easily and conveniently generated and effectively edited.

  The text-based subtitle stream 220 is converted into a bitmap graphic image, overlaid on the multimedia video, and output to the screen. The process of converting text-based data into a graphic-based bitmap image is called rendering. The text-based subtitle stream 220 includes information necessary for rendering subtitle text.

  Hereinafter, the structure of the text-based subtitle stream 220 including rendering information will be described in detail with reference to FIG. FIG. 3 is a diagram illustrating a data structure of a text-based subtitle stream 220 according to the present invention.

  Referring to FIG. 3, a text-based subtitle stream 220 according to an embodiment of the present invention includes a dialog style unit (hereinafter referred to as DSU) 310 and a plurality of dialog presentation units (hereinafter referred to as “Dialog Presentation Unit”). 320 to 340) (abbreviated as DPU). Dialogue style units (DSU) or dialogue presentation units (DPU) are also called dialogue units. Dialogue units constituting the text-based subtitle stream 220 according to the present invention are recorded in the form of a packetized elementary stream (hereinafter abbreviated as PES), that is, a PES packet 350. The PES of the text-based subtitle stream is recorded and transmitted in units of transmission packets 362 (Transport Packet: hereinafter abbreviated as TP). Such a series of transmission packets is called a transport stream (hereinafter abbreviated as TS).

  However, as shown in FIG. 2, the text-based subtitle stream 220 according to an embodiment of the present invention is not multiplexed with the AV data stream 210 and is recorded on the recording medium 230 as a separate TS.

  Also, referring to FIG. 3, one PES packet 350 included in the text-based subtitle stream 220 records one dialogue unit. The text-based subtitle stream 220 includes one DSU positioned first and a plurality of DPUs positioned thereafter. The DSU includes information that specifies the output style of the dialogue with subtitles displayed on the screen on which the multimedia video is reproduced. On the other hand, the plurality of DPUs include text information and the like related to the output line contents and information related to each output time.

  FIG. 4 is a view illustrating an embodiment of a text-based subtitle stream 220 having the data structure shown in FIG. Referring to FIG. 4, a text-based subtitle stream 220 according to an embodiment of the present invention includes one DSU 410 and a plurality of DPUs 420. In the present embodiment, the number of DPUs is defined as num_of_dialog_presentation_unit. However, the number of DPUs need not be specified separately. For example, a case of using a syntax such as “while” (processed_length <end_of_file) is an example.

  Hereinafter, a more specific data structure of the DSU and DPU will be described with reference to FIG. FIG. 5 is a diagram illustrating an embodiment in which the DSU 310 illustrated in FIG. 3 is implemented.

  Referring to FIG. 5, dialog style unit 310 defines dialog_styleset () 510 which is a set of dialog style information obtained by collecting output style information of dialog output to subtitles. The dialogue style unit 310 includes information related to the position of a region in which dialogue is displayed in subtitles, information necessary for dialogue rendering, information relating to a style that can be controlled by the user, and the like. Specific contents of the data will be described later.

  FIG. 6 is a diagram for explaining an example of a data structure of a DSU according to an embodiment of the present invention. Referring to FIG. 6, the DSU 310 includes a palette set 610 and a region style set 620. The palette set 610 is a set of a plurality of hue palettes that define hues used for subtitles. Hue information such as a combination of hues or transparency included in the palette set can be applied to a plurality of DPUs located after the DSU.

  The area style set 620 is a set of output style information for each line constituting the caption. Each area style includes area information 622 indicating a position where a dialogue is displayed and text style information 624 indicating an output style applied to the text of each dialogue. Further, a user changeable style set 626 representing a style that can be arbitrarily changed by the user may be further included.

  FIG. 7 is a diagram for explaining an example of a data structure of a DSU according to another embodiment of the present invention. Referring to FIG. 7, unlike FIG. 6, a case where the palette set 610 is not included is shown. That is, a hue palette set is not defined in the DSU, but a palette set 610 is defined in the DPU described later (see FIGS. 12A and 12B). The data structure of each area style 710 is the same as that described with reference to FIG.

  FIG. 8 is a diagram illustrating an embodiment in which the DSU illustrated in FIG. 6 or 7 is implemented. Referring to FIGS. 8 and 6, the dialogue style unit 310 according to the present invention includes palette sets 860 and 610 and a plurality of area styles 820 and 620. As described above, the palette set 610 is a set of a plurality of hue palettes that define hues used for subtitles. Hue information such as a combination of hues or transparency included in the palette set can be applied to a plurality of DPUs located after the DSU.

  On the other hand, each of the area styles 820 and 620 includes area information 830 and 622 indicating information related to the window area in which the caption is output. The area information includes the X coordinate, the Y coordinate, the width, and the height of the window area in which the caption is displayed. And information such as background color.

  Each area style 820 and 620 includes text style information 840 and 624 indicating an output style applied to the text of each line. That is, the X and Y coordinates of the position where the dialogue text is output in the window area, from left to right, from top to bottom, the output direction of such text, alignment, line spacing, reference font identifier, bold Information about font style, font size, font hue, such as font or italic may be included.

  Further, each region style 820, 620 may include a user-modifiable style set 850, 626 indicating styles that the user can arbitrarily change. Whether to include user-modifiable style sets 850, 626 is optional. The user-changeable style sets 850 and 626 are basically the text output style information 840 and 624 applied to the text of each dialogue, and the change information for the window area position, the text output position, the font size, and the line spacing. Can be included. Each change information can be expressed as a relative increase / decrease value with respect to information 840 and 624 regarding the output style that is basically applied to the text of each line.

  When organized, the style-related information includes style information (region_style) 620 defined in the area styles 820 and 620, inline style information (inline_style) 1510 for emphasizing a part of subtitles, which will be described later, and style information that can be changed by the user ( use_changable_style) 850, and the order in which these are applied is as follows.

  1) Most basically, the area style information 620 defined in the area style is applied.

  2) If there is inline style information, the inline style information 1510 in which a part of the subtitle text is emphasized is applied to the part to which the area style information is applied.

  3) If there is style information 850 that can be changed by the user, this information is finally applied. The presence of user-modifiable style information is selective.

  On the other hand, the font information file referred to by the font identifier (font_id) 842 among the text style information 840 and 624 applied to the text of each dialogue can be defined as follows.

  9A is a diagram showing a clip information file 910 including a plurality of font sets referred to by the font information 842 in FIG. 8 according to an embodiment of the present invention.

  Referring to FIG. 9A, FIG. 8 and FIG. 1, StreamCodingInfo () 930 which is a stream coding information structure included in clip information 910 and 110 files includes information on various streams recorded on the recording medium according to the present invention. It is included. That is, information on a video stream, an audio stream, a presentation graphic stream, an interactive graphic stream, a text-based subtitle stream, and the like is included. In particular, for a text-based subtitle stream, information (textST_language_code) 932 regarding a language for displaying subtitles may be included. Also, a font name 936 corresponding to font_id 842 and 934 indicating the identifier of the referenced font shown in FIG. 8 and a file name 938 in which font information is stored can be defined. A method for searching for a font file corresponding to the identifier of the referenced font defined here will be described later with reference to FIG.

  FIG. 9B is a diagram showing a clip information file including a plurality of font sets referred to by the font information 842 in FIG. 8 according to another embodiment of the present invention. Referring to FIG. 9B, a structure called ClipInfo () can be defined in the clip information 910 and 110 files. A plurality of font sets referenced by the font information 842 in FIG. 8 can be defined in this structure. That is, the font file name 952 corresponding to the font_id 842 indicating the identifier of the referenced font shown in FIG. 8 is designated. A method of searching for a font file corresponding to the identifier of the referenced font defined here is as follows.

  FIG. 10 is a diagram showing the positions of a plurality of font files referenced by the font file names 938 or 952 in FIGS. 9A and 9B. Referring to FIG. 10, a directory structure of files related to multimedia images recorded on a recording medium according to the present invention is shown. In particular, if the directory structure shown is used, 11111.11 stored in the auxiliary data (AUXDATA) directory. font or 99999. The location of a font file such as font 1010 or 1020 can be easily found.

  On the other hand, in the following, the structure of the DPU constituting the dialogue unit will be described in detail with reference to FIG.

  FIG. 11 is a diagram for explaining an embodiment of the data structure of the DPU 320 shown in FIG. Referring to FIGS. 11 and 3, the DPU 320 including the text information about the content of the dialogue output on the screen and the information about the output time specifies the time information 1110 indicating the time when the dialogue is output, and the hue palette to be referred to. Palette reference information 1120 to be output, and dialogue area information 1130 to be output. In particular, the output dialogue area information 1130 includes style reference information 1132 that specifies an output style applied to the dialogue, and dialogue text information 1134 that represents the text of the dialogue that is actually output. In this case, it is assumed that the hue palette set indicated by the palette reference information 1120 is defined by the DSU (see 610 in FIG. 6).

  On the other hand, FIG. 12A is a diagram for explaining another embodiment of the data structure of the DPU 320 shown in FIG.

  Referring to FIGS. 12A and 3, the DPU 320 includes time information 1210 representing the time when dialogue is output to the screen, a palette set 1220 defining a hue palette set, and output dialogue area information 1230. In this case, the palette set 1220 is not defined in the DSU as shown in FIG. 11, but is directly defined in the DPU.

  On the other hand, FIG. 12B is a diagram for explaining another embodiment of the data structure of the DPU 320 shown in FIG.

  Referring to FIG. 12B, the DPU 320 includes time information 1250 indicating a time when a dialogue is output, a hue update flag 1260, a hue palette set 1270 used when the hue update flag is set to 1, and an output dialogue. Area information 1280 is included. In this case, the palette set 1270 is defined in the DSU as shown in FIG. 11 and directly stored in the DPU. In particular, in order to express effects such as fade-in / out using continuous playback, in addition to the basic palette set defined in the DSU, a hue palette set used to express fade-in / out is thus set in the DPU. The hue update flag 1260 can be set to 1. This will be described in detail with reference to FIG.

  FIG. 13 is a diagram illustrating an embodiment in which the DPU 320 illustrated in FIGS. 11, 12A, and 12B is implemented. Referring to FIG. 13, FIG. 11, FIG. 12A, and FIG. 12B, the DPU has dialogue start time information (dialog_start_PTS) and dialogue end time information (dialog_end_PTS) as time information 1110 representing the time when dialogue is output to the screen. 1310 is included. Further, the dialogue reference identifier 1120 includes a dialogue palette identifier 1320 (dialog_palette_id). In the case of FIG. 12A, a hue palette set 1220 may be included instead of the palette reference information. The dialogue area information 1230 to be output includes dialogue text information (region_subtitle) 1334, and an area style identifier (region_style_id) 1332 may be included to specify an output style to be applied thereto. The example shown in FIG. 13 is merely an embodiment of the DPU, and other than that, the DPU having the data structure of FIGS. 11 to 12B can be variously modified and implemented.

  FIG. 14 is a diagram for explaining the data structure of the dialogue text information (region_subtitle) 1334 shown in FIG. Referring to FIG. 14, dialogue text information (1134 in FIG. 11, 1234 in FIG. 12A, 1284 in FIG. 12B, and 1334 in FIG. 13) is inline style information 1410 as an output style for emphasizing a part of the dialogue. And dialogue text 1420.

  FIG. 15 is a diagram illustrating an embodiment in which the dialogue text information 1334 of FIG. 13 is implemented. FIG. 15 shows an example in which inline style information (inline_style) 1510 and dialogue text (text_string) 1520 are implemented. In addition, it is desirable that the illustrated embodiment further includes information indicating the end of the inline style. This is because if the end part of the inline style is not defined, the inline style once specified is different from the intention of the producer and can be applied subsequently.

  On the other hand, FIG. 16 is a diagram for explaining a restriction for continuously playing back a continuous DPU.

  Referring to FIGS. 16 and 13, when the plurality of DPUs need to be reproduced continuously, the following restriction condition is necessary.

  1) Dialog start time information (dialog_start_PTS) 1310 defined in the DPU indicates a time at which a dialog object starts to be output to a graphic plane described later.

  2) Dialog end time information (dialog_end_PTS) 1310 defined in the DPU indicates a time for resetting a decoder that processes a text-based subtitle described later.

  3) When a plurality of the DPUs need to be reproduced continuously, the dialogue end time information (dialog_end_PTS) of the current DPU is the next DPU dialogue start time information (dialog_start_PTS) to be reproduced continuously. Must be identical. That is, in order for DPU # 2 and DPU # 3 to be played back continuously in the figure, the line end time information included in DPU # 2 must be the same as the line start time information included in DPU # 3. Don't be.

  On the other hand, the DSU according to the present invention preferably satisfies the following limiting conditions.

  1) The text-based subtitle stream 220 includes one DSU.

  2) The number of style information (user_control_style) that can be changed by the user included in the whole area style (region_style) must be the same.

  On the other hand, the DPU according to the present invention preferably satisfies the following restriction conditions.

  1) A window area for a maximum of two subtitles must be defined.

  Hereinafter, the structure of the playback apparatus according to the present invention will be described based on the data structure of the text-based subtitle stream recorded on the recording medium according to the present invention described in detail.

  FIG. 17 is a diagram illustrating the structure of a playback apparatus for playing back a text-based subtitle stream according to the present invention. Referring to FIG. 17, the playback apparatus 1700 includes a font preloading buffer (FPB) 1710 for storing font files and a subtitle preloading buffer (SPB) 1712 for storing text-based subtitle files. And a subtitle decoder 1730 for decoding and reproducing a text-based subtitle stream already recorded on the recording medium. Further, a graphic plane (GP) 1750 and a hue reference table (CLUT) 1760 may be provided.

  Specifically, the buffer unit includes a subtitle preloading buffer (SPB) 1710 in which the text-based subtitle data stream 220 is preloaded and a font preloading buffer (FPB) 1712 in which font information is preloaded.

  The subtitle decoder 1730 includes a text subtitle processor 1732, a dialogue configuration buffer (DCB) 1734, a dialogue buffer (DB) 1736, a text subtitle renderer 1738, a dialogue presentation controller 1740, and a bitmap object buffer (BOB) 1742.

  The text subtitle processor 1732 receives the text-based subtitle data stream 220 from the text subtitle preloading buffer (SPB) 1710 and outputs style related information included in the DSU and output time information of dialogue included in the DPU. Are transmitted to the dialogue structure buffer (DCB), and the dialogue text information included in the DPU is transmitted to the dialogue buffer (DB).

  The presentation controller 1740 controls the text renderer 1738 using the style related information included in the dialogue composition buffer (DCB) 1734, and is rendered in the bitmap object buffer (BOB) using the dialogue output time information. Controls the time that the bitmap image is output to the graphics plane 1750.

  Under the control of the presentation controller 1740, the text subtitle renderer 1738 receives the font corresponding to the dialogue text information stored in the dialogue buffer (DB) 1736 and the font information preloaded in the font preloading buffer (FPB) 1712. Applying the information converts the line text information into a bitmap image, ie, rendering. The rendered bitmap image is stored in a bitmap object buffer (BOB), and output to a graphic plane (GP) 1750 under the control of the presentation controller 1740. At this time, the hue specified in the DSU with reference to the hue reference table (CLUT) 1760 is applied.

  As style-related information applied to the dialogue text, information defined by the producer in the DSU can be used, but style-related information predefined by the user may be applied. The playback apparatus 1700 shown in FIG. 17 applies the style information defined by the user before the style related information defined by the producer.

  As described above with reference to FIG. 8, the area style information (region_style) defined in the DSU by the producer is basically applied to the style related information applied to the dialogue text, and the corresponding area style information is applied. If the inline style is included in the DPU including the dialogue text, the inline style information (inline_style) is applied to the corresponding part. In addition, if the producer defines a style that can be changed by the user in addition to the DSU, and one of the styles that can be changed by the user is selected, the dialogue style is applied to the area style and / or inline style. After that, a style that can be changed by the user is finally applied. Further, as described above with reference to FIG. 15, it is preferable that the content of the inline style includes information notifying the end of application of the inline style.

  Furthermore, the producer must specify whether the style-related information defined by the playback device itself can be used or prohibited separately from the style-related information defined by the producer recorded on the recording medium. Is also possible.

  FIG. 18 is a diagram for explaining a preloading process of the text-based subtitle data stream 220 in the playback apparatus 1700 according to the embodiment of the present invention shown in FIG. 17, for example. Referring to FIG. 18, the text-based subtitle data stream 220 shown in FIG. 2 is defined in the playlist sub-path. A plurality of text-based subtitle data streams 220 supporting a plurality of languages can be defined in the subpath. Also, the font file applied to the text-based subtitle stream can be defined in the clip information file as described above with reference to FIGS. 9A and 9B. Up to 255 text-based subtitle data streams 220 that can be included in one recording medium can be defined per playlist. In addition, the maximum number of font files that can be included in one recording medium can be defined as 255. However, in order to guarantee seamless playback, the size of the text-based subtitle data stream 220 must be smaller than or equal to the size of the preloading buffer 1710 of the playback device.

  FIG. 19 is a diagram for explaining a process in which a DPU is played back in the playback apparatus according to the present invention.

  Referring to FIGS. 19, 13, and 17, a process of reproducing a DPU is shown. The presentation controller 1740 uses the dialogue start time information (dialog_start_PTS) and dialogue end time information (dialog_end_PTS) for specifying the dialogue output time 1310 included in the DPU, and the rendered dialogue is output to the graphic plane. Control the time. At this time, the dialogue start time information specifies a time at which the rendered dialogue bitmap image stored in the bitmap object buffer 1742 included in the text-based subtitle decoder 1730 is transmitted to the graphic plane 1750. That is, when the dialogue start time defined in the DPU is reached, the bitmap information necessary for constructing dialogue must be transmitted to the graphic plane (GP) and be usable. Further, the dialogue end time information designates a time at which the reproduction of the DPU ends. At this time, the subtitle decoder 1730 and the graphic plane 1750 are reset. A buffer in the subtitle decoder 1730 such as a bitmap object buffer (BOB) is preferably reset between the start time and end time of the DPU regardless of continuous playback.

  However, if continuous playback of a plurality of DPUs is required, the subtitle decoder 1730 and the graphic plane 1750 are not reset, and the dialogue composition buffer (DCB) 1734, dialogue buffer (DB) 1736, and bitmap object buffer (BOB). The saved contents of each buffer, such as 1742, must be maintained. That is, when the dialogue end time information of the DPU currently being reproduced is the same as the dialogue start time information of the DPU continuously reproduced thereafter, the contents of each buffer are maintained without being reset.

  In particular, a fade-in / out effect is an example in which continuous playback of a plurality of DPUs is applied. The fade-in / out effect can be realized by changing the hue reference value (CLUT) 1760 of the bitmap object that has been transmitted to the graphic plane (GP). That is, the first DPU includes configuration information such as hue, style, and output time, and a plurality of subsequent DPUs have the same configuration information as the first DPU, but only the hue palette information is updated. Is done. In this case, a fade-in / out effect can be obtained by sequentially changing the transparency of the hue information from 0% to 100%.

  In particular, if the DPU data structure shown in FIG. 12B is used, the fade-in / out effect can be effectively implemented using the hue update flag 1260. That is, when the dialogue presentation controller 1740 confirms the hue update flag 1260 included in the DPU and is set to 0, that is, in a general case where the fade-in / out effect is not necessary, basically, The hue information included in the DSU shown in FIG. 6 is used. On the other hand, as a result of checking the hue update flag 1260, when it is set to 1, that is, when a fade-in / out effect is required, instead of using the hue information 610 included in the DSU shown in FIG. Further, the fade-in / out effect can be implemented using the hue information 1270 included in the DPU. At this time, the fade-in / out effect can be easily obtained by adjusting the transparency of the hue information 1270 included in the DPU.

  After showing the fade-in / out effect in this way, the hue reference table (CLUT) 1760 is preferably updated with the hue information included in the original dialogue presentation unit (DSU). If the update is not performed in this way, the hue information once specified is different from the intention of the producer and can be applied subsequently.

  FIG. 20 is a diagram for explaining a process in which a text-based subtitle stream is output in synchronization with moving image data in the playback apparatus according to the present invention. Referring to FIG. 20, the dialogue start time information and dialogue end time information included in the DPU of the text-based subtitle data stream 220 are synchronized with the output time of the multimedia video AV data stream 210. It must be defined as the time on the global time axis used in the playlist. Thereby, discontinuity between the system time clock (STC) of the AV data stream and the dialogue output time (PTS) of the text-based subtitle data stream 220 can be prevented.

  FIG. 21 is a diagram for explaining a process of outputting a text-based subtitle data stream on the screen in the playback apparatus according to the present invention. Referring to FIG. 21, rendering information 2102 including style related information is applied to dialogue text information 2104 to convert to bitmap image 2106, and the converted bitmap image is output position information ( Based on region_horizontal_position, region_vertical_position, etc., a process of outputting to a corresponding position on the graphic plane (GP) 1750 is shown.

  The rendering information 2102 refers to style information such as area width, height, display color, background color, text alignment, font name, font style, and font size. As described above, it is defined in the region style set in the DSU. On the other hand, the configuration information 2108 refers to the presentation start time and end time, the horizontal and vertical position information of the window area where the caption is output on the graphic plane (GP) 1750, and the like. This is defined in the DPU.

  FIG. 22 illustrates a process of rendering the text-based subtitle data stream 220 in the playback apparatus according to the present invention. Referring to FIGS. 22, 21, and 8, a window region designated using region_horizontal_position, region_vertical_position, region_width, and region_height, which are window region position information 830 for subtitles defined in the DSU, is subtitled. Is designated as an area on the graphic plane (GB) 1750 on which is displayed. The rendered dialog bitmap image is displayed from the start position specified in text_horizontal_position, which is the output position 840 of the dialog in the window area, and text_vertical_position.

  On the other hand, the playback apparatus according to the present invention stores style information (style_id) selected by the user in the system register area. FIG. 23 is a diagram illustrating a playback device status register provided in a playback device for playing back a text-based subtitle stream according to the present invention.

  Referring to FIG. 23, style information (Selected Style) 2310 selected by the user is stored in a twelfth register of a playback apparatus status register (Player Status Register: hereinafter abbreviated as PSRs). Thus, for example, even after the playback device performs a menu call or other operation, when the user presses the style information change button, the style information previously selected by the user with reference to the PSR 12 can be applied first. . Of course, the position stored in the PSR can be changed.

  The text-based subtitle stream playback method will be described based on the structure of the recording medium on which the text-based subtitle stream 220 according to the present invention is recorded and the playback apparatus for playing back the same. FIG. 24 is a flowchart illustrating a method for reproducing a text-based subtitle stream according to the present invention.

  Text-based subtitle stream data including DSU information and DPU information is read from the recording medium (step 2410), and the subtitle text included in the DPU information is converted into a bitmap image based on the rendering information included in the DSU information. (Step 2420). The converted bitmap image is output to the screen according to the time information and the position information for outputting the dialogue of the configuration information included in the DPU information (step 2430).

  The present invention can also be embodied as computer readable codes on a computer readable recording medium. Computer-readable recording media include all types of recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy (registered trademark) disk, optical disk, etc., and are embodied in the form of carrier waves (for example, transmission over the Internet). Including The computer-readable recording medium can be distributed in a computer system connected to a network, and can store and execute computer-readable code in a distributed manner.

  The above description is only one embodiment of the present invention, and those skilled in the art can implement the present invention in a modified form without departing from the essential characteristics of the present invention. Therefore, the scope of the present invention is not limited to the above-described embodiments, but should be construed to include various embodiments within the scope equivalent to the contents described in the claims.

220 Subtitle Stream 1700 Playback Device 1710 Font Preloading Buffer 1712 Subtitle Preloading Buffer 1730 Subtitle Decoder 1750 Graphic Plane 1760 Hue Reference Table

Claims (6)

Video data,
Including text-based subtitle data for providing subtitles of the video data;
The text-based subtitle data includes a plurality of dialogue presentation units,
A dialogue style unit defining a set of output styles applied to the plurality of dialogue presentation units;
Each dialogue presentation unit is composed of dialogue text information, time information indicating the time when the dialogue text information is output, palette information defining the hue applied to the dialogue text information, and the graphic configuration of the dialogue presentation unit before. A recording medium comprising a hue update flag indicating whether or not only palette information has been changed.   The recording medium according to claim 1, wherein when the hue update flag is 1, palette information is applied to previous dialogue text information output by the previous dialogue presentation unit.   The recording medium according to claim 1, wherein when the hue update flag is 0, palette information is applied to dialogue text information output by a current dialogue presentation unit. In an apparatus for reproducing data from a recording medium storing moving image data and text-based subtitle data for providing subtitles of the moving image data,
A decoder for decoding the video data;
Receiving the text-based subtitle data including a plurality of dialogue presentation units and a dialogue style unit defining a set of output styles applied to the plurality of dialogue presentation units, and referring to the dialogue style unit A subtitle decoder that converts text information for dialogue included in a dialogue presentation unit into a bitmap image and outputs the transformed bitmap image in synchronization with the decoded video data;
Each dialogue presentation unit includes the dialogue text information, the time information indicating the time when the dialogue text information is output, the palette information defining the hue applied to the dialogue text information, and the graphic composition of the previous dialogue presentation unit. An apparatus comprising a hue update flag indicating whether or not only palette information has been changed.   The apparatus of claim 4, wherein the subtitle decoder applies palette information to previous dialogue text information output by the previous dialogue presentation unit when the hue update flag is 1.   5. The apparatus of claim 4, wherein the subtitle decoder applies palette information to dialogue text information output by a current dialogue presentation unit when the hue update flag is zero.

Images