KR20050088035A - Storage medium recording text-based subtitle stream, reproducing apparatus and reproducing method thereof - Google Patents

Abstract

A storage medium storing a multimedia image stream and a text-based subtitle stream, and a reproducing apparatus and a reproducing method therefor are provided to reproduce the text-based subtitle data stream recorded separately from the multimedia image stream such that the subtitle data can be easily produced and edited and a caption can be provided in a plurality of languages. The storage medium stores: image data; and text-based subtitle data to display a caption on an image based on the image data, wherein the subtitle data includes: one style information item specifying an output style of the caption; and a plurality of presentation information items that are displaying units of the caption, and the subtitle data is separated and recorded separately from the image data. Accordingly, a caption can be provided in a plurality of languages, and can be easily produced and edited, and the output style of caption data can be changed in a variety of ways. In addition, part of a caption can be emphasized or a separate style that a user can change can be applied.

Description

Storage medium recording text-based subtitle stream, reproducing apparatus and reproducing method

The present invention relates to the reproduction of a multimedia image, and more particularly, to a storage medium, a reproduction apparatus, and a reproduction method for recording a multimedia image stream and a text-based subtitle stream.

AV data recorded on a storage medium for providing a high definition (HD) -quality high-definition multimedia image currently includes a presentation graphic stream for providing a video stream, an audio stream, a subtitle, and a mutual interaction with a user. Interactive graphic streams for providing buttons or menus for operation are multiplexed. In particular, the presentation graphics stream for providing subtitles provides a bitmap based image for displaying subtitles.

Since the bitmap-based subtitle data is not only large in size but also multiplexed with other streams such as video, audio, interactive graphics, etc., there is a problem in that the production of the subtitle data and the editing of the produced subtitle data are very difficult. Furthermore, there is a problem in that the output style of the caption data cannot be variously changed.

Accordingly, an object of the present invention is to provide a storage medium, a reproducing apparatus, and a reproducing method for recording a text-based subtitle stream, in order to solve the above problems.

The above object is an apparatus for reproducing image data and a storage medium on which text-based subtitle data for displaying subtitles on an image based on the image data is recorded, the apparatus comprising: a video decoder for decoding image data; And converting the presentation information, which is a display unit of the subtitle, into a bitmap image based on the style information specifying the output style of the subtitle among the subtitle data, and synchronizing the converted presentation information with the decoded image data. And a subtitle decoder for controlling to output.

The subtitle decoder preferably decodes the subtitle data recorded separately from the image data, and overlays the detitle image data to output the detitle data.

In addition, the style information and the presentation information are configured in a packetized elementary stream (PES) unit, and the subtitle decoder preferably interprets and processes the style information and the presentation information in the PES unit.

The style information is composed of one PES and is recorded at the beginning of the subtitle data, and a plurality of presentation information are recorded in PES units after the style information, and the subtitle decoder has one style for the plurality of presentation information. It is desirable to apply the information.

In addition, the presentation information includes text information indicating the content of the caption and configuration information for controlling the output of the text information converted into the bitmap image. The subtitle decoder refers to the configuration information, and the converted text information is It is desirable to control the output time.

The presentation information designates at least one or more window regions to which a subtitle is to be output, and the subtitle decoder may output the converted text information simultaneously to the at least one or more window regions.

Among the configuration information, the output start time and output end time of the presentation information are defined as time information on a global time axis used in a playlist that is a playback unit of video data, and the subtitle decoder determines the output start time and the output end time. For reference, it is preferable to synchronize the output of the decoded image data with the converted text information.

When the output end time of the presentation information currently being reproduced is the same as the output start time information of the next presentation information, the subtitle decoder preferably reproduces the two presentation information continuously.

The subtitle decoder resets the buffer in the subtitle decoder between the output end time and the output end time if the next presentation information does not require continuous playback. If the subtitle decoder requires continuous playback, the subtitle decoder is preferably maintained without resetting the buffer. .

Also, the style information is a set of output styles to be applied to the presentation information, predefined by the producer of the storage medium, and the subtitle decoder converts the plurality of presentation information recorded thereafter into a bitmap image based on the style information. It is preferable.

In addition, the text information in the presentation information includes text to be converted into a bitmap image and inline style information applied only to a portion of the text. The subtitle decoder includes inline style information only in a portion of the text to which the pre-defined style information is applied. It is desirable to provide a function to highlight a portion of text by applying.

The subtitle decoder preferably applies a relative value, or a predetermined absolute value, to a portion of the text, relative to predetermined font information included in the style information predefined by the manufacturer as inline style information.

The style information further includes style information that can be changed by the user, and the subtitle decoder receives selection information about one style from among the style information that can be changed by the user, and the style information predefined by the producer. After applying, it is particularly preferable to apply inline style information, and finally apply style information that can be changed by the user corresponding to the selection information to the text.

The subtitle decoder is a style information that can be changed by the user. The subtitle decoder preferably applies a relative value of predetermined font information among the pre-defined style information to the text.

The subtitle decoder preferably applies the predetermined style information to the text when the storage medium allows predetermined style information defined by the playback apparatus in addition to the style information predefined by the producer.

In addition, the style information includes a set of color palettes to be applied to the presentation information, and the subtitle decoder preferably converts all presentation information after the style information into a bitmap image based on the colors defined in the color palette. .

Apart from the set of color palettes included in the style information, the presentation information further includes a set of color palettes and a color update flag, and the subtitle decoder, when the color update flag is set to 1, sets of color palettes included in the presentation information. If the color update flag is set to 0, it is preferable to apply the set of color palettes included in the style information as it is.

The subtitle decoder sets the color update flag to 1 and gradually changes the transparency value of the color palette included in a plurality of consecutive presentation information to implement a fade in / out effect. After the / out effect is finished, it is preferable to reset the color reference table (CLUT) in the subtitle decoder based on the set of color palettes originally included in the style information.

The style information may include region information indicating a position of a window region in which the converted presentation information is to be output on an image, and font information necessary for converting the presentation information into a bitmap image. The subtitle decoder may include region information and It is preferable to convert the converted presentation information into a bitmap image using font information.

The font information includes at least one of an output start position, output direction, alignment, line spacing, font identifier, font style, font size, and color of the converted presentation information, and the subtitle decoder is based on the font information. It is desirable to convert the presentation information into bitmap images.

As the identifier of the font, the subtitle decoder preferably refers to the instruction information for the font file included in the clip information file in which the attribute information for the recording unit of the video data is recorded.

In addition, the subtitle decoder preferably buffers the subtitle data and the font file referred to by the subtitle data before reproduction of the video data.

In addition, when a plurality of subtitle data supporting a plurality of languages are recorded on the storage medium, the subtitle decoder receives selection information regarding a desired language from a user and reproduces corresponding subtitle data among the plurality of subtitle data. It is preferable.

On the other hand, according to another field of the present invention, the above object is, in the method for reproducing a subtitle data in a method of reproducing a text-based subtitle data for displaying a subtitle on the image based on the image data and the image data, the caption output Reading subtitle data including style information specifying a style and presentation information which is a display unit of a subtitle; Converting the presentation information into a bitmap image based on the style information; And controlling to output the converted presentation information in synchronization with the image data.

On the other hand, according to another field of the present invention, the above object is, image data; And text-based subtitle data for displaying a subtitle on an image based on the image data. The subtitle data includes one style information specifying an output style of the subtitle and a plurality of presentation information which is a display unit of the subtitle. It is achieved by a storage medium, characterized in that it is recorded separately from the image data.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

1 is a diagram illustrating a multimedia data structure recorded in a storage medium according to an exemplary embodiment of the present invention.

Referring to FIG. 1, it can be seen that a storage medium according to the present invention has four layer structures for managing a multimedia video stream. Each layer is composed of clips 100 and 110, which are recording units of a multimedia image, a playlist 120, which is a playback unit of a multimedia image, a movie object 130 including navigation instructions for playing a multimedia image, and a movie to be reproduced first. An index table 140 specifying the objects and respective titles is included.

The clips 100 and 110 implement the AV data stream for the high definition movie and the attributes of the AV data stream as one object. The AV data stream is called a clip AV stream 100 and the attribute information of the AV data stream is called a clip information 110. The playlist 120 is a set of playback sections of the above-described clips, and each playback section is called a playitem 122. The movie object 130 is composed of navigation command programs, which initiate playback of playlists, switch between movie objects, or manage playback of playlists according to user preferences. The index table 140 is a top-level table for defining a plurality of titles and menus. The index table 140 includes information on starting positions of all titles and menus, and performs user input such as title search or menu call. You can play the selected title or menu. It also includes information on the start position of the title or menu to be automatically reproduced first when the storage medium is inserted into the playback apparatus.

Among them, the structure of the clip AV stream 100 in which the multimedia image is compressed and encoded is as follows. FIG. 2 is a diagram illustrating a structure of a clip video stream 100 shown in FIG. 1 and a text-based subtitle stream according to the present invention.

Referring to FIG. 2, a text-based subtitle 220 according to the present invention is provided to solve the problem of the bitmap-based subtitle data as described above. Storage media according to the present invention include an AV data stream 210 in which a video stream 202, an audio stream 204, a presentation graphics stream 206, and an interactive graphics stream 208 are multiplexed. Also included is text-based subtitle 220 data separate from the AV data stream.

The text-based subtitle 220 data according to the present invention may be implemented using a markup language such as XML (eXtended Markup Language), but in the present invention, a subtitle of a multimedia image is provided using binary data. Mainly look at the case. Hereinafter, text-based subtitle data providing subtitles of a multimedia image using binary data will be referred to as "text-based subtitle stream."

The text-based subtitle stream is converted into a bitmap graphic image and overlaid on the multimedia image. This process of converting text-based data into graphic-based bitmap images is called rendering. The text-based subtitle stream contains information necessary for rendering the subtitle text.

Hereinafter, the structure of the text-based subtitle stream 220 including the rendering information will be described in detail. 3 is a diagram illustrating a data structure of a text-based subtitle stream 220 according to the present invention.

Referring to FIG. 3, the text-based subtitle stream 220 according to the present invention includes a dialogue style unit (hereinafter, abbreviated as DSU) 310 and a plurality of dialogue presentation units. Abbreviated as DPU) (320 to 340). The dialogue style unit (DSU) or dialogue presentation unit (DPU) is also called a dialogue unit. Metabolic units constituting the text-based subtitle stream 220 according to the present invention are recorded in the form of a packetized elementary stream (hereinafter, abbreviated as PES). In addition, PESs of a text-based subtitle stream are recorded and transmitted in units of a transport packet (hereinafter, abbreviated as TP). Such a series of transport packets is called a transport stream (hereinafter referred to as TS).

However, the text-based subtitle stream 220 according to the present invention is not multiplexed with the AV data stream 210 as shown in FIG. 2 and is recorded as a separate transport stream TS.

Referring to FIG. 3 again, one PES packet included in the text-based subtitle stream 220 records one metabolic unit. The text-based subtitle stream 220 includes one dialogue style unit (DSU) located first and a plurality of dialogue presentation units (DPUs) located thereafter. The dialogue style unit (DSU) includes information for specifying an output style of dialogue in a caption displayed on a screen on which a multimedia image is played. On the other hand, the plurality of dialogue presentation units (DPU) includes text information on the dialogue content to be output and information on each output time.

4 is a diagram illustrating an embodiment of implementing a text-based subtitle stream 220 having the data structure shown in FIG. 3.

Referring to FIG. 4, the text-based subtitle stream 220 according to the present invention includes one metabolic style unit (DSU) 410 and a plurality of metabolic presentation units (DPU) 420. In this embodiment, the number of metabolic presentation units (DPUs) is defined as num_of_dialog_presentation_units. However, the number of metabolic presentation units (DPUs) may not be specified separately. For example, if you use a syntax such as while (processed_length <end_of_file).

Hereinafter, a more detailed data structure of the dialogue style unit (DSU) and the dialogue presentation unit (DPU) will be described. FIG. 5 is a diagram illustrating an embodiment of implementing the metabolic style unit (DSU) 310 illustrated in FIG. 3.

Referring to FIG. 5, dialog_styleset () 510, which is a set of dialogue style information that collects output style information of dialogue lines that are output as subtitles, is defined. The dialogue style unit (DSU) includes information on the location of a region where dialogue is displayed in the caption, information necessary for rendering the dialogue, information on a style that can be controlled by the user, and the like. The content of specific data is mentioned later.

FIG. 6 is a diagram for explaining an example of a data structure of a metabolic style unit (DSU) as an embodiment of the present invention.

Referring to FIG. 6, the dialogue style unit (DSU) 310 includes a palette collection 610 and an area style collection 620. The palette collection 610 is a collection of a plurality of color palettes defining colors to be used for the subtitles. Color information such as color combination or transparency included in the palette collection may be applied to all the plurality of metabolic presentation units (DPUs) located after the metabolic style unit (DSU).

The area style set 620 is a set of output style information of each dialogue constituting the subtitle. Each region style includes region information 622 indicating where the dialogue is to be displayed and text style information 624 indicating the output style to be applied to the text of each dialogue. In addition, the user may further include a user changeable style set 626 indicating a style that can be changed by the user.

7 is a diagram for explaining an example of a data structure of a metabolic style unit (DSU) according to another embodiment of the present invention.

Referring to FIG. 7, unlike the case of FIG. 6, the pallet collection 610 is not included. That is, the case where the palette collection 610 is defined in the dialogue presentation unit DPU to be described later without defining the palette palette in the dialogue style unit DSU (see FIGS. 12A and 12B). The data structure of each region style 710 is the same as described above in FIG.

FIG. 8 is a diagram illustrating an embodiment of implementing the metabolic style unit (DSU) illustrated in FIG. 6 or 7.

8 and 6, the metabolic style unit (DSU) according to the present invention includes a palette collection 860, 610 and a plurality of region styles 820, 620. As described above, the palette collection 610 is a collection of a plurality of color palettes defining colors to be used for subtitles. Color information such as color combination or transparency included in the palette collection may be applied to all the plurality of metabolic presentation units (DPUs) located after the metabolic style unit (DSU).

Meanwhile, each region style 820 and 620 includes region information 830 and 622 representing information about a window region in which subtitles are to be output, and the region information includes X coordinates and Y coordinates of the window region in which the subtitles are to be displayed. , Width, height, and background color.

In addition, each region style 820, 620 includes text style information 840, 624 indicating an output style to be applied to the text of each dialogue. That is, the X and Y coordinates of the position where the text of the dialogue is to be output in the aforementioned window area, the output direction of the text such as left to right, top to bottom, alignment, line spacing, identifier of the font to be referred to, bold or italic Information about the font style, font size, font color, etc. may be included.

Furthermore, each region style 820, 620 may include a user modifiable style set 850, 626 that represents a style that the user can arbitrarily change. Inclusion of user modifiable style sets 850 and 626 is optional. User-definable style sets 850 and 626 change the position of the window area and the output position of the text, font size and line spacing among the text output style information 840 and 624 to be applied to the text of each dialogue by default. Information may be included. Each change information may be basically expressed as a relative increase / decrease value for information 840 and 624 about an output style to be applied to the text of each dialogue.

In summary, the style related information includes the style information (region_style) 620 defined in the region styles 820 and 620, the inline style information 1510 for emphasizing a part of a subtitle to be described later, and the user's change. There are three kinds of style information (use_changable_style) 850, and the order of applying them is as follows.

1) Mostly, region style information 620 defined in region style is applied.

2) If there is inline style information, the inline style information 1510 that emphasizes the portion overlapped with the region style information is applied is applied.

3) If there is style information 850 that can be changed by the user, this information is finally applied. The presence of user modifiable style information is optional.

Meanwhile, among the text style information 840 and 624 to be applied to the text of each dialogue, a font information file to be referred to by the font identifier (font_id) 842 may be defined as follows.

FIG. 9A illustrates a clip information file including a plurality of font collections referred to by the font information 842 of FIG. 8 as an embodiment of the present invention.

9A, 8, and 1, the stream coding information structure StreamCodingInfo () 930 included in the clip information 910 and 110 files includes information on various streams recorded in a storage medium according to the present invention. Is included. That is, information about a video stream, an audio stream, a presentation graphics stream, an interactive graphics stream, a text-based subtitle stream, and the like are included. In particular, the text-based subtitle stream may include information (textST_language_code) 932 about a language for displaying a subtitle. In addition, a name 936 of a font corresponding to font_id 842 and 934 representing an identifier of a font to be referred to in FIG. 8, a name 938 of a file in which font information is stored, and the like may be defined. A method of finding a font file corresponding to an identifier of a font to be referred to herein will be described later with reference to FIG. 10.

FIG. 9B is a diagram illustrating another clip information file including a plurality of font collections referred to by the font information 842 of FIG. 8.

Referring to FIG. 9B, a structure called ClipInfo () may be defined in a clip information 910 and 110 file. In this structure, a plurality of font collections referred to by the font information 842 of FIG. 8 can be defined. That is, the name 952 of the font file corresponding to font_id 842 indicating the identifier of the font to be referred to shown in FIG. 8 is designated. A method of finding a font file corresponding to an identifier of a font to be referred to herein is as follows.

FIG. 10 is a diagram illustrating positions of a plurality of font files referred to by names 938 or 952 of font files in FIGS. 9A and 9B.

Referring to FIG. 10, a directory structure of files related to a multimedia image recorded on a storage medium according to the present invention is shown. In particular, using the illustrated directory structure, it is easy to find the location of a font file such as 11111.font or 99999.font 1010 or 1020 stored in the AUXDATA directory.

Meanwhile, the structure of the metabolic presentation unit (DPU) constituting the metabolic unit will be described in detail below.

FIG. 11 is a diagram for describing an embodiment of a data structure of the metabolic presentation unit (DPU) 320 illustrated in FIG. 3.

Referring to FIGS. 11 and 3, a dialogue presentation unit (DPU) 320 including text information on output of dialogue content and information on output time may include time information 1110 indicating a time at which dialogue is output. , Palette reference information 1120 for specifying a color palette to be referred to, and metabolic region information 1130 to be outputted. In particular, the dialogue area information 1130 to be output includes style reference information 1132 for specifying an output style to be applied to the dialogue and dialogue text information 1134 indicating text of the dialogue to be actually output. In this case, it is assumed that the color palette collection indicated by the palette reference information 1120 is defined in the metabolic style unit DSU (see 610 of FIG. 6).

12A is a diagram for explaining another embodiment of the data structure of the metabolic presentation unit (DPU) 320 shown in FIG. 3.

12A and 3, the dialogue presentation unit (DPU) 320 includes time information 1210 indicating a time at which a dialogue is to be output, a palette collection 1220 defining a palette of color palettes, and a dialogue to be output. Area information 1230 is included. In this case, the palette collection 1220 is not defined in the metabolic style unit DSU as shown in FIG. 11, but is defined directly in the metabolic presentation unit DPU.

12B is a diagram for explaining another embodiment of the data structure of the metabolic presentation unit (DPU) 320 shown in FIG. 3.

Referring to FIG. 12B, the dialogue presentation unit (DPU) 320 may include a color palette to be used when time information 1250, a color update flag 1260, and a color update flag are set to 1 to indicate when a dialogue is output. The vowel 1270 and the metabolic region information 1280 to be output are included. In this case, the palette collection 1270 is defined in the dialogue style unit DSU as shown in FIG. 11 and is also stored in the dialogue line presentation unit DPU. In particular, in order to produce an effect such as fade-in / out using continuous playback, a collection of color palettes to be used to express fade in / out, in addition to the default palette set defined in the dialogue style unit (DSU), is thus presented. It is defined in the unit (DPU), and the color update flag 1260 can be set to one. A detailed description thereof will be given below with reference to FIG. 19.

FIG. 13 is a diagram illustrating an embodiment of implementing the metabolic presentation unit (DPU) 320 illustrated in FIGS. 11 to 12B.

13, 11, 12A, and 12B, the metabolic presentation unit (DPU) includes metabolic start time information (dialog_start_PTS) and metabolic end time information as time information 1110 indicating a time at which metabolism is output. (dialog_end_PTS) 1310 is included. Also included as the palette reference information 1120 is a metabolic palette identifier 1320 (dialog_palette_id). In the case of FIG. 12A, the color palette collection 1220 may be included instead of the pallet reference information. The dialogue region information 1230 to be output includes dialogue text information (region_subtitle) 1334, and may include a region style identifier (region_style_id) 1332 to specify an output style to be applied thereto. The example illustrated in FIG. 13 is only one embodiment of the metabolic presentation unit (DPU). In addition, the metabolic presentation unit (DPU) having the data structure of FIGS. 11 to 12B may be variously modified.

FIG. 14 is a diagram for explaining the data structure of the dialogue text information (region_subtitle) 1334 shown in FIG. Referring to FIG. 14, the dialogue text information includes inline style information 1410 and dialogue text 1420 as an output style for emphasizing a portion of the dialogue.

FIG. 15 is a diagram illustrating an embodiment of implementing the metabolic text information 1334 of FIG. 13. 15 shows an example in which inline style information (inline_style) 1510 and dialogue text (text_string) 1520 are implemented. In addition, it is preferable that the illustrated embodiment further includes information indicating the end of the inline style. If you don't define the end of an inline style, the once specified inline style can still be applied later, contrary to the author's intention.

Meanwhile, FIG. 16 is a diagram for explaining limitations for continuously playing back a continuous dialogue presentation unit (DPU).

16 and 13, the following limitation condition is required when the plurality of metabolic presentation units (DPUs) described above are to be reproduced continuously.

1) The dialogue start time information (dialog_start_PTS) 1310 defined in the dialogue presentation unit (DPU) indicates a time at which a dialogue object starts to be output on a graphic plane which will be described later.

2) The dialogue end time information (dialog_end_PTS) 1310 defined in the dialogue presentation unit (DPU) indicates a time for resetting a decoder for processing a text-based subtitle described later.

3) When a plurality of aforementioned dialogue presentation units (DPUs) are to be reproduced continuously, dialogue end time information (dialog_end_PTS) of the current DPU and dialogue start time information (dialog_start_PTS) of the DPU to be continuously reproduced next; Should be the same. That is, in order to reproduce DPU # 2 and DPU # 3 continuously, the dialogue end time information included in DPU # 2 must be the same as the dialogue start time information included in DPU # 3.

On the other hand, the metabolic style unit (DSU) according to the present invention preferably satisfies the following constraints.

1) The text-based subtitle stream 220 includes one dialogue style unit (DSU).

2) The number of style information (user_control_style) that can be changed by a user included in all region styles (region_style) should be the same.

Meanwhile, the metabolic presentation unit (DPU) according to the present invention preferably satisfies the following constraints.

1) A window area for at most two subtitles should be defined.

Hereinafter, the structure of the reproduction apparatus according to the present invention will be described based on the data structure of the text-based subtitle stream recorded on the storage medium according to the present invention.

17 is a view for explaining the structure of a playback apparatus for playing a text-based subtitle stream according to the present invention.

Referring to FIG. 17, the playback apparatus according to the present invention includes buffer units 1710 and 1712, and a subtitle decoder 1730. It may also have a graphics plane 1750 and a color reference table 1760.

The buffer unit includes a subtitle preloading buffer (SPB) 1710 to which the text-based subtitle stream 220 is to be preloaded, and a font preloading buffer (FPB) 1712 to which font information is to be preloaded.

The subtitle decoder decodes a text-based subtitle stream according to the present invention, and includes a text subtitle processor 1732, a dialogue composition buffer (DCB) 1734, a dialogue buffer (DB) 1736, a text subtitle renderer. (1738), a metabolic presentation controller 1740, and a bitmap object buffer (BOB) 1742.

The text subtitle processor 1732 receives the text-based subtitle stream from the text subtitle preloading buffer (FPB), and includes the style related information and the dialogue presentation unit (DPU) included in the aforementioned dialogue style unit (DSU). The output time information of the metabolism included in the) is transmitted to the metabolic composition buffer (DCB), and the metabolic text information included in the metabolic presentation unit (DPU) is transferred to the metabolic buffer (DB).

The presentation controller 1740 controls the text renderer 1738 using style related information included in the dialogue composition buffer DCB, and the bitmap rendered in the bitmap object buffer BOB using the dialogue output time information. Controls the time at which the image is output to the graphics plane 1750.

The text subtitle renderer 1738 applies the corresponding font information among the font information preloaded to the font preloading buffer FPB to the dialogue text information stored in the dialogue buffer DB under the control of the presentation controller 1740. To convert, i.e. render, the dialogue text information into a bitmap image. The rendered bitmap image is stored in the bitmap object buffer (BOB) and is output to the graphics plane (GP) 1750 under the control of the presentation controller 1740. In this case, the color specified in the dialogue style unit DSU is applied with reference to the color reference table CLUT 1760.

The style-related information to be applied to the dialogue text may use information defined by the creator in the dialogue style unit (DSU), but may also apply style information previously defined by the user. The playback apparatus prefers user-defined style information over style-related information defined by the producer.

As described above with reference to FIG. 8, the style related information to be applied to the dialogue text basically includes region style information (region_style) defined by the producer in the dialogue style unit (DSU), and includes dialogue text to which corresponding region style information is applied. If the dialogue presentation unit (DPU) contains an inline style, the inline style information (inline_style) is applied to that part. In addition, authors define styles that the user can change in addition to the dialogue style unit (DSU), and when one of the user-defined styles defined by the user is selected, the dialogue text is replaced by the area style and / or inline style. After it is applied, the style that the user can change is finally applied. In addition, as described above with reference to FIG. 15, the contents of the inline style may preferably include information indicating that the application of the inline style is finished.

Furthermore, the producer may specify whether to allow or prohibit the use of the style related information defined by the playback apparatus itself separately from the style related information defined by the producer recorded on the storage medium.

18 is a diagram illustrating a preloading process of a text-based subtitle stream in a playback device according to the present invention.

Referring to FIG. 18, a text based subtitle stream is defined in a sub path of the above-described playlist. In the sub path, a plurality of text-based subtitle streams 220 supporting a plurality of languages may be defined. Also, the font file to be applied to the text-based subtitle stream may be defined in the clip information file as described above with reference to FIGS. 9A and 9B. The text-based subtitle stream 220 that can be included in one storage medium can define up to 255 per playlist. In addition, up to 255 font files may be included in one storage medium. However, in order to ensure seamless presentation, the size of the text-based subtitle stream 220 should be smaller than or equal to the size of the preloading buffer 1710 of the playback device.

19 is a diagram for describing a process of reproducing a metabolic presentation unit (DPU) in a reproducing apparatus according to the present invention.

19, 13, and 17, a process of reproducing a metabolic presentation unit (DPU) is illustrated. The presentation controller 1740 uses the dialogue start time information (dialog_start_PTS) and the dialogue end time information (dialog_end_PTS) to designate the output time 1310 of the dialogue included in the dialogue presentation unit (DPU). Controls the time output to the plane. In this case, the dialogue start time information designates a time at which the rendered dialogue bitmap image stored in the bitmap object buffer 1730 is completed to be transferred to the graphic plane 1750. That is, when the dialogue start time defined in the dialogue presentation unit (DPU) is reached, the bitmap information necessary for constructing the dialogue must be delivered to the graphic plane GP and be in a usable state. In addition, the dialogue end time information designates a time at which reproduction of the dialogue presentation unit (DPU) ends. At this time, both the subtitle decoder 1730 and the graphic plane 1750 are reset. The buffer in the subtitle decoder, such as the bitmap object buffer (BOB), is preferably reset between the start time and the end time of the dialogue presentation unit (DPU), whether or not it is continuously played.

However, if continuous reproduction of a plurality of dialogue presentation units (DPUs) is required, the subtitle decoder 1730 and the graphics plane 1750 will not be reset, and the stored contents of each buffer should be maintained. That is, when the dialogue end time information of the dialogue presentation unit (DPU) currently being reproduced and the dialogue start time information of the dialogue presentation unit (DPU) to be reproduced subsequently are the same, the contents of each buffer are not reset. maintain.

In particular, a fade in / out effect can be cited as an example in which continuous reproduction of a plurality of dialogue presentation units (DPUs) is applied. The fade in / out effect may be implemented by changing the color reference value CLUT of the bitmap object transferred to the graphic plane GP. That is, the first dialogue presentation unit (DPU) includes configuration information such as color, style, output time, etc., and a plurality of subsequent dialogue presentation units (DPUs) are the first dialogue presentation unit (DPU). It has the same configuration information as, except that only the color palette information is updated. In this case, the fade in / out effect can be obtained by gradually changing the transparency of the color information between 0% and 100%.

In particular, when using a data structure of a metabolic presentation unit (DPU) as shown in FIG. 12B, the fade in / out effect may be effectively implemented using the color update flag 1260. That is, when the dialogue presentation controller 1740 checks the color update flag 1260 included in the dialogue presentation unit (DPU), and is set to 0, that is, in a general case where no fade in / out effect is required, basically, Color information included in the metabolic style unit (DSU) shown in FIG. 6 is used. On the other hand, when the color update flag 1260 is set as 1 as a result, that is, when a fade in / out effect is required, the color information 610 included in the dialogue style unit (DSU) illustrated in FIG. 6 is used. Instead, the fade in / out effect may be implemented using the color information 1270 included in the metabolic presentation unit (DPU). In this case, the fade in / out effect can be obtained simply by adjusting the transparency of the color information 1270 included in the dialogue presentation unit (DPU).

After showing the fade in / out effect as described above, the color reference table CLUT is preferably updated with color information included in the metabolic presentation unit DSU. If not updated like this, once designated color information may continue to be applied later, unlike the intention of the producer.

20 is a diagram illustrating a process of outputting a text-based subtitle stream in synchronization with video data in a playback device according to the present invention.

Referring to FIG. 20, the dialogue start time information and dialogue end time information included in the dialogue presentation unit (DPU) of the text-based subtitle stream 220 may be synchronized with the output time of the AV data stream of the multimedia image. It must be defined as the time on the global time axis used in the playlist. Accordingly, it is possible to prevent a discontinuity between the system time clock (STC) of the AV data stream and the dialogue output time (PTS) of the text-based subtitle stream 220.

21 is a diagram illustrating a process of outputting a text-based subtitle stream on a screen in the playback apparatus according to the present invention.

Referring to FIG. 21, the rendering information 2102 including style related information is applied to the dialogue text information 2104 to convert to a bitmap image 2106, and the converted bitmap image is included in the configuration information 2108. The process of outputting to the corresponding position of the graphic plane based on the output position information (region_horizontal_position, region vertical_position, etc.) is illustrated.

The rendering information 2102 refers to style information such as the width, height, foreground color, background color, text alignment, font name, font style, and font size of the area. As we saw earlier, within the Metabolic Style Unit (DSU) it is defined in a region style set. On the other hand, the configuration information 2108 refers to the start time and end time of the presentation, and horizontal and vertical position information of the window area to which the subtitle is output. It is defined within the Metabolic Presentation Unit (DPU).

22 is a diagram illustrating a process of rendering a text-based subtitle stream in a playback device according to the present invention.

Referring to FIGS. 22, 21, and 8, a window region designated by using region_horizontal_position, region_vertical_position, region_width, and region_height, which are position information 830 of the window region for the caption defined in the dialogue style unit (DSU), is defined by the caption. Is designated as the area to be displayed. The bitmap image of the rendered dialogue is displayed from the starting point positions specified in text_horizontal_position and text_vertical_position, which are output positions 840 of the dialogue in the window area.

On the other hand, the playback apparatus according to the present invention stores the style information (style_id) selected by the user in the system register area. FIG. 23 is a diagram illustrating a playback device status register provided in a playback device for reproducing a text-based subtitle stream according to the present invention.

Referring to FIG. 23, a style information selected by a user is stored in a twelfth register of a player status register (hereinafter referred to as PSRs). Accordingly, for example, when the user presses the style information change button even after the playback apparatus performs a menu call or other operation, the user may first apply the style information previously selected by referring to the PSR 12. Of course, the location stored in the PSR can be changed.

A method of reproducing a text-based subtitle stream based on the structure of a storage medium recording the text-based subtitle stream 220 and a reproduction device for reproducing the same will now be described. 24 is a flowchart illustrating a method of playing a text-based subtitle stream according to the present invention.

Reads text-based subtitle stream data including the metabolic style unit (DSU) information and the metabolic presentation unit (DPU) information from the storage medium (step 2410), and renders the rendering information included in the metabolic style unit (DSU) information. In operation 2420, the caption text included in the dialogue presentation unit (DPU) information is converted into a bitmap image. The converted bitmap image is output on the screen according to time information and position information to output dialogue, which is configuration information included in dialogue presentation unit (DPU) information, in operation 2430.

The invention can also be embodied as computer readable code on a computer readable recording medium. Computer-readable recording media include all kinds of recording devices that store data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, and the like, and may also include those implemented in the form of carrier waves (eg, transmission over the Internet). do. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

The above description is only one embodiment of the present invention, and those skilled in the art may implement the present invention in a modified form without departing from the essential characteristics of the present invention. Therefore, the scope of the present invention should not be limited to the above-described examples, but should be construed to include various embodiments within the scope equivalent to those described in the claims.

As described above, by providing a storage medium, a reproducing apparatus, and a reproducing method for recording a text-based subtitle stream separated from the image data, it is easy to produce the subtitle data and to edit the subtitle data once produced. In addition, the subtitle may be provided in a plurality of languages without limit on the number of subtitle data.

In addition, since the subtitle data is composed of one style information (DSU) and a plurality of presentation information (DPU), the output style to be applied to the entire presentation data can be predefined and variously changed. You can also define inline styles to highlight and styles that you can change.

Furthermore, it is possible to continuously reproduce the subtitles using a plurality of neighboring presentation information. By applying this, effects such as fade in / out can be easily implemented.

1 is a view for explaining a multimedia data structure recorded on a storage medium according to an embodiment of the present invention;

2 is a diagram illustrating a structure of a clip AV stream 100 shown in FIG. 1 and a text-based subtitle stream according to the present invention;

3 is a view for explaining a data structure of a text-based subtitle stream 220 according to the present invention;

4 is a diagram illustrating an embodiment of implementing a text-based subtitle stream 220 having the data structure shown in FIG.

FIG. 5 is a diagram illustrating an embodiment of implementing the metabolic style unit 310 illustrated in FIG. 3.

6 is a view for explaining an example of the data structure of the metabolic style unit 310 as an embodiment of the present invention;

7 is a view for explaining an example of a data structure of a metabolic style unit 310 as another embodiment of the present invention;

FIG. 8 is a diagram illustrating an embodiment of implementing the metabolic style unit 310 illustrated in FIG. 6 or 7;

9A and 9B illustrate an embodiment of a clip information file including a plurality of font collections referred to by the font information 842 of FIG. 8;

FIG. 10 is a diagram illustrating positions of a plurality of font files referred to by font file information 938 or 952 in FIGS. 9A and 9B;

FIG. 11 is a view for explaining an embodiment of a data structure of the metabolic presentation unit 320 shown in FIG. 3;

12A and 12B are views for explaining another embodiment of the data structure of the metabolic presentation unit 320 shown in FIG. 3;

FIG. 13 illustrates an embodiment of implementing the metabolic presentation unit 320 illustrated in FIGS. 11 to 12B.

FIG. 14 is a view for explaining the data structure of the dialogue text information 1334 shown in FIG. 13;

FIG. 15 is a diagram illustrating an embodiment of implementing the dialogue text information 1334 of FIG. 13.

FIG. 16 is a diagram for explaining limitations for continuously playing back a continuous dialogue presentation unit (DPU); FIG.

17 is a view for explaining the structure of a playback apparatus for playing a text-based subtitle stream according to the present invention;

18 is a view for explaining a preloading process of a text-based subtitle stream in a playback device according to the present invention;

19 is a view for explaining a process of reproducing a metabolic presentation unit (DPU) in a reproducing apparatus according to the present invention;

20 is a view for explaining a process of outputting a text-based subtitle stream in synchronization with video data in a playback device according to the present invention;

21 is a view for explaining a process of outputting a text-based subtitle stream on a screen in a playback device according to the present invention;

22 is a diagram illustrating a process of rendering a text-based subtitle stream in a playback device according to the present invention;

23 is a view showing a playback device status register provided in the playback device for reproducing a text-based subtitle stream according to the present invention;

24 is a flowchart illustrating a method of playing a text-based subtitle stream according to the present invention.

Claims (65)

An apparatus for reproducing a storage medium on which image data and text-based subtitle data for displaying subtitles on an image based on the image data are recorded. A video decoder for decoding the image data; And The presentation information, which is a display unit of the subtitle, is converted into a bitmap image based on the style information specifying the output style of the subtitle among the subtitle data, and the converted presentation information is synchronized with the decoded image data. And a subtitle decoder for controlling the output to be synchronized. The method of claim 1, The subtitle decoder is configured to decode the subtitle data recorded separately from the image data, and to output the subtitle decoder by overlaying the decoded image data. The method of claim 2, The style information and the presentation information are configured in a packetized elementary stream (PES) unit. And the subtitle decoder interprets and processes the style information and the presentation information in units of the PES. The method of claim 3, The style information is composed of one PES and is recorded in the first portion of the subtitle data, and the plurality of presentation information is recorded in the PES unit after the style information. And the subtitle decoder applies the one style information to the plurality of presentation information. The method of claim 1, The presentation information includes text information indicating the content of the caption and configuration information for controlling the output of the text information converted into a bitmap image. And the subtitle decoder controls the time at which the converted text information is output with reference to the configuration information. The method of claim 5, The presentation information designates at least one window area to which a subtitle is to be output. And the subtitle decoder simultaneously outputs the converted text information to at least one window area. The method of claim 5, Among the configuration information, an output start time and an output end time of the presentation information are defined as time information on a global time axis used in a playlist that is a reproduction unit of the video data. And the subtitle decoder synchronizes the output of the decoded image data with the converted text information with reference to the output start time and the output end time. The method of claim 7, wherein And if the output end time of the presentation information currently being reproduced is the same as the output start time information of the next presentation information, the subtitle decoder continuously reproduces the two presentation information. The method of claim 8, The subtitle decoder resets the buffer in the subtitle decoder between the output start time and the output end time if the next presentation information does not require continuous playback, and does not reset the buffer if continuous playback is requested. Device for maintaining. The method of claim 5, The style information is a set of output styles to be applied to the presentation information, predefined by the producer of the storage medium, And the subtitle decoder converts the plurality of subsequently recorded presentation information into a bitmap image based on the style information. The method of claim 10, The text information of the presentation information includes text to be converted into a bitmap image, and inline style information applied only to a portion of the text. And the subtitle decoder provides a function of applying the inline style information to only a portion of the text to which the style information predefined by the producer is applied to emphasize the portion of the text. The method of claim 11, And the subtitle decoder applies, as the inline style information, a relative value to a predetermined font information or a predetermined absolute value included in style information predefined by the creator to a part of the text. The method of claim 11, The style information further includes style information that can be changed by the user. The subtitle decoder receives selection information about one style among style information that the user can change from a user, applies style information predefined by the producer, and then applies the inline style information, and finally the And apply style information, which can be changed by the user corresponding to selection information, to the text. The method of claim 13, The subtitle decoder is a style information that can be changed by the user, characterized in that for applying the relative value of the predetermined font information of the pre-defined style information to the text to the text. The method of claim 10, And the subtitle decoder is configured to apply the predetermined style information to the text when the storage medium allows predetermined style information defined by a playback device in addition to the style information predefined by the producer. The method of claim 10, The style information includes a set of color palettes to be applied to the presentation information. And the subtitle decoder converts all the presentation information after the style information into a bitmap image based on the color defined in the color palette. The method of claim 16, Apart from the set of color palettes included in the style information, the presentation information further includes a set of color palettes and a color update flag. The subtitle decoder applies the set of color palettes included in the presentation information when the color update flag is set to 1, and resets the color palette included in the style information when the color update flag is set to 0. Apparatus characterized by applying a set. The method of claim 17, The subtitle decoder sets the color update flag to 1 and gradually changes the transparency values of color palettes included in the plurality of consecutive presentation information to implement a fade in / out effect, and the fade in / out effect. And when it is finished, resetting the color reference table (CLUT) in the subtitle decoder based on the set of color palettes included in the style information. The method of claim 10, The style information includes region information indicating a position of a window region in which the converted presentation information is to be output on the image, and font information necessary for converting the presentation information into a bitmap image. And the subtitle decoder converts the converted presentation information into a bitmap image using the area information and the font information. The method of claim 19, The font information includes at least one of an output start position, an output direction, alignment, line spacing, an identifier of a font, a style of a font, a size of a font, and a color of the converted presentation information. And the subtitle decoder converts the presentation information into a bitmap image based on the font information. The method of claim 20, And the subtitle decoder refers to the indication information on the font file included in the clip information file recording the attribute information on the recording unit of the image data as the identifier of the font. The method of claim 1, And the subtitle decoder buffers the subtitle data and the font file referred to by the subtitle data before reproduction of the image data. The method of claim 1, When a plurality of subtitle data supporting a plurality of languages are recorded on the storage medium, the subtitle decoder receives selection information regarding a desired language from a user and selects corresponding subtitle data among the plurality of subtitle data. Device for playback. A method of reproducing a storage medium on which image data and text-based subtitle data for displaying subtitles on an image based on the image data are recorded. Reading the subtitle data including style information specifying an output style of the subtitle and presentation information which is a display unit of the subtitle; Converting the presentation information into a bitmap image based on the style information; And And controlling to output the converted presentation information in synchronization with the image data. The method of claim 24, The reading of the subtitle data may include buffering the subtitle data and the font file referenced by the subtitle data before playing the image data. The method of claim 24, When the plurality of subtitle data supporting a plurality of languages are recorded in the storage medium, the reading of the subtitle data includes receiving selection information regarding a desired language from a user and reading the corresponding subtitle data. The playback method characterized in that the step of entering. The method of claim 24, And converting the bitmap image into the bitmap image by analyzing and transforming the style information and the presentation information configured in a packetized elementary stream (PES) unit. The method of claim 27, The style information is composed of one PES and is recorded in the first portion of the subtitle data, and the plurality of presentation information is recorded in the PES unit after the style information. And converting the bitmap image into the bitmap image by applying the one style information to the plurality of presentation information. The method of claim 24, The style information is a set of output styles to be applied to the presentation information, predefined by the producer of the storage medium, And converting the bitmap image into a bitmap image based on the style information. The method of claim 29, The text information of the presentation information includes text to be converted into a bitmap image, and inline style information applied only to a portion of the text. The converting of the bitmap image may include applying the inline style information only to a portion of the text to which the style information predefined by the producer is applied, thereby emphasizing a portion of the text. The method of claim 30, The converting into the bitmap image may include applying, as the inline style information, a relative value to a predetermined font information included in the style information predefined by the creator, or a predetermined absolute value to a portion of the text. How to play. The method of claim 29, The style information further includes style information that can be changed by the user. The converting into the bitmap image may include inputting selection information on one style among style information that the user can change from a user, applying style information predefined by the producer, and then applying the inline style information. And finally applying style information that can be changed by the user corresponding to the selection information to the text. 33. The method of claim 32, The converting of the bitmap image may include applying a relative value of predetermined font information among style information predefined by the producer to the text as style information that can be changed by the user. The method of claim 29, The converting into the bitmap image may include applying the predetermined style information to the text when the storage medium allows predetermined style information defined by a playback device in addition to the style information predefined by the producer. How to play. The method of claim 29, The style information includes a set of color palettes to be applied to the presentation information. And converting the bitmap image into a bitmap image based on the color defined in the color palette. 36. The method of claim 35 wherein Apart from the set of color palettes included in the style information, the presentation information further includes a set of color palettes and a color update flag. The converting into the bitmap image may include applying a set of color palettes included in the presentation information when the color update flag is set to 1, and reverting to the style information when the color update flag is set to 0. And applying a set of included color palettes. The method of claim 36, The converting into the bitmap image may include setting the color update flag to 1 and gradually changing a transparency value of a color palette included in the plurality of presentation information to implement a fade in / out effect. And resetting the color reference table (CLUT) in the subtitle decoder based on the color palette set included in the style information when the out effect ends. The method of claim 29, The style information includes region information indicating a position of a window region in which the converted presentation information is to be output on the image, and font information necessary to convert the text information into a bitmap image The converting of the bitmap image comprises converting the presentation information using the area information and the font information. The method of claim 38, The font information includes at least one of an output start position, an output direction, alignment, line spacing, an identifier of a font, a style of a font, a size of a font, and a color of the converted presentation information. The converting method into the bitmap image may include converting the presentation information into a bitmap image based on the font information. The method of claim 39, The converting into the bitmap image may include referring to the indication information on the font file included in the clip information file recording the attribute information on the recording unit of the image data as an identifier of the font. . The method of claim 24, The presentation information includes text information indicating the content of the caption and configuration information for controlling the output of the text information converted into a bitmap image. And controlling the output of the converted presentation information comprises controlling the time at which the converted text information is output with reference to the configuration information. The method of claim 41, wherein The presentation information designates at least one window area to which a subtitle is to be output. And controlling the output of the converted presentation information comprises simultaneously outputting the converted text information to the at least one window area. The method of claim 42, wherein Among the configuration information, an output start time and an output end time of the presentation information are defined as time information on a global time axis used in a playlist that is a reproduction unit of the video data. The controlling of the output of the converted presentation information may include synchronizing the output of the converted text information and the decoded image data with reference to the output start time and the output end time. . The method of claim 43, The controlling of the output of the converted presentation information may include: continuously playing the two presentation information when the output end time of the presentation information currently being reproduced is the same as the output start time information of the next presentation information. Playback method characterized in that the step. The method of claim 44, The controlling of the output of the converted presentation information may include: resetting a buffer in the subtitle decoder between the output start time and the output end time if the next presentation information does not require continuous playback, and continuously playing back the continuous presentation. And resetting the buffer without resetting if required. Image data; And Text-based subtitle data for displaying captions is recorded on an image based on the image data. The subtitle data includes one style information for designating an output style of the subtitle and a plurality of presentation information which is a display unit of the subtitle, and are separately recorded from the image data. 47. The method of claim 46 wherein The style information and the presentation information are configured in a packetized elementary stream (PES) unit, and the style information is configured in one PES and recorded in the first portion of the subtitle data. A plurality of presentation information is recorded in the PES unit after the style information. 47. The method of claim 46 wherein The presentation information includes text information indicating the content of the caption and configuration information for controlling the output of the text information converted into a bitmap image, wherein the text information indicates at least one window area for caption output. Designating a storage medium. The method of claim 48, The configuration information may include style reference information for designating one of the style information as an output style to be applied to the text information, time information for outputting the converted text information on a screen, and color to be applied to the converted text information. A storage medium comprising pallet information. The method of claim 49, Among the configuration information, an output start time and an output end time of the presentation information are global times used in a playlist that is a playback unit of the video data to synchronize the output of the decoded video data with the converted text information. A storage medium, characterized by time information on the axis. 51. The method of claim 50, And when the two neighboring presentation informations are continuously played back, an output end time of the presentation information currently being played is designated equal to the output start time information of the next presentation information. The method of claim 51, When the two neighboring presentation information are not continuously played back, a storage end time of the presentation information currently being played is set to a value smaller than the output start time information of the next presentation information. The method of claim 48, And the style information includes a set of output styles to be applied to the presentation information, which are predefined by the producer of the storage medium. The method of claim 53, The text information of the presentation information includes text to be converted into a bitmap image, and inline style information applied only to a portion of the text. And the inline style information is applied only to a portion of the text to which the style information predefined by the creator is applied to emphasize the portion of the text. The method of claim 54, And the inline style information is designated as a relative value or predetermined absolute value with respect to predetermined font information included in the style information predefined by the producer. The method of claim 53, The style information further includes style information that can be changed by the user. The style information which can be changed by the user is applied to the text after applying the style information predefined by the creator and the inline style information. The method of claim 56, wherein The style information changeable by the user is specified as a relative value of predetermined font information among style information predefined by the producer. The method of claim 53, And information on whether to allow predetermined style information defined by the playback apparatus in addition to the style information predefined by the producer. The method of claim 53, The style information includes a set of color palettes to be applied to the presentation information. The method of claim 59, Apart from the set of color palettes included in the style information, the presentation information further includes a set of color palettes and a color update flag. When the color update flag is set to 1, the set of color palettes included in the presentation information is applied, and when the color update flag is set to 0, the set of color palettes included in the style information is applied as it is. Characterized in that the storage medium. The method of claim 60, A fade in / out effect is realized by setting the color update flag included in the plurality of consecutive presentation information to 1 and gradually changing the transparency value of the color palette included in the plurality of consecutive presentation information. Storage media. The method of claim 53, The style information includes region information indicating a position of a window region in which the converted presentation information is to be output on the image, and font information necessary for converting the text information into a bitmap image. The method of claim 62, The font information includes at least one of an output start position, an output direction, alignment, line spacing, an identifier of a font, a style of a font, a size of a font, and a color of the converted presentation information. The method of claim 63, wherein And the identifier of the font is indication information for a font file included in a clip information file in which attribute information of a recording unit of the image data is recorded. 47. The method of claim 46 wherein And a plurality of the subtitle data composed of a plurality of languages to support a subtitle of a user selected language.