TWI417873B - A storage medium and an apparatus for reproducing data from a storage medium storing audio-visual data and text-based subtitle data - Google Patents

Abstract

A storage medium storing a multimedia image stream and a text-based subtitle stream, and a reproducing apparatus and a reproducing method therefor are provided to reproduce the text-based subtitle data stream recorded separately from the multimedia image stream such that the subtitle data can be easily produced and edited and a caption can be provided in a plurality of languages. The storage medium stores: image data; and text-based subtitle data to display a caption on an image based on the image data, wherein the subtitle data includes: one style information item specifying an output style of the caption; and a plurality of presentation information items that are displaying units of the caption, and the subtitle data is separated and recorded separately from the image data. Accordingly, a caption can be provided in a plurality of languages, and can be easily produced and edited, and the output style of caption data can be changed in a variety of ways. In addition, part of a caption can be emphasized or a separate style that a user can change can be applied.

Description

Device for storing media and reproducing data from a storage medium storing image data and text subtitle data

The present invention relates to a multimedia image reproduction, and more particularly to a storage medium for recording a multimedia video stream and a text subtitle stream, and a reproduction of a text subtitle stream recorded on the storage medium. Device and regeneration method.

In order to provide high-density multimedia images, video streaming, audio streaming, playback of graphics streams providing subtitles, and interactive graphics streams that provide buttons and menus to interact with the user are multiplexed to a primary string. The stream is recorded and recorded on a storage medium, wherein the primary stream is known as an audio visual "AV" data stream. In particular, a playback graphics stream that provides subtitles also provides a bitmap image for displaying subtitles or titles on the image.

In addition to its large size, bitmap title data can be problematic in the production of subtitles or title material and it can be quite difficult to edit the title material that has been created. This is because the header data is multiplexed with other streaming data (such as video, audio and interactive graphics streams). Furthermore, another problem is that the output style of the title material cannot be changed in various ways, that is, the output style of one title cannot be changed to another output style.

It is an object of the present invention to provide a storage medium for recording a text subtitle stream, and a reproducing apparatus and method for reproducing text subtitle data recorded on the storage medium.

The object according to the invention is to provide a way to store image data and text The device for reproducing media by using a font subtitle for displaying a title according to the image data on an image, the device comprising: a video decoder for decoding image data; and a subtitle decoder for Converting the playback information into a bitmap image according to the style information, and controlling the output of the converted playback information to be synchronized with the decoded image data, wherein the text data includes the playback information of the unit for displaying the title and the style of the output style of the specified title. News.

The subtitle decoder decodes the text subtitles separately recorded from the image data and outputs the subtitle data, which covers the subtitle data on the decoded image data. The style information and the play information are formed by completing the units of the packetized elementary streams (PESs), and the subtitle decoder parses and processes the style information and the play information in the unit of the PESs.

The style information is formed by a PES and recorded in the front part of the subtitle data, and several play information items are recorded in the PESs unit after the style information, and the subtitle decoder applies a style information item to the play information items.

In addition, the playback information includes text information indicating the content of the title and combined information for controlling the output of the bitmap image obtained by converting the text information, and wherein the subtitle decoder is output when the converted text information is output by referring to the combined information. Control this time.

The playback information specifies one or more window areas, where the window area is the area on which the title is output on the screen, and the subtitle decoder outputs the converted text information in one or more windows at the same time.

The output start time and the output end time of the playback information in the combined information are defined as time information on the global time axis, wherein the global time axis is used in the playlist, and the playlist is a reproduction unit of the image data, and the subtitle is decoded. The output of the converted text information is synchronized with the output of the decoded image data by reference to the output start time and the output end time.

If the output end time of the currently reproduced play information item is the same as the output start time of the next play information item, the subtitle decoder continuously reproduces the two play information items.

If the next playback information does not require continuous reproduction, the subtitle decoder resets the interval buffer between the output start time and the output end time, and if continuous reproduction is required, the interval buffer is retained without resetting. .

The style information is a collection of output styles, and the output style is pre-defined by the manufacturer of the storage medium and applied to the playback information, and the subtitle decoder converts the playback information items recorded to the bitmap information according to the style information to the bitmap image. .

In addition, the text information in the playback information includes the text to be converted into the bitmap image and the inline style information to be applied to the unique portion of the text, and the subtitle decoder applies the only part of the inline style information of the applied text. To provide a feature to enhance the text portion by pre-defined style information from the manufacturer.

The subtitle decoder applies a relative value of the predefined font information or a predefined absolute value included in the style information predefined by the manufacturer to the text Part of the information as inline style.

In addition, the style information further includes the user can change the style information, and after receiving the selection information of a style in the changeable style information item from the user, the subtitle decoder applies the pre-defined style information generated by the user, and then applies the application. The inline style information, and then the user who last applied the corresponding selection information can change the style information item to the text.

The subtitle decoder applies the relative value of the pre-defined font information among the style information items predefined by the manufacturer to the text, and the user can change the style information.

If the storage medium allows for predefined style information defined in the playback device in addition to the style information predefined by the manufacturer, the subtitle decoder applies the predefined style information to the text.

In addition, the style information includes a collection of color palettes to apply to the playback information, and the subtitle decoder converts all of the playback information items after the style information into bitmap images according to the color defined in the color palette.

The play information further includes a set of color palettes and a color update flag, which are separated from the set of color palettes included in the style information, and if the color update flag is set to "1", the subtitle decoder A set of color palettes included in the playback information is applied, and if the color update flag is set to "0", the subtitle decoder applies the original set of color palettes included in the style information.

By setting the color update flag to "1" and gradually changing the transparency value of the color palette included in the continuous play information item, the subtitle decoder implements the fade in/out effect, and when the fade in/out effect is completed Word The curtain decoder resets the color look-up table (CLUT) based on the original set of color palettes included in the style information.

In addition, the style information includes area information indicating the position of the window area, which is used for the converted play information to be output on the image, and the font information required for converting the broadcast information into the bitmap image, and the subtitle decoding The converted information is converted to a bitmap image by using area information and font information.

The font information includes an output start position, an output direction, a sort, a line interval, a font identification word, a font size, or a color of at least one converted play information, and wherein the subtitle decoder converts the play information into a bitmap image according to the font information. .

The subtitle decoder refers to the indication information on the font file as a font identification word, wherein the font file is included in the clip information file, which is attribute information of the recording unit storing the image data.

In addition, the subtitle decoder buffers the subtitle data and the font file referenced by the subtitle decoder before the image data is reproduced.

In addition, if a plurality of subtitle data items supporting a plurality of languages are recorded on the storage medium, the subtitle decoder receives the selection information of the expected language from the user, and reproduces the subtitle data corresponding to the selected information among the subtitle data items.

It is still another object of the present invention to provide a method for reproducing data from a storage medium storing image data and text subtitles, wherein the image is displayed on the image according to the image data, the method comprising: decoding the image data; reading the style information and Play information; convert the playback information into a dot matrix based on the style information The image; and the output that controls the converted playback information is synchronized with the decoded image data. The text data includes the playback information of the unit indicating the title and the style information of the output style of the specified title.

It is still another object of the present invention to provide a storage medium for storing: image data; and text subtitle data for displaying a title on the image according to the image data, wherein the subtitle data includes: a style information, which is used To indicate the output style of the title; and a plurality of playback information items, which are units for displaying the title, and the subtitle data is separately recorded from the image data and separately recorded.

Other objects and advantages of the present invention will be described in detail below and are obtained by the embodiments of the present invention.

The above and other objects, features, and advantages of the present invention will become more apparent and understood.

Referring to FIG. 1, a storage medium (for example, the medium 230 shown in FIG. 2) is configured in a multi-layer manner to manage a multimedia material structure 100 of a multimedia video stream recorded thereon according to an exemplary embodiment of the present invention. The multimedia material structure 100 includes a clip 110, a playlist 120, a movie object 130 and a catalog table 140, wherein the clip 110 is a recording unit of the multimedia image, the playlist 120 is a reproducing unit of the multimedia image, and the movie object 130 includes a multimedia object for reproducing the multimedia image. The navigation instructions and directory table 140 are used to specify the movie object that was first reproduced and the title of the movie object 130.

The clip 110 will be implemented as an object, which is included for high image products. A video stream of an audio-visual (AV) data stream and a clip information 114 for corresponding to the stream of AV data. For example, the AV data stream can be compressed according to, for example, Motion Picture Experts Group (MPEG). However, this clip 110 does not require compression of the AV data stream 112 for the purposes of the present invention. In addition, the clip information 114 includes audio/video attributes of the AV material stream 112, an entry point map, etc., wherein information regarding the location of the random access entry point is recorded in the entry point map in units of predefined magnetic regions.

The playlist 120 is a set of playback intervals of these clips 110, and each playback interval is considered a play item 122. The movie object 130 is constituted by a navigation program, and the navigation programs start playback of the playlist 120 according to the user's needs, exchange between the movie objects 130, or manage the reproduction of the playlist 120.

The table of contents 140 is a table at the top of the storage medium, which is used to define a plurality of titles and menus, and the table of contents 140 includes information on the start positions of all the titles and menus so as to be reproducible through user operations (such as title search or Menu Call) The selected title and menu. The table of contents 140 also includes the start position information of the title and menu that are automatically regenerated for the first time when the storage medium is placed on the reproducing device.

In such projects, the data structure of the clip AV stream that compresses the encoded multimedia image will be described in detail in conjunction with FIG. FIG. 2 is a schematic diagram showing an example data structure of the AV data stream 210 and the text subtitle stream 220 of FIG. 1 according to an embodiment of the invention.

Please refer to FIG. 2, in order to solve the above-mentioned title data about the dot pattern. The problem is that the text subtitle stream 220 is provided in a separate manner from the clip AV data stream 210 recorded on the storage medium 230, such as a digital versatile disc (DVD), in accordance with an embodiment of the present invention. The AV data stream 210 includes a video stream 202, an audio stream 204 for providing a play graphics stream 206 of caption data, and an interactive graphics stream 208 for providing buttons and menus for interacting with the user, and the stream stream described above The multiplexed main stream is multiplexed and recorded in the storage medium 230, wherein the animated main stream is a well-known audio-visual (AV) data stream.

According to an embodiment of the present invention, the text subtitle data 220 indicates that the subtitle and title data for providing the multimedia image is recorded in the storage medium 230, and is implemented using a markup language, such as an Extensible Markup Language (XML). ). However, the subtitles and titles of the multimedia image are provided using two-bit data. Thereafter, the subtitle data of the multimedia image and the caption data 220 of the title are simply regarded as "text subtitle stream". The playback graphics stream 206 for providing subtitle data also provides bitmap subtitle data to display subtitles (or titles) on the screen.

Since the text subtitle stream 220 is recorded separately from the AV material stream 210 and is not multiplexed with the AV material stream 210, the size of the text subtitle stream 220 is not limited thereto. Therefore, subtitles and titles can be provided in several languages, and further, the text subtitle stream 220 can be continuously reproduced and efficiently edited without any difficulty.

The text subtitle stream 220 is then converted into a bitmap image image and output to overlay the multimedia image on the screen. Convert text subtitles The process of imaging a bitmap image is considered as rendering. The text subtitle stream 220 includes information needed to render the title text.

The text subtitle stream 220 including the rendering information will be described in detail below with reference to FIG. FIG. 3 is a schematic diagram of a data structure for explaining a text subtitle stream 220 according to an embodiment of the present invention.

Referring to FIG. 3, the text subtitle stream 220 includes a dialog style unit (DSU) 310 and a plurality of dialog presentation units (DPUs) 320 to 340 according to an embodiment of the present invention. DSU 310 and DPUs 320 through 340 can also be considered as dialog units. Each of the dialog units 310 to 340 forming the caption stream 220 is stored in the form of packetized elementary streams (PESs) or simply known PES packets 350. Similarly, the PES of the text subtitle stream 220 is recorded and transmitted in units of transport packets (TP) 362. A continuous TP can be regarded as a transport stream (TS).

However, as shown in FIG. 2, the text subtitle stream 220 is not multiplexed with the AV material stream 210 and the separate TSs are recorded on the storage medium 230 in accordance with an embodiment of the present invention.

Referring to FIG. 3, a dialog unit is recorded in a PES packet 350 included in the text subtitle stream 220. The text subtitle stream 220 includes a DSU 310 disposed in front and a plurality of DPUs 320 through 340 connected to the DSU 310. The DSU 310 includes information describing the output style of the dialog displayed in the title of the screen, wherein the multimedia image is reproduced on this screen. on. Meanwhile, the plurality of DPUs 320 to 340 include text information items on the content of the conversation to be displayed and information on the respective output items.

4 is a schematic diagram of a text subtitle stream 220 having the data structure of FIG. 3, in accordance with an embodiment of the present invention.

Referring to FIG. 4, the text subtitle stream 220 includes a DSU 410 and a plurality of DPUs 420.

In an exemplary embodiment of the invention, several DPUs are defined as num_of_dialog_presentation_units. However, several DPUs are not specified separately. The example case is to use a syntax like while(processed_length<end_of_life).

The data structure of the DSU and DPU will be described in detail in conjunction with FIG. 5. FIG. 5 is a schematic diagram of the dialog style unit of FIG. 3 according to an embodiment of the invention.

Referring to FIG. 5, a set of dialog_styleset() 510 of dialog style information items is defined in the DSU 310, in which an output style information item of a dialog to be displayed as a title is assembled. The DSU 310 includes information showing the position of the area of the conversation in the title, information required for the rendering of the conversation, information of the style that the user can control, and the like. The details will be explained below.

6 is a schematic diagram showing an example data structure of a dialog style unit (DSU) according to an embodiment of the present invention.

Referring to FIG. 6, the DSU 310 includes a palette collection 610 and a region style collection 620. The palette set 610 is a collection of several color palettes that are used to define the colors used in the title. The color combinations and color information (such as transparency) included in the palette set 610 can be applied to all of the DPUs that are configured after the DSU.

A region style collection 620 is a collection of output style information for respective conversations that form a title. Each region style includes area information 622 indicating the location of the dialog displayed on the screen, text style information 624 indicating the output style to be applied to each dialog text, and a user changeable style collection indicating the style. ) 626, wherein the user can arbitrarily change the style applied to each dialog text.

FIG. 7 is a schematic diagram showing an example data structure of a dialog style unit according to another embodiment of the present invention.

Referring to FIG. 7, unlike FIG. 6, the palette set 610 is not included. That is, the color palette set is not defined in the DSU 310, but the palette set 610 is defined in the DPUs described in Figures 12A and 12B. The data structure of each region pattern 710 is the same as the data structure described in FIG.

FIG. 8 is a schematic diagram showing an example dialog style unit of FIG. 6 or FIG. 7 according to an embodiment of the invention.

Referring to Figures 8 and 6, DSU 310 includes palette sets 860 and 610 and a plurality of area styles 820 and 620. As mentioned above, the palette set 610 is a collection of several color palettes that are used to define the colors used in the title. The color combinations and color information (such as transparency) included in the palette set 610 can be applied to all of the DPUs that are configured after the DSU.

Meanwhile, each of the area patterns 820 and 620 includes area information 830 and 622 indicating information on the window area, wherein the title of the window area is to be displayed on the screen, and the area information 830 and 622 includes X, Y coordinates, width, Information in a window area such as a high background color, in which the title in the window area is to be displayed on the screen.

Likewise, each of the regional styles 820 and 620 includes textual style information 840 and 624 indicating the output style to be applied to each dialog text. That is, the X, Y coordinates, the output direction (for example, left to right or top to bottom), the sorting, the line spacing, the font identification word to be referred to, and the font style (for example, the position of the dialog text to be displayed in the above-mentioned window area) (for example, Blackbody or italic), font size and font color information, and more.

Moreover, each of the regional styles 820 and 620 also includes user-changeable style collections 850 and 626 that indicate a style that the user can arbitrarily change. However, it is not necessary for the user to change the style sets 850 and 626. The user changeable style sets 850 and 626 may include change information such as a window area position, a text output position, a font size line interval, and the like among the text output style information items 840 and 624. Each change information item can be represented as a relative increase or decrease in the associated information on output styles 840 and 625 for each dialog text.

In summary, there are three types of style related information: style information (region_style) 620 defined in the area styles 820 and 620, inline style information (inline_style) 1510 (explained later) and the user used to strengthen the part of the title. The style information (user_changeable_style) 850 can be changed, and the order in which the information item is applied is as follows:

1) Basically, the area style information 620 defined in the area style is applied.

2) If the style information is wired, the inline style information 1510 is applied to cover the part of the area style information application, and the part of the title text is enhanced.

3) If there is a user who can change the style information 850, this information is finally applied. The user can change the presentation of the style information is not necessary.

Meanwhile, among the text style information items 840 and 624 to be applied to each dialog text, the font file information referred to by the identification word of the font (font_id) 842 can be defined as follows.

FIG. 9A is a diagram showing an example clip information file 910 including a plurality of font sets referenced by the font information 842 of FIG. 8 in accordance with an embodiment of the present invention.

Referring to FIG. 9A, FIG. 8, FIG. 2 and FIG. 1, according to the present invention, various information recorded on a stream of a storage medium is included in StreamCodingInfo() 930, wherein StreamCodingInfo() 930 is included in the clip information file 910. And the stream encoding information structure in 110. That is, information including video stream 202, audio stream, playback graphics stream, interactive graphics stream, and text subtitle stream. In particular, it includes language information (textST_language_code) 932 for which a title is to be displayed, which is related to the text subtitle stream 220. Similarly, the font name 936 and the file name 938 of the file storage font information may be defined, which correspond to the font_ids 842 and 934 indicating the identification words of the fonts to be displayed and displayed in FIG. A method for finding a font file of an identification word to be referred to with a font defined herein will be described in detail with reference to FIG.

FIG. 9B is a schematic diagram showing an example clip information file 940 including a plurality of font sets referenced by the font information 842 of FIG. 8 in accordance with another embodiment of the present invention.

Referring to FIG. 9B, the structure ClipInfo() is defined in the clip information files 910 and 110. A plurality of font sets referenced by the font information 842 in FIG. 8 are defined in this structure. That is, the font file name 952 corresponding to the font_id 842 is specified, where the font_id 842 indicates the identification word to be referred to and displayed in the font of FIG. A method for finding a font file of an identification word to be referred to with a font defined herein will be described in detail below.

Figure 10 is a diagram showing the locations of several font files referenced by font file names 938 and 952 in Figures 9A and 9B.

Referring to FIG. 10, a directory structure for an archive recorded on a multimedia is displayed according to an embodiment of the present invention. In particular, because of the directory structure, it is easy to find the location of the font file, such as 11111.font 1010 or 99999.font 1020 stored in the AUXDATA directory.

Meanwhile, the structure of the DPU forming the dialog unit will be described in detail in conjunction with FIG.

FIG. 11 is a schematic diagram showing an example data structure of the DPU 320 of FIG. 3 according to another embodiment of the present invention.

Referring to FIG. 11 and FIG. 3, the DPU 320 including the text information for displaying the content of the conversation and the information for displaying the time includes a time information 1110 indicating the time for outputting the dialogue time on the screen, and specifically specifying the color palette to be referred to. Palette reference information 1120 and dialog area information 1130 for the dialog to be output on the screen. In particular, it is used for the pair to be output on the screen. The dialog area information 1130 includes style reference information 1132 indicating the output style to be applied to the dialog and dialog text information 1134 indicating the text actually output on the screen. In this case, it is assumed that the set of color palettes indicated by palette reference information 1120 is defined in the DSU (see 610 of Figure 6).

Meanwhile, FIG. 12A is a schematic diagram for explaining an example data structure of the DPU 320 of FIG. 3 according to an embodiment of the present invention.

Referring to FIG. 12A and FIG. 3, the DPU 320 includes time information 1210 indicating that a dialog time is to be output on the screen, a palette set 1220 defining a color palette set, and a dialog for a dialog to be output on the screen. Regional information 1230. In this case, palette set 1220 is not defined in the DSU as in Figure 11, but is directly defined in DPU 320.

Meanwhile, FIG. 12B is a schematic diagram for explaining an example data structure of the DPU 320 of FIG. 3 according to an embodiment of the present invention.

Referring to FIG. 12B, the DPU 320 includes time information 1250 indicating the time for the dialogue to be output on the screen, a color update flag 1260, a color palette set 1270 required when the color update flag is set to 1, and In the dialog area information 1280 to be output on the screen. In this case, the color palette set 1270 is also defined in the DSU of FIG. 11 and stored in the DPU 320. In particular, in order to indicate the use of continuous fade in/out, in addition to the basic palette defined in the DSU, the palette set 1270 used to represent fade in/out is defined in the DPU 320 and the color update flag 1260 Will be set to 1. This will be described in detail in conjunction with FIG.

FIG. 13 is a diagram of FIG. 11 to FIG. 12B according to an embodiment of the invention. Schematic of DPU 320.

Referring to FIG. 13, FIG. 11, FIG. 12A and FIG. 12B, the DPU includes dialog start time information (dialog_strat_PTS) and dialog end time information (dialog_end_PTS) 1310 as time information 1110 indicating the time for the dialog to be output on the screen. Likewise, the dialog palette identification word (dialog_palette_id) is included as palette reference information 1120. In the case of FIG. 12A, color palette set 1220 can be included in place of palette reference information 1120. The dialog text information (region_subtitle) 1334 is included as the dialog area information 1230 for the dialog to be output, and also includes the area style identification word (region_style_id) 1332 in order to indicate the output style applied thereto. The example in FIG. 13 is only an embodiment of the DPU and the DPU having the data structure as shown in FIGS. 11 to 12B can be modified in various ways.

FIG. 14 is a schematic diagram showing an example data structure of the dialog text information (region_subtitle) in FIG.

Referring to FIG. 14, the dialog text information (1134 in FIG. 11, 1234 in FIG. 12A, 1284 in FIG. 12B, and 1334 in FIG. 13) includes inline information 1410 and dialog text 1420 as output patterns to enhance the dialogue.

FIG. 15 is a schematic diagram of the dialog text information 1334 of FIG. 13 according to an embodiment of the invention. As shown in FIG. 15, the dialog text information 1334 is implemented by inline style information (inline_style) 1510 and dialog text (text_string) 1520. Likewise, it is preferred that information indicating the end of the inline pattern is included in the embodiment of FIG. Unless the end portion of the inline style is defined, once the specified inline style may be applied to it, it will The opposite of the manufacturer's settings.

Meanwhile, FIG. 16 is a schematic diagram for explaining restrictions on continuously reproducing continuous dialog presentation units (DPUs).

Referring to FIG. 16 and FIG. 13, when it is necessary to continuously reproduce the above several DPUs, the following restrictions are required.

1) When the dialog object starts to be output on the graphic plane (GP), the dialog start time information (dialog_start_PTS) 1310 defined in the DPU will indicate a time, and the graphic plane (GP) will be matched below. Figure 17 is explained in detail.

2) The dialog start time information (dialog_start_PTS) 1310 defined in the DPU indicates a time to reset the text subtitle decoder for processing the text subtitles, wherein the text subtitle decoder will be described in detail below with reference to FIG.

3) When it is necessary to continuously reproduce the above several DPUs, the current DPU session end time information (dialog_end_PTS) should be the same as the dialog start time information (dialog_start_PTS) of the next continuously reproduced DPU. That is, in FIG. 16, in order to continuously reproduce DPU #2 and DPU #3, the session end time information included in DPU #2 should be identical to the dialog start time information included in DPU #3.

In the meantime, it is preferable that the DSU according to the present invention satisfies the following limitations.

1) The text subtitle stream 220 includes a DSU.

2) Several user-changeable style information items (user_control_style) included in all region styles (region_style) should be the same.

Meanwhile, it is preferable that the DPU according to the present invention satisfies the following limitations.

1) The window area for at least two titles should be defined.

The structure of an exemplary reproducing apparatus based on the data structure of the caption stream 220 recorded on the storage medium according to an embodiment of the present invention will be described below with reference to FIG.

Figure 17 is a diagram for explaining an example reproducing apparatus for text subtitle streaming in accordance with an embodiment of the present invention.

Referring to FIG. 17, a reproducing apparatus 1700 (so-called recording and reproducing apparatus) includes a buffer unit and a caption decoder 1730. The buffer unit includes a font preloading buffer (FPB) 1712 for storing a font file and a subtitle preloading buffer (SPB) 1710 for storing a text subtitle file, and the text subtitles. The decoder 1730 is configured to decode and reproduce the text subtitle stream recorded in the storage medium as an output by a graphics plane (GP) 1750 and a color look-up table (CLUT) 1760.

In particular, the subtitle preloading buffer (SPB) 1710 preloads the text subtitle data stream 220 and the font preloading buffer (FPB) 1712 preloads the font information.

The text subtitle decoder 1730 includes a text screen processor 1732, a dialog composition buffer (DCB) 1734, a dialog buffer (DB) 1736, a text subtitle conversion device 1738, and a dialog play. The controller 1740 and a bitmap object buffer (BOB) 1742.

The text screen processor 1732 receives the text subtitle stream from the subtitle preloading buffer (SPB) 1710. 220. Convert the foregoing information about the information included in the DSU and the dialog output time information included in the DPU to the dialog composition buffer (DCB) 1734 and convert the dialog text information included in the DPU to the dialog buffer (dialog buffer) , DB) 1736.

The dialog playback controller 1740 controls the caption rendering device 1738 by using a pattern regarding information included in the dialog composition buffer (DCB) 1734, and controls the output by using the dialog output time information. It is output to the graphics plane (GP) 1750 at the time of rendering the bitmap image of the bitmap object buffer (OBO) 1742.

In accordance with the control of the dialog playback controller 1740, the text-based captioning device 1738 converts the dialog text information (i.e., performs rendering) into a bitmap image, which is applied to the font preload buffer ( The font preloading buffer, FPB) 1712 preloaded font information item corresponds to the font information item of the dialog text information stored in the dialog buffer (DB) 1736 to the dialog text information. The rendered bitmap image is stored in a bitmap object buffer (OBO) 1742 and output to a graphics plane (GP) 1750 in accordance with the control of the dialog playback controller 1740. At this time, the color specified in the DSU is applied by referring to a color look-up table (CLUT) 1760.

The information defined by the manufacturer in the DSU can be used as style-related information applied to the dialog text, and the user-predefined style related information can also be applied. The regeneration device 1700 shown in Figure 17 will take precedence over the manufacturer's decision. User-defined style information is applied before the style related information.

As shown in FIG. 8, the region style information (region_style) defined by the manufacturer in the DSU is basically applied to the style related information applied to the dialog text, and if the inline style information (inine_style) is included in the DPU, The DPU includes the dialog text of the application area style information, and the inline style information (inline_style) is applied to the corresponding part. Similarly, if the manufacturer additionally defines that the user can change the style in the DSU and one of the user-defined user changeable styles is selected, the area style or inline style is applied, and then the user can be finally applied. Change the information. Similarly, as described in FIG. 15, it is preferable that the information indicating the end of the application inline style is included in the content of the inline style.

Furthermore, the manufacturer can indicate whether style-related information defined in the reproduction device itself can be used, which is separate from the style-related information defined by the manufacturer and recorded on the storage medium.

FIG. 18 is a diagram for explaining a preloading procedure of the text subtitle stream 220 in the example reproduction device 1700 (eg, as shown in FIG. 17) in accordance with an embodiment of the present invention.

Referring to FIG. 18, the caption stream 220 shown in FIG. 2 is defined in the sub-path of the playlist. In the sub-path, a plurality of text subtitle streams 220 supporting several languages can be defined. Similarly, the font file applied to the text subtitles can be defined in the clip information file 910 or 940 as described in FIGS. 9A and 9B. A maximum of 255 text subtitle streams 220 that may be included in a storage medium may be defined in each playlist. Similarly, you can define up to 255 font files included in a storage medium. case. However, to ensure uninterrupted playback, the size of the text subtitle stream 220 should be less than or equal to the size of the preload buffer 1710 of the playback device 1700 (eg, as shown in FIG. 17).

19 is a schematic diagram for explaining a reproduction procedure of a DPU in an example reproduction apparatus according to an embodiment of the present invention.

Referring to FIG. 19, FIG. 13, and FIG. 17, the flow of reproducing the DPU is shown. The playback controller 1740 controls the time for the rendering dialogue to be output on the graphics plane (GP) 1750 by using the dialog start time information specifying the output time 1310 of the dialog included in the DPU ( dialog_start_PTS) and dialog end time information (dialog_end_PTS). At this time, when the converted rendering bitmap image stored in the bitmap object buffer (BOB) 1742 is completed to the graphics plane (GP) 1750, the bitmap object is completed. A buffer object buffer (BOB) 1742 is included in the text subtitle decoder 1730, and the session start time information is specified for a time. That is, if the dialog start time is defined in the DPU, the bitmap information required to construct the dialog after completing the conversion of the information to the graphics plane (GP) 1750 is ready to be used. Similarly, when the regenerated DPU is completed, the session end time information is specified for a time. At this time, the text subtitle decoder 1730 and the graphics plane (GP) 1750 are reset. Most preferably, whether it is a buffer that is continuously reproduced in the text subtitle decoder 1730 (such as a bitmap object buffer (BOB) 1742), it will also be between the start time and the end time of the DPU. Was reset.

However, when several DPUs are required for continuous reproduction, the text subtitle decoder 1730 and the graphics plane (GP) 1750 are not reset and stored in each buffer (such as a dialog composition buffer). , DCB) 1734, dialog buffer (DB) 1736 and bitmap object buffer (OBO) 1742) will be retained. That is, when the session end time information of the currently reproduced DPU is the same as the session start time information of the DPU that is continuously reproduced later, the content of each buffer is retained without being reset.

In particular, there is a fade in/out effect as a continuous regeneration example in which several DPUs are applied. The fade in/out effect can be implemented by changing the color look-up table (CLUT) 1760 of the bitmap object, where the bitmap object is converted to a graphics plane (GP) 1750. That is, the first DPU includes combined information such as color, style, and output time, and the subsequent consecutive DPUs have the same combination information as the first DPU, but only update the color palette information. In this case, the fade in/out effect is implemented by gradually changing the transparency (from 0% to 100%) in the color information item.

In particular, when using the data structure of the DPU as shown in FIG. 12B, the fade in/out effect can be effectively implemented using the color update flag 1260. That is, if the dialog playback controller 1740 checks and confirms that the color update flag 1260 included in the DPU is set to "0", that is, in the case of a case where the fade in/out effect is generally not required, it is basically The color information included in the DSU shown in Fig. 6 is used. However, if the dialog playback controller 1740 checks and confirms that the color update flag 1260 included in the DPU is set When it is "1", that is, if the fade in/out effect is required, the fade in/out effect is implemented by using the color information 1270 (instead of the color information in the DSU shown in Fig. 6). At this time, the fade in/out effect is simply implemented by adjusting the transparency of the color information 1270 included in the DPU.

After displaying the fade in/out effect, it is best to update the color look-up table (CLUT) 1760 to the original color information included in the DSU. This is because unless the color look-up table (CLUT) 1760 is updated, once the specified color information can be applied continuously, contrary to the manufacturer's expectations.

20 is a schematic diagram for explaining a procedure for synchronizing and outputting a text subtitle stream and animation data in an exemplary reproducing apparatus according to an embodiment of the present invention.

Referring to FIG. 20, the dialog start time information and the session end time information of the DPU included in the text subtitle data stream 220 should be defined as time points on the global time axis used in the playlist to be used with the AV data of the multimedia image. The output time of the stream is synchronized. Therefore, the discontinuity between the system time clock (STC) of the AV data stream and the dialog output time (PTS) of the text subtitle stream 220 can be avoided.

21 is a diagram for explaining a procedure of outputting a text subtitle stream to a screen in an example reproducing apparatus according to an embodiment of the present invention.

Please refer to FIG. 21, which shows a flow of applying the rendering information 2101 including the style related information, a flow of the text information 2140 into the bitmap image 2106, and a basis for including the combined information 2108. The output position information (such as region_horizontal_position and region_vertical_position) outputs the converted bitmap image to the corresponding position on the graphics plane (GP) 1750.

The rendering information 2102 renders style information such as the width, height, foreground color, background color, font name, and font size of the region. As described above, the combination information 2108 indicates the start time and end time of the play, the horizontal and vertical position information of the window area, and the like, wherein the title is output on the graphics plane (GP) 1750 in the window area.

FIG. 22 is a diagram for explaining a flow of rendering a text subtitle stream 220 in a reproducing apparatus 1700 (shown in FIG. 17) according to an embodiment of the present invention.

Referring to FIGS. 22, 21 and 8, the window region specified by using region_horizontal_position, region_vertical_position, region_width, and region_height is specified as an area in which the title is displayed on a graphics plane (GP) 1750, where region_horizontal_position, region_vertical_position, region_width The region_height is location information 830 for defining a window region of the title of the DSU. The bitmap image of the rendered dialogue is displayed from the start point position specified by region_horizontal_position and region_vertical_position, where region_horizontal_position and region_vertical_position are output positions 840 of the dialog in the window region.

Meanwhile, the reproducing apparatus stores the style information (style_id) selected by the user in the system temporary storage area according to the present invention. Figure 23 is a representation of the present invention The embodiment illustrates a schematic diagram of an example state register configured to reproduce a text subtitle data stream in an example regenerative device.

Referring to FIG. 23, the status register (play status register, hereinafter referred to as PSRs) stores the style information selected by the user in the 12th register (the style 2310 has been selected). Therefore, for example, if the user presses the style information change button even after the menu device or other operation is performed by the reproducing device 1700 (as shown in FIG. 17), the style information previously selected by the user is first applied by referring to the PSR 12. The register that stores the information will be changed.

The method of reproducing the caption data stream 220 based on the above-described recording medium for recording the caption data stream 220 and the reproducing device of the reproduced text subtitle stream 220 will be described below with reference to FIG. 24 is a flow diagram of a method of reproducing a text subtitle data stream 220 in accordance with an embodiment of the present invention.

In step 2410, the text subtitle stream 220 including the DSU information and the DPU information is read from the storage medium 230 (shown in FIG. 2), and in step 2420, based on the rendering included in the DSU information. The information will include the title text in the DPU information converted into a bitmap image. In step 2430, the converted bitmap image is output on the screen according to the time information and the location information, wherein the time information and the location information are combined information included in the DPU information.

As described above, the present invention provides a storage medium that stores a stream of text subtitle data separately from image data. The present invention also provides a reproducing apparatus and a method of reproducing the streaming of the text subtitle data, so that the creation of the subtitle data and the editing of the created subtitle data can be made easier. At the same time, because not Limit the number of subtitle data items, so titles in several languages are available.

In addition, since the subtitle data is formed by one style information item and a plurality of play information items, the output style applied to all the play materials can be defined in advance and can be changed in various ways, and the inline information of the enhanced title portion can also be defined. The style can be changed with the user.

Furthermore, by using a plurality of adjacent playback information items, continuous reproduction of the title can be turned on and the fade in/out effect can be implemented using this.

The present invention can be implemented as a program code on a computer readable recording medium, which can be read by a general computer. The computer readable recording medium includes various recording media that can store computer readable materials, including magnetic storage media (such as ROM, floppy disk, hard disk), optical storage media (such as CD-ROM, DVD), and The carrier wave (that is, transmitted over the Internet), and the computer readable recording medium can be shared in the computer system through the network and can be stored and executed in a distributed manner.

While the present invention has been described in its preferred embodiments, it is not intended to limit the invention, and may be modified and modified by those skilled in the art without departing from the spirit and scope of the invention. For example, the text subtitle data can be recorded separately from the AV material using any computer readable medium or data storage device. In addition, the text subtitle data can be configured in different manners as shown in FIGS. 3 and 4. Furthermore, the reproducing apparatus of Fig. 17 can be implemented as a part of the recording apparatus or as a single apparatus for performing recording and/or reproducing functions. Similarly, the CPU can be implemented as a firmware-based chip or a general purpose or special purpose stylized computer to perform the method described in FIG. Therefore, the scope of protection of the present invention is not limited to the disclosed embodiments, and the scope of the patent application is attached. The definition is final.

100‧‧‧Multimedia data structure

110‧‧‧ editing

112‧‧‧AV data stream

114‧‧‧ Clipping information

120‧‧‧Playlist

122‧‧‧Playing project

130‧‧‧ Movie objects

140‧‧‧Table of contents

202‧‧‧Video Streaming

204‧‧‧ audio streaming

206‧‧‧Play graphics stream

208‧‧‧ interactive graphics streaming

210‧‧‧AV data stream

220‧‧‧Text subtitles

230‧‧‧Storage media

310‧‧‧dialog style unit (DSU)

320, 330, 340‧‧‧ dialog presentation units (DPU)

350‧‧‧PES packets

362‧‧‧Transport packets (TP)

410‧‧‧DSU

420‧‧‧DPU

610‧‧‧ palette collection

620‧‧‧Regional style collection

622‧‧‧Regional Information

624‧‧‧Text style information

626‧‧‧Users can change the style collection

710‧‧‧Regional style

820‧‧‧Regional style

830‧‧‧Regional Information

840‧‧‧Text style information

850‧‧‧Users can change the style collection

860‧‧‧ palette collection

910, 940‧‧‧ editing information files

1110‧‧‧Time Information

1120‧‧‧ Palette Reference Information

1130‧‧‧Dialog area information

1132‧‧‧ Style Reference Information

1134‧‧‧Dialog text information

1210‧‧‧Time Information

1220‧‧‧ palette collection

1230‧‧‧Dialog area information

1232‧‧‧ Style Reference Information

1234‧‧‧Dialog text

1250‧‧‧Time Information

1260‧‧‧Color update flag

1270‧‧‧Color palette collection

1280‧‧‧Dialog area information

1282‧‧‧ Style Reference Information

1284‧‧‧Dialog text information

1410‧‧‧Inline style information

1420‧‧‧Dialog text

1700‧‧‧Regeneration device

1710‧‧‧Subtitle preloading buffer (SPB)

1712‧‧‧font preloading buffer (FPB)

1730‧‧‧Text Subtitle Decoder

1732‧‧‧Text screen processor

1734‧‧‧dialog composition buffer (DCB)

1736‧‧‧Dialog buffer (DB)

1738‧‧‧Text subtitle conversion (rendering)

1740‧‧‧Dialog Play Controller

1742‧‧‧ bitmap object buffer (BOB)

1750‧‧‧graphic plane (GP)

1760‧‧‧color look-up table (CLUT)

1 is a schematic diagram for explaining a structure of a multimedia material recorded on a storage medium according to an embodiment of the present invention.

FIG. 2 is a schematic diagram showing an example data structure of the clip AV stream and the text subtitle stream of FIG. 1 according to an embodiment of the invention.

FIG. 3 is a schematic diagram of a data structure for explaining a text subtitle stream according to an embodiment of the present invention.

4 is a schematic diagram showing a text subtitle stream having the data structure of FIG. 3, in accordance with an embodiment of the present invention.

FIG. 5 is a schematic diagram of the dialog style unit of FIG. 3 according to an embodiment of the invention.

6 is a schematic diagram of an exemplary data structure for explaining a dialog style unit in accordance with an embodiment of the present invention.

FIG. 7 is a schematic diagram showing an example data structure of a dialog style unit according to another embodiment of the present invention.

FIG. 8 is a schematic diagram showing an example dialog style unit of FIG. 6 or FIG. 7 according to an embodiment of the invention.

9A and 9B are schematic diagrams showing exemplary clip information files including a plurality of font sets referenced by font information, in accordance with an embodiment of the present invention.

Figure 10 is a diagram showing the locations of several font files referenced by font file information (shown in Figures 9A and 9B).

FIG. 11 is a schematic diagram showing an example data structure of the dialog playing unit of FIG. 3 according to another embodiment of the present invention.

12A and 12B are diagrams for explaining an example data structure of the dialog playing unit of FIG. 3 according to another embodiment of the present invention.

FIG. 13 is a schematic diagram of the dialog playing unit in FIG. 11 to FIG. 12B according to an embodiment of the invention.

Figure 14 is a diagram for explaining the structure of an example data of the dialog text information in Figure 13;

FIG. 15 is a schematic diagram showing the dialog text information of FIG. 13 according to an embodiment of the invention.

Figure 16 is a diagram for explaining the limitation of continuously reproducing continuous dialog presentation units (DPUs).

Figure 17 is a diagram for explaining an example reproducing apparatus for text subtitle streaming in accordance with an embodiment of the present invention.

Figure 18 is a diagram for explaining a preloading procedure of a text subtitle stream in an example reproducing apparatus in accordance with an embodiment of the present invention.

19 is a diagram for explaining a reproduction procedure of a dialog presentation unit (DPU) in an exemplary reproduction apparatus according to an embodiment of the present invention.

20 is a schematic diagram for explaining a procedure for synchronizing and outputting a text subtitle stream and animation data in an exemplary reproducing apparatus according to an embodiment of the present invention.

21 is a diagram for explaining a procedure of outputting a text subtitle stream to a screen in an example reproducing apparatus according to an embodiment of the present invention.

Figure 22 is a diagram for explaining a procedure for representing a text subtitle stream in an example reproducing apparatus according to an embodiment of the present invention.

23 is a schematic diagram of an example state register configured to reproduce a text subtitle stream in an example regenerative device, in accordance with an embodiment of the present invention.

24 is a flow chart of a method of reproducing a text subtitle stream in accordance with an embodiment of the present invention.

310‧‧‧dialog style unit (DSU)

320, 330, 340‧‧‧ dialog presentation units (DPU)

350‧‧‧PES packets

362‧‧‧Transport packets (TP)

Claims (6)

A storage medium includes: a video and audio material; and a text subtitle data for providing subtitles of the audio and video material, wherein the text subtitle data includes a plurality of dialog play units and a dialog style unit, and the dialog style unit defines use And outputting a style to the one of the dialog playing units, and each of the dialog playing units includes a dialog text information indicating a time information of the dialogue text information output time, and defining one of the colors of the dialog text information The board information, and a color update flag, is used to indicate whether only the palette information has changed when compared with a previous dialog playing unit. The storage medium of claim 1, wherein if the color update flag is set to "1", the palette information is used for outputting a previous dialog text message according to the previous dialog playback unit. . The storage medium of claim 1, wherein if the color update flag is set to "0", the palette information is used for outputting the dialog text information according to a current dialog playback unit. A device for reproducing data from a storage medium storing image data and text subtitle data, wherein an image is displayed on an image according to the image data, the device comprising: a video decoder for decoding the image data; a caption decoder for receiving the caption data, comprising a plurality of dialog play units and a dialog style unit, the dialog style unit Defining a set of output patterns for the dialog playing units, converting the dialog playing units into bitmap images according to the dialog style unit, and controlling the converted output of the dialog playing units and the decoded image data Synchronization, wherein each of the dialog playing units includes a dialog text message indicating a time information of the conversation text information output time, a palette information defining a color of the dialog text information, and a color update flag. The color update flag is used to indicate whether only the palette information has changed when compared to a previous dialog playback unit. The apparatus for reproducing data from a storage medium storing image data and text subtitle data as described in claim 4, wherein if the color update flag is set to "1", the subtitle decoder uses the color adjustment The board information is used for outputting a previous dialog text message according to the previous dialog playing unit. The apparatus for reproducing data from a storage medium storing image data and text subtitle data according to item 4 of the patent application, wherein if the color update flag is set to "0", the subtitle decoder uses the color adjustment The board information is used for outputting the dialog text information according to a current dialogue playing unit.