TWI320925B - Apparatus for reproducing data from a storge medium storing imige data and text-based subtitle data - Google Patents

Abstract

A storage medium storing a multimedia image stream and a text-based subtitle stream, and a reproducing apparatus and a reproducing method therefor are provided to reproduce the text-based subtitle data stream recorded separately from the multimedia image stream such that the subtitle data can be easily produced and edited and a caption can be provided in a plurality of languages. The storage medium stores: image data; and text-based subtitle data to display a caption on an image based on the image data, wherein the subtitle data includes: one style information item specifying an output style of the caption; and a plurality of presentation information items that are displaying units of the caption, and the subtitle data is separated and recorded separately from the image data. Accordingly, a caption can be provided in a plurality of languages, and can be easily produced and edited, and the output style of caption data can be changed in a variety of ways. In addition, part of a caption can be emphasized or a separate style that a user can change can be applied.

Description

16252pif.doc IX. Description of the Invention: [Technical Field] The present invention relates to a multimedia image reproduction, and more particularly to a storage medium for recording multimedia video stream and text subtitle stream and A reproduction device and a reproduction method for recording a text subtitle stream of the storage medium for reproduction. [Prior Art] In order to provide high-density multimedia images, video streaming, audio_streaming, playback of graphics streams providing subtitles, and interactive graphics streams that provide buttons and menus to interact with the user are multiplexed. The main stream is recorded and recorded on the storage medium, wherein the main stream is also known as the audio visual ''AV' data stream. In particular, the playback graphics stream providing the subtitle also provides the bitmap image for the sake of Display subtitles or titles on the image. In addition to its large size, the bitmap title data may have problems in the production of subtitles or title materials, and it is difficult to edit the created title data. This is because the title Data and other streams (such as video, audio and interactive graphics streams) - multiplexed. In addition, the other problem 曰S changes the output style of the title data in various ways, that is, ^, - The output style of the title is changed to another output style. " [Summary] The storage medium device and method for recording the text subtitle stream by the acupoints. (4) The text type stored here Reproduction of Curtain Data According to the purpose of the present invention, it is provided to display a title from a storage medium for storing image data and a storage medium of text 1320925 16252pif.doc font subtitles, which is used to display the title, the image of the ', ', and the image The upper part is used to decode the image data; the subtitle is converted into the bitmap image by the information of the ί type information, and the j is used to synchronize the output of the sample information with the decoded image data, and the two characters are the display unit. Style information. 鞠 徕 字幕 字幕 字幕 subtitle decoding transcoding and miscellaneous _ correction output subtitle data, which is covered by subtitles carefully ρ @又子式子幕 and μ (four) in the decoded image data. The message is a single device that completes the packetized elementary streams (PESs). The syntax analysis and processing of the ESs unit's information and style information is formed by a PES and counts the number of playback information items. The unit of PESs will be recorded in the style ί broadcast ^ and the sub-screen decoder will apply a style information item to play the education project. The playback information includes the content of the title. The word information and the control fines are exchanged by I, and the bitmap image obtained by the poor news is combined with Qfl' and the towel is controlled by reference to the combined information and the subtitles will control the time. The hole will specify one or more window areas where the window area 疋仏4 outputs the area on the screen, and the subtitle decoder will output the converted text information in one or more windows at the same time. *7 16252pif .doc in the combined information ^ bundle time on the global timeline ~ Mei information output start time and output knot is used in the broadcast enemy list, Yicheng 4 information, where the global time is fortunately, and the subtitle list is the image #料的再生单影像资料的轮出同步: _ 奂 text information output and decoded end time. ^八系碡 by reference output start time and turn out if the current playback of the next playback information item is out; the output end time of the item is the same as continuously reproducing the two playback information ^ time, then the subtitle decoder will be under A playback information force coder will reset the subtitle solution when the output start time and continuous reproduction are performed. , won't retain the interval buffer, and the style information is the output style set. The manufacturer of the human body is pre-defined and the shore is to ^ and the output style is wrong. The storage medium will change the information according to the style information and the subtitle decoder to the point. Array image. , ', after the broadcast of the information project, in addition to the text in the playback of the text to the text of the second and second guard and the decoder decoder application by the predefined absolute value of the straight text 925 925 16252pif.doc Partially, as inline style information. In addition, the style information includes a user-changeable style information, and after receiving a selection of a style from the user that can change the style information item, the subtitle decoder applies the predefined styles generated by the student. · Message, after applying the inline style information, and then applying the corresponding selection information to the user can change the style information item to the text. Sub-screen decoding benefits the relative value of the predefined font information in the style information item 预先 predefined by the manufacturer to the text, and the user can change the style information. If the storage medium allows for predefined style information defined in the playback device in addition to the style information predefined by the manufacturer, the subtitle stone will apply the predefined style information to the text. In addition, the style information includes a collection of color palettes to apply to the playback information, and the subtitle decoder converts all of the playback information items after the style information into bitmap images according to the color defined in the color palette. The playback information further includes a collection of color palettes and a color update flag, which is separated from the collection of color palettes included in the style information, and if the color update flag is set to "丨,, then, the subtitles The decoder will apply the set of color palettes included in the play tribute, and if the color update flag is set to 'the subtitle decoder will apply the original set of color palettes included in the style information. ^ By setting the color update flag to "1" and gradually changing the transparency value of the color palette included in the continuous play information item, the subtitle solution β is subjected to the fade in/out effect, and when the fade in/out effect is completed , the word 9 1320925 16252pif.doc The curtain decoder resets the color map (c〇l〇rl〇〇k-Up tabie, CLUT ) according to the original set of color palettes included in the style information. The style information includes area information indicating the position of the window area, which is used for the converted play information to be output on the image, and the font used to convert the play tribute into the bitmap image. And subtitle ===: area information and font information will be converted playback information set, it two packs ί at least one converted playback information output start bit or color, and the subtitles are solved:, replaced by bitmap image. The sub-heart compensating play Gongxun subtitle decoder reference font 栲宏一!, where the font broadcast case is included in the message: the attribute information of the recording unit for the font recognition greedy material., l,,, store image

And = subtitle decoding J decoder buffer subtitle data: the number of words in the language of the item, select information, and in the subtitle data ° θ (four) to receive the expected language screen material. , "Regeneration of the corresponding information to select the information of the word ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 252 The playback of the unit. And the style information of the output style of the extension. Once again - the purpose is to provide - a kind of storage Gu's department storage. Two if font subtitle data, which is used according to the image data basin; to 'the subtitle data includes: - a style information' output style; and number The playback information items, ;==福元元, and the subtitles (4) are separate from the (4) and other objects and advantages of the invention will be learned in detail below by the embodiments of the present invention.卫 丑 [Embodiment] 显易士二:: his purpose, features, and advantages can more clearly explain the following embodiment 'and with the drawings, for details F1 0, ?, Figure 1, according to the example implementation of the present invention An example storage medium (e.g., media 23G) is constructed in a multi-layered manner to manage the (four) volume data structure (10) on which the image stream is recorded. The multimedia data includes a clip 110, a playlist 120, a movie object 130 and a directory I β ", a medium 110 is a recording unit of a multimedia image, a playback unit for playing a clear multimedia image, and a movie object 13 〇 ^ The navigation command of the media image and the table of contents (10) is used to refer to the first movie object and the title of the movie object 13G. The clip 110 is implemented as an object, which includes a clip AV stream for audio and video (audio_visua丨, AV) data stream of a high-image 16252pif.doc movie and for corresponding to the AV data string. Streaming clip information 114. For example, ~T compresses AV data streams according to the M〇ti〇n picture EXperts Group (MPEG). However, in the present invention, the clip 11 does not need to compress the AV stream 112. In addition, the clip #114 includes the audio/video attribute of the AV stream 112, enters. The information of the position of the random access entry point is recorded in the entry point map by the unit of the predefined magnetic area. The play list 12A is a set of reproduction intervals of these clips 11〇, and is regarded as the play item 122. The movie object i3G It is the navigation, the main 1 ι (4) voyage according to the user's needs to start playing ΐ m =, between the electricity (four) 13G or management play the number is the top of the storage media table, the system Used to define the starting position of the second two early days, a record 14G includes all the titles and menus of the opening menu; two through the user operations (such as the title search storage media and menus. The table of contents 140 also includes the starting position and Set the information. The title and menu that are automatically regenerated in the first time are compressed and compiled in detail. The graph P knot: stream (10) and text subtitle string (4) 凊 refer to Figure 2, in order to solve the above point Question of the title data of the pattern 16252pif.doc The text subtitle stream 220 is provided in a separate manner from the clip AV data stream 210 recorded on the storage medium 230 in accordance with an embodiment of the present invention, such as a digital versatile disc (DVD). The stream 210 includes a video stream 202, an audio stream 204 for providing a play graphics stream 206 of subtitle data, and an interactive graphics stream 208 for providing buttons and menus for interacting with the user, and the stream is active The main stream is multiplexed and recorded in the storage medium 230, wherein the animated main stream is a well-known audio-visual (AV) data stream. The text subtitle data 220 is represented according to an embodiment of the present invention. The data for providing subtitles and titles of multimedia images is recorded in the storage medium 23' and is implemented using a markup language, such as Extensible Markup Language (XML). However, the subtitles of this multimedia image are The title is provided using two-bit data. Thereafter, using the two-bit data to provide subtitles of the multimedia image and the caption data 220 of the title is simply regarded as Text subtitle streaming, '. The playback graphics stream 206 for providing subtitle data also provides bitmap subtitle data to display subtitles (or titles) on the screen. Since the text subtitle stream 220 is an AV data string The stream 210 is recorded separately and is not multiplexed with the AV data stream 210, so the size of the text subtitle stream 220 is not limited thereto. Therefore, subtitles and titles can be provided in several languages, and further, the text type The subtitle stream 220 can be continuously reproduced and effectively edited without any difficulty. The text subtitle stream 220 is then converted into a bitmap image image, and the output overlays the multimedia image on the screen. In this way, the conversion of the text subtitles 16252pif.doc is considered to be the rendering of the image bitmap image. The text subtitle stream 220 includes the information required to render the title text. A text subtitle stream 220 including rendering information will be described in detail below in conjunction with FIG. FIG. 3 is a diagram showing the data structure of a text subtitle stream 220 in accordance with an embodiment of the present invention. Referring to FIG. 3, a text subtitle stream 220 includes a dialog style unit (DSU) 310 and a plurality of dialog presentation units (DPU) 320 to 340, in accordance with an embodiment of the present invention. DSU 310 and DPUs 320 through 340 can also be considered as dialog units. Each of the dialog units 310 to 340 forming the caption stream 220 is stored in the form of packetized elementary streams (PESs) or simply known PES packets 350. Similarly, the PES of the text-based caption stream 220 is recorded and transmitted in units of transport packets (TP) 362. A continuous TP can be viewed as a transport stream (TS). However, as shown in FIG. 2, the text subtitle stream 220 is not multiplexed with the AV material stream 210 and the separated TSs are recorded on the storage medium 230 in accordance with an embodiment of the present invention. Referring to Figure 3', a dialog unit is recorded in a PES packet 350 included in the caption stream 220. The text subtitle stream 22 includes a DSU 310 disposed in front and a plurality of DPUs 320 to 340 connected to the DSU 31A. The DSU 310 includes information describing the output style of the dialog displayed in the title of the screen, wherein the multimedia image is reproduced on this screen 16252pif.doc. In the meantime, a plurality of DPUs 320 to 340 include text information items on the content of the conversation to be displayed and information on the respective output items. 4 is a schematic diagram of a text subtitle stream 220 having the data structure of FIG. 3, in accordance with an embodiment of the present invention. Referring to FIG. 4', the caption stream 220 includes a dsu 410 and a plurality of DPUs 420. In an exemplary embodiment of the invention, several DPUs are defined as num_of_dialog-presentation_units. However, several DPUs are not specified separately. The example case uses a syntax like while(processed_length<end_of_life). The data structure of the DSU and DPU will be described in detail in conjunction with FIG. 5. Figure $ is a diagram showing the dialog style unit of Figure 3 in accordance with an embodiment of the present invention. Referring to FIG. 5, a set of dialog-styleset() 510' defining a dialog style information item is defined in the DSU 310 in which an output style information item of a dialog to be displayed as a title is assembled. The DSU 310 includes information on the position of the area of the dialog in the title, information required to render the dialog, information on the style that the user can control, and the like. The details will be explained below. 6 is a schematic diagram showing an example data structure of a dialog style unit (DSU) according to an embodiment of the present invention. Referring to FIG. 6, the DSU 310 includes a palette set collection 610 and a region style set 620. The palette set 61 is a collection of color palettes that define the colors used in the title. 1320925 I6252pif.doc The color combinations and color information (such as transparency) included in the palette set 610 can be applied to all of the DPUs that are configured after the DSU.

A region style collection (regi〇n styie c〇iiecti〇n) 620 is a collection of output style information for the respective conversations that form the title. Each region style includes area information 622 indicating the location of the dialog displayed on the screen, text style information 624 indicating the output style to be applied to each dialog text, and a user changeable style collection indicating the style. 626, wherein the user can arbitrarily change the style applied to each dialog text. Figure 7 is a diagram for explaining an example data structure of a dialog style unit in accordance with another embodiment of the present invention. Referring to Figure 7, the difference from Figure 6 is that there is no set of palettes. That is, the color palette set is not defined in the DSU M0, but the palette set 610 is defined in the DPUs described in FIGS. 12A and 12B. The data structure of each of the area patterns 710 is the same as that described in FIG. structure.

FIG. 8 is a schematic diagram showing an example dialog style unit of FIG. 6 or FIG. 7 according to an embodiment of the invention. Referring to Figures 8 and 6, DSU 310 includes palettes 860 and 610 and a plurality of zone patterns 82A and 62B. As mentioned above, palette set 610 is a collection of color palettes that are used to define the colors used in the title. The color combinations and color lags (such as transparency) included in the palette set 610 can be applied to all of the DPUs that are configured after the DSU. 16252pif.doc Meanwhile, each of the area patterns 820 and 620 includes area information 83〇 and 622' which indicates information on the window area, wherein the title ^ in the window area is displayed on the screen, and the area information 830 and 622 includes X, γ. The information of the window area such as the width of the person and the background color of the seat is displayed in the window area to be displayed on the screen. Similarly, parent region styles 820 and 620 include text styles 840 and 624' which indicate the output style to be applied to each dialog text. That is, the X, Y coordinates, the output direction (for example, left to right or top to bottom), the order, the line, the interval, the font identification word to be referred to, and the font style to be displayed in the position of the above-mentioned window area. (e.g., bold or italic = font size and font color information, etc. Again, each of the region styles 820 and 620 also includes user-changeable style sets 850 and 626, which indicate a style that the user can arbitrarily change. = However, the user can change the style set 85 〇 and 626 is not necessary: the user can change the (4) set 85Q and 626 can include the window area position, the text output position, the word in the text output style information items 840 and 624 ^ Change the information such as the size of the line interval. Each change information item can be expressed as in use, and the relative increase or decrease of the relevant information on the 弋4〇 and 625 should be the parent pair of 63⁄4' text. In total, there are three styles. Type of related information: style information (regi〇n-styie) 620 defined in the area φ θ 立 ', 620, inline style information (inline_Style) 151 used to strengthen the part of the second question. (Explained later) By The style information (user-changeable_style) 850 can be changed, and the order in which the information items are applied is as follows: 16252pif.doc 1) Basically, the area style information 620 defined in the area style is applied. If Y is wired within the style information, then the inline style information 丨 510 is applied to overlay the portion of the regional style information application and to enhance the portion of the title text. ~ 3) If there is a user who can change the style information 85G ’, then the last application will be applied. The user can change the presentation of the style information is not necessary. Meanwhile, among the text style information items 840 and 624 to be applied to each of the dialog words, the font file information by the font (f〇nt_id) 842 can be defined as follows. > Figure 9A is a schematic diagram showing an example clip information file gw including a plurality of font sets referenced by the font information 842 of Figure 8 in accordance with an embodiment of the present invention. Referring to FIG. 9A, FIG. 8, FIG. 2 and FIG. 1, according to the present invention, StreamCodingInf0〇930 includes various information recorded on a stream of a storage medium, wherein StreamCodingInfo() 930 refers to information included in the clip. Streaming encoded information structures in files 910 and 11〇. That is to say, the information on the streaming stream 202, the audio streaming, the playing graphics stream, the interactive graphics string, and the streaming text of the text subtitles are included. In particular, it includes a message (textST_language_code) 932 to display the title % language, which is related to the text gas subtitle stream 220. Similarly, the file name 936 and the file name 938 of the file storage font information may be defined, which corresponds to the font-ids 842 and 934 of the identification words of the fonts in Fig. 8 which are to be referred to. A method for finding a font file of a character to be referred to with a font defined herein will be described in detail with reference to FIG. 16252pif.doc Figure 9B is a diagram showing an exemplary clip information archive 940 including a plurality of font sets referenced by the font information 842 of Figure 8 in accordance with another embodiment of the present invention. Referring to FIG. 9β, the structure ClipInfoO is defined in the clip information files 910 and no. In this structure, a plurality of font sets referenced by the font information 842 in FIG. 8 are defined. That is, the corresponding font-id 842 is specified. The child file name 952, where f〇nt_id 842 indicates the wealth to be referred to and displayed in the font of Fig. 8. The method for finding the font file of the character to be referred to with the font defined herein will be DETAILED DESCRIPTION Fig. 10 is a diagram showing the positions of a plurality of font files exemplified by the font file names 938 and 952 in Figs. 9A and 9B. "Eye is shown in Fig. 1" in accordance with an embodiment of the present invention. The directory structure of ^. In particular, because of the directory structure, it is easy to find the location of the font file, such as lllu f〇nt 1〇1〇 or 99999 f(10) 1〇2〇 stored in the AUXDATA directory. Meanwhile, the structure of the DPU forming the dialog unit will be combined with the schematic diagram of the first example data structure of the "other RS, Η 4 1 丨 卞 卞 π π Μ 猓 另 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 。 3' includes text information that wants to turn out the content of the conversation, indicating that the _ color of the dialogue area to be referred to is to be tested on the screen to be output on the screen... Domain 1130. In particular, 'for the pair to be output on the screen 16252pif.doc = dialog area information U3G includes an output sample indicating the application to be applied to the dialog = style ii information 1132 and the text indicating the actual output on the screen of the glory • ~ 0 tongue text machine 1134. In this case, it is assumed by the palette References • The set of color palettes indicated by the stomach K1120 is defined in the DSU (please refer to 610 of FIG. 6). FIG. 12A is a schematic diagram for explaining an example data structure of the DPU 320 according to an embodiment of the present invention. § Poor Please refer to FIG. 12A and FIG. 3, the DPU 320 includes a time information 丨2丨Q for defining a dialogue time to be outputted in the flash, a color palette set, a color palette, a set mo, and a The dialogue on the camp is in the area of Gongzhi 1230. In the case, the palette set 122 is not defined in the DSU as in FIG. 11, but will be directly defined in the DPU 320. Meanwhile, FIG. 12B is a diagram for explaining the DPU 320 of FIG. 3 according to an embodiment of the present invention. Schematic of the example data structure. Referring to Figure 12B, the DPU 320 includes time information 125 指示 for the time to output the live activity on the screen, a color update flag 126 〇, when the color % update flag is set to 1 The desired color palette set 1270 is used for the dialog area information to be outputted on the screen. In this case, the color palette set 1270 is also defined in the DSU as shown in FIG. In the DPU 320. In particular, 'in order to indicate the use of continuous reproduction of fade in/out, in addition to the basic palette defined in the DSU, the palette set 1270 used to represent fade in/out is defined in the DPU 320 and the color The update flag 1260 will be set forth in detail with reference to Figure 19. Figure 13 is a schematic illustration of the 20 16252 pif.doc DPU 320 of Figures 11 through 12B, in accordance with an embodiment of the present invention. Figure 12A and Figure 12B, DTO The dialog start time information (dialog_strat_PTS) and the dialog end time information (dialog_end_PTS) 1310 are used as time information indicating the time for the dialog to be output on the screen. Similarly, the dialog palette identification word (dialog_palette_id) is included. The color palette reference information 1120. In the case of FIG. 12A, the color palette set 122A can be included in place of the palette reference information 1120. The dialog text information (regi〇n-subtitle) 1334 is included as the dialog area information 1230 for the dialog to be output, and also includes the area style identification word (region_style_id) 1332 in order to indicate the output pattern applied thereto. The example in Fig. 13 is only an embodiment of the DPU and the DPU having the data structure as shown in Figs. 11 to 12B can be modified in various ways. Figure 14 is a diagram for explaining an example data structure of the dialog text information (region_subtitle) in Figure 13 . Referring to Fig. 14, the dialog text information (1134 of Fig. 11, 1234 of Fig. 12A, 1284 of Fig. 12B, and 1334 of Fig. 13) includes inline information 1410 and dialog text 1420 as output patterns to enhance the dialogue. FIG. 15 is a schematic diagram of the dialog text information 1334 of FIG. 13 according to an embodiment of the invention. As shown in Fig. 15, the dialog text information 1334 is composed of inline_style 1510 and text_string 1520. Similarly, the information indicating the end of the inline pattern is included in the embodiment of Fig. 15. Unless the end of the inline style is defined, the specified inline style may be applied afterwards, as opposed to the one set by the 1320925 16252pif.doc manufacturer. Meanwhile, Fig. 16 is a diagram for explaining the limitation of continuously reproducing the continuous dialog presentation units (DPUs). Referring to Fig. 16 and Fig. 13', when it is necessary to continuously reproduce the above several DPIjs, the following restrictions are required.

1) When the dialog object starts to be output on the graphic plane (GP), the dialog start time information (dialog_start_PTS) 1310 defined in the DPU will indicate a time 'graphic plane (GP) will be matched below Figure π is described in detail. 2) The dialog start time information (dialog_start_PTS) defined in DI>U 1310 indicates a time to reset the text sub-picture decoder for processing the text subtitles. The text subtitle decoder will be described in detail below with reference to FIG. .

3) When it is necessary to continuously reproduce the above several DPUs, the dialog end time information (dialog_end_PTS) of the current DPU should be the same as the dialog start time information (dial〇g_start_pTs) of the next continuously reproduced DPU. That is, in Fig. 16, in order to continuously reproduce DPU #2 and DPU #3, the session end time information included in DPU #2 should be identical to the dialog start time information included in DPU #3. The best among them is that the DSU according to the present invention satisfies the following limitations. 1) The text subtitle stream 220 includes a DSU. 2) Several user-changeable style information items (user_contr〇l_style) included in all regional styles (regi〇n sty le ) should be the same. In the meantime, the DPU according to the present invention satisfies the following limitations. 22 1320925 16252pif.doc 1) The window area for at least two titles should be defined. The structure of an exemplary reproducing apparatus based on the material structure of the caption stream 220 recorded on the storage medium according to an embodiment of the present invention will be described below with reference to FIG. Figure 17 is a diagram for explaining an example reproducing apparatus for text subtitle streaming in accordance with an embodiment of the present invention.

Referring to Fig. 17, a reproducing apparatus 1700 (so-called recording and reproducing apparatus) includes a buffer unit and a caption decoder 173A. The buffer unit includes a font preload buffer (FPB) 1712 for storing a child volume slot and a subtitle preloading buffer (SPB) for storing a text subtitle file. 1710, and the text subtitle decoder 1730 is configured to decode and reproduce the text subtitle stream previously recorded in the storage medium by using a graphics piane (1750 and color look-up table (CLUT) 1760 as an output. .

In particular, the subtitle preloading buffer (SPB) 1710 preloads the text subtitle data stream 22, and the font preloading buffer (FPB) 1712 preloads the font information. The text subtitle decoder 1730 includes a text screen processor 1732, a dialog composition buffer (DCB) 1734, a dialog buffer (DB) 1736, a text subtitle conversion device 1738, The dialog playback controller 1740 and a bitmap object buffer (BOB) 1742. The text screen processor 1732 receives the text subtitle stream 23 1320925 16252pif.doc 220 from the subtiting preloading buffer (SPB) 1710, converts the above information about the information included in the DSU, and includes the pattern included in the DPU. The dialog outputs time information to the dialog array buffer (DCB) 1734 and converts the dialog message information included in the DPU to a dialog buffer (DB) 1736.

The live play controller 1740 controls the text subtitle rendering device 1738 by using a pattern regarding information included in the dialog c缓冲器mpositi〇n buffer (DCB) 1734, and outputs by using a dialog. The time information is used to control the time of the bitmap image for the bitmap object buffer (OBO) Π 42 to be output to the graphics plane (GP) 1750.

In accordance with the control of the dialog playback controller 1740, the text-based captioning device 1738 converts the dialog text information (i.e., performs rendering) into a bitmap image, which is applied to the font preload buffer ( Font preloading buffer, FPB) The 1712 preloaded font asset item corresponds to the font information item of the dialog text information stored in the dialog buffer (diai〇g buffer, DB) 1736 to the dialog text information. The rendered bitmap image is stored in the bitmap object buffer (OBO) 1742 and output to the graphics plane (GP) 1750 according to the control of the dialog playback control state 1740. At this time, the color specified in the DSU is applied by referring to a color look-up table (CLUT) Π60. The information defined by the manufacturer at the DSU can be used as style-related information applied to the dialog text, and the style-related information pre-defined by the user can also be applied. The reproducing apparatus 1700 shown in Fig. 17 applies the user-defined style information in preference to the style-related information defined by the manufacturer 24 1320925 16252 pif.doc.

As shown in FIG. 8 'region-style information defined by the manufacturer in the DSU (region-Style) is basically applied to the style-related information applied to the dialog text, and if the inline style information (inine_style) is included in the DPU The DPU includes the dialog text of the application area style information, and the inline style information (inline_style) is applied to the corresponding part. Similarly, if the manufacturer additionally defines that the user can change the style in the DSU and one of the user-defined user changeable styles is selected, the area style or inline style is applied, and then the user can finally apply Change the information. Similarly, as described in Fig. 15, it is preferable that the information indicating the end of the application inline style is included in the content of the inline style. Furthermore, the manufacturer can indicate whether style-related information defined in the reproduction device itself can be used, which is separate from the style-related information defined by the manufacturer and recorded on the storage medium.

Figure 18 is a schematic illustration of a preloading procedure for a text subtitle stream 22 in an example playback device 1700 (e.g., as shown in Figure 17) in accordance with an embodiment of the present invention. Referring to Figure 18, the caption stream 220 shown in Figure 2 is defined in the sub-path of the playlist. In the sub-path, a plurality of text subtitle streams 220 of a plurality of δ wu 5 can be defined. Similarly, the font file applied to the text subtitles can be defined in the clip information file 910 or 940 as shown in Figs. Up to 255 text subtitle streams 220 that may be included in a storage medium may be defined in each playlist. Similarly, it is also possible to define up to 255 font files 25 1320925 16252pif.doc included in a storage medium. However, in order to ensure uninterrupted playback, the size of the text subtitle stream 22〇 should be less than or equal to the reproduction device 1700 (eg The size of the preload buffer 1710 shown in FIG. • Fig. 19 is a schematic diagram for explaining a reproduction procedure of a DPU in an exemplary reproduction apparatus according to an embodiment of the present invention. Referring to FIG. 19, FIG. 13, and FIG. 17, the flow of reproducing the DPU is shown. The playback controller 1740 controls the time for a rendering dialogue to be output on the graphics plane (Grass Plane, GP), which is started by using a dialog that specifies the output time 1310 of the conversation included in the DPU. Time information (dialog_start_PTS) and session end time information (dialog_end_PTS). At this time, when the conversion of the bitmap image of the bitmap object buffer (BOB) 1742 to the graphics plane (GP) 1750 is completed, the bitmap object is slowed down. A bitmap object buffer (BOB) 1742 is included in the text subtitle decoder 1730, and the dialog start time information specifies a time. That is, if the dialog start time of % in the DPU is defined, the bitmap information required to construct the dialog after completing the conversion of the information to the graphics plane (GP) 1750 is ready to be used. Similarly, when the regenerative DPU is completed, the dialog end time information is specified for a time. At this time, the text subtitle decoder 1730 and the graphics plane (GP) 1750 are reset. Best: Yes, regardless of whether it is continuously reproduced in the buffer of the text subtitle decoder 1730 (such as a bitmap object buffer (BOB) 1742), it will also be at the start time and end time of the DPU. Between being reset. 26 1320925 16252pif.doc However, when several DPUs are required for continuous reproduction, the text subtitle decoding state 1730 and the graphics plane (GP) 1750 are not reset and stored in each buffer (like a dialog arrangement buffer). Dialog

Composition buffer, DCB) 1734, dialog buffer (DB) 1736 and bitmap object buffer (OBO) 1742) will remain. That is, when the session end time information of the currently regenerated dpu is the same as the session start time information of the DPU which is continuously reproduced later, then the contents of each buffer are retained without being reset. In particular, there is a fade-in/fade-out effect as a continuous reproduction example in which several DPUs are applied. The fade in/out effect can be implemented by changing the color look-up table (CLUT) 1760 of the bitmap object, where the bitmap object is converted to a graphics plane (graphics piane, 〇ρ) 1750. That is, the first DPU includes combined information such as color, style, and output time ^ and subsequent consecutive DPUs have the same composition as the first DPU, but only the color palette information is updated. Here, _ towel, by

The color information project gradually changes the transparency (from 〇% to 1〇〇%) to achieve the fade in/out effect. Fire In particular, when using the data structure of the DPU as shown in Fig. 12B, the fade in/out effect can be effectively implemented using the color update flag 126. That is, if the dialogue play control (4) 丨 check money confirmation is included in the ^ color update flag · is set to, 〇,,, that is, if it is generally not required to fade / fade out the effect of # shot, then Basically, the color included in 1^740 =^ DSU will be used. However, if the dialog playback controller checks and confirms, it is included in the _ towel_color update flag 1260 is set to 27 1320925 16252pif.doc is "1"" If the fade in/out effect is required, the fade in/out effect is implemented by using the color information 1270 (instead of the color information in the DSU shown in FIG. 6). At this time, the fade in/out effect is simply implemented by adjusting the transparency of the color information 1270 included in the DPU. • After displaying the fade in/out effect, it is best to update the color look-up table (CLUT) 1760 to the original color information included in the DSU. This is because unless the color map (c〇1〇r l〇ok-叩table, CLUT) 1760 is updated, once the specified color information can be linked, the application is continued, contrary to the manufacturer's expectations. Figure 20 is a schematic diagram showing a procedure for character stream streaming and moving steps and outputs in an exemplary reproducing apparatus in accordance with an embodiment of the present invention.

Referring to FIG. 2 〇 'the dialogue of the DPU included in the text subtitle data stream 220, the time information and the dialogue end time information should be defined to use the time point on the global time axis in the play, month f, in order to communicate with the multimedia. The output time of the AV data stream of the image is synchronized. Therefore, the discontinuity between the system time dock (STC) of the stream stream and the dialog output time (PTS) of the text subtitle stream 220 can be avoided. Figure 21 is a diagram for explaining a procedure for inputting a stream of a subtitle stream to a screen in an exemplary reproducing apparatus according to an embodiment of the present invention. Month>", ® 21 displays the flow of applying the rendering information 21〇1 including the style-related information, the flow of the text information 2140 into the bitmap image 2106, and the basis for inclusion in the combined information 2· 28 1320925 16252pif.doc The output position information (such as region_horizontal_p〇sition and region_vertical_position) outputs the converted bitmap image to the corresponding position on the graphics plane (GP) 1750.

The rendering information 2102 renders style information such as the width, height, foreground color, background color, font name, and font size of the region. As described above, the combined information 2108 indicates the start time and end time of the play, the horizontal and vertical position information of the window area, and the like, wherein the title is output on the graphics plane (GP) 1750 in the window area. Figure 22 is a diagram for explaining the flow of rendering a text subtitle stream 220 in a reproducing apparatus 1700 (shown in Figure 17) in accordance with an embodiment of the present invention. Referring to FIGS. 22, 21 and 8, the window area specified by region-horizontal-position, region_vertical_position, region_width, and region_height is specified as an area in which the title is displayed on the graphics plane (GP) 1750, where region_horizontal_position The region_vertical_position, region_width, and region_height are position information 830 for defining a window region of the title of the DSU. The bitmap image of the rendered dialogue is displayed from the start point position specified by region_horizontal_position and region_vertical_position, where region_horizontal_position and region_vertical_position are the output positions 840 of the dialog in the viewport region. In the meantime, the reproducing apparatus stores the style information (style_id) selected by the user in the system temporary storage area according to the present invention. FIG. 23 is a diagram showing an exemplary state register of an example regenerative device stream for reproducing text subtitle data according to the present invention. FIG. 23 is a diagram of a team of complaints. (Playback status register, the following 1 is called PSRs) Stores the sample 2 (style 2310) selected by the (4) in the 12th register. Therefore, for example, if the user even '°, test 12 to apply. The temporary storage of stored information will be changed. The method of reproducing the text subtitle data "22G re-lined and re-characterized data stream 220" according to the above-mentioned recording media subtitle data stream DO will be described below with reference to Fig. 24. Fig. 24^ The method of text subtitle data streaming coffee ^ In step 2410, from the storage medium 23 () (as shown in the figure = then the information and the text of the subtitles (10) stream 22 〇, ^ in the step period, according to the included coffee The conversion of the asset () (4) converts the title text included in the coffee message into a bitmap image. In step 2430, according to the time information and the location information, the converted bitmap image is displayed on the screen, wherein The time information and the location information are combined information included in the DPU information. As described above, the invention provides a storage medium that stores the text subtitles and the video material separately from the image. It also provides a reproduction device to reproduce the text subtitle data string. For example, it is easier to reduce the material of the reduction screen and edit the subtitle data. At the same time, because there is no 16252pif.doc limit= The title. xU is defined by a style information item and several broadcasts: it can be changed in the way of output to all play data, and can also define the inline and user-changeable styles that enhance the title file.连择::廿:t Use several adjacent playback information items to open the continuous reproduction of the title and make it possible to implement the fade/fade effect. The code can be made into a computer-readable code. The computer readable recording medium includes various types of recording media, and the computer readable recording medium includes magnetic, φη«<-γ-) 乂 and carrier (ie, through the Internet) Transmission), which can be used to share and read computer readable codes in a computer system through a network. The invention has been disclosed above in the preferred embodiment, but it is not used for Those skilled in the art can make some changes and refinements in the spirit of the present invention. For example, any "recording device" can be used to configure the text subtitle data in the same manner. Further, the subtitle data can be realized as a device for recording and/or reproducing the recording device by means of a reproducing device of no, part or 17 as shown in Figs. 3 and 4. The scope of a similar stylized computer for the purpose of the general purpose or specific purpose is not limited to the method disclosed. The invention is therefore to be construed as being limited by the scope of the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram for explaining a structure of a multimedia material recorded on a storage medium according to an embodiment of the present invention. 2 is a schematic diagram showing an exemplary lean structure of the clip AV stream and the text subtitle stream of FIG. 1 according to an embodiment of the present invention.

3 is a schematic diagram of a data structure for explaining a text subtitle stream according to an embodiment of the present invention. 4 is a schematic diagram showing a text subtitle stream having the data structure of FIG. 3, in accordance with an embodiment of the present invention. FIG. 5 is a schematic diagram of the dialog style unit of FIG. 3 according to an embodiment of the invention. Fig. 6 is a schematic diagram for explaining a sample material structure of a dialog style unit according to an embodiment of the present invention. Figure 7 is a diagram for explaining an example data structure of a dialog style unit in accordance with another embodiment of the present invention.

FIG. 8 is a schematic diagram showing an example dialog style unit of FIG. 6 or FIG. 7 according to an embodiment of the invention. 9A and 9B are diagrams showing exemplary clip information files including a plurality of font sets referenced by font information, in accordance with an embodiment of the present invention. Figure 10 is a diagram showing the locations of several font files referenced by font file information (shown in Figures 9A and 9B). FIG. 11 is a schematic diagram showing an example data structure of the dialog playing unit of FIG. 3 according to another embodiment of the present invention. 32 1320925 16252pif.doc FIGS. 12A and 12B are diagrams for explaining an example data structure of the dialog playing unit of FIG. 3 according to another embodiment of the present invention. FIG. 13 is a schematic diagram showing the dialog playing unit of FIG. 11 to FIG. 12B according to an embodiment of the present invention. Figure 14 is a diagram for explaining an example data structure of the dialog text information in Figure 13; Figure 15 is a diagram showing the dialog text information of Figure π, in accordance with an embodiment of the present invention. Figure 16 is a diagram for explaining the limitation of continuously reproducing the dialog presentation units (DpUs). Figure 7 is a schematic diagram for explaining an example reproducing apparatus for text subtitle streaming in accordance with an embodiment of the present invention. Figure 18 is a diagram for explaining a preloading procedure of the Chinese subtitle stream in the example reproducing apparatus according to an embodiment of the present invention. Figure 9 is a diagram for explaining a re-spraying of a visual presentation unit (DPU) in an exemplary reproducing apparatus according to an embodiment of the present invention. The intention of the order. Figure 20 is a diagram for explaining a procedure for synchronizing and outputting a text subtitle stream and an animation data in an exemplary reproducing apparatus according to an embodiment of the present invention. Fig. 21 is a schematic diagram for explaining a procedure for outputting a text-drying sub-screen stream to a screen in an example reproducing apparatus according to an embodiment of the present invention. Figure 22 is a diagram for explaining a procedure for representing a text subtitle stream in an exemplary reproducing apparatus in accordance with an embodiment of the present invention. 33 1320925 16252pif.doc FIG. 23 is a diagram showing an exemplary state register for reproducing a text subtitle stream in an example reproduction device, in accordance with an embodiment of the present invention. Figure 24 is a flow diagram of a method of reproducing a text subtitle stream in accordance with an embodiment of the present invention. [Main component symbol description] 1〇〇: Multimedia material structure 110: Clip

112: AV data stream 114: Clip information 120 • Playlist 122: Play item 130: Movie object 140: Table of contents 202: Video stream 204: Audio stream 206: Play graphics stream 208: Interactive graphics stream 210: AV data stream 220: text subtitle data 230: storage medium 310 • diij〇g styie unit (DSU) 320, 330, 340: dialogue play unit (dial) g presentation units (DPU) 350 : PES Packet 34 1320925 16252pif.doc 362: transport packets (TP)

410 : DSU

420 : DPU 610 : Palette Collection 620 : Area Style Collection 622 : Area Information 624 : Text Style Information

626: User can change style collection 710: Area style 820: Area style 830: Area information 840: Text style information 850: User can change style collection 860: Palette collection 910, 940: Clip information file 1110: Time information

1120 : Palette Reference Information 1130 : Conversation Area Information 1132 : Style Reference Information 1134 : Conversational Text Information 1210 : Time Information 1220 : Palette Collection 1230 : Conversation Area Information 1232 : Style Reference Information 35 1320925 16252pif.doc

1234: Conversational text information 1250: Time information 1260: Color update flag 1270: Color palette collection 1280: Conversation area information 12 8 2 . Style reference information 1284: Conversational text information 1410: Inline style information 1420: Conversation text 1700 : Reproduction device subtitle preloading buffer (SPB) font preloading buffer (FPB) 1730: text subtitle decoder 1732: text screen processor 1734: dialog arrangement buffer ( Dialog composition buffer, DCB) 1736. Pair of tongue buffers (diai〇g buffer, DB) 1738 • Text subtitle conversion (rendering) device 1740: dialog playback controller 1742 'bitmap object buffer (bitmap object buffer, BOB ) 175 〇 · graphics plane ( GP ) 1760 · color comparison table (c〇i〇ri〇〇k-up table, CLUT ) 36

Claims (1)

For the Chinese patent scope No. 94105743, there is no slash correction. The date of this amendment: 98 years of the month of the month of 1998, application for the patent garden, · repair:; ι, the device for reproducing data, the library of two materials and text subtitles The media title, the device includes: an image according to the image data display:::=r the shadow-"and a dialog playback unit and a pair of the text subtitle data, including Lu convert the dialog playback unit into a message The style unit where =: two has: code image data synchronization, specify the dialogue output to - a kind of text used in the dialogue, and a time output information on the screen, the message, the Ι ϊ ϊ ί ί ί ί ί Style information and - palette palette information package = two-word round-out style, the meaning of the use of _^ color * palette, the color palette fixed color, and ~ heart 'the dialogue of the The text is less colored on the screen. A color picker selects the set of the plurality of color palettes to be outputted to the screen = the text type for the corresponding dialogue _ receives the forest image data and Text decoding and the image data, The caption decoder screen material, and recording the text word decoded image on the storage medium. The subtitle data is overlaid on the subtitle data in the 37. 3. As described in claim 2, item 2 The device for reproducing data from a storage medium storing image subtitles, wherein the dialog playing unit and the dialog pattern unit are formed by a unit of packetized elementary streams (PESs), and the subtitle decoding is performed. In the PESs, the unit towel syntax analysis and the unit and the dialogue style unit. f words play, 4. such as the cap patent · the third rhyme description (four) save the image subtitles of the reservoir body regeneration (four) device again = The subtitle decoder buffers the text and the device for reproducing data from the storage medium of the storage material as described in the third paragraph of the patent application scope:: In the text items: : 生者二 38 IS