TW201009820A - A storage medium and an apparatus for reproducing data from a storage medium storing audio-visual data and text-based subtitle data - Google Patents

Abstract

A storage medium storing a multimedia image stream and a text-based subtitle stream, and a reproducing apparatus and a reproducing method therefor are provided to reproduce the text-based subtitle data stream recorded separately from the multimedia image stream such that the subtitle data can be easily produced and edited and a caption can be provided in a plurality of languages. The storage medium stores: image data; and text-based subtitle data to display a caption on an image based on the image data, wherein the subtitle data includes: one style information item specifying an output style of the caption; and a plurality of presentation information items that are displaying units of the caption, and the subtitle data is separated and recorded separately from the image data. Accordingly, a caption can be provided in a plurality of languages, and can be easily produced and edited, and the output style of caption data can be changed in a variety of ways. In addition, part of a caption can be emphasized or a separate style that a user can change can be applied.

Description

201009820 ioz^zi^-pif.doc VI. Description of the Invention: [Technical Field] The present invention relates to a multimedia image reproduction, and in particular to a method for recording a multimedia video stream and a text subtitle string A streaming storage medium and a reproducing device and a reproducing method for reproducing a text subtitle stream recorded on the storage medium. [Prior Art] In order to provide high-density multimedia images, video streaming, audio streaming, playback of graphics streams providing subtitles, and interactive graphics streams that provide buttons and menus to interact with the user are multiplexed. The main stream is recorded on a storage medium, which is known as an audio visual "AV" data stream. In particular, the playback graphics stream that provides subtitles also provides bitmap images for displaying subtitles or titles on the image. In addition to its large size, bitmap title data can be problematic in the production of subtitles or title material and it can be quite difficult to edit the title material that has been created. This is because the header data is multiplexed with other streaming data (such as video, θ, and interactive graphics streams). Furthermore, another problem is that the output style of the title material cannot be changed in various ways, that is, the output style of one title cannot be changed to another output style. SUMMARY OF THE INVENTION An object of the present invention is to provide a storage medium for recording a text subtitle stream, and a reproducing apparatus and method for reproducing text subtitle data recorded on the storage medium. SUMMARY OF THE INVENTION It is an object of the present invention to provide an apparatus for reproducing data from a storage medium storing image data and text 201009820. 1 υ, ώ j^-x>-pif.d〇C font subtitles. Data to display the title, the device includes: a video decoder, = for decoding image data; and a subtitle decoding H, which is used to convert the broadcast information into a bitmap image and control the converted information. The output is synchronized with the decoded image data, wherein the text data scoop is the style information of the single title, the broadcast capital, and the sensitive title of the title. The subtitle decoder decodes the text recorded separately from the image data. ❹ Outputs the subtitle data, which covers the subtitle data on the decoded image (4). The style information and the play information are formed by the units of the packetized elementary streams (PESs), and the subtitle decoding II parses and processes the style information in the PESs unit = play information. The style information is formed by a PES and recorded in the front part of the subtitle data, and several playback information items will be based on the unit information of the PESs, and the subtitles will be used to play the information items. In addition, the +aa poor news includes text information indicating the content of the title and the combined negative output of the bitmap image output obtained by converting the text information, and the towel is outputted by referring to the touch information. The subtitle decoder controls this time. = One or more window areas ‘where the window area 疋 is output on the screen, and the subtitles are decoded, and the converted text information is output in one or more windows at the same time. 201009820 i〇zDz-i>-pif.doc The output start time of the playback information in the port information defines the inter-slope information on the global_axis, where all the two are used in the sharp list towel' The sharp list is the same as the data of the image data: 7L 'and the output of the wheel image data of the converted text information is synchronized when the subtitle is decoded, and the output time is output by the reference output and the output end time of the currently reproduced playback information item. When the output start time of the next playback information item is the same, the subtitle decoding crying continuously reproduces the two playback information items. If the next playback information does not require continuous reproduction, the subtitle decoder will reset the interval buffer between the output start time and the output end time, and if continuous reproduction is required, the interval buffer will be retained. Set. The style information is a collection of output styles, and the output style is pre-defined by the manufacturer of the storage medium and applied to the playback information, and the subtitle decoder converts the playback information items recorded to the bitmap information according to the style information to the bitmap image. . In addition, the text information in the playback information includes the text to be converted into the bitmap image and the inline style information to be applied to the unique portion of the text' and the subtitle decoder application is unique by the inline style information of the application text. Partially provides a function to enhance the text portion by style information predefined by the manufacturer. The subtitle decoder applies a relative value of the pre-defined font information or a portion of the pre-defined absolute value included in the style information predefined by the manufacturer to the text 201009820 as the inline style information. In addition, the style information further includes the user can change the style information, and & after receiving the selection information of one of the style information items from the user, the 'subtitle decoder applies the predefined style information generated by the student' The inline style information is applied, and the user who last applies the corresponding selection information can change the style information item to the text. The subtitle decoder applies the relative value of the pre-defined font information among the style information items predefined by the manufacturer to the text, and the user can change the style information. If the storage medium allows for predefined style information defined in the playback device in addition to the style information predefined by the manufacturer, the subtitle maser will apply the predefined style information to the text. ~ In addition, the 'style information includes a collection of color palettes to apply to the broadcast information, and the subtitle decoder converts all of the play information items after the style information into bitmap images according to the color defined in the color palette. The play information further includes a set of color palettes and a color update flag, which are separated from the set of color palettes included in the style information, and if the color update flag is set to "1", the subtitle is decoded. The set of color palettes included in the playback information is applied, and if the color update flag is set to "0", the subtitle decoder applies the original set of color palettes included in the style information. By setting the color update flag to "1" and gradually changing the transparency value of the color palette included in the continuously played information item, the subtitle gramper is implemented as a fade in/out effect, and when the fade in/out effect is completed At the time, the word 201009820 will solve the color comparison table (c〇l〇rl〇〇k-Up tabie, CLUT) according to the original set of color palettes included in the style information. The area information indicating the position of the window area 'is used for the converted play information to be outputted on the image' and the font required for converting the broadcast information into the bitmap image The subtitle decoder converts the converted playback information into a bitmap image by using the area information and the font information. The font information includes an output start position, an output direction, a sort, a line interval, and a font of at least one converted play information. Recognition word, font size, or color, and the subtitle decoder converts the playback information into a bitmap image according to the font information. - Subtitle 2 code H reference word on the ride (4) * Information as font recognition in the font file included in the clip In information (4), it is the attribute information of the recording unit that stores the image assets. = Outside 'Subtitle decoding before the reproduction of the shadow material ^ Buffered subtitle data i and the font file referenced by the subtitle decoder. The storage medium records several words in several languages. When the screen is decoded, the expected language is received from the time: the screen data; and the words corresponding to the selected information are reproduced in the towel of the sub-screen data item.

The method for reproducing materials and text is based on the method, including: unpacking the image data, and reading the sample according to the style, bribe playing the money into a dot matrix 201009820 -jJ-pif.doc image; and controlling The output of the converted play information and the decoded stone image data step/, the Chinese sub-type data include the play information indicating the unit displaying the title and the style information of the output style of the specified title. Another purpose of the month is to provide a storage medium for storing: image breeding; and text subtitle data, which is used to display a title on the image according to the image data, and the subtitle data includes: - a style information, It is used to refer to the output style of the title; and several playback information items, which are the units of the title, and the subtitles (4) are separated from the image data and recorded separately. Other objects and advantages of the present invention will be described in detail below and are obtained by the embodiments of the present invention. The above and other objects, features, and advantages of the present invention will become more apparent and understood. δ _, , , , FIG. 1, a storage medium (such as the media 230 shown in FIG. 2) is configured in a multi-layer manner to manage the multimedia material structure 100 recorded in the video stream according to an exemplary embodiment of the present invention. The multimedia material misconfiguration 100 includes a clip 110, a playlist 120, a movie object 13 and a record unit in the directory f 140 J, a recording unit for multimedia images, a playback unit for playing early morning multimedia images, and a movie object 130 including a reproduction media. The navigation command of the image and the table of contents 14G are used to specify the title of the first regenerated electrical object and the movie object 130. The clip m will be reduced, the object, its package _ _ high image 201009820 10Z3Z-JLf-pif.doc audio-visual video (audio-visual, AV) data stream clip AV stream and used to correspond to this The clip information 114 of the AV data stream. For example, the AV data stream can be compressed according to, for example, Motion Picture Experts Group (MPEG). However, this clip 110 does not require compression of the AV data stream 112 for purposes of the present invention. In addition, the clip information 114 includes the audio/video attributes of the AV material stream 112, the entry point map, etc. wherein the information about the position of the random access entry point is recorded in the entry point map with the unit defining the magnetic area. The playlist 120 is a set of playback intervals of these clips 11〇, and ❿ each playback interval is regarded as a play item 122. The movie object 130 is constructed by a navigation program and the navigation programs start playback of the list 120 according to the user's needs, exchange between the movie objects 130, or manage the reproduction of the play list 120. The table of contents 140 is the table at the top of the storage medium, which is used to define a plurality of titles and menus ' and the table of contents 140 includes the start position information of all the titles and menus so that the reproduction can be performed by the user (such as title search or The selection is simply called the selected title and menu. The table of contents 140 also includes the start position information of the title and menu that are automatically reproduced for the first time when the storage medium is placed on the reproducing apparatus. In these items, the data structure of the clip AV stream of the compression-encoded multimedia image will be described in detail in conjunction with FIG. FIG. 2 is a schematic diagram showing an exemplary data structure of the AV data stream 210 and the text subtitle stream 220 of FIG. 1 according to an embodiment of the present invention. Referring to FIG. 2', in order to solve the above problem with the header data 10 201009820 of the dot pattern, the text subtitle stream 220 is separated from the clip AV data stream 210 recorded on the storage medium 230 according to an embodiment of the present invention. Mode & for 'digital versatile disc (DVD). The AV data stream 21 includes a video stream 202, an audio stream 204 for providing a playback graphics stream 206 of subtitle data, and an interactive graphics stream 208 for providing buttons and menus for interacting with the user, and the string The stream is multiplexed in the animation main stream and recorded in the storage medium 230, wherein the active stream is a well-known audio-visual (AV) data stream. According to an embodiment of the present invention, the caption data 220 indicates that the subtitle and title data for providing the multimedia image is recorded in the storage medium 23, and is implemented using a markup language, such as an Extensible Markup Language (Extensible Markup Language, XML). However, the subtitles and titles of the multimedia image are provided by using two-bit data. Thereafter, using the two-bit data to provide subtitles of the multimedia image and the caption text of the caption 220 is simply regarded as, the text subtitle stream, . The playback graphics stream 206 for providing subtitle data also provides bitmap subtitle data to display subtitles (or titles) on the screen. Since the text subtitle stream 220 is recorded separately from the AV material stream 210 and is not multiplexed with the AV material stream 210, the size of the text subtitle stream 220 is not limited thereto. Therefore, subtitles and titles can be provided in several languages. Further, the text subtitle stream 220 can be continuously reproduced and efficiently edited without any difficulty. The text subtitle stream 220 is then converted into a bitmap image image, and the multimedia image is overlaid on the screen. This converts text subtitles 11 201009820.

丄 υ厶 j‘rL^pif, d〇G The process of image-based bitmap image processing is regarded as rendering. The text sub-screen stream 220 includes the information needed to render the title text. A text subtitle stream 220 including rendering information will be described in detail below in conjunction with FIG. FIG. 3 is a diagram showing the data structure of a text subtitle stream 220 in accordance with an embodiment of the present invention. Referring to FIG. 3, a text subtitle stream 22〇 includes a dialog style unit (DSU) 310 and a plurality of dialog presentation units (DPU) 320 to 340 according to an embodiment of the present invention. ❹ DSU 310 and DPUs 320 through 340 can also be considered as dialog units. Each of the dialog units 31A through 340 forming the caption stream 220 is stored in the form of packetized elementary streams (PESs) or simply known PES packets 350. Similarly, the PES of the text-based caption stream 220 is recorded and transmitted in units of tranSp〇rt packets (TP) 362. The continuous τρ can be regarded as a transport stream (TS). However, as shown in FIG. 2, the text subtitle string stream 220 will not be multiplexed with the AV material stream 210 and will record a separate TS on the storage medium 230 in accordance with an embodiment of the present invention. Referring to FIG. 3, a dialog unit is recorded in a PES packet 350 included in the text subtitle stream 220. The text subtitle stream 22 includes a DSU 310 disposed in front and a plurality of DPUs 320 through 340 connected to the DSIJ 310. The DSU 310 includes information describing the output style of the dialog displayed in the title of the screen, wherein the multimedia image is reproduced on this screen 12 201009820 . In the meantime, a plurality of DPUs 320 to 340 include text information items in the dialog to be displayed and information on the respective output items. 4 is a schematic diagram of a text subtitle stream 220 having the data selection of FIG. 3 in accordance with an embodiment of the present invention. The '° ' 凊 知 , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , In an exemplary embodiment of the invention, several DPUs are defined as num_of_dialog_presentation_units. However, several Dpus will not be specifically pointed. The case of the example is to use a syntax like while(processed_length<end_of-life). The data structure of the DSU and DPU will be described in detail in conjunction with FIG. 5. Figure 5 is a schematic illustration of the dialog style unit of Figure 3, in accordance with an embodiment of the present invention. Referring to Fig. 5', a set of dialog stylesets 510' defining a dialog style information item in the DSU 310 is set in which an output style information item of a dialog to be displayed as a title is assembled. The DSU 310 includes information showing the position of the area in which the dialog is displayed in the title, information required to render the dialog, information on the style that the user can control, and the like. The details will be explained below. 6 is a schematic diagram showing an example data structure of a dialog style unit (DSU) according to an embodiment of the present invention. Referring to FIG. 6, the DSU 310 includes a palette collection 610 and an area style collection 620. The palette set 610 is a collection of color palettes that are used to define the colors used in the title. 13 201009820 iozDz-u-pif.doc The color combinations and color information (such as transparency) included in palette set 610 can be applied to all of the DPUs that are configured after the DSU. A region style collection 620 is a collection of output style information for the respective conversations that form the title. Each region style includes area information 622 indicating the location of the dialog displayed on the screen, text style information 624 indicating the output style to be applied to each dialog text, and a user changeable style set to indicate the style (user changeable) Styie collection ) 626, where the user can arbitrarily change the style applied to each dialog text. Figure 7 is a diagram for explaining an example data structure of a dialog style unit in accordance with another embodiment of the present invention. Referring to Fig. 7', unlike FIG. 6, the palette set 610 is not included. That is, the color palette set is not defined in the DSU 310, but the palette set 610 is defined in the DPU _ described in FIGS. 12A and 12B. The data structure of each of the area patterns 710 is the same as that of the data structure described in FIG. 6. FIG. 8 is a schematic diagram showing the example dialog style unit of FIG. 6 or FIG. 7 according to an embodiment of the present invention. Referring to Figures 8 and 6, DSU 310 includes palette sets 860 and 610 and a plurality of regional styles 820 and 620. As mentioned above, palette set 610 is a collection of color palettes that are used to define the colors used in the title. The color combinations and color information (such as transparency) included in the palette set 610 can be applied to all of the DPUs configured after the DSU. 14 201009820 ιυ '以-i>pifd〇c, each of the area styles 820 and 620 includes area information 83〇 and 622, which indicates information on the window area, wherein the title in the window area is to be displayed on the screen, and the area Information 830 and 622 include information on window areas such as χ, γ coordinates, width, and high background color, where the window area is not on the screen. Similarly, each of the regional styles 820 and 62 includes text style information detail and 624' indicating the output style to be applied to each dialog text. That is, the X, Υ coordinates, the output direction (for example, left to right or top to bottom), the sorting, the line spacing, the font identification word to be referred to, and the font style (for example, the position of the dialog text to be displayed in the above-mentioned window area) (for example) Blackbody or italic), font size and font color information, and more. Moreover, each of the regional styles 82A and 620 also includes user-changeable style sets 850 and 626' which indicate a style that the user can arbitrarily change. However, it is not necessary for the user to change the style sets 85〇 and 626. The user changeable style sets 85 〇 and 626 may include text output style information items 840 and 624, such as window area position, text output position, word line spacing, and the like. Each change information item can be represented as a relative increase or decrease in the associated information on output styles 840 and 625 for each dialog text. In summary, there are three types of style-related information: style information (region_style) 620 defined in the area styles 820 and 620, and _style information (inline-style) 151G (explained later) for enhancing the part of the title. And the user can change the style information (Shen Shen-gw, and the order in which the information item is applied is as follows: _ 15 201009820 io/D2-L>-pif.doc 1) Basically 'apply the area style defined in the area style 620. Gongbei § 2) If the style information is wired, the inline style information l5i〇 is applied to cover the part of the area style information application, and the title text is strengthened. 3) If there is a user who can change the style information 850, then this information is last. The user can change the presentation of the style information is not necessary. In the meantime, among the text style information items 840 and 624 to be applied to each dialog text, the font file information determined by the identification word of the font (font_id) 842 can be defined as follows. Figure 9A is a diagram showing an example clip information file 91A including a plurality of font sets referenced by the font information 842 of Figure 8 in accordance with an embodiment of the present invention. Referring to FIG. 9A, FIG. 8, FIG. 2 and FIG. 1, according to the present invention, various information recorded on a stream of a storage medium is included in StreamCodingInfo() 930, wherein StreamCodingInfo() 930 is included in the clip information file 910. And the stream encoding information structure in 110. That is, information including video stream 202, audio stream, playback graphics stream, interactive graphics stream, and text subtitle stream. In particular, it includes language information (textST_language_code) 932 for which a title is to be displayed, which is related to the text subtitle stream 220. Similarly, the font name 936 and the file name 938 of the file storage font information can be defined, which corresponds to the font_ids 842 and 934 indicating the identification words of the fonts to be displayed in Fig. 8. A method for finding a font file of an identification word to be referred to with a font defined herein will be described in detail in conjunction with FIG. 201009820 .

1 υζ, Jz,-i)-pif.d〇C FIG. 9A illustrates an exemplary fried information slot 940 including a plurality of font sets referenced by the font information 842 of FIG. $ according to another embodiment of the present invention. schematic diagram. Referring to Fig. 9B', the structure ClipInfo() is defined in the clip information files 91A and 110. A plurality of font sets referenced by the font information 842 in Fig. 8 are defined in this structure. That is, 'specifically designate the font file name 952 corresponding to f0nt__i (i842, where font_id 842 indicates the identification word to be referred to and displayed in the font of Fig. 8. The font file for finding the identification word of the font β to be defined herein is defined. The method will be described in detail below. Fig. 10 is a diagram showing the positions of several font files referenced by the font file names 938 and 952 in Figs. 9A and 9B. ^ Referring to Fig. 10', the display is shown in accordance with an embodiment of the present invention. The directory structure of the files recorded on the multimedia. In particular, because of the directory structure, it is easy to find the location of the font file, such as lllll.font 1010 or 99999 font 1020 stored in the AUXDATA directory. The structure of the DPU of the dialog unit will be described in detail with reference to Fig. 11. Fig. 11 is a schematic diagram showing the structure of an example data of the Dpu 320 of Fig. 3 according to another embodiment of the present invention. Referring to Fig. 11 and Fig. 3, The DPU 320 for outputting the text information of the conversation content and displaying the information on the time includes a time indicating the time for outputting the conversation time on the screen. 1110. The palette reference information 1120 of the color palette to be referred to is specifically used and the dialog area information 1130 for rotating in the camping session. In particular, it is used for the pair to be turned out in the honor screen. The dialog area information 1130 of the 201009820 102^2-u-pif.doc statement includes the round-out style reference information 1132 to be applied to the dialog and the dialog text information 1134 indicating that the actual output is on the screen. In this case, It is assumed that the set of color palettes indicated by the palette information 1120 is defined in the DSU (see 610 of Figure 6). In less detail, Figure 12A is an illustration of an example of the DPU 320 of Figure 3 in accordance with an embodiment of the present invention. Referring to FIG. 12A and FIG. 3, the DPU 320 includes time information 1210 indicating that a dialog time is to be output on the screen, a palette set 1220 defining a color palette set, and for outputting on the screen. The dialog area information 1230 of the dialog. In this case, the palette set 122 is not defined in the DSU as in Fig. 11, but is directly defined in the DPU 320. Meanwhile, Fig. 12B is used to Embodiment of the present invention A schematic diagram of an example data structure of the DPU 320 in Fig. 3. Referring to Figure 12B, the DPU 320 includes time information 1250 indicating the time for the dialogue to be output on the screen, a color update flag 1260, and a color & update flag setting. The color palette set required for 1! 27〇 and the dialog area information for the dialogue to be output on the screen. 28 In this case, the color palette set 1270 is also defined in Figure 11. In the DSU, and stored in the DPU 320. In particular, in order to indicate the use of continuous fade in/out, in addition to the basic palette defined in the DSU, the palette set 1270 used to represent fade in/out is defined in the DPU 320 and the color update flag 1260 Will be set to 1. This will be described in detail in conjunction with FIG. Figure 13 is a diagram showing the 18 201009820 of Figures 11 to 12B in accordance with an embodiment of the present invention.

1 υζ. JZ,-jJ-plf.d〇C DPU 320 schematic. Referring to FIG. 13, FIG. 11, FIG. 12A and FIG. 12B, the DPU includes dialog start time information (dialog_strat_PTS) and dialog end time information (dialog_end_PTS) 1310 as time information indicating the time for the dialogue to be output on the screen. 1110. Similarly, the dialog palette identification word (dialog_palette_id) is included as palette reference information 112. In the case of Figure 12A, the color palette set 1220 can be included in place of the palette reference information 1120. The dialog text information (region_subtitle) 1334 is included as dialog area information 1230 for the dialog to be output, and also includes a region style recognize word (region_style_id) 1332 in order to indicate the output style applied thereto. The example in Fig. 13 is only an embodiment of the DPU and the Dpu having the data structure as shown in Figs. 11 to 12B can be modified in various ways. Figure 14 is a diagram for explaining the structure of an example data of the region-subtitle of Figure 13; Referring to Fig. 14' dialog text information (1134 of Fig. u, 1234 of Fig. 12A, 1284 of Fig. 12B, and 1334 of Fig. 13), the inline information 1410 and the dialog text 1420 are included as output patterns to enhance the dialogue. Figure 15 is a schematic illustration of the dialog text information 1334 of Figure 13 in accordance with an embodiment of the present invention. As shown in Fig. 15, the dialog text information 1334 is implemented by inline style information (inline_style) 1510 and dialog text (text_string) 152〇. Likewise, it is preferred that the information indicating the end of the inline style is included in the embodiment of Fig. 15. Unless the end of the inline style is defined, the inline style will be applied afterwards, as opposed to the one set by the 201009820 i o/^^'U-pif.doc manufacturer. Meanwhile, Fig. 16 is a diagram for explaining the limitation of continuously reproducing the continuous dialog presentation units (DPUs). Referring to Fig. 16 and Fig. 13', when it is necessary to continuously reproduce the above several Dpus, the following restrictions are required. 1) When the 3⁄4 dialog object starts to be output on the graphics plane (graphic piane, 〇ρ), the dialog start time information (dialog-start-PTS) defined in the DPU 1310 will indicate a time, the graphics plane (graphk plane, GP) The details will be described below in conjunction with FIG. ❹ 2) Define the dialog start time information (dialog-start-PTS) in the DPU 1310 to indicate a time to reset the text subtitle decoder for processing the text subtitles, wherein the text subtitle decoder will be combined with FIG. 17 below. Detailed description. 3) When it is necessary to continuously reproduce the above several dpus, the current Dpu session end time information (dialog-end-PTS) should be the same as the dialog start time information of the next continuously reproduced DPU. That is, in Fig. 16, in order to continuously reproduce 〇1 >11#2 and 1)1)11#3, the session end time information included in DPU #2 should be the same as the conversation included in I3PU #3. Time information. In the meantime, it is preferable that the DSU according to the present invention satisfies the following limitations. 1) The text subtitle stream 220 includes a DSU. 2) Several user-changeable style information items (user_contr〇l_style) included in all regional styles (regi〇n_styie) should be the same. In the meantime, the DPU according to the present invention satisfies the following limitations. 20 201009820 x v^-^^-J-pif.doc 1:) The window area for at least two titles should be defined. The structure of an exemplary reproducing apparatus recorded in accordance with the present invention in the data structure of the bribe-type subtitle stream 220 will be described below with reference to FIG. Figure 17 is a diagram for explaining an example reproducing apparatus for text subtitle streaming in accordance with an embodiment of the present invention. Referring to Fig. 17, a reproducing apparatus Π00 (so-called recording and reproducing apparatus) includes a buffer unit and a caption decoder 1730. The buffer unit includes a font preload buffer (FPB) 1712 for storing a child broadcast and a subtitle preloading buffer (SPB) for storing a text subtitle file. 1710, and the text subtitle decoder 1730 is used for decoding and reproducing the text subtitles previously recorded in the storage medium by means of a graphics 〇ρ 175 color and a color look-up table (CLUT) 1760. Stream as an output. In particular, the subtitle preloading buffer (SPB) 1710 preloads the text subtitle data stream 220 and the font preloading buffer (FPB) 1712 preloads the font information. The text subtitle decoder 1730 includes a text screen processor 1732, a dialog composition buffer (DCB) 1734, a dialog buffer (DB) 1736, a text subtitle conversion device 1738, and a dialog play. Controller 1740 and bitmap object buffer (BOB) 1742. The text screen processor 1732 receives the text subtitle data stream 21 from the subtitle preloading buffer (SPB) 1710. 201009820 10Z) Z-JL^pifd〇c 220, converts the above information about the information included in the DSU. The style and the dialog output time information included in the DpU are converted to a dialog composition buffer (DCB) 1734 and the dialog text information included in the DPU is converted to a dialog buffer (DB) 1736. The dialog play controller 1740 controls the caption rendering device 1738 by using a pattern regarding information included in the dialog composition buffer (DCB) 1734, and controls the output of the time information by using the dialog. It is used to render the bitmap image of the bitmap object buffer (OBO) 1742 at the time of output to the graphics plane (GP) 1750. In accordance with the control of the dialog playback controller 1740, the text-based captioning device 1738 converts the dialog text information (i.e., performs rendering) into a bitmap image, which is applied to the font preload buffer ( Font preloading buffer, FPB) The 1712 preloaded font information item corresponds to the font information item of the dialog text information stored in the dialog buffer (DB) 1736 to the dialog text information. The rendered bitmap image is stored in bitmap object buffer (OBO) 1742 and output to the graphics plane (graphiCs plane, GP) 1750 according to the control of dialog playback controller 1740. At this time, the color specified in the DSU is applied by referring to the color comparison table (c〇l〇r l〇〇k-up table, CLUT) 1760. The information defined by the manufacturer at the DSU can be used as style-related information applied to the dialog text, and the style-related information pre-defined by the user can also be applied. The reproduction device 17 shown in Fig. 17 applies the user-defined style information in advance of the style-related information defined by the manufacturer. As shown in Figure 8, the region style information (regi〇n_style) defined by the manufacturer in the DSU is basically applied to the style of the text applied to the dialog.

Off information' and if the inline-style information (inine-style) is included in the j)PU, where the DPU includes the dialog text of the application area style information, the inline style information (inline_style) is applied to the corresponding part. Similarly, if the manufacturer additionally defines that the user can change the style in Dsu and one of the user-defined user-changeable styles is selected, the area style or inline style is applied, and then the user can finally apply Change the information. Similarly, as described in Fig. 15, it is preferable that the information indicating the end of the application inline style is included in the content of the inline style. Furthermore, the manufacturer can indicate whether it is possible to use the style information defined in the reproduction device itself, which is separate from the style-related information defined by the manufacturer and recorded on the storage medium. 1700 (for example, as shown in Figure 17) Chinese character subtitle stream 22〇

255 Font Files FIG. 18 is a diagram for explaining an example reproduction device 201009820 i〇z^/-iJ-pif.doc according to an embodiment of the present invention. However, to ensure uninterrupted playback, the size of the text subtitle stream 22〇 should be less than or equal to the size of the preload buffer Π 10 of the reproducing device 17 (e.g., as shown in FIG. 17). Figure 19 is a diagram for explaining a reproduction procedure of a DPU in an exemplary reproduction apparatus according to an embodiment of the present invention. Referring to Fig. 19, Fig. 13, and Fig. pi, the flow of reproducing j)pu is shown. The playback controller 1740 controls the time for the rendering dialogue to be output on the graphics plane plane, GP) 1750, by using the pair of start time information (dialog) specifying the output time of the dialog included in the DPU (dialog) A start-PTS) and dialog end time information (dialog-end-PTS). At this time, when the conversion is stored in the bitmap object buffer (BOB) 1 42 of the rendered dialogue bitmap image to the graphics plane (GP) 1750, where the bitmap The object buffer (BB) is included in the text subtitle decoder 1730, and the session start time information is specified for a time. That is, if the dialog start time is defined in the DPU, the bitmap information required to construct the dialog after completing the conversion of the information to the graphics plane (GP) 1750 is ready to be used. Similarly, when the regenerative DPU is completed, the dialog end time information is specified for a time. At this time, the caption decoder 173A and the graphics plane (GP) 1750 are reset. The best 疋', whether it is continuously reproduced in the text subtitle decoder 1730 buffer (like the bitmap object buffer (BOB) 1742) will also be between the start and end times of the DPU. Was reset. 24 201009820 . 1 ν^^^,-jJ-pif.doc However, when several DPUs are required for continuous reproduction, the text subtitle decoder 1730 and the graphics plane (GP) 1750 are not reset and stored in Each buffer (such as a dialog array buffer (DCB) 1734, a dialog buffer (DB) 1736, and a bitmap object buffer (OBO) 1742) The content will be retained. That is, when the conversation end time information of the currently reproduced Dpu is the same as the conversation start time of the continuously reproduced DPU, then the contents of each buffer are retained without being reset. In particular, there is a fade in/out effect as a continuous reproduction example in which several Dpus are applied. The fade in/out effect can be implemented by changing the color l〇〇k-up table (CLUT) 1760 of the bitmap object, where the bitmap object is converted to a graphics plane (Gp) 175 Hey. That is, the first DPU includes combined information such as color, style, and output time, and subsequent consecutive DPUs have the same combination information as the first DPU, but only update the color palette information. In this case, the fade in/out effect is achieved by gradually changing the transparency (from 0°/. to 100%) in the color information item. In particular, when the data structure of the DPU shown in Fig. 12B is used, the lightening effect can be effectively implemented using the color update flag 1260. That is, if the dialog playback controller 174 checks and confirms that the color update flag 1260 included in the Dpu is set to, 〇,,, that is, if it is generally not necessary to fade in/out the effect, then The color information included in the DSU shown in Fig. 6 will be basically used. However, if the play controller 1740 checks and confirms that the color update flag 126 included in the DPU is 25 201009820 ιοζ^ζ-ij-pif.doc is "1", that is, if it is necessary to fade in/out For the effect, the fade in/out effect is implemented by using the color information 1270 (instead of the color information in the DSU shown in FIG. 6). At this time, the fade in/out effect is simply implemented by adjusting the transparency of the color information 1270 included in the DPU. After displaying the fade in/out effect, it is best to update the color look-up table (CLUT) 1760 to the original color information included in the DSU. This is because unless the color map is updated (c〇1〇r l〇〇k_up table, CLUT) 1760', once the specified color information can be applied continuously, contrary to the manufacturer's expectations. φ Figure 20 is a schematic diagram for explaining a procedure for synchronizing and outputting a text subtitle stream and an animation data in an exemplary reproducing apparatus according to an embodiment of the present invention. Referring to FIG. 20, the dialog start time information and the dialog end time information of the Dpu included in the text subtitle data stream 22〇 should be defined as the time point on the global time axis used in the playlist, so as to be associated with the AV of the multimedia image. The output time of the data stream is synchronized. Therefore, it is possible to avoid the discontinuity between the system time clock of the Av data stream (System time is also, π.) and the dialogue output time of the text subtitle stream 220 (dial 〇 〇 说 time time pTS). Figure 21 is a diagram for explaining a procedure for outputting a text subtitle stream to a screen in an exemplary reproducing apparatus according to an embodiment of the present invention. Referring to FIG. 21, the flow of the application of the rendering information 2101 including the style-related information, the flow of the text information 214, the conversion to the bitmap image 2106, and the basis for inclusion in the combined information employment 26 201009820 1 -i3 are shown. The output position information in -pif.doc (such as region_horizontal_p〇sition and _region_vertical_position) outputs the converted bitmap image to the corresponding position on the graphics plane (GP) 1750. The rendering information 2102 renders style information such as the width, height, foreground color, background color, font name, and font size of the region. As described above, the combined information 2108 indicates the start time and end time of the play, the horizontal and vertical position information of the window area, and the like, wherein the title is output on the graphics plane (GP) 1750 in the window area. Figure 22 is a diagram for explaining the flow of rendering a text subtitle stream 220 in a reproducing apparatus 17 (shown in Figure 17) in accordance with an embodiment of the present invention. Referring to FIGS. 22, 21 and 8, the window region specified by using region_horizontal_position, region_vertical_position, region_width, and region_height is specified as an area in which the title is displayed on a graphics plane (GP) 1750, where region_horizontal position, regi〇 N_vertical position, • region-width, and regi〇n_height are position information 830 for defining a window region of the title of the DSU. The bitmap image of the rendered dialogue is displayed from the starting point position specified by regi〇nJi〇rizontal_position and region-vertical_p〇siti〇n, where region-horizontal_p〇sition and regi〇n_vertical_position are window regions The output position of the middle conversation is 840. In the meantime, the reproduction device stores the style information (style_id) selected by the user in the system temporary storage area according to the present invention. FIG. 23 is a schematic diagram of the example reproduction device according to the present invention 27 201009820 l ooi>pif.doc The schematic diagram of the flow of the continuation of the stream is shown in Figure 23, and the state register is suspended. The user is stored in the following figure. Therefore, for example, the 2700 (as shown in FIG. 17) performs the menu call/device type information change button, and the user presses the sample before, and then presses the sample H Λ _ the temporary storage of the information 11 Will be changed. According to the above, the recording medium of the text subtitle data stream 22 () and the reproduction type caption data stream 220 have a reproduction device for reproducing the text subtitles. The method of string grabbing 220 will be described as follows. 2 is a flow diagram of a method of reproducing a text subtitle data stream 22() in accordance with an embodiment of the present invention. In step 2410, the text subtitle stream 22 including the DSU information and the DPU information is read from the storage medium 23 (shown as 2), and in step 2420, 'converting according to the inclusion in the Dsu information (rendering) The information will include the title text in the DPU information converted into a bitmap image. In step 2430, the converted bitmap image is output on the screen according to the time information and the location information, wherein the time information and the location information are combined information included in the DPU information. As described above, the present invention provides a storage medium that stores a stream of text subtitle data separately from image data. The present invention also provides a reproducing apparatus and a method of reproducing the stream of the subtitle data so that the creation of the subtitle data and the editing of the subtitle data can be made easier. At the same time, because 201009820. i oz jz-iJ-pif-doc limits the number of subtitle data items, it can provide _ language. In addition, since the subtitle data is formed by a style information information item, it is applied to all the playing materials. The formula can be defined in advance and can be changed in various ways, and the in-line information and the user can change the style in part (4). In addition, the domain can be used for continuous reduction and can be used to implement the fade in/out effect. The process of the present invention which can be implemented on a computer readable recording medium can be read by a general computer. Computer trackable pro-included all kinds of chain-storable computer-readable resources (four) recording miscellaneous '(four) readable recording media drop = storage media (such as R0M, floppy disk, hard disk), optical storage such as CD-ROM, DVD) and carrier (That is, through the Internet transmission (magic simultaneous 'computer-readable recording media can be shared in the computer system through the duck; can store and execute computer readable code in a decentralized manner.

The present invention has been described in its preferred embodiments as a matter of course, and is not intended to be a part of the invention. For example, the text subtitle data can be recorded with A using any computer readable medium or data storage device. In addition, the text subtitle data can be configured as shown in FIG. 3 and FIG. 4, and the reproducing device of FIG. 17 can be implemented as a heart of the recording device or a device for performing recording and/or reproducing Wei. U can be implemented as a wafer having a body or a general purpose or a specific purpose. The protection of the present invention is not limited to the disclosed embodiment, and the scope of the patent application is attached. 29 201009820 丄ooz-u-pif.doc is defined as follows. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram for explaining a structure of a multimedia material recorded on a storage medium according to an embodiment of the present invention. The embodiment of the present invention is a schematic diagram showing an example data structure of a clip AV stream and a text subtitle stream in FIG. 3. FIG. 3 is a schematic diagram of a data structure for explaining a text subtitle stream according to an embodiment of the present invention. 4 is a schematic diagram showing the data subtitle stream of FIG. 3 according to an embodiment of the present invention. FIG. 5 is a schematic diagram of the dialog style unit of FIG. 3 according to an embodiment of the present invention. Used to A schematic diagram of a structure of a dialog style example is described in accordance with an embodiment of the present invention. FIG. 7 is a schematic diagram of an exemplary data structure for explaining a dialog box according to another embodiment of the present invention. FIG. 8 is a diagram of a method according to the present invention. FIG. 9A and FIG. 7B are schematic diagrams showing an exemplary clip information file including a plurality of font sets referenced by a font reference according to an embodiment of the present invention. Figure 丨〇 is a schematic diagram showing the position of several font files referenced by Figures 9A and 9 by means of font file information. Figure 5 is a diagram for explaining the placement unit of Figure 3 according to another embodiment of the present invention. FIG. 12A and FIG. 12B are diagrams for explaining an example data structure of the dialog playing unit of FIG. 3 according to another embodiment of the present invention. FIG. 13 is a diagram showing an example of a structure of a dialog box according to another embodiment of the present invention. Figure η to Figure UB is a schematic diagram of the dialog playing unit. Figure 14 is a schematic diagram for explaining the example data structure of the dialog text information of Figure π_. Figure 15 is a diagram of the present invention. The embodiment shows a schematic diagram of the dialog text information of Fig. 13. Fig. 16 is a schematic diagram for explaining the limitation of continuously reproducing the continuous dialog presentation units (DPUs). The figure is for explaining according to an embodiment of the present invention. FIG. 18 is a schematic diagram showing a preloading procedure for a text subtitle stream in an example reproducing apparatus according to an embodiment of the present invention. FIG. DETAILED DESCRIPTION OF THE INVENTION A schematic diagram of a playback procedure of a dialog presentation unit (DPU) in an example playback device is illustrated. Figure 20 is a diagram for explaining a procedure for synchronizing and outputting a text subtitle stream and an animation data in an exemplary reproducing apparatus according to an embodiment of the present invention. Figure 21 is a diagram for explaining a procedure for outputting a text subtitle stream to a screen in an example reproducing apparatus according to an embodiment of the present invention. Figure 22 is a diagram for explaining a procedure for representing a text subtitle stream in an exemplary reproducing apparatus in accordance with an embodiment of the present invention. 31

201009820. 丄 OZ JZrL^pif.dOC FIG. 23A is a diagram showing an exemplary state register for reproducing a text subtitle stream in an example reproduction device according to an embodiment of the present invention. Figure 24 is a flow diagram of a method of reproducing a text subtitle stream in accordance with an embodiment of the present invention. [Main Component Symbol Description] 1〇〇: Multimedia Data Structure 110: Clip 112: AV Data Stream 114: Clip Information 120: Playlist 122: PlayItem 130: Movie Object 140: Table of Contents 202: Video Stream 204 • Audio Stream 206: Play graphics stream 208: interactive graphics stream 210: AV data stream 220. Text subtitle data 230: storage medium 310. dialog style unit (heart (four) styie unit, Dsu) 320 330 340. dialog playback unit ( Diai〇g presentati〇n units, DPU) 350: PES packet 32 201009820, 362: transport packets (TP)

410 : DSU

420: DPU 610: palette set 620: region style set 622. area information 624: text style information 626: user can change style set ❹ 710: area style 820: area style 830: area information 840: text style information 850 User can change style set 860: palette set 910, 940: clip information file 1110: time information ❹ 1120: palette reference information 1130: dialog area information 1132: style reference information 1134: dialog text information 1210: time Information 1220: Palette Collection 1230: Conversation Area Information 1232: Style Reference Information 33 201009820.

丄 ;x_i^_pif.d〇G

1234: Conversational text information 1250: Time information 1260: Color update flag 1270: Color palette collection 1280: Conversation area information 1282: Style reference information 1284: Conversational text information 1410: Inline style information 1420: Conversational text 1700: Regeneration Device 1710: Subtitle preloading buffer (SPB) 1712. Font prei〇ading buffer (FPB) 1730: Text subtitle decoder 1732: Text screen processor reference 1734: Conversation arrangement Dialogue composition buffer (DCB) 1736: dialog buffer (dial〇g buffer, DB) 1738 · text subtitle conversion (rendering) device 1740: dialog playback controller 1742: bitmap object buffer (bitmap object buffer , BOB ) 1750 · graphics plane (GP ) 1760 : color look-up table (CLUT ) 34

Claims (1)

201009820 i〇z^zi)-pif.doc VII. Patent application scope: 1. A storage medium comprising: a video and audio material; and a subtitle data for providing subtitles of the audio and video material, wherein the text type The subtitle data includes a plurality of dialog play units and a dialog style unit. The dialog style unit defines a group output style used for the dialog play unit, and Each dialog playing unit includes a dialog text message indicating a time information of the dialogue text information output time, a palette information defining a color of the dialog text information, and a color update flag, the color update flag Used to indicate whether only the palette information has changed when compared to a previous dialog playback unit. 2. The storage medium storing image data and text subtitles as described in the scope of the patent application, wherein if the color update flag is set to "Γ, the palette information is based on the previous dialog playback unit. For the output of a previous conversational text message. 3 3. The storage medium for storing image data and text subtitles as described in item i of the patent scope, wherein the color update flag is set to "〇,, When the color palette information is based on the current dialogue playing unit, the dialog box is used for the text 4. The device for reproducing data from the storage medium storing the image data and the text subtitle data 'money in the shadow _ _ _ dry title The device comprises: a shell type .4; and a video decoder for decoding the image data 35 201009820 L〇^zu-pif.doc font subtitle data, including defining a set of output patterns for the:: 70. The dialog style unit style unit converts the dialog playlists: converts the bitmap image of the dialog playback unit 1 that has been converted according to the dialog system, and controls synchronization, and rotates and decodes the image data. The pair of units includes - dialog text information, which refers to the * word information time information, is defined for the dialog text update flag and a color update flag, and the stitching is only when the first-to-speech unit is compared. The apparatus for storing image data and text reproduction (4) according to item 4 of the H patent scope of the vehicle, wherein if the color is updated, the sigh: 1 when the sub-picture decoder uses the palette information, according to the dialog unit, Used for the output of the previous conversation text message. For example, the device for reproducing data from the storage medium and the storage medium of the text f as described in the first paragraph of the patent application, wherein the color correction _ is smashed as '', the subtitle grammar uses the tone The swatch information is used for outputting the dialog text information according to the standby dialog playback unit. 36