RU2490730C2 - Device for reproducing data from data storage medium - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: device has a video decoder for decoding image data and a subtitle decoder which receives data based on subtitle text. The subtitle data contain a dialogue style unit and a dialogue display unit, which converts each dialogue display unit to a raster image based on the dialogue style unit, and controls output of the converted dialogue display unit synchronised with the decoded image data. The dialogue style unit contains a plurality of screen server display styles and a plurality of colour palettes to be applied to the dialogue display unit. Each dialogue display unit contains dialogue text information, time of output information which indicates the time at which dialogue text information is to be displayed on the screen, and style link information which indicates the screen saver display style from a plurality of screen saver display styles. The plurality of colour palettes define colours to be applied to the dialogue text information.

EFFECT: enabling display of subtitles in multiple languages.

4 cl, 24 dwg

Description

FIELD OF THE INVENTION

The present invention relates to reproducing a multimedia image, and more particularly, to a storage medium for recording a multimedia image stream and a text-based subtitle stream, a reproducing apparatus and a reproducing method for reproducing a multimedia image stream and a text-based data stream recorded on a recording medium information storage.

State of the art

To provide high-definition multimedia images (HD), video streams, audio streams, demonstration graphic streams for providing subtitles, and interactive graphic streams for providing buttons (control elements of the interface) or menus for interactive user interaction are compressed (multiplexed) into the main stream, also known as a stream of audiovisual "AV" data, and recorded on a storage medium. In particular, the demo graphics subtitle stream also provides a bitmap-based image in order to display subtitles or screensavers on the image.

Disclosure of invention

Technical problem

In addition to its large size, bitmap-based splash screen data has a problem in that it is very difficult to generate subtitle or splash screen data and edit the generated splash screen data. This is because the splash screen data is multiplexed with other data streams, such as video, audio, and interactive graphics streams. In addition, there is another problem that the screen saver data output style cannot be changed in various ways, that is, to change one screen saver output style to another screen saver output style.

Technical solution

Aspects of the present invention advantageously provide a medium for storing information on which a text-based subtitle stream is recorded, and a reproducing apparatus and method for reproducing text-based subtitle data recorded on such a medium for storing information.

Useful Results

The present invention advantageously provides an information storage medium storing a text-based subtitle data stream separately from image data, a reproducing apparatus and a reproducing method for reproducing such a text-based subtitle data stream, so that the creation of subtitle data and editing of the created subtitle data can be made more easy. In addition, regardless of the number of subtitle data elements, a splash screen can be provided in a large number of languages.

Brief Description of the Drawings

A better understanding of the present invention will become apparent from the following detailed description of exemplary embodiments and claims, when read in connection with the accompanying drawings, fully forming part of the disclosure of this invention. Although the following, written and illustrated, the disclosure focuses on the disclosure of exemplary embodiments of the invention, it should certainly be understood that the foregoing is by way of illustration and example only, and that the invention is not limited to this. The essence and scope of the present invention are limited only by the scope of the attached claims. The following is a brief description of the drawings, in which:

1 is a diagram for explaining the structure of multimedia data recorded on an information storage medium according to an embodiment of the present invention;

FIG. 2 illustrates an exemplary data structure of the clip AV stream shown in FIG. 1 and a text-based subtitle stream according to an embodiment of the present invention;

3 is a diagram for explaining an exemplary data structure of a text-based subtitle stream according to an embodiment of the present invention;

FIG. 4 illustrates a text-based subtitle stream having the data structure shown in FIG. 3 according to an embodiment of the present invention;

5 illustrates a dialog style block shown in FIG. 3 according to an embodiment of the present invention;

6 is a diagram for explaining an exemplary structure of a dialog style block according to an embodiment of the present invention;

7 is a diagram for explaining an exemplary data structure of a dialog style block according to an embodiment of the present invention;

Fig. 8 illustrates an exemplary dialog style block shown in Figs. 6 or 7, according to an embodiment of the present invention;

9A and 9B illustrate an exemplary clip information file including a large number of font sets indicated by reference font information according to an embodiment of the present invention;

FIG. 10 is a diagram showing the locations of a large number of font files indicated by reference to font file information shown in FIGS. 9A and 9B;

11 is a diagram for explaining an exemplary data structure of the dialog presentation unit shown in FIG. 3, according to another embodiment of the present invention;

11 is a diagram for explaining an exemplary data structure of the dialog presentation unit shown in FIG. 3, according to another embodiment of the present invention;

FIG. 13 illustrates the dialog style block shown in FIG. 11 to 12B according to an embodiment of the present invention;

FIG. 14 is a diagram for explaining an exemplary data structure of textual dialog information shown in FIG. 13;

Fig. 15 illustrates the text information of the dialog of Fig. 13 according to an embodiment of the present invention;

16 is a diagram for explaining limitations in the continuous reproduction of continuous dialogue presentation units (DPUs);

17 is a diagram for explaining an example reproducing apparatus for reproducing a text-based subtitle stream according to an embodiment of the present invention;

Fig. 18 is a diagram for explaining a flowchart for preloading a text-based subtitle stream in an example reproducing apparatus according to an embodiment of the present invention;

Fig. 19 is a diagram for explaining a reproduction flowchart of a dialog presentation unit (DPU) in an exemplary reproducing apparatus according to an embodiment of the present invention;

FIG. 20 is a diagram for explaining a flow of operations in which a text-based subtitle stream is synchronized with motion picture data and output in an example reproducing apparatus according to an embodiment of the present invention;

21 is a diagram for explaining a sequence of operations in which a text-based subtitle stream is displayed on the screen in an exemplary reproducing apparatus according to an embodiment of the present invention;

FIG. 22 is a diagram for explaining a sequence of operations of reproducing a text-based subtitle stream in an exemplary reproducing apparatus according to an embodiment of the present invention; FIG.

23 illustrates an example status register located in an example reproducing apparatus for reproducing a text-based subtitle stream according to an embodiment of the present invention; and

24 is a flowchart illustrating a method for reproducing a text-based subtitle stream according to an embodiment of the present invention.

The implementation of the invention

According to an aspect of the present invention, an apparatus for reproducing image data and text-based subtitle data recorded on an information storage medium to display a screensaver on an image based on image data, comprises: a video decoder for decoding image data; and a subtitle decoder for converting the presentation information element into a bitmap based on the style information, and for controlling the output of the converted presentation information element synchronized with the decoded image data. The text-based subtitle data includes a presentation information element, which is a screen saver display unit, and style information that defines a screen saver output style.

The subtitle decoder can decode the subtitle data recorded separated from the image data, and output the subtitle data by superimposing the subtitle data on the decoded image data. Style information and presentation information can be generated in packaged elementary stream (PES) blocks, and a subtitle decoder can perform structural analysis and process style information and presentation information in blocks of PES streams.

Style information can be generated by one PES and recorded in front of the subtitle data, and a large number of presentation information elements can be recorded in blocks of PES streams following the style information, and a subtitle decoder can apply style information to a large number of presentation information elements.

In addition, the presentation information may include text information indicating the contents of the screensaver and construction information controlling the output of the bitmap obtained by converting the text information. The subtitle decoder can control the time at which the converted text information is output by reference to the construction information.

Presentation information can specify one or more window zones in which a screen saver should be displayed, and a subtitle decoder can output converted text information simultaneously in one or more window zones.

The start time of the output and the end time of the output of the presentation information among the construction information can be determined as time information on the common time axis used in the playlist, which is a data playback unit, and the subtitle decoder can synchronize the output of the converted text information with the output of the decoded data images by reference to the start time of the output and the end time of the output.

If the information about the end time of the output of the presentation information element reproduced at the current moment is the same as the information about the start time of the output of the next presentation information element, the subtitle decoder can reproduce two elements of the presentation information continuously.

If the next element of presentation information is not to be reproduced, the subtitle decoder can flush the internal buffer between the start time of the output and the end time of the output, and if the next element of presentation information is to be played continuously, the subtitle decoder can maintain the buffer without dropping it.

Style information may be a plurality of output styles that are predefined by the manufacturer of the information storage medium and should be applied to presentation information, and the subtitle decoder can convert a large number of presentation information elements recorded subsequently into raster images based on the style information.

In addition, text information from among the presentation information may include text that must be converted to a bitmap, and macro style information that should be applied only to part of the text, and by applying stream style information to only part of the text, to which style information predetermined by the manufacturer is applied, the subtitle decoder can provide a function with visual highlighting of a part of the text.

As the macro style information, the subtitle decoder may apply the relative value of the font preset information or may use the absolute value of the font preset information or a predetermined absolute value included in the style information predetermined by the manufacturer to a part of the text.

In addition, the style information may further include user-modifiable style information, and after receiving the selection information from the user one style from the number of modifiable elements of the style information, the subtitle decoder may apply the style information predetermined by the manufacturer, then apply the macro style information, and then finally apply the user-modifiable element of style information corresponding to the selection information to the text.

As the user-modifiable style information, the subtitle decoder can apply to the text the relative value of the user preset information from among the style information elements predetermined by the manufacturer.

If the information storage medium enables predetermined style information defined in the reproducing apparatus in addition to the style information predetermined by the user, the subtitle decoder can apply the predetermined style information to the text.

In addition, the style information may include a plurality of color palettes to be applied to the presentation information, and based on the color defined in the color palette, the subtitle decoder can convert all elements of the presentation information, in accordance with the style information, into bitmap images.

Apart from the plurality of color palettes included in the style information, the presentation information may further include a plurality of color palettes and a color refresh flag, and if the color refresh flag is set to “1”, the subtitle decoder may apply a plurality of color palettes included in the presentation information, and if the color update flag is set to “0”, apply the original set of color palettes included in the style information.

By setting the color update flag to “1” and gradually changing the transparency value of the color palette included in a large number of continuous elements of the presentation information, the subtitle decoder can realize the effect of smooth input / output of the image, and if the effect of smooth input / output is completed, reset the color conversion table palettes (CLUT) in the subtitle decoder, based on the original set of color palettes included in the style information.

In addition, the style information may include area information indicating the location of the window area for the converted presentation information to be displayed on the image, and font information required to convert the presentation information into a bitmap, and using the area information and font information, a subtitle decoder can convert the converted image information into a bitmap image.

Font information may include at least one of a start location for output of converted presentation information, output direction, font identifier, font style, font size or color, and a subtitle decoder converts the presentation information into a bitmap based on the font information.

As the font identifier, the subtitle decoder may refer to the indication information for the font file included in the clip information file storing attribute information of the image data recording unit.

In addition, the subtitle decoder can buffer the subtitle data and the font file indicated by the subtitle data before the image data is reproduced.

In addition, if a large number of subtitle data elements supporting a large number of languages are recorded on an information medium, the subtitle decoder can receive highlighting information about a desired language from a user and reproduce a subtitle data element corresponding to the selection information from among a large number of subtitle data elements.

According to another aspect of the present invention, a method for reproducing data from an information storage medium storing image data and text-based subtitle data to display a screensaver on an image based on image data, comprises: decoding image data; reading style information and a presentation information element; converting a presentation information element into a raster image based on style information; and controlling the output of the converted presentation information element synchronized with the decoded image data. The text-based subtitle data includes a presentation information element, which is a screen saver display unit, and style information that defines a screen saver output style.

According to yet another aspect of the present invention, there is provided a storage medium for storing information to store: image data; and text-based subtitle data to display a screensaver on an image based on image data, wherein the subtitle data includes: one style information element defining a screen saver output style; and a large number of presentation information elements, which are screensaver display units, and the subtitle data is separated from the image data and separately recorded.

Additional aspects and / or advantages of the invention will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by using the invention in practice.

The present invention will now be more fully described with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown.

With reference to FIG. 1, an information storage medium (such as a medium 230 shown, for example, in FIG. 2) according to an exemplary embodiment of the invention is formed of multiple layers in order to control the multimedia data structure 100 of the multimedia image streams recorded on him. The multimedia data structure 100 includes clips 110, which are multimedia image recording units, playlists 120, which are multimedia image playback units, movie objects 130 including navigation commands that are used to reproduce the multimedia image, and an index table 140. which is used to specify movie objects to be played first, and movie object titles 130.

Clips 110 are implemented as a single object, which includes an AV stream 112 clips for a stream of audio-visual (AV) data for a high-quality image film and clip information 114 for attributes corresponding to the AV data stream. For example, an AV data stream may be compressed in accordance with a standard such as the Moving Image Expert Group (MPEG). However, such clips 110 do not need to require the AV data stream 112 to be compressed in all aspects of the present invention. In addition, the clip information 114 may include the audio / video properties of the AV data stream 112, an entry point map in which information regarding the location of an arbitrarily selected access point is recorded in blocks of a predefined section, and the like.

Playlist 120 is a plurality of play intervals of these clips 110, and each play interval is indicated by reference as play list item 122. A movie object 130 is formed from navigation command programs, and these navigation commands trigger playback of the playlist 120, switch between movie objects 130, or control the playback of the playlist 120 in accordance with the user's preference.

The index table 140 is a table at the top level of the information storage medium to determine a large number of screensavers and menus, and includes information about placing the beginning of all the headers and menus, so that headers or menus selected by a user operation, such as search for a title or call up a menu. The index table 140 also includes the location information of the beginning of the title or menu, which is automatically played first when the information storage medium is placed in the reproducing apparatus.

Of these elements, the structure of the AV stream of the clip in which the multimedia images are compression encoded will now be explained with reference to FIG. FIG. 2 illustrates an example data structure of the clip AV stream shown in FIG. 1 and a text-based subtitle stream according to an embodiment of the present invention.

With reference to FIG. 2, in order to solve a problem relating to bitmap-based screensaver data as described above, a text-based subtitle data stream 220 according to an embodiment of the present invention is provided separately from the clip AV data stream 210 recorded on an information storage medium 230, such as a universal digital disc (DVD). The AV data stream 210 includes a video stream 202, an audio stream 204, a demo graphic stream 206 for providing subtitle data, and an interactive graphic stream 208 for providing buttons and menus to interact with a user, all of which are multiplexed in the main stream of moving visual images, known as the stream of audiovisual "AV" data, and recorded on a storage medium 230.

Text-based subtitle data 220 according to an embodiment of the present invention represents subtitle or splash screen multimedia image data to be recorded on information storage medium 230 and may be implemented using a markup language such as Extensible Markup Language (XML). However, such subtitles or screensavers of the multimedia image are provided using binary data. Hereinafter, text-based subtitle data 220 providing screensavers of a multimedia image using binary data will be briefly referred to as a “text-based subtitle stream”. The demo graphics stream 206 for providing subtitle data or screensaver data also provides bitmap-based subtitle data in order to display subtitles (or screensavers) on a screen. Since the text-based subtitle data stream 220 is recorded separately from the AV data stream 210 and is not multiplexed with the AV data stream 210, the size of the text-based subtitle data stream 220 is not limited thereto. As a result, subtitles or screensavers can be provided using a large number of languages. Moreover, the text-based subtitle data stream 220 can be simply reproduced and efficiently edited without any difficulty.

The text-based subtitle stream 220 is then converted to a bitmap graphic and displayed on top of the multimedia image. A sequence of operations that converts text-based data in this way into a graphic-based bitmap is indicated by reference as visualization. Text-based subtitle stream 220 includes information required to render the splash text.

The structure of the text-based subtitle stream 220 including the visualization information will now be explained in detail with reference to FIG. 3 is a diagram for explaining an exemplary data structure of a text-based subtitle stream 220 according to an embodiment of the present invention.

Referring to FIG. 3, a text-based subtitle stream 220 according to an embodiment of the present invention includes a dialog style unit (DSU) 310 and a large number of dialog presentation units (DPUs) 320 to 340. DSU 310 and DPU 320-340 are also referred to as dialog boxes. Each of the dialogue blocks 310-340 forming a text-based subtitle stream 220 is recorded as a packetized elementary stream (PES), or simply known as a PES packet 350. In addition, the PES of a text-based subtitle stream 220 is recorded and transmitted to blocks of transport packages 362 (TP). The sequence of TP packets is referred to as a transport stream (TS).

However, the text-based subtitle stream 220 according to an embodiment of the present invention is not multiplexed with the AV data stream 210 and recorded as a separate TS on the information storage medium 230, as shown in FIG. 2.

Referring again to FIG. 3, in one PES packet 350 included in a text-based subtitle stream 220, one dialog box is recorded. The text-based subtitle stream 220 includes one DSU 310 located in front and a large number of DPUs 320 through 340 following the DSU 310. The DSU 310 includes information defining a dialogue output style in a screensaver displayed on a screen on which a multimedia image is played. Meanwhile, a large number of DPUs 320 through 340 include text information items about the contents of the dialog to be displayed, and information about the respective output time points.

FIG. 4 illustrates a text-based subtitle stream 220 having the data structure shown in FIG. 3 according to an embodiment of the present invention.

Referring to FIG. 4, a text-based subtitle stream 220 includes one DSU 410 and a large number of DPU 420.

In an exemplary embodiment of the present invention, the number of DPUs is defined as num_pf_dialog_presentation_units. However, the number of DPUs cannot be set separately. An example case is the use of syntax such as while (processed_length <end_of_file).

The data structures of the DSUs and DPUs will now be explained in more detail with reference to FIG. FIG. 5 illustrates a dialog style block shown in FIG. 3 according to an embodiment of the present invention;

With reference to FIG. 5, in the DSU 310, a plurality of dialog style information elements, dialog_styleset () 510, are defined in which the dialog output style information elements to be displayed as a screensaver are collected. The DSU 310 includes information about the location of the zone in which the dialogue is displayed in the splash screen, information required to render the dialogue, style information that the user can control, and so on. The detailed contents of the data will be explained later.

6 is a diagram for explaining an exemplary data structure of a dialog style unit (DSU) according to an embodiment of the present invention.

With reference to FIG. 6, the DSU 310 includes a set of 61 palettes and a set of 620 zone styles. A set of 60 palettes is the set of a large number of color palettes that define the colors that should be used in the splash screen. A combination of colors or color information, such as the degree of transparency included in the set of 610 palettes, can be applied to the entire large number of DPUs placed next to the DSU.

A set of 620 zone styles is a set of output style information elements of the corresponding dialogs forming the screensaver. Each zone style includes zone information 622 indicating the location at which the dialogue should be displayed on the screen; text style information 624 indicating an output style to be applied to the text of each dialog; and a user-modifiable set of 626 styles indicating styles that the user can arbitrarily change that should be applied to the text of each dialog.

7 is a diagram for explaining an exemplary data structure of a dialog style block according to an embodiment of the present invention.

With reference to FIG. 7, in contrast to FIG. 6, a set of 610 palettes is not included. That is, the set of color palettes in the DSU 310 is not defined, but the set of 610 palettes in the DPU is defined, which will be explained with reference to figa or figv. The data structure of each zone style 710 is the same as described above with reference to FIG. 6.

FIG. 8 illustrates a dialog style block shown in FIG. 6 or 7, according to an embodiment of the present invention;

With reference to FIG. 8 and FIG. 6, the DSU 310 includes a set of 860 and 610 palettes and a large number of zone styles 820 and 620. As described above, a set of 60 palettes is the set of a large number of color palettes that determine the colors that should be used in the splash screen. A combination of colors or color information, such as the degree of transparency included in the 610 palette set, can be applied to all of the large number of DPUs placed next to the DSU.

Meanwhile, each zone style 820 and 620 includes zone information 830 and 622 indicating information about the window zone in which the screensaver is to be displayed on the screen, and zone information 830 and 622 includes information about X, Y coordinates, height , width, background color, and so on, the window area in which the screen saver should be displayed on the screen.

In addition, each zone style 820 and 620 includes text style information 840 and 624 indicating an output style to be applied to the text of each dialog. That is, the X, Y coordinates of the location at which the dialog text should be displayed in the window zone described above, the direction of the text output, such as from left to right, or from top to bottom, ordering, line spacing, font identifier, which must be referenced, font style, such as bold or italic, font size, font color information, and so on.

In addition, each zone style 820 and 620 may also include a user-modifiable set of styles 850 and 626, which the user can arbitrarily change. However, a user-modifiable set of 850 and 626 is optional. A user-modifiable style set 850 and 626 may include window zone location information, text output location, font size, and line spacing of the output style information elements 840 and 624. Each element of the change information may be expressed as respectively increased or decreased with respect to the information about the output styles 840 and 624, which should be applied to the text of each dialog.

To summarize the above, there are three types of style-related information, style information 620 ((region_style), defined in the style 820 and 620 of the zone, information micro style command 1510 (inline_style), which will be described later and to visually highlight part of the splash screen, and user-modifiable information of style 850 (user_changeable_style), and the procedure for applying these information elements is as follows:

1) Basically, style information 620 defined in the style of the zone is applied.

2) If there is information of micro-command styling, information 1510 of micro-command styling is applied overlaid on top of the part in which the zone style information is used, and visually highlights part of the text of the splash screen.

3) If there is an 850 style user-modifiable information, this information is finally applied. The presence of user-modifiable style information is optional.

Meanwhile, among the text style information elements 840 and 624 to be applied to the text of each dialog, font file information can be determined, which must be indicated by the font identifier 842 (font_id), as set forth below.

FIG. 9A illustrates an example clip information file 910 including a large number of font sets referenced by the font information 842 shown in FIG. 8 according to an embodiment of the present invention.

With reference to FIG. 9A, FIG. 8, FIG. 2 and FIG. 1, in StreamCodingInfo () 930, which is a structure of a stream encoding information included in a clip information file 910 and 110, information on a variety of streams recorded on a medium is included for storing information according to the present invention. That is, the composition includes information about a video stream 202, an audio stream, a stream of demo graphics, a stream of interactive graphics, a text-based subtitle stream, and so on. In particular, with respect to the text-based subtitle stream 220, language information 932 (textST_language_code) for displaying a screensaver may be included. In addition, a font name 936 and a file name 938 for a file storing font information corresponding to font_id 842 and 934 (font identifier) indicating a font identifier to be referenced and shown in FIG. 8 can be determined. A method for determining a font file corresponding to a font identifier that is to be referenced and defined here will be explained later with reference to FIG. 10.

FIG. 9B illustrates an example clip information file 940 including a large number of font sets referenced by the font information 842 shown in FIG. 8, according to yet another embodiment of the present invention.

With reference to FIG. 9B, the structure of Cliplnfo () can be defined in the clip information file 910 and 110. In this structure, a large number of font sets can be defined indicated by reference to the font information 842 shown in FIG. That is, the name 952 of the font file is set corresponding to font_id 842 indicating the identifier of the font to be referenced and shown in FIG. Next, a method for determining a font file corresponding to a font identifier defined here and which should be referenced will be explained.

FIG. 10 is a diagram showing the locations of a large number of font files indicated by a reference of the font file name 938 and 952 shown in FIG. 9A and FIG. 9B.

With reference to FIG. 10, a file directory structure is shown, which should be related to a multimedia image recorded on an information medium according to an embodiment of the present invention. In particular, by using a directory structure, the location of a font file, such as 1111l.font 1010 or 99999.font 1020, stored in an auxiliary data directory (AUXDATA) can be easily determined.

Meanwhile, the data structures of the DSU and DPU forming the dialog box will now be explained in more detail with reference to FIG. 11.

11 is a diagram for explaining an exemplary data structure of a DPU dialog presentation unit 320 shown in FIG. 3 according to yet another embodiment of the present invention.

With reference to FIG. 11 and FIG. 3, a DPU 320 including text information about the contents of a dialog to be output and display time information includes time information 1110 indicating a point in time for the dialog that should be displayed, palette link information 1120 defining a color palette to be indicated by the link, and dialog area information 1130 for the dialog to be displayed. In particular, the dialog area information 1130 for the dialog to be displayed includes style link information 1132 defining an output style to be applied to the dialog, and dialog text information 1134 indicating the text of the dialog that actually should be displayed. In this case, it is allowed that the set of color palettes indicated by the palette reference information 1120 is defined in the DSU (refer to 610 of FIG. 6).

Meanwhile, FIG. 12A is a diagram for explaining an exemplary data structure of the DPU 320 shown in FIG. 3 according to an embodiment of the present invention.

With reference to FIG. 12A and FIG. 3, the DPU 320 includes time information 1210 indicating a point in time for the dialogue to be displayed, a set of palettes 1220 defining a set of color palettes, and dialogue area information 1230 for the dialogue to be displayed. In this case, the palette set 1220 is not defined in the DSU, as shown in FIG. 11, but is defined directly in the DPU 320.

Meanwhile, FIG. 12B is a diagram for explaining an exemplary data structure of the DPU 320 shown in FIG. 3 according to an embodiment of the present invention.

With reference to FIG. 12B, the DPU includes time information 1250 indicating a point in time for a dialog to be displayed, a color refresh flag 1260, a set of 1270 color palettes that should be used when the color refresh flag is set to 1, and dialogue area information 1280 for a dialogue to be displayed. In this case, the set of 1270 palettes is not defined in the DSU, as shown in Fig. 11, but is defined directly in the DPU 320. In particular, in order to express a smooth input / output image using continuous playback, in addition to the standard set of palettes, defined in the DSU, a set of 1270 color palettes that should be used to express smooth image input / output is defined in the DPU 320, and the color update flag 1260 can be set to 1. This will be explained in more detail with reference to FIG. 19.

FIG. 13 illustrates the dialog style block shown in FIG. 11 to 12B according to an embodiment of the present invention;

With reference to FIG. 13, FIG. 11, FIG. 12A, and FIG. 12B, the DPU includes information about the start time of the dialog (dialog_start_PTS) and information about the end time of the dialog 1310 (dialog_end__PTS) as time information 1110 indicating the time for the dialog to be displayed. In addition, the dialog palette identifier (dialog_palette_id) is included as the palette link information 1120. In the case of FIG. 12A, a set of 1220 color palettes may be included in place of the palette reference information 1120. The text information of the dialog 1334 (region_subtitle) is included as the information of the dialog zone 1230 for the dialogue to be output, and in order to specify the output style to be applied to it, the region style identifier 1332 (region_style_id) can be included. The example shown in FIG. 13 is only an exemplary embodiment of a DPU, and the DPU containing the data structures shown in FIG. 11 to 12V, can be implemented with modification in various ways.

Fig. 14 is a diagram for explaining an exemplary data structure of textual dialog information shown in Fig. 13.

With reference to FIG. 14, the dialogue text information 1134 shown in FIG. 11, 1234 shown in FIG. 12A, 1284 shown in FIG. 12B and 1334 shown in FIG. 13 includes macro style information 1410 layout and dialogue text 1420 as an output style to visually highlight part of the dialogue.

FIG. 15 illustrates the text information 1334 of the dialog of FIG. 13 according to an embodiment of the present invention. As shown in FIG. 15, dialogue text information 1334 is implemented by macro-style information 1510 (inline_style) and dialog text 1520 (text_string). In addition, it is preferable that information indicating the end of the macro style design is included in the embodiment shown in FIG. With the exception of the end part of the macromand style design, the once specified macro command style design can subsequently be continuously applied, contrary to the intention of the manufacturer.

Meanwhile, FIG. 16 is a diagram for explaining limitations in the continuous reproduction of continuous dialogue presentation units (DPUs).

With reference to FIG. 16 and FIG. 13, when a large number of DPUs, as described above, need to be continuously played back, the following limitations are necessary.

1) Information 1310 (dialog_startJPTS) about the start time of the dialogue, defined in the DPU, indicates the time when the object of the dialogue begin to display on the graphics plane (GP), which will be explained later with reference to Fig.17.

2) The dialog end time information 1310 (dialog_end_PTS) defined in the DPU indicates the time to reset the text-based subtitle decoder processing the text-based subtitles, which will be explained later with reference to FIG.

3) When the large number of DPUs described above need to be continuously played back, the information (dialog_end_PTS) about the end time of the dialogue of the current DPU could be the same as the information (dialog_start_PTS) about the start time of the dialogue of the DPU, which should be continuously played back next . That is, in FIG. 16, in order to continuously reproduce the DPU # 2 and the DPU # 3, the dialog end time information included in the DPU # 2 could be the same as the dialog start time information included in DPU # 3.

Meanwhile, it is preferable that the DSU according to the present invention satisfies the following limitations.

1) Stream 220 based on text subtitles includes one DSU.

2) The number of elements (user_control_style) of the user-modified style information included in all styles (region_style) of the zone must be the same.

Meanwhile, it is preferable that the DSU according to the present invention satisfies the following limitations.

1) A window area must be defined for at least two inserts.

The structure of an exemplary reproducing apparatus based on the data structure of a text-based subtitle stream 220 recorded on an information storage medium according to an embodiment of the present invention will now be explained with reference to FIG. 17 given later in the materials of the present application.

FIG. 17 is a diagram for explaining the structure of an example reproducing apparatus for reproducing a text-based subtitle stream according to an embodiment of the present invention; FIG.

With reference to FIG. 17, a reproducing apparatus 700, also known as a reproducing apparatus, includes a buffer assembly that includes a font preload buffer (FPB) 1710 for storing font files, and a subtitle preload buffer 1712 that decodes and reproduces the text-based subtitle stream previously recorded on the information storage medium as output through the graphics plane 1750 (GP) and the color palette conversion table (CLUT) 1760.

Namely, the buffer unit includes a subtitle preloading buffer (SPB) 1710, in which a text-based subtitle data stream 220 is preloaded, and a font preloading buffer (FPB) 1712 in which the font information is preloaded.

The subtitle decoder 1730 includes a subtitle processor 1732, a dialog comparison buffer (DCB) 1734, a dialogue buffer (DB) 1736, a text subtitle visualizer 1738, a dialog presentation controller 1740, and a raster object buffer (BOB) 1742.

A text subtitle processor 1732 receives a text-based subtitle data stream 220 from a text subtitle preloading buffer (SPB) 1710, transfers style-related information included in a DSU, and dialogue output time information included in a DPU described above to a buffer 1734 dialogue building (DCB), and transfers the textual information of the dialogue included in the DPU, in the buffer 1736 dialogue (DB).

A view controller 1740 controls the text visualizer 1738 by using style-related information included in the dialog building buffer (DCB) 1734, and by using the dialog output time information, controls the timing of the bitmap rendered in the object raster buffer 1742 (BOB), which should be displayed on the graphics plane 1750 (GP).

In accordance with the control of the view controller 1740, the text subtitle visualizer 1738 converts the dialogue text information into a bitmap, that is, performs mapping by applying a font information element corresponding to the dialogue text information stored in the dialogue buffer (DB) 1736 from among the font information elements, pre-loaded into the buffer 1712 pre-loaded font (FPB), to the text information dialog. The rendered raster image is stored in the object raster buffer 1742 (BOB) and, in accordance with the control of the view controller 1740, is displayed on the graphics plane 1750 (GP). At this time, the color specified in the DSU is applied by reference to the color palette conversion table (CLUT) 1760.

Style-related information that should be applied to the dialogue text, information defined in the manufacturer's DSU, and style-specific information predefined by the user can also be applied. The playback device 1700, as shown in FIG. 17, applies style information defined by a user previously to a style of information defined by the manufacturer.

As described with reference to Fig. 8, as style-related information to be applied to the dialogue text, the region style information (region_style) defined by the manufacturer in the DSU is mainly applied and if the macro style is included in the DPU including the text of the dialogue to which the zone style information is applied, the information (inline_style) of the macro style design is applied to the corresponding part. In addition, if the manufacturer additionally defines user-modifiable styles in the DSU, and one of the user-modifiable styles selected by the user is selected, the zone style and / or macro style design is applied, and then the user-modifiable style is finally applied. In addition, as described with reference to FIG. 15, it is preferable that information indicating the end of the application of the macro style design is included in the contents of the macro style design.

In addition, the manufacturer can set, allow or prohibit the use of style-related information defined in the playback device separately from the style-related information determined by the manufacturer and recorded on the information storage medium.

FIG. 18 is a diagram explaining a pre-loading flow of a text-based subtitle data stream 220 in an example reproducing apparatus 1700, which is shown, for example, in FIG. 17, according to an embodiment of the present invention.

With reference to FIG. 18, a text-based subtitle data stream 220 shown in FIG. 2 is defined in a subpath of the playlist described above. In the subpath, a large number of data streams 220 based on text subtitles supporting a large number of languages can be defined. In addition, the font file to be applied to the text-based subtitles may be in the clip information file 910 or 940, as described above, with reference to FIG. 9A and FIG. 9B. Up to 225 streams of data 220 based on the text of the subtitles, which can be concluded in one medium for storing information, can be defined in each playlist. Also, up to 255 font files can be defined, which can be enclosed in a single information storage medium. However, in order to guarantee a consistent presentation, the size of the text-based subtitle data stream 220 should be less than or equal to the size of the pre-load buffer 1710 of the reproducing apparatus 1700 shown, for example, in FIG. 17.

FIG. 19 is a diagram explaining a DPU playback flowchart in a reproducing apparatus according to the present invention.

With reference to FIG. 19, FIG. 13 and FIG. 17, a flowchart of reproducing a DPU is shown. The presentation controller 1740 controls the time for the rendered dialog to be displayed on the graphics plane 1750 (GP) shown in FIG. 17 by using the dialog start time information (dialog_start_PTS) and the dialog end time information (dialog_end_PTS) setting the dialog output time 1310 included in the DPU. At this time, the dialogue start time information sets the point in time when the transfer of the rendered dialog bitmap stored in the bitmap object buffer (BOB) 1742 included in the text-based subtitle decoder 1730 to the graphics plane 1750 is completed. That is, if it is the start time of the dialogue defined in the DPU, the raster information required to build the dialogue should be ready for use after the transfer of information to the graphics plane 1750 (GP) is completed. Also, information about the end time of the dialogue sets the time when the DPU playback ends. At this point in time, both the subtitle decoder 1730 and the graphics plane 1750 (GP) are reset. Preferably, the buffer in the subtitle decoder 1730, such as the object raster buffer 1742 (BOB), is flushed between the start time and the end time of the DPU, despite continuous playback.

However, when continuous playback of a large number of DPUs is required, the subtitle decoder 1730 and the graphics plane 1750 are not reset, and the contents stored in each buffer, such as the dialog building buffer 1734 (DCB) and the object raster buffer 1742 (BOB), must be maintained in working condition. That is, when the information about the end time of the DPU that is currently being played back and the information about the start time of the DPU dialog, which should then be continuously played back, are the same, the contents of each buffer are not flushed, but maintained.

In particular, as an application for continuous reproduction of a large number of DPUs, the effect of gradual image input / output is present. The effect of gradual input / output images can be implemented by changing the table 1760 conversion of the color palette (CLUT) of the raster object, which is transferred to the graphics plane 1750 (GP). That is, the first DPU includes build information such as color, style, and output time, and the large number of DPUs that follow it contain build information identical to that of the first buffer, but only the color palette information is updated. In this case, by gradually changing the transparency of the number of color information elements, from 0% to 100%, the effect of gradual image input / output can be realized.

In particular, when a DPU data structure is used, as shown in FIG. 12B, the effect of gradual image input / output can actually be realized by using the color update flag 1260. That is, if the dialog presentation controller 1740 checks and confirms that the color update flag 1260 included in the DPU is set to “0”, that is, if this is an ordinary case that does not require the effect of gradual image input / output, information about color included in the DSU shown in Fig.6. However, if the view controller 1740 confirms that the color update flag 1260 is set to “1”, that is, if the effect of fading in / out of the image is needed by using the color information 1270 included in the DPU, instead of using the color information 610 included in the DSU shown in Fig.6, the effect of the gradual input / output image can be implemented. At this time, by adjusting the transparency of the color information 1270 included in the DPU, the fade-in / out effect can simply be realized.

After such a fade-in effect is shown, it is preferable to update the color palette conversion table (CLUT) 1760 with the original color information included in the DSU. This is because until it is updated, the color information once set can then be continuously applied, contrary to the intent of the manufacturer.

FIG. 20 is a diagram explaining a flow of operations in which a text-based subtitle stream is synchronized with motion picture data and output in an exemplary reproducing apparatus according to an embodiment of the present invention.

With reference to FIG. 20, dialogue start time information and dialog end time information included in a DPU of a subtitle text data stream 220 could be determined as time points on a common time axis used in a playlist, so in order to be synchronized with the output time of the media stream AV data stream 210. Therefore, the heterogeneity between the system time clock (STC) of the AV data stream and the dialogue output time (PTS) of the text-based subtitle data stream 220 can be eliminated.

21 is a diagram for explaining a flow of operations in which a text-based subtitle stream is displayed on a screen in a reproducing apparatus according to an embodiment of the present invention.

With reference to FIG. 21, a flowchart is shown in which, by applying visualization information 2102, including information related to the style of information, the dialog text information 2104 is converted to a bitmap 2106, and the converted bitmap is displayed at an appropriate location on the graphics plane 1750 (GP) based on output location information (such as region_horizontal_position and region_vertical_position) included in the build information 2108.

The rendering information 2102 represents style information such as zone width, height, image color, background color, text type, font name, font style and font size. As described above, visualization information 2102 is defined in the set of zone styles in the DSU. Meanwhile, construction information 2108 indicates a start time and a presentation time, vertical position information of a window zone in which a screensaver is displayed on a graphics plane (GP) 1750, and so on. This is defined in the DPU.

FIG. 22 is a diagram explaining a visualization flow of a text-based subtitle data stream 220 in the reproducing apparatus 1700 shown in FIG. 17 according to an embodiment of the present invention.

With reference to FIG. 22, FIG. 21 and FIG. 8, a window zone defined by using region_horizontal_position, region_vertical_position, region_width and region_height, which are the window zone location information 830 for the screensaver defined in the DSU, is set as the zone in which The splash screen is displayed on the 1750 (GB) graphics plane.

The bitmap of the rendered dialog is displayed from the location of the starting point specified by text_horizontal_position and text_vertical_position, which are the dialog output location 840 in the window area.

Meanwhile, the reproducing apparatus according to the present invention stores style information (style_id) selected by using the system register area. 23 illustrates an example status register located in a reproducing apparatus for reproducing a text-based subtitle stream according to an embodiment of the present invention.

With reference to FIG. 23, the status register (player status registers, hereinafter referred to as PSR registers) stores style information (selected style 2310) selected by the user in the 12th register. Therefore, for example, even after the playback device 1700, shown, for example, in FIG. 17, performs a menu call or other operation, if the user presses the button to change the style information, the style information previously selected by the user can be made applied first, by reference to PSR 12. The register storing information may be changed.

A method for reproducing a text-based subtitle data stream 220 based on an information storage medium recording a text-based subtitle stream 220, and a structure of a reproducing apparatus reproducing a subtitle data stream 220 described above will now be described with reference to FIG. 24. 24 is a flowchart of a method for reproducing a text-based subtitle data stream 220 according to an embodiment of the present invention.

A text-based subtitle data stream 220 including DSU information and DPU information is read from the information storage medium 230 shown, for example, in FIG. 2, at operation 2410, and based on the visualization information included in the DSU information, text the splash screen included in the DPU information is converted to a bitmap in operation 2420. The converted bitmap is displayed on the screen in accordance with the time information and location information, which are construction information included into the DPU information, at operation 2430.

As described, starting with the foregoing, the present invention advantageously provides an information storage medium storing a text-based subtitle data stream separately from image data, a reproducing apparatus and a reproducing method for reproducing such a text-based subtitle data stream, so as to create data Subtitle and editing created subtitle data could be made easier. In addition, regardless of the number of subtitle data elements, a splash screen can be provided in a large number of languages.

In addition, as soon as the subtitle data is formed with one style information element (DSU) and a large number of presentation information elements (DPU), the output style to be applied to the entire presentation data can be determined in advance, and can be changed in various ways. as well as macro-style design can be defined to visually highlight part of the screen saver, and user-modifiable style.

In addition, by using a large number of neighboring presentation information elements, continuous reproduction of the splash screen is enabled, and using this, gradual image input / output and other effects can be easily implemented.

Exemplary embodiments of the present invention may also be recorded as a computer program and may be implemented in public digital computers that execute programs using computer-readable media. Examples of computer-readable media include magnetic media for storing information (e.g., ROM (ROM - read-only memory), flexible magnetic disks, hard drives, etc.), optical recording media (e.g., CD-ROM (ROM on compact disc) discs), DVD (universal digital discs), etc.), and a storage medium such as carrier waveforms (e.g., transmission over the Internet). The computer-readable medium may also be distributed over networked computer systems, so that the computer-readable code is stored and executed in a distributed manner.

Although it has been illustrated and described that are exemplary embodiments of the present invention, those skilled in the art and as the technology develops, it will be understood that various changes and modifications can be made, and equivalents can be replaced by its elements, without departing from the essence and scope of the present invention. Numerous modifications can be made to adapt the ideas of the present invention to a specific situation without leaving its essence and scope. For example, any computer-readable medium or data storage device may be used, as long as the text-based subtitle data and the AV data are written to them separately. In addition, text-based subtitle data can also be configured in different ways, as shown in FIG. 3 or FIG. 4. Moreover, the playback device, which is shown in Fig. 17, can be implemented as part of a playback device, or alternatively, a separate device for performing recording and / or playback functions with respect to the information storage medium. Similarly, the CPU may be implemented as a chipset containing firmware, or a general purpose or special purpose computer programmed to perform methods as described, for example, with reference to FIG. 24. Accordingly, it is understood that the present invention, therefore, is not limited to the various exemplary embodiments disclosed, and that the present invention includes all embodiments falling within the scope defined by the appended claims.

Industrial applicability

Aspects of the present invention are applied to an information storage medium in which a text-based subtitle stream is recorded, and a reproducing apparatus and method for reproducing text-based subtitle data recorded on such information storage medium.

The present invention advantageously provides an information storage medium storing a text-based subtitle data stream separately from image data, a reproducing apparatus and a reproducing method for reproducing such a text-based subtitle data stream, so that the creation of subtitle data and editing of the created subtitle data can be made more easy. In addition, regardless of the number of subtitle data elements, a splash screen can be provided in a large number of languages.

Claims (5)

1. A device for reproducing data from a storage medium for storing information storing image data and text-based subtitle data, comprising:
a video decoder for decoding image data; and
a subtitle decoder that receives text-based subtitle data comprising a dialog style block and at least one dialog presentation block, converting each at least one dialog presentation block to a bitmap based on the dialog style block, and controlling output of the converted dialog presentation block synchronized with decoded image data,
wherein the dialog style block contains a plurality of screensaver output styles and a plurality of color palettes, which should be applied to at least one dialog presentation block,
wherein each dialogue presentation unit contains information about the text of the dialogue, information about the output time indicating the time at which the information about the text of the dialogue should be displayed, and style link information indicating the display style of the screensaver from the plurality of screensaver display styles,
however, many color palettes determine the colors that should be applied to information about the text of the dialogue. 2. The device according to claim 1, in which the subtitle decoder decodes the text-based subtitle data recorded separately from the image data on the information storage medium, and outputs the text-based subtitle data by superimposing the subtitle data on the decoded image data. 3. The device according to claim 2, in which the dialogue presentation block and the dialogue style block are formed in packaged elementary stream (PES) blocks, and the subtitle decoder performs structural analysis and processes the dialogue presentation block and the dialogue style block in the PES stream blocks. 4. The device according to claim 1, in which the subtitle decoder buffers the text and font file before the image data is reproduced. 5. The device according to claim 1, wherein if a plurality of text-based subtitle data supporting a plurality of languages is recorded on an information storage medium, a subtitle decoder receives selection information from a user about a desired language and reproduces one of a plurality of text-based subtitle data corresponding to the selection information from a plurality of text elements.

Images