RU2276811C2 - Data carrier, including marked up document and audio-video data, recording method, reproduction method and reproduction device - Google Patents

Abstract

FIELD: engineering of data carriers, including marked up document and AV data, recording method, reproduction method and reproduction device.

SUBSTANCE: data carrier includes AV data, including audio and video data, marked up document, and information about synthesis of frame, which describes at least one of two displaying modes for joint display of frame of marked up document, received from marked up document, and AV frame, received from AV data.

EFFECT: simple and informative displaying of AV data in display window.

7 cl, 25 tbl, 23 dwg

Description

FIELD OF THE INVENTION

The present invention relates to a method for displaying audio-video (AV) data in conjunction with a markup document, and more particularly, to a storage medium including a markup document and AV data such that the markup document and AV data can be reproduced and displayed together different methods in an interactive mode, a recording method, a reproducing method and a reproducing apparatus.

BACKGROUND

Digital video discs (DVDs) (hereinafter referred to as "interactive DVDs"), onto which a marked-up document is recorded together with audio-video (AV) data, were originally developed for applications in the film industry, and later began to be widely used in the computer industry. AV data recorded on interactive DVDs can be played back in two ways: an interactive mode displayed in the same way as a regular DVD, and an interactive mode in which the reproduced AV data is displayed in a display window defined by a markup document. If the interactive mode is selected by the user, the display means installed in the DVD reproducing apparatus displays the markup document recorded on the interactive DVD. AV data selected by the user is displayed in the display window of the marked-up document. For example, when the AV data is a movie, the movie is shown in the display window of the markup document, and various additional information related to the film, including the script, story and portraits of the actors, are displayed on the remainder of the screen, excluding the display window of the markup document. Additional information includes image files or text files.

However, still in the interactive mode, the AV data is based on a simple display method in which the AV data is displayed in a display window determined according to the grammar of the marked-up document.

SUMMARY OF THE INVENTION

To solve the above and other problems, there is an aspect of the present invention providing a storage medium including AV data and a markup document such that AV data and a markup document can be reproduced and displayed together in various ways in an interactive mode, a recording method, a reproducing method and playback device.

There is another aspect of the present invention, providing a storage medium including AV data and a markup document such that the AV data and the markup document can be displayed in various ways in an interactive mode, in accordance with a resolution and aspect ratio (screen format), which installed by the user or installed in the playback device, the recording method, the playback method and the playback device.

There is another aspect of the present invention, providing a storage medium including interactive content (content) made with a fixed aspect ratio so that the interactive content can be effectively displayed on a display having various aspect ratios, a recording method, a playback method and a playback device .

Accordingly, to achieve the above aspects, in accordance with one aspect of the present invention, a storage medium is provided. The storage medium includes AV data including audio and video data, a markup document and frame synthesis information that describes at least one of two display modes for displaying a frame (image) of a markup document obtained from the markup document, and AV frame jointly obtained from AV data.

Preferably, the frame synthesis information includes a link tag recorded in the markup document, and more preferably, the frame synthesis information includes a cascading style sheet (CTC) inserted in the link tag.

A CCC includes at least one of: information for specifying a display mode for assigning a display mode of an AV frame, information specifying an AV tuning (fitting) area for specifying an enlargement and reduction area of a required portion of an AV frame, information specifying background colors for assigning a background color of an AV frame, information specifying a setting area (fit) for designating a frame setting area in which an AV frame is synthesized with a markup document, information specifying a window for designating a window in which a frame where AV p is synthesized with a marked-up document, displayed on the display screen, information about the type of display screen representing the aspect ratio of the frame on which the AV frame is synthesized with the frame of the marked-up document, and information specifying an AV frame window for specifying a window area in which a custom AV frame is displayed on the display screen.

In addition, information about the synthesis of the frame further includes an object having variable properties that control the CCC, and a program for controlling the CCC based on the object.

To achieve the above aspects, according to another aspect of the present invention, there is provided a method of recording AV data, including audio and video data, on a storage medium. The method includes (a) recording AV data, (b) recording a markup document intended to be displayed together with AV data, and (c) recording frame synthesis information that describes at least one of two display modes for sharing displaying a frame (image) of a markup document obtained from the markup document, and an AV frame obtained from AV data.

In step (a), the AV data is recorded in the video directory, in step (b), the marked-up document is recorded in the interactive directory, and in step (c), information about the frame synthesis is recorded in the interactive directory.

In step (b), the content intended for display is recorded on the maximum displayed area, regardless of the aspect ratio of the display, i.e. active area, and in other areas, non-essential content is recorded or no content is recorded. When a marked-up document having a first aspect ratio is displayed on a display having a second aspect ratio having a resolution lower than the resolution of the first aspect ratio, the active region is selected using information defining a setting area (fit) of the synthesized frame, and the selected active region is displayed in a certain an area on the display screen using information defining a synthesized frame window.

To achieve the above aspects, according to another aspect of the present invention, there is provided a method for reproducing AV data including audio data and video data recorded on a storage medium. The method includes (a) interpreting a markup document intended to be displayed together with AV data, (b) interpreting frame synthesis information that describes at least two display modes for jointly displaying a frame of a markup document obtained by reproducing a markup document , and an AV frame obtained by reproducing AV data, and (c) displaying an AV frame and a frame of a markup document in one of the display modes, according to the interpreted information about the synthesis of the frame.

To achieve the above aspects, according to another aspect of the present invention, there is provided a method for reproducing AV data including audio and video data having a predetermined aspect ratio recorded on a storage medium and a markup document having a predetermined aspect ratio, and displaying AV data and a markup document . The method includes (a) reading frame synthesis information corresponding to a frame mode set in a reproducing apparatus or set by a user, and (b) interpreting the read frame synthesis information, displaying an AV frame obtained by reproducing AV data and a frame of a markup document, obtained by reproducing a markup document intended to be displayed together with AV data, and changing the output state of the frame (image) of the markup document in response to change the frame mode.

To achieve the above aspects, according to another aspect of the present invention, there is provided an apparatus for reproducing AV data including audio data and video data recorded on a storage medium. The device includes a reader that reads the AV data and a markup document for displaying together with the AV data, a decoder that decodes the AV data read by the reader and outputs an AV frame, and a controller that interprets the markup document read by the reader , provides a frame (image) of the marked-up document, interprets information about the synthesis of the frame, which describes at least two display modes for displaying the frame of the marked-up document together with AV to core, and displays the AV frame (picture) and a frame (image) of the markup document in one of the display modes according to the interpreted information about the synthesis frame (image).

To achieve the above aspects, according to another aspect of the present invention, there is provided an apparatus for reproducing AV data including audio data and video data recorded on a storage medium. The device includes a reader that reads the AV data and a markup document for displaying together with the AV data, a decoder that decodes the AV data read by the reader and outputs an AV frame (image), and a controller that interprets the synthesis information the frame corresponding to the frame mode set by the playback device or set by the user interprets the markup document intended to be displayed together with the AV data read by the module reading, using the interpreted information about the synthesis of the frame (image), displays the frame of the marked-up document, and changes the output state of the frame of the marked-up document in response to a change in the frame (image) mode.

BRIEF DESCRIPTION OF THE DRAWINGS

The above aspects and advantages of the present invention will be more apparent from the detailed description of preferred embodiments of the present invention with reference to the accompanying drawings, in which:

1 is a block diagram of a DVD reproducing apparatus according to a preferred embodiment of the present invention;

FIG. 2 is a diagram illustrating an arrangement of frames (images) (Z order) of a display (not shown) associated with the reproducing apparatus of FIG. 1;

Figure 3 shows the file structure of the DVD 100 of Figure 1 according to a preferred embodiment of the present invention;

4 shows a picture-in-picture (PIC) mode as one of the display modes according to a preferred embodiment of the present invention;

5 shows an embedded mode, as one of the display modes, according to a preferred embodiment of the present invention;

6 shows a background mode as one of the modes according to a preferred embodiment of the present invention;

7 shows a relationship diagram, more specifically illustrating the display mode of the AV frame (image) and image of the marked-up document according to video-viewport: and video-placement :;

Fig. 8 is a diagram more specifically illustrating a display mode of an AV frame and a frame of a markup document according to viewport: and window :;

Fig. 9 is a flowchart illustrating a preferred embodiment of a reproducing method according to the present invention;

FIG. 10 is a flow chart illustrating more precisely the steps following step 903 of FIG. 9;

11 is a flowchart illustrating a preferred embodiment of a reproducing method according to the present invention;

12 is a diagram illustrating a method for displaying AV data and a markup document while minimizing distortion of interactive content on various displays having different screen ratios;

13 is a diagram illustrating frames in which 16 × 9 AV data is displayed on a 4 × 3 display as a “mailbox” and as pan and scan;

14 is a diagram illustrating a layered document using the active region principle;

on Fig shows the changes in the coordinate systems necessary when displaying the area selected using viewport: on the area defined using window :;

Fig. 16 is a flowchart of another preferred embodiment of a reproducing method according to the present invention;

17 shows a diagram in which 16 × 9 AV data is synthesized with a 4 × 3 marked-up document in the embedded, background, and KVK modes, respectively,

FIG. 18 is a diagram in which 16 × 9 AV data is synthesized with a 4 × 3 tagged document in the background, and then displayed on a 16 × 9 display;

19 is a diagram illustrating a display, a markup document and AV data according to various aspect ratios;

20 is a diagram illustrating a ratio of width to length in pixels on a 16 × 9 display and a ratio of width to length in pixels on a 4 × 3 display;

21 is a diagram illustrating various aspect ratio transformations;

on Fig shows a diagram in which the AV data 16 × 9 and the marked-up document 4 × 3, each having a window region, is synthesized with each other, and then displayed on the display 16 × 9; and

23 is a flowchart of another preferred embodiment of a reproducing method according to the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

Preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings.

The meanings of the terms used in the present description are as follows. “Tagged document” means a tagged document and a tagged resource including various image files and image files inserted into the tagged document. “Layout of document” means an image (scene) in which “Markup document” is displayed by the viewer. “AV frame” means an image in which AV data is decoded and displayed. “Frame synthesis information” means information defining a method for jointly displaying an image of a markup document and an AV image according to the present invention.

1 is a block diagram of a reproducing apparatus according to a preferred embodiment of the present invention. 1, the reproducing apparatus displays together the AV image (frame) and the image (frame) of the markup document, which is achieved by decoding the AV data and the markup document recorded on the optical disc 100 according to the present invention, interactively using the display method according to the present invention . The playback device includes a reader module 1, an AV decoder 2, presentation (presentation) means 3, and a mixer 4.

The reading unit 1 reads the AV data, the markup document and the frame synthesis information from the optical disk 100 and provides the read AV data, the read markup document and the read frame synthesis information to the AV decoder 2 and presentation means 3. Additionally, the reader module 1 may comprise buffer memory (not shown) and cache memory (not shown) for buffering the read AV data and caching the read markup document, respectively.

The presentation means 3 supports a display mode according to the present invention. From the point of view of the software module, the presentation tool 3 includes a viewer, which is an application that functions as an interface with the operating system of the playback device through an application program interface (API), and a client interpretation engine. An API is a predefined special way to request processing of an operating system or other application. The client interpretation engine is implemented using the JavaScript or Java interpretation engine and interprets programs written in JavaScript or Java, like a web browser, and executes the program. In addition, the presentation tool 3 may further include plug-ins. Plug-ins allow you to open files of various formats included in the composition of the marked-up document or called up by the marked-up document. The presentation means 3 interprets the frame synthesis information according to the present invention and transmits a decoding command and a display command according to the interpretation result to the AV decoder 2 and mixer 4, respectively. The presentation tool 3 also provides the mixer 4 with an image of the marked-up document. The AV decoder 2 decodes the AV data according to the provided decoding program and outputs the decoded AV data to the mixer 4. The mixer 4 together displays the frame (image) of the marked-up document and the AV frame (image) according to the display command.

To perform the reproducing method according to an embodiment of the present invention, the presentation means 3 calls up a stylesheet associated with or inserted into the markup document generated by the reading unit 1, and interprets the stylesheet. The style sheet describes information on the method of synthesizing (displaying) a frame of a marked-up document and an AV frame.

To perform the playback method according to another embodiment of the present invention, the presentation means 3 interprets the screen mode (aspect ratio, resolution, video output mode) set in the playback device or set by the user, and issues a command according to the set screen mode using the frame synthesis information, which determined by using the default stylesheet installed in the playback device or the stylesheet installed by the manufacturer eat (more specifically, using viewport: to indicate the area of the screen fit in which the AV frame scene and frame of the marked-up document are synthesized with each other, window: to indicate the screen window in which the AV frame and frame of the marked-up document are synthesized with each other, and video-viewport: to indicate the area of increase or decrease of the required part of the AV frame). If the screen mode is changed by the user, the presentation tool 3 issues a command according to the changed screen mode using the frame synthesis information (viewport :, window: and video-viewport :). Additionally, the composition of the AV decoder 2 may include a switching module. When setting the display size to 4 × 3, the AV decoder 2 converts the AV stream into the form of a letter box (“mailbox”) or pan & scan (“pan and scan”) and produces a converted AV stream. When setting the display size to 16 × 9, the AV decoder 2 outputs an 16 × 9 AV stream without conversion. This is because, in a DVD playback device, an AV stream is usually encoded at 16 × 9. However, if the display mode in interactive mode is the built-in mode or the picture-in-picture (PIC) mode, the AV decoder 2 can output an 16 × 9 AV stream without converting the AV stream to letter box or pan & scan according to the “Original Display Aspect Ratio”, when wherein the aspect ratio preferred by the user is initially set by the presentation device 3 even in a 4 × 3 display.

Thus, preferably, when displaying 16 × 9 AV data on a 4 × 3 display, presentation tool 3 controls the AV decoder 2 to output 16 × 9 AV data in the built-in interactive mode or KVK mode and outputs AV data in the form of a “letter box "Or" pan & scan "in the background of interactive mode or video mode. However, AV data can be output in the form of a letter box or pan & scan AV decoder 2 even in the built-in interactive mode or KVK mode.

To perform the reproducing method according to yet another embodiment of the present invention, the presentation means 3 interprets the viewing window and the window (document-viewport :, document-window :) only for the marked-up document defined in the frame synthesis information, respectively, both the viewing window and the window ( video-viewport :, video-window :) for AV data only. To perform the playback method according to another embodiment of the present invention, in contrast to an AV decoder 2 having a switching module, even though the aspect ratio of the display is set to 4 × 3 in the embedded mode or the KVK mode, the AV decoder 2 without an additional module switching, outputs the 16 × 9 AV stream in such a way that the display is set to 16 × 9 without an outgoing AV stream in the form of a letter box and pan & scan according to the viewing window or only for an interpreted marked-up document and window n View and window for AV data only.

FIG. 2 is a diagram illustrating a frame placement order (Z order) of a display (not shown) connected to the reproducing apparatus of FIG. 1. In FIG. 2, the final frame shown to the user is generated by four frames physically added. The frame 21 on which the pointer is displayed is placed at the very beginning, then the scene (frame) 22 of the marked-up document according to the marked-up document, the AV frame 23 according to the AV data, and the background frame (image) 24 are usually displayed in the same color.

FIG. 3 shows the file structure of the DVD 100 of FIG. 1 according to a preferred embodiment of the present invention. Figure 3 in the root directory provides a video directory (directory) VIDEO_TS containing AV data, and an interactive directory DVD_ENAV containing data to support an interactive function, such as a marked-up document. AV data and playback control information (also known as navigation data) are recorded in the VIDEO_TS video directory. The playback control information contains information related to decoding AV data. The marked-up document and information about the frame synthesis are recorded in the interactive directory DVD_ENAV.

More precisely, the VIDEO_TS.IFO file, in which the header information about the entire video work is recorded, is recorded in the VIDEO_TS video directory. Then, the file VTS_01_0.IFO, in which the header information about the first video is recorded, is recorded in the VIDEO_TS video directory, and then the files VTS_01_0.VOB, VTS_01_1.VOB, ..., which are the AV data constituting the video, are recorded in the VIDEO_TS video directory. The structure is described in more detail in the DVD-Video standard "DVD-Video for Read Only Memory Disc 1.0".

The playback control information file DVD_ENAV.IFO, in which the title information of all data is recorded to support the interactive function, is recorded in the interactive directory DVD_ENAV. The DVD_ENAV.IFO file can be replaced with various meta tags for a markup document that serves as a launch function. Then, the marked-up A.NTM document is recorded in the DVD_ENAV interactive directory, and the A.CSS stylesheet, as information about the frame synthesis, is recorded in the DVD_ENAV interactive directory. Additionally, B. NTM and C. NTM markup documents and B.CSS and C.CSS stylesheets corresponding to B. NTM and C. NTM markup documents are recorded in the DVD_ENAV interactive directory. A.PNG as a graphic file inserted and displayed in a marked-up document A.NTM, B1.PGN and B2.PGN as graphic files inserted and displayed in a marked-up document B.NTM, and C.PGN as a graphic file inserted and displayed in the marked-up document C. NTM, are recorded in the interactive directory DVD_ENAV. In the interactive directory DVD_ENAV, other marked-up documents and files may be recorded, having various forms inserted and displayed in them.

FIG. 4 shows a picture-in-picture (PIC) mode as one of the display modes according to the present embodiment. In FIG. 4, in KVK mode, an AV frame is output as KVK in a frame of a markup document. Only the frame of the markup document is physically placed before the AV frame, as described with reference to FIG. 2. KVK mode allows the AV frame, from the point of view of the user, to be visible as output to the frame of the marked-up document. Preferably, the KVK mode is subdivided by setting the placement and size of the AV frame. In the present embodiment, the KVK mode is divided into several forms using KVK- # such as KVK-1 and KVK-2. In KVK mode, the user can change the position and size of the AV frame using a remote controller (not shown). Meanwhile, the following is an example of XML code constituting the markup document A. NTM shown in FIG. 4.

Obviously, the A.CSS stylesheet file is linked to the above source code using the link tag. The following is an example of the source code for the stylesheet.

In the present embodiment, the cascading style sheet (CTC) uses the @screen_display rule similar to the above to use the display mode between the frame of the marked-up document and the AV frame. We describe such properties as video-placement: (video position :), which determines the display mode of the AV frame, background-color: (background-color :), which determines the background color of the AV frame, viewport: (viewport :), which defines the settings (fit ) a frame in which an AV frame is synthesized with a frame of a marked-up document, window: (window :), which defines a window frame in which an AV frame is synthesized with a frame of a marked-up document, video-viewport: (video viewing field :), which defines the area for enlarging and reducing the required part of the AV frame.

Figure 5 shows the embedded mode, as one of the display modes according to the present invention. In FIG. 5, in the embedded mode, the AV frame is embedded in the marked-up document by <object ...>. Thus, the position and size of the AV frame moves and changes under the control of the marked-up document. In the built-in AV mode, the frame is embedded and displayed in the display window defined (set) by the marked-up document. The following is an example of XML code for creating the markup document B. NTM shown in FIG. 5, and an example of the source code for the stylesheet.

The display window in which the AV frame should be displayed using the object tag is defined in V. NTM. That is, the display window area is determined by properties such as "width" and "height" in the "object" tag. Additionally, it is obvious that the B.CSS stylesheet file is linked to B. NTM using the link tag. In the present description, B.CSS stands for Cascading Style Sheet (CTO) file. CCC provides an opportunity to describe the "style" of the marked-up document. Alternatively, the stylesheet file may be associated with B. NTM using a style tag.

6 shows a background mode as one of the display modes according to the present embodiment. Figure 6 in the background, a frame with a marked document is displayed on the AV frame. The following is an example of XML code for creating the markup document C. NTM shown in FIG. 6, and an example of the source code for the stylesheet. Similarly, a C.CSS style sheet file is linked to C. NTM using the “link” tag.

The following are the properties and values used as the @screen_display rule, which represent the display mode between the frame of the marked-up document and the AV frame.

1. video-placement: Sets the display mode of the AV frame. The values "None", "embedded", "pip #" and "background" correspond to the absence of display, the built-in mode, the mode of the CEC and the background mode, respectively. The initial value is the built-in mode.

The background mode is different from the background <body background = "dvd:"> using the "body" tag. <body background = "dvd;"> represents the background in the window assigned to display the frame of the marked-up document. That is, in the background according to the present embodiment, the AV frame is displayed in the entire frame, but if the background is determined using the “body” tag, the AV frame is displayed only in the predetermined window frame (“window”).

2. background-color: Sets the background color of the frame, formed by a simple color. The value is <color>, and the original value may vary according to the user agent (UA).

3. window: Specifies the window in which the frame is displayed, into which the AV frame with the frame of the marked-up document is synthesized. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%).

4. viewport: Sets the frame adjustment (fit) area in which the AV frame is synthesized with the frame of the marked-up document. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%).

5. video-viewport: Sets the area for increasing and decreasing the AV frame. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%). Here, the value of a specific <shape> is a rectangle (<top>, <right>, <bottom>, <left>).

7 is a diagram illustrating in more detail the display mode of an AV frame and a frame of a marked-up document in accordance with the video-viewport: and video-placement: properties. 7, if the region a for increasing and decreasing the AV frame is determined using “video-viewport:”, when “video-placement:” is the background mode, the fit region a is displayed on the background frame, and the frame of the marked-up document (not shown ) is displayed in fitting area a . When “video-placement:” is the KVK mode, the fit area a is displayed at the set position. When “video-placement:” sets the built-in mode, the fitting area a is embedded in the display window specified by the marked-up document and displayed in the display window. Figure 7 shows an example in which only part of the AV data area is selected, that is, the video-viewport: area is selected as a partial area so that the partial area is converted to the "window:" area defined by each display mode.

On Fig shows a diagram illustrating in more detail the display mode of the AV frame and the frame of the marked-up document, according to the "video-viewport:" and "window:". If the “viewport:” property is selected to display the content content fitting area of the frame in which the AV frame is synthesized with the frame of the marked-up document on the display frame, and the “window:” property (selected) to determine the window area so that all or part the selected document could be displayed in a predetermined area of the frame on the display screen, the values of “viewport:” and “window:” are used without changes. However, FIG. 8 shows an example illustrating that only a portion of a frame region is selected in which an AV frame is synthesized with a frame of a marked-up document, that is, a video-viewport: region is selected as part of a region such that a portion of the region is converted to a region " window: "specified by the display mode. Thus, the concepts “viewport:” and “window:” allow you to increase / decrease the part or the entire frame in which the AV frame is synthesized with the frame of the marked-up document.

Fig. 8, in the built-in mode, in which the AV frame is embedded in the document frame and is displayed, if the frame fitting region b, in which the AV frame is synthesized with the frame of the marked-up document, is set using “viewport:”, the fitting region b is displayed in the window defined using "window:" as shown by position (1). If the marked-up document is entirely placed in “viewport:”, the fit region b is displayed in the window defined by “window:”, as shown by position (2). If the background is set using the “body” tag, the synthesized frame is displayed in its entirety in a window defined using “window:”.

Property variables specifying the display mode, property variables specifying the background color of the AV frame, property variables specifying the frame window in which the AV frame is synthesized with the frame of the marked-up document, property variables specifying the frame fitting area in which the AV frame is synthesized with a frame of the marked-up document, and property variables specifying the area of increase and decrease of the required part of the AV frame are defined in the object managing the above CCC file.

Additionally, an AV frame can be enlarged / reduced according to user input using the source code of an application program interface object (API) for a document object model (OMD). The value of the source code of the object needed to perform this operation can be indicated by reference, using the scripting language in the marked-up document.

The object source code below is used to bind the "ScreenDisplayProperties" in the root elements (ie <frameset>, <html>) at the highest level.

In the present description, "ScreenDisplayProperties" is associated with the root elements of the markup document, and the value of "ScreenDisplayProperties" can be referenced in the markup document using a scripting language. The following is an example of the source code of an object.

Attributes

videoPlacement: Sets the display mode of DVD-video. That is, he establishes that

const unsigned short VIDEO_PLACEMENT_NONE = 0;

const unsigned short VIDEO_PLACEMENT_EMBEDDED = 1;

const unsigned short VIDEO_PLACEMENT_ BACKGROUND = 2;

const unsigned short VIDEO_PLACEMENT_PIP = 3;

colorBackground: set to <color> as the background color of the AV frame.

viewport: has a value of <shape>, as the setting area of the synthesized frame.

window: has the value <shape>, as the display area on the display into which the tuned (adjusted) synthesized scene should be converted.

videoViewport: has a value of <shape> as the fit region of the AV frame.

-------------------------

A static definition is possible using the <meta> or <link> tag, just like a dynamic definition using the object source code above.

Meanwhile, the scripting language included in the markup document is used to increase / decrease the output AV frame according to user input using the source code of the API object for OMD described above. The following example is an example in which a manufacturer can enlarge / reduce an AV frame displayed in an embedded state, as shown in FIG.

In this case, manipulation with the scale of the AV frame can be carried out through user input using the API for OMD and the scripting language.

Therefore, according to the above embodiment, the AV frame and the frame of the markup document are easily synthesized with each other, and the display location of the AV frame is set using the stylesheet associated with the markup document or embedded in the markup document, thereby allowing the user to receive frames in various forms .

A reproducing method according to the present invention is described below based on the structure described above.

9 is a flowchart illustrating a preferred embodiment of a reproducing method according to the present invention. In FIG. 9, in step 910, the reader unit 1 of the reproducing apparatus reads from the optical disc 100 a markup document to be reproduced with AV data. The presentation (presentation) tool 3 interprets the markup document in step 902 and, in step 903, calls the stylesheet file associated with the markup document. Then, at step 904, the presentation tool 3 interprets the style sheet file and outputs the result of the AV interpretation to the decoder 2. More specifically, the presentation tool 3 reads the display mode setting information from the optical disk 100 to specify the display mode of the AV frame described in the style sheet file, information specifying the background color for specifying the background color of the AV frame, information specifying the window for specifying the window, the frame in which the AV frame with the marked-up document is synthesized is displayed on the display screen, information fitting guide region synthesizable frame, - to define the area of the frame fitting in which AV frame is synthesized with the markup document and information specifying the area AV adjustment - to define the field adjustment to increase and reduce a desired portion of AV block. The AV decoder 2 decodes the AV data according to the style sheet file and outputs the corresponding AV frame to the mixer 4. The presentation means 3 issues a command to display the frame of the marked-up document and the AV frame and the frame of the marked-up document in which the marked-up document is played to the mixer 4 according to the description in the table file styles. To this end, the presentation tool 3 interprets a program that is programmed based on an object having property variables that control the stylesheet file, and manages the stylesheet file. The mixer 4 mixes and outputs the marked-up document and the AV frame, which are issued from the presentation means 3 and the AV decoder 2, respectively. At 905, an AV frame and a frame of the markup document are displayed according to the interpreted frame synthesis information. At step 905-1, if the CVC mode is described in the style sheet file, the AV frame is superimposed on the frame of the marked-up document and displayed. At step 905-2, if the built-in mode is described in the style sheet file, an AV frame is embedded in the frame of the marked-up document and displayed. At step 905-3, if the background mode is described in the style sheet file, the frame of the marked-up document is superimposed on the AV frame and displayed.

FIG. 10 is a flowchart illustrating in detail the steps following step 903 of FIG. 9. 10, the presentation tool 3, at step 1001, interprets the CTC file in a markup document, or interprets the link tag and calls the CTC file, at step 1002 interprets the called CTC file, and at step 1003 reads information specifying a display mode and information specifying a fitting area AV, which is described in the CCC file. The mixer 4 mixes and issues the command and the frame of the markup document issued from the presentation means 3, and the AV frame output from the AV decoder 2, and at step 1004, the frame of the markup document and the AV frame are displayed according to the display mode described in the CCC file. In the case of the "none" mode, the AV frame in step 1004-1 is not displayed. Otherwise, one mode from: KVK (step 1004-2), background mode (step 1004-3), and embedded mode (step 1004-4) may be displayed.

11 is a flowchart illustrating a preferred embodiment of a recording method according to the present invention. 11, a recording device records AV data on a storage medium (block 1101), writes a markup document that is intended to be reproduced with AV data (block 1102), and writes the above frame synthesis information to a stylesheet file associated with the markup document or embedded in it (step 1103). At 1103, an object having property variables managing a stylesheet file in a markup document and a program managing a stylesheet file based on the object are recorded on the storage medium.

So far, embodiments have been described in which a frame where a frame of a marked-up document is synthesized with an AV frame is enlarged / reduced using the “window:” and “viewport:” properties from the frame synthesis information, a portion of the AV frame is enlarged / reduced using the property “Video-viewport:” so that the AV data and the tagged document are displayed interactively in various ways.

The following describes an embodiment of a method for displaying AV data and a marked-up document in various ways in an interactive mode according to a resolution and aspect ratio (screen format) set by a user or in a playback device using the “window:” and “viewport:” properties from the above synthesis information frame. In the present invention, if a markup document designed with a fixed screen format is displayed on a display having different aspect ratios, a frame distortion phenomenon may occur in which a portion of data such as text or graphic data intended to be displayed on a display screen is displayed wrong. Thus, in the present invention, frame distortion is minimized in accordance with the screen mode (aspect ratio, resolution, and video output method) set by the user or already installed in the playback device by changing the interactive content designed for one fixed screen format in order to have various screen formats using the “window:” and “viewport:” properties.

First, methods for displaying interactive content developed using a markup language on multiple displays having different screen formats with minimized distortion of interactive content will be described with reference to FIG. For convenience of explanation, the ratio of pixel sizes in all cases is set to 1 × 1.

First display method: The manufacturer prepares the corresponding marked-up documents and the corresponding AV data, considering several screen formats in order to correspond to displays having different aspect ratios.

In order to display interactive content that is not distorted on a display having different aspect ratios, as shown by (1) and (2), the manufacturer prepares the corresponding marked-up documents, considering the different display ratios indicated by (3) and (4) , and the corresponding AV data (i.e., AV content in DVD-video format), bearing in mind the various aspect ratios of the display shown by (5) and (6). Content (3) + (5), in which 3 × 4 AV data is synthesized with a 3 × 4 tagged document, can be displayed on a 3 × 4 display screen as indicated (1), and content (4) + (6), in in which 16 × 9 AV data is synthesized with a 16 × 9 marked-up document, can be displayed on a 16 × 9 display screen, as indicated (2), in the form required by the manufacturer, without performing any special operations.

The second display method: When content is generated having a fixed aspect ratio, the manufacturer prepares the corresponding marked-up documents, taking into account the display aspect ratios, and AV data corresponding to the display having various aspect ratios, as follows.

If only (3), (4) and (5) are formed

- In the case of a display, a 4 × 3 display: Content (3) + (5), in which 4 × 3 AV data is synthesized with a 4 × 3 marked-up document, can be displayed in frame (1) as required by the manufacturer, without execution any special operations.

- In the case of displaying 16 × 9: AV data (5) 4 × 3 is embedded in the marked-up document 16 × 9, with right and left empty bars, without extension. The right and left blank bars can only be removed by setting the size to 16 × 9 in the tagged object of the markup document, so that 4 × 3 AV data can be embedded in the markup 16 × 9 document. Content (4) + (5) can be displayed in frame (2) in the form required by the manufacturer, without performing any special operations.

When only (3), (4) and (6) are formed

If 4 × 3: AV is displayed, the data 6, 16 × 9 is converted to a normal 4 × 3 frame, a 4 × 3 letter box of a mailbox or a 4 × 3 pan & scan (pan and scan) frame and then embed in marked-up document 3 4 × 3. Created content (3) + (6) can be displayed in frame (1) in the form required by the manufacturer, without performing any special operations.

Here, a full-screen frame is called a standard frame and is created and reproduced in a 4 × 3 aspect ratio (1.33: 1). The full normal frame is displayed on a 4 × 3 display. A black bar appears at both ends of the 16 × 9 display frame. If the user sees the full frame on the 16 × 9 display screen (wide mode: (a) Fig. 13), the picture appears to be stretched in the horizontal direction, and if the user sees the frame close-up, the upper and lower parts of the frame are cut out. In these two cases, the picture is simply enlarged, and thus the resolution is reduced.

“Pan & scan” is a picture created by cropping two sides of a picture created in a widescreen frame (16 × 9), and only the middle part of the scene corresponding to the aspect ratio of 4 × 3 (1.33: 1) is taken, as shown in (b) 13, and the pan & scan playback method is the same as the full frame playback method.

The “letter box” frame has the advantage that the user can perceive the frame as going in a movie theater, but has the drawback of reducing the frame size. Thus, with the pan & scan method, both ends of an insignificant frame are cut out, and the picture fits into a 4 × 3 frame, instead of reducing and displaying the frame. Differences in the beauty of a 4 × 3 pan & scan picture depend on the professionalism of the editor.

A “letter box” is a picture created by inserting a black bar at the top and bottom of the frame and reducing the frame so that the user can efficiently view the picture created in wide format frame (16 × 9) on a regular display (4 × 3 screen format) ) The upper and lower black stripes of the picture are called "Matte" ("mask").

In the case of displaying 16 × 9: Content (4) + (6), in which 16 × 9 AV data is synthesized with a 16 × 9 marked-up document, can be displayed in frame 2 in the form required by the manufacturer, without any special operations.

Third display method: When content is created having a fixed aspect ratio, the manufacturer prepares the corresponding AV data, taking into account the aspect ratios of the display, and the marked-up document corresponds to a display having different aspect ratios, as follows.

When only (3), (5) and (6) are created

- In the case of a 4 × 3 display: Content (3) + (5), in which 4 × 3 AV data is synthesized with a 4 × 3 tagged document, can be displayed in frame 1 in the form required by the manufacturer, without any or special operations.

- In the case of a 16 × 9: AV display, the 6 16 × 9 data is converted to a normal 4 × 3 frame, a 4 × 3 “letter box” frame, or a 4 × 3 “pan & scan” frame, and then embedded in a marked 4 × 3 document 3. Created 3 + 6 content can be displayed, including empty bars on the left and right sides of frame 2 from the midline.

When only (4), (5) and (6) are created

- In the case of a 4 × 3: AV display, 5 4 × 3 data is embedded in a 4 16 × 9 marked-up document with left and right empty bars, without extension. The resolution of the created content (4) + (5) is, for example, 854 × 480, and thus only a significant part of the frame can be displayed in the frame (1) of the 4 × 3 display, using the principle of the “active area” and API, in aspect ratio conversion ratio.

- In the case of displaying 16 × 9: Content (4) + (6), in which 16 × 9 AV data is synthesized with a 16 × 9 document marked up, can be displayed in frame 2 in the form required by the manufacturer, without any or special operations.

Fourth display method: When each of the AV data and the markup document are produced in one aspect ratio, the AV data and the markup document correspond to a display having different aspect ratios, as follows.

When only (3) and (5) are formed

- In the case of a 4 × 3 display: Content (3) + (5), in which 4 × 3 AV data is synthesized with a 4 × 3 tagged document, can be displayed in frame 1 in the form required by the manufacturer, without any or special operations.

- In the case of a 16 × 9 display: Centering the full content (3) + (5), in which 4 × 3 AV data is synthesized with a 4 × 3 marked document, content (3) + (5) can be displayed with right and left empty bars in the frame (2) of the 16 × 9 display.

When only (4) and (6) are formed

- In the case of a 4 × 3 display: The resolution of the created content (4) + (6), in which the 16 × 9 AV data is synthesized with a 16 × 9 tagged document, is 854 × 480, and thus only a significant part of the frame can be displayed in frame (1) of a 4 × 3 display using the "active area" principle and API, with respect to aspect ratio conversion. In this case, a letter box or pan & scan is preferably applied to the video mode other than the interactive mode.

- In the case of a display, the display is 16 × 9: Content (4) + (6), in which the AV data is synthesized with the marked-up document, can be displayed in the frame (2) in the form required by the manufacturer, without performing any special operations .

The active area and API are described in more detail below with respect to aspect ratio conversion.

When interactive content created for use at 16 × 9 (resolution 854 × 480) is displayed on a 4 × 3 display (resolution 640 × 480), on a 4 × 3 display only the 640 × 480 area of the entire interactive content area is displayed, another area 214 × 480 is not displayed on a 4 × 3 display. Therefore, the manufacturer includes content to be displayed in the 640x480 area (in the present invention, the maximum display area is called the “active area” regardless of the aspect ratio of the display), which can be displayed regardless of the aspect ratio of the display at the initial location, and includes non-significant content or does not include any content in another area. In order to display the marked-up document created on the basis of the "active area" principle on a 4 × 3 display and in order to display the AV frame and the frame of the marked-up document in various ways, interactive content is displayed using the above "viewport:" and "window: ", used in the source code of the API object for OMD, and their descriptions will be given later.

A simple example is described below with reference to FIG. 14, in which 16 × 9 interactive content is displayed on a 4 × 3 display regardless of the aspect ratio of the display.

The manufacturer creates the marked-up document using the principle of the "active area" in such a way as to display a frame that is not distorted regardless of the different aspect ratios of the display. That is, in the document space of the markup document shown in FIG. 14, a complete markup document created for 854 × 480 should be displayed on a 4 × 3 display. In the present description, the size of the "active region" is not fixed, but an example of 640 × 480 is given as a size that minimizes distortion, and its position is also not fixed.

Additionally, in the space of the markup document generated for the 16 × 9 format, the manufacturer uses the “viewport:” property in order to select the “active area”, which is set without distortion and displayed on the 4 × 3 display, and converts the specified frame area using property “window:” so as to display the selected “active area” on the 4 × 3 display.

On Fig shows the changes in the coordinate systems needed to convert the area selected using "viewport:" to the area defined using "window:".

The above equations 1 and 2 show that one point (X _document , Y _document ) of the document coordinate system is converted to one point (X _window , Y _window ) of the corresponding window coordinate system.

The above equations 3 and 4 show that one point (X _window , Y _window ) of the window coordinate system obtained using equations 1 and 2 is converted to one point (X _screen , Y _screen ) of the corresponding coordinate system of the display screen.

Equations 1 through 4 above apply to a tagged document, but if the subscript "document" is changed to "video", the definition for AV data is obtained.

The following is an example of an optimal table showing the size of each area for the above display methods with a pixel size ratio of 1 × 1 to facilitate recognition of the document area, viewing window area, window area and screen area and area size among other possible display methods.

Happening Document Area Viewport Area Window area Screen area In case interactive content created as 640x480 is displayed on a 640x480 display. 640 × 480 640 × 480 640 × 480 640 × 480 In case the interactive content created as 640 × 480 is displayed on the display, 854 × 480 640 × 480 640 × 480 640 × 480 854 × 480 In case the interactive content created as 640 × 480 is displayed on the display, 854 × 480 640 × 480 640 × 480 854 × 480 854 × 480 In case interactive content created as 854x480 is displayed on a 640x480 display 854 × 480 854 × 480 640 × 480 640 × 480 In case interactive content created as 854x480 is displayed on a 640x480 display 854 × 480 854 × 480 640 × 480 640 × 480 In case interactive content created as 854x480 is displayed on a 640x480 display 854 × 480 640 × 480 640 × 480 640 × 480 In case interactive content created as 854x480 is displayed on a 640x480 display 854 × 480 854 × 480 854 × 480 854 × 480

Until now, reproduction methods according to the aspect ratio have mainly been classified in a static way using KTP and in a dynamic way using the API for OMD. If the interactive content is initially displayed in the frame, then the interactive content is displayed in a static way using the default stylesheet in the presentation device or CCC, defined by the “link” and “style” tags in the marked-up document. However, if the aspect ratio is changed by the user during playback, the aspect ratio of the output to the screen can be dynamically changed by adding the aspect ratio conversion function to the markup document using a scripting language using the API for OMD.

The static method using the @ screen-display rule is described below. The property "screen-display type:" is added to the "@ screen-display" rule according to another embodiment of the present invention.

1. “screen-display type:” Specifies the aspect ratio of the frame in which the AV frame is synthesized with the marked-up document.

4 × 3N: In case the user sets the output to the screen in the normal form 4 × 3;

4 × 3L: If the user sets the output to the screen in the form of a letter box 4 × 3,

4 × 3P: In case the user sets the output to the screen in the form of pan & scan 4 × 3,

16 × 9W: In case the user sets the output to the screen in wide format 16 × 9.

2. “video-placement:” Sets the display mode of the AV frame.

The values “none”, “embedded”, “pip #” and “background” correspond to the absence of display, the built-in mode, the CEC mode and the background mode, respectively. The initial value is the built-in mode.

3. “video-viewport:” Sets the area for increasing and decreasing the AV frame. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%). Here, the value of a specific <shape> is a rectangle (<top>, <right>, <bottom>, <left>).

4. "background-color:" Specifies the background color of the frame, formed by a simple color. The value is <color>, and the original value may vary according to the user agent (UA).

5. “window:” Specifies the window in which the frame is displayed in which the AV frame is synthesized with the frame of the marked-up document. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%).

6. “viewport:” Defines the area of fit (trim) of the frame in which the AV frame is synthesized with the frame of the marked document. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%).

Since the default style sheet is set differently in each playback device, usually the frame cannot be displayed as required by the manufacturer. Thus, preferably, the manufacturer creates an additional CCC in the markup document and attaches the CCC to the document so that the user can efficiently display AV data (video DVD) and the markup document created in a fixed aspect ratio, even when the user sets the aspect ratio. The following example shows that the manufacturer creates the CCC in the markup document so that the 16 × 9 AV data (video DVD) and the 4 × 3 markup document can be effectively displayed in the background. A CCC can be created using the "style" tag, as shown in the following example, and can be applied using an external link using the "link" tag.

In this case, documents initially displayed by means of the static application of the CCC are displayed in the frame by the processing structure shown in the table below in the presentation (presentation) tool, and the corresponding page of the document, the aspect ratio of which changes during playback, must be reloaded to ensure correct frame. If the corresponding page of the document does not reload and is displayed in the frame, the frame of the marked-up document may be distorted, or the marked-up document may not be converted to AV data.

In the above algorithm, the presentation tool "Initial Display aspect ratio" corresponds to the original aspect ratio of the display of the SPRM parameter (14) of the system, as defined in DVD Specifications for Read-Only Disc / Part3. The “Initial Display aspect ratio” is a parameter obtained initially by setting the aspect ratio preferred by the user, and has two types of values 4 × 3 and 16 × 9, as shown in the above algorithm.

The no-video element indicates whether there is AV data in the markup document downloaded initially. If the value of the "no-video" element is "0", this means that the video-DVD is included in the markup document, and if the value of the "no-video" element is "1", this means that the video-DVD is not included in the markup document. "Current display" is a parameter representing the video output mode (normal, 4 × 3P and 4 × 3L) in the current domain and is defined in SPRM (14) DVD Specifications for Read-Only Disc / Part3.

Similar to the above, a static method for displaying interactive content according to the aspect ratio of the screen is described using the default stylesheet or the CCC attached to the document by the manufacturer.

The following source code for the object is used to bind the "ScreenDisplayProperties" in the root elements (ie <frameset> and <html>) of the highest level.

The ScreenDisplayProperties properties are associated with the root elements of the markup document, and the ScreenDisplayProperties value can be referenced in the markup document using a scripting language.

Attributes

screenDisplayMode: User-defined screen output format

const unsigned short SCREEN_DISPLAY_MODE_4X3NORMAL = 0;

const unsigned short SCREEN_DISPLAY_MODE_4X3LETTERBOX = 1;

const unsigned short SCREEN_DISPLAY_MODE_4X3PAN & SCAN = 2;

const unsigned short SCREEN_DISPLAY_MODE_16X9WIDE = 3;

videoPlacement: Defines the display mode of the AV frame.

const unsigned short VIDEO_PLACEMENT_NONE = 0;

const unsigned short VIDEO_PLACEMENT_EMBEDDED = 1;

const unsigned short VIDEO_PLACEMENT_ BACKGROUND = 2;

const unsigned short VIDEO_PLACEMENT_PIP = 3;

colorBackground: set to <color> as the background color of the AV frame.

viewport: has a value of <shape>, as the setting area of a markup document.

window: has the value <shape>, as the area of the window on the display in which the customized markup document should be displayed.

videoviewport: has a value of <shape>, as the setting area of the AV frame.

-------------------------------

The above dynamic definition, using the source code of the API object for OMD, is implemented in the scripting language included in the markup document, as shown in the following example. This example is created by the manufacturer, considering the processing of an event associated with the user converting the aspect ratio of the AV data 16 × 9 (i.e. video DVD) and the markup document 16 × 9, which should be displayed in the embedded mode.

The marked-up document is displayed in the frame by the initial static definition, and then, due to the occurrence of a user pressing a key (or button) of the aspect ratio conversion, the information "vdi.screenDisplayMode" is read, thereby restoring the aspect ratio of the frame using the scripting language included into the markup document above.

16 is a flowchart of another preferred embodiment of a reproducing method according to the present invention. On Fig, using the above static and dynamic definitions, the frame of the marked-up document is displayed according to the screen mode (aspect ratio, resolution and method of outputting video data) set by the user in the playback device. The screen mode can be changed even during playback by user input. The “viewport” value and the “window” value of the markup document used in this case does not change in the next markup document.

At step 1601, the presentation (presentation) tool 3 reads the screen mode (aspect ratio, resolution, and video output method) set in the reproducing device, or the screen mode set by the user. Here, the method of outputting video data means that 16 × 9 video is output in 4 × 3 letter-box or 4 × 3 pan & scan modes, and in 16 × 9 wide-format mode, which can be displayed without distorting the frame.

If the display size is set to 4 × 3, the AV decoder 2 converts the AV stream into a “letter-box” or “pan & scan” form and outputs the converted AV stream. If the display size is set to 16 × 9, the AV decoder 2 outputs an AV stream with a size of 16 × 9 without conversion. This is because, in a DVD playback device, an AV stream is usually encoded at 16 × 9. However, it is preferable that the output be made only if the AV stream is played in a video mode other than the normal interactive mode, and in the interactive mode, the AV stream is always output with a size of 16 × 9.

At 1602, a default stylesheet is selected in presentation tool 3 based on the set screen mode, and properties such as viewport, window, and video-viewport, which are defined in the corresponding default stylesheet, are set.

Presentation tool 3 interprets the markup document read by the reader module 1 and checks the stylesheet associated with or embedded in the markup document. At step 1603, if the manufacturer does not provide a style sheet in the markup document, presentation tool 3 outputs the markup document in the frame using properties such as viewport, window and video-viewport, which are defined in the default stylesheet selected based on the set screen mode and if the manufacturer provides a style sheet in the markup document, the presentation tool 3 displays the markup document in the frame using properties such as viewport, window and video-viewport, according to @ screen-display, which is defined accordingly th style sheet.

At step 1604, it is determined whether the screen mode is changed in accordance with a user key (or button) of the aspect ratio conversion. In step 1605, if the screen mode is changed by the user, the presentation tool 3 informs the corresponding markup document of the aspect ratio conversion event ASPECT_RATIO_CHANGE, executes an event-related script, interprets the screen-display property variable corresponding to the changed screen mode using ScreenDisplayProperties in tool 3 presentation, changes the status of the output of the marked-up document on the screen, based on the interpreted information, and issues a new marked-up document in the frame. At step 1606, if the screen mode has not changed at step 1604, it is determined whether the output of the markup document is completed, and the output of the data of the markup document ends.

In the case of a marked-up document, such modes as letter-box or pan & scan are not set. Therefore, for the case where a markup document created with a size of 16 × 9 is displayed on a 4 × 3 display, a method for effectively displaying a markup document using the principle of the “active area”, properties such as “viewport” and “window”, is described so as to prevent distortion of the frame in which the content appears small in other embodiments of the above reproducing method according to the present invention.

Below, in another embodiment of the reproducing method according to the present invention, in which, using the method for the most efficient synthesis with each other, without distorting the frame, AV frame and the marked-up document, which is created at a fixed aspect ratio (screen format), the user can obtain an image closest to that specified by the manufacturer, and at the same time, using a marked-up document having a fixed aspect ratio (screen format), disk space can be used more more efficiently by eliminating re-recording of interactive content.

Firstly, if a storage medium in which AV data (video DVD) is created for a size of 16 × 9 and a markup document is created for a size of 4 × 3 is displayed on a 16 × 9 display using a playback device, display methods according to display modes ( embedded mode, background mode and KVK mode) will be described with reference to Fig.17.

First, a case will be described in which 16 × 9 AV data, as shown in (a) in FIG. 17, is synthesized with a marked-up document in “embedded mode”, embedded using “object” elements, as shown in (b ) on Fig. If the manufacturer sets the "width" and "height" of the "object" tag in the marked-up document so that the 16 × 9 AV data is displayed “as is”, the entire synthesized frame is selected as the area of the viewing window and does not increase, since the 16 × 9 display no frame distortion occurs, and the region, with the exception of the right and left empty bars, is selected as the window region, and the synthesized frame is displayed, whereby the scene can be displayed efficiently. However, if the manufacturer sets the "width" and "height" of the "object" tag using the built-in 16 × 9 AV data for a 4 × 3 screen format, the AV data will be embedded in the markup document in the normal form, in the form of a letter-box or pan & scan, and the synthesized frame will be displayed on the 16 × 9 display without extension. In this case, despite the fact that the AV data is created for a size of 16 × 9, the AV data is embedded in the 16 × 9 display with a 4 × 3 screen format and, therefore, this case is not considered as preferred.

Secondly, a case will be described when AV data is synthesized with a marked-up document in the background using the “video-placement:” property in the @ screen-display cascading style sheet (CTC), as shown in (c) in FIG. 17. In another embodiment of the reproducing method according to the present invention, the viewing window region contains both AV data and a markup document, but the window region is determined only in the synthesized frame. Thus, if the synthesized frame in the "background" mode is displayed on a 16 × 9 display, the AV data displayed as background is simply displayed in the same 4 × 3 screen format as the aspect ratio of the marked-up document.

Thirdly, a case will be described in which AV data is synthesized with a marked-up document in the “CAC” mode using the “video-placement:” property in the @ screen-display cascading style sheet (CCC), as shown in (d) in FIG. .17. This case is the same in form as the built-in mode, and the original marked-up document is created for a total 4 × 3 frame without taking into account the AV data, the marked-up document is displayed in the frame, and then the AV data is displayed under the image plane in a transparent adjustable area set for each PIP- # in the presentation tool. In this case, the reduced AV data under the transparent adjustable area appears in the predefined area for each PIP- #, and thus adaptability is reduced.

Since the area set for “viewport:” in the frame in which the marked-up document is synthesized with AV data is converted to “window:” to set the area so that the corresponding interactive content is displayed, in particular, in the “background” mode from different playback modes, the frame cannot be created as planned by the manufacturer. Namely, in (a) of FIG. 18, a case is shown in which 16 × 9 AV data is synthesized with a 4 × 3 marked-up document in the form of a letter-box in the “background” mode and displayed on a display having a 16 × 9 aspect ratio. Additionally, (b) of FIG. 18 shows a case where 16 × 9 AV data is synthesized with a 4 × 3 tagged document in the form of a “pan & scan” in the background and displayed on a display having a 16 × 9 aspect ratio. Since when displaying the frame, only the window region of the synthesized frame is determined, even if the manufacturer encodes the AV data in the size of 16 × 9, in order to prevent the display of AV data in the form of a letter-box or pan & scan, as shown in Fig. (A) and (b) , in another embodiment of the present invention, the frame can be displayed in the most suitable form according to the aspect ratio of the display or the display mode (built-in mode, background mode and KVK mode) by defining the “viewport” and “window” properties only for the marked-up document and properties in viewport and window only for AV data, respectively.

In Fig. 19, it is assumed that the markup documents corresponding to different aspect ratios of displays (3) and (4), and AV data (i.e., AV content of a video-DVD format) taking into account different aspect ratios of displays (5) and (6 ) exist on displays (1) and (2) 4 × 3 and 16 × 9, the resolution of displays having the same number of pixels, as shown in FIG. 20 in the case of NTSC, is 720 × 480. However, in the aspect ratio of 16 × 9, the ratio of the width to the length of the pixel is 1.78: 1, as shown in (a) in FIG. 20, and in the aspect ratio of 4 × 3, the ratio of the width to the length of the pixel is 1.33: 1.

In this case, if the display is a television receiver (TV), the aspect ratio of the pixels of the frame changes according to the type of TV and, accordingly, it is difficult to understand the changes in the frame. Thus, for convenience of explanation, the conversion equation for each case of the screen format of 1.78 × 1, 1.33 × 1 and 1 × 1 will be displayed according to FIG. However, the length of a single pixel is the same. Namely, in all cases there are no differences in height.

Conversion (1): A resolution of 720 × 480 having a aspect ratio of 16 × 9 pixels is converted to a view having a aspect ratio of a single pixel of 1 × 1.

General horizontal resolution

= normalization (if the relative size along the length of one pixel is 1, the relative size along the width, the total vertical resolution)

= if the relative size along the length of a single pixel is 1, the relative size along the width x, the total horizontal resolution

= 1.78 × 480

= 854

Therefore, a resolution of 720 × 480, having a aspect ratio of 16 × 9 pixels, is consistent with a resolution of 854 × 480, having a format ratio of a single pixel of 1 × 1. That is, in the case of conversion to the form (1), the following equation is obtained:

Conversion (2): Conversion between the resolutions 854 × 480 and 640 × 480, having a unit pixel aspect ratio of 1 × 1.

In the case of interactive content created for a size of 854 × 480, no content can be displayed on the 640 × 480 display, and thus using “viewport:” only the area (corresponding to the “active area” is selected and displayed on the 640 × 480 display ) corresponding to 640 × 480. If interactive content created for a size of 640x480 is displayed on a 854x480 display, any content is displayed in a 640x480 area and another 214x480 area is filled with background color. That is, when the 854x480 interactive content is displayed on a 640x480 display, the area of the interactive content viewing window should be carefully selected, and when the 640x480 interactive content is displayed on the 854x480 display, the display window area should be well selected.

Conversion (3): A resolution of 720 × 480 having a 4 × 3 pixel aspect ratio is converted to a shape having a 1 × 1 unit pixel aspect ratio.

General horizontal resolution

= rationing (if the ratio of the length of one pixel is 1, the ratio of the width, the total vertical resolution)

= if the ratio of the length of one pixel is 1, the relative size of the width x, the total vertical resolution

= 1.33 × 480

= approximately 640

Therefore, a resolution of 720 × 480 having a 4 × 3 pixel aspect ratio is consistent with a resolution of 640 × 480 having a 1 × 1 pixel aspect ratio. That is, in the case of conversion to the form (3), the following equation is obtained:

Conversion (4): Conversion between a resolution of 720 × 480 having a aspect ratio of 16 × 9 pixels and a resolution of 720 × 480 having a aspect ratio of 4 × 3 pixels.

The following equation is obtained between the horizontal resolution having a pixel aspect ratio of 4 × 3 (12 × 9) and the horizontal resolution having a pixel aspect ratio of 16 × 9.

That is, it is most suitable that the resolution of 720 × 480 for a 4 × 3 display is displayed with a resolution of 540 × 480 on a 16 × 9 display, and thus, when only the region (corresponding to the “active region”) corresponding to the resolution of 540 × 480 in interactive content for 16 × 9, this selected area is correctly displayed on the 4 × 3 display.

Meanwhile, if the resolution of 720 × 480, having a aspect ratio of 16 × 9 pixels, is converted to the "letter box" with a resolution of 720 × 480, having a format aspect ratio of 4 × 3, the vertical resolution changes. Thus, the following equation is obtained between a vertical resolution having a 4 × 3 (16 × 12) pixel aspect ratio and a vertical resolution having a 16 × 9 pixel aspect ratio.

That is, the size of the region of the 4 × 3 display window should be 720 × 360 so that the resolution of 720 × 480 for 16 × 9 is supported for 16 × 9 and displayed on the 4 × 3 display.

As indicated above, if the AV data and the marked-up document are created by the manufacturer at the same aspect ratio, based on the conversion methods performed in the case where the unit pixel size ratio is different, their content is displayed according to the display aspect ratio, as shown in the following table.

For information, in the following table, the pixel size in each case is set to 1 × 1 based on the ratio of the above transformation, and thus, it is assumed that a resolution having a 4 × 3 aspect ratio is converted to 640 × 480, and a resolution having aspect ratio 16 × 9, converted to 854 × 480. Additionally, in the embedded mode or the KVK mode, it is assumed that the 4 × 3 AV data is displayed in the 200 × 150 region, and the 16 × 9 AV data is displayed in the 272 × 153 region.

In the above table (P) means pan & scan form.

The frame in which the AV data is synthesized with a 4 × 3 marked-up document, based on the table above, is displayed on the 16 × 9 display as follows: in the built-in mode, as shown in (a) in FIG. 22, the AV data is 16 × 9, synthesized with a markup document 16 × 9 are displayed in the embedded mode, and in the background, as shown in (b) in FIG. 22, AV data 16 × 9 synthesized with a markup document 16 × 9 is displayed in the background, and in KVK mode - as shown in (c) of FIG. 22, 16 × 9 AV data synthesized with a 16 × 9 markup document is displayed in VC.

Playback methods according to aspect ratio according to another embodiment of the present invention are largely classified in a static manner using CCC, and dynamically using an API for OMD. When interactive content is initially displayed in a frame, the interactive content is displayed in a static way using the default stylesheet in the presentation tool or CCC, defined using the "link" tag and the "style" tag in the markup document. However, if the aspect ratio during playback is changed by user input, the aspect ratio of the output to the screen can be dynamically changed by introducing the aspect ratio conversion function using the scripting language using the API for OMD into the markup document.

The static method using the "@ screen-display" rule is described below. Properties such as “viewport” and “window” for a marked-up document and “viewport” and “window” for AV data, respectively, are determined by the improved @ screen-display rule.

1. screen-display type:

4 × 3N: This case indicates that the user sets the output to the screen in the normal 4 × 3 view, and this view is a reduced view of the 16 × 9 AV data in which there is no distortion in which the frame appears to be compressed, unlike the usual normal view.

4 × 3L: If the user sets the output to the screen in the form of a letter box 4 × 3,

4 × 3P: In case the user sets the output to the screen in the form of pan & scan 4 × 3,

4 × 3W: In case the user sets the output to the screen in wide format 16 × 9.

2. The "video-placement" property

Sets the display mode of the AV frame. The values none, embedded, pip # and background correspond to no display, built-in mode, KVK mode and background mode, respectively. The initial value is the built-in mode.

3. The property "background-color"

Specifies the background color of the frame, formed by a simple color. The value is <color>, and the original value may vary according to the user agent (UA).

4. Property "document-viewport"

Specifies the area to fit (trim) a marked document. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%). Here, the value of a specific <shape> is a rectangle (<top>, <right>, <bottom>, <left>).

5. The "document-window" property

Specifies the area of the window in which the marked-up document is displayed in a frame on the display. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%).

6. Property "video-viewport"

Specifies the area of fit (trim) of the frame, in which the AV frame is synthesized with a marked document. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%).

7. The property "video-window"

Specifies the area of the window in which AV data is displayed in a display frame. The value is <shape>, and the original value is a rectangle (0%, 100%, 100%, 0%).

The following is an example of a stylesheet created using the type and properties of the @ screen-display rule described above.

The default style sheet has various forms, depending on the presentation tool installed in the playback device, and cannot guarantee that the frame is displayed as desired by the manufacturer. If the manufacturer wants to display the frame as he wishes, the CCC must be entered in the marked-up document. The default stylesheet below is a default stylesheet installed in the presentation tool, assuming that the AV data and the markup document stored on the information storage medium are created for a size of 16 × 9. The <shape> value used in the above example is based on the above (4) (conversion between 720 × 480 resolution having a 16 × 9 pixel aspect ratio and 720 × 480 resolution having a 4 × 3 pixel aspect ratio).

Since the default style sheet is set differently in each playback device, the frame usually cannot be displayed as the manufacturer wishes. Therefore, it is preferable that the manufacturer creates an additional CCC in the markup document and attaches the CCC to the document so that the AV data and the markup document can be displayed effectively even in the aspect ratio set by the user. The following example shows how a manufacturer creates a CCC in a tagged document so that the 16 × 9 AV data and the 4 × 3 tagged document can be effectively displayed in the background. A CCC can be created using the "style" tag, as shown in the following example, and can be used via an external link using the "link" tag.

The static method for displaying interactive content according to the aspect ratio of the screen is described above using the default style sheet or CTS attached to the document by the manufacturer. The following describes the dynamic method using the source code of the API object for OMD. The value of the source code of an object can be referenced in a markup document using a scripting language.

To bind the "ScreenDisplayProperties" in the root elements (ie <frameset> and <html>) of the highest level, the following source code of the object is used.

Here, "ScreenDisplayProperties" is associated with the root elements of the markup document, and the value of "ScreenDisplayProperties" can be referenced using the scripting language in the markup document.

The following is the definition and properties of an interface definition language (IDL).

Attributes

screenDisplayMode: User defined aspect ratio of the output frame

const unsigned short SCREEN_DISPLAY_MODE_4X3NORMAL = 0;

const unsigned short SCREEN_DISPLAY_MODE_4X3LETTERBOX = 1;

const unsigned short SCREEN_DISPLAY_MODE_4X3PAN & SCAN = 2;

const unsigned short SCREEN_DISPLAY_MODE_16X9WIDE = 3;

videoPlacement: Defines the DVD-video display mode.

const unsigned short VIDEO_PLACEMENT_NONE = 0;

const unsigned short VIDEO_PLACEMENT_EMBEDDED = 1;

const unsigned short VIDEO_PLACEMENT_ BACKGROUND = 2;

const unsigned short VIDEO_PLACEMENT_PIP = 3;

colorBackground: <color>, as the background color of the video DVD frame.

documentviewport; <shape> is set as the setting area of the markup document.

documentwindow: has the value <shape>, as the area of the window on the display in which the customized markup document should be displayed.

videoviewport: has a value of <shape>, as the setting area for a video-DVD frame.

videowindow: has the value <shape>, as the area of the window on the display in which the customized video DVD is to be displayed.

However, if videoPlacement is inline mode, the window area is cropped to the "width" and "height" defined by the <object> tag in the marked-up document.

--------------------------------------------

The above dynamic definition, using the source code of the API object for OMD, is implemented in the scripting language included in the markup document, as shown in the following example. The specified example is generated by the manufacturer, having in mind the processing of the event associated with the conversion by the user of the aspect ratio of the AV data 16 × 9 (i.e. video DVD) and the markup document 16 × 9, which should be displayed in the built-in mode.

The marked-up document is displayed in the frame by the initial static definition, and then, due to the event of a user pressing a key (or button) converting the aspect ratio, the information "vdi.screenDisplayMode" is read, thereby restoring the aspect ratio of the frame using the scripting language included into the markup document above.

23 is a flowchart of another preferred embodiment of a reproducing method according to the present invention. 23, using the above static and dynamic definitions, a frame of a marked-up document is displayed according to the screen mode (aspect ratio, resolution, and method of outputting video data) set by a user or installed in a playback device. The screen mode can be changed even during playback through user input. The “viewport” and “window” values of the markup document and the AV data used in this case can be used in the next markup document “as is” if they are not changed in the next markup document.

At step 2301, the presentation tool 3 reads a screen mode (aspect ratio, resolution, and video output method) set in the reproducing device, or a screen mode set by the user. Here, the video output method means that 16 × 9 video is output in 4 × 3 letter box or pan & scan modes, and 16 × 9 wide mode, which can be displayed without distorting the frame.

In this case, even if the display is set to 4 × 3, in embedded mode or KVK mode, AV decoder 2 does not output the AV stream in the form of a letter box or pan & scan, but outputs an AV stream of 16 × 9, as if the size were set for the display 16 × 9. This is because in a DVD playback device, an AV stream is usually encoded with a size of 16 × 9.

At step 2302, the default stylesheet is selected in the presentation tool 3 based on the set screen mode, and properties such as document-viewport, document-window, video-viewport, video-window, which are specified in the corresponding style sheet, are set default.

The presentation tool 3 interprets the markup document read by the reader 1 and checks the stylesheet associated with or embedded in the markup document. At step 2303, if the stylesheet is not presented by the manufacturer in the markup document, presentation tool 3 outputs the markup document using properties such as document-viewport, document-window, video-viewport, video-window, which are defined in the stylesheet by default, selected based on the set screen mode, and if the stylesheet is presented by the manufacturer in the marked-up document, presentation tool 3 outputs the marked-up document in a frame using properties such as document-viewport, document-window, video-viewport, video-window according to @ screen-display which op edelyayutsya in the corresponding style sheet.

At step 2304, it is determined whether the screen mode has changed according to the user key (or button) of the aspect ratio conversion. At step 2305, if the screen mode is changed by the user, the presentation tool 3 informs the corresponding markup document about the ASPECT_RATIO_CHANGE aspect ratio conversion event, executes an event-related script, interprets the screen-display property variable corresponding to the changed screen mode using ScreenDisplayProperties in the presentation tool 3 , changes the display state of the marked-up document based on the interpreted information, and issues a new marked-up document to the frame. At step 2306, if the screen mode has not changed at step 2304, it is determined whether the output of the markup document has completed, and the output of the markup document is completed.

The recording and reproducing methods described above may be carried out by a computer program. Program codes and computer program code segments can be easily created by a programmer specializing in this field. In addition, the above program is stored on a storage medium (machine-readable medium) readable and executed by a computer, thereby realizing a method for recording and reproducing a marked-up document and AV data. The storage medium includes a magnetic recording medium, an optical recording medium, and carrier waves.

INDUSTRIAL APPLICABILITY

As described above, according to the present invention, there is provided a storage medium including AV data and a markup document, such that the AV data and the markup document can be displayed in various ways interactively in accordance with the resolution and aspect ratio (screen format), a recording method and a reproducing method and a reproducing apparatus. The user can be completely satisfied with the excellent display frame. In addition, the content manufacturer and the manufacturer of recording and reproducing devices can enlarge / reduce the frame of the marked-up document using the “window” and “viewport” properties, thus saving available memory and providing a special function, such as scrolling during viewing. Additionally, part of the AV frame can be enlarged or reduced using the “video-viewport” property, and interactive content created in one fixed screen format can be converted to different screen formats using the “viewport” and “window” properties of the interactive content.

According to the present invention, when interactive content created for a fixed screen format is reproduced by a reproducing apparatus using a markup language, interactive content can be effectively displayed without a part from which important information is removed, regardless of the display screen format, thereby simplifying and authorizing the process avoiding partial duplication of content and using disk space more efficiently.

Additionally, the AV data and the markup document created in a fixed aspect ratio can be efficiently displayed on a display having different aspect ratios by a static method using a CCC associated with the aspect ratio and a dynamic method using the scripting language in the markup document using the API for OMD. Thus, the user can be completely satisfied with the state of the image that is closest to the intent of the manufacturer, and the manufacturer can more efficiently use the storage medium, avoiding partial duplication of interactive content.

Although the present invention has been shown and described in detail with reference to preferred embodiments of the present invention, it will be understood by those skilled in the art that various changes in form and detail can be made without departing from the spirit and scope of the present invention as defined by the appended claims.

Claims (90)

1. A storage medium containing audio-video data (AV) including audio and video data, a markup document and frame synthesis information that describes one of at least two display modes for displaying a frame of a markup document obtained from a markup document, and an AV frame obtained from AV data, wherein display modes include an embedded mode in which an AV frame is embedded in at least a portion of the frame of the markup document and displayed. 2. The medium of claim 1, wherein the display modes include a picture-in-picture (CVC) mode in which an AV frame is superimposed on a frame of the marked-up document. 3. The medium of claim 1, wherein the display modes include a background mode in which an AV frame and a frame of a markup document are superimposed on top of one another and displayed. 4. The medium of claim 3, wherein the display modes include a background mode in which a frame of a markup document is superimposed on an AV frame and displayed. 5. The medium according to claim 1, in which the information about the synthesis of the frame includes a stylesheet associated with the markup document or built into it. 6. The medium of claim 1, wherein the frame synthesis information includes a link tag recorded in a markup document and a cascading style sheet (CTC) embedded in the link tag. 7. The medium according to claim 6, in which the CCC includes information of setting the display mode for setting the display mode of the AV frame. 8. The medium according to claim 7, in which the CCC further includes setting information of an AV fit region for specifying an area for increasing and decreasing a required portion of an AV frame. 9. The medium according to claim 7, in which the CCC further includes background color setting information for setting a background color of an AV frame. 10. The medium of claim 7, wherein the CCC further includes setting area information for setting a frame area in which an AV frame is synthesized with a markup document. 11. The medium according to claim 7, in which the CCC further includes window setting information for setting a window in which a frame is displayed on the display screen in which an AV frame is synthesized with a markup document. 12. The medium according to claim 7, in which the CCC further includes information about the type of display screen, representing the aspect ratio of the frame in which the AV frame is synthesized with the frame of the marked-up document. 13. The storage medium according to claim 7, in which the CCC further includes information on setting the window of the AV frame to specify the area of the window in which the fitted AV frame is displayed on the display screen. 14. The storage medium according to claim 6, in which the information about the synthesis of the frame further includes an object having variable properties for controlling the CTC, and a program controlling the CTC based on this object. 15. The medium of claim 14, wherein the property variables include property variables for setting the display mode of the AV frame. 16. The medium of claim 15, wherein the property variables further include a property variable for defining an area for increasing or decreasing a desired portion of an AV frame. 17. The medium of claim 15, wherein the property variables further include a property variable for assigning a background color of an AV frame. 18. The medium of claim 15, wherein the property variables further include a property variable for defining a window in which a frame in which an AV frame is synthesized with a markup document is displayed on a display screen. 19. The medium of claim 16, wherein the property variables further include a property variable for designating a fitting area in which a frame where an AV frame is synthesized with a markup document is displayed on a display screen. 20. The medium of claim 15, wherein the variable properties further include a display screen mode representing a aspect ratio of a frame in which an AV frame is synthesized with a frame of a marked-up document. 21. The medium of claim 15, wherein the property variables further include a property variable defining a window in which a frame in which an AV frame is synthesized with a markup document is displayed on a display screen. 22. The medium of claim 1, further including AV data reproduction control information and said AV data are decoded as an AV frame based on the reproduction control information. 23. The medium of claim 1, wherein the AV data and playback control information are recorded in the video directory, and the markup document and the frame synthesis information are recorded in the interactive directory. 24. A storage medium containing audio-video data (AV) including audio and video data, a markup document and frame synthesis information in which a markup document frame obtained from a markup document is synthesized with an AV frame obtained from AV data, without distortion of the frame corresponding to a change in screen mode, including aspect ratio. 25. The medium of claim 24, wherein the frame synthesis information is stored in a cascading style sheet (CTC) file associated with the markup document using the link tag or embedded in the markup document using the style tag. 26. The medium of claim 25, wherein the frame synthesis information includes at least one of: display screen type information for designating a frame aspect ratio in which the AV frame is synthesized with a frame of the marked-up document, mode setting information display for setting the display mode of the AV frame, background color setting information for setting the background color of the frame, setting area information for the frame fitting area in which the AV frame is synthesized with the frame of the marked-up document, information a window for defining a window in which the synthesized frame is displayed on the display screen, and information for specifying an AV fit region to specify an enlargement or reduction region of a desired portion of the AV frame. 27. The medium of claim 26, wherein the display mode setting information indicates at least one of: an embedded mode in which at least an AV frame is embedded in at least a portion of the frame of the markup document; “picture-in-picture” (CVC), in which an AV frame is superimposed on a frame of a markup document, and a background mode in which a frame of a markup document is superimposed on an AV frame. 28. The storage medium according to item 27, in which information about the synthesis of the frame is set so that in the built-in interactive mode or KVK mode, if AV data having a first aspect ratio is displayed on a display having a second aspect ratio with a lower resolution, than the resolution of the first aspect ratio, the AV data is output in the first aspect ratio, and in the background of the interactive mode or video mode, the AV data is output in the form of a pan & scan in which both sides of the picture are formed in wide frame mode, they are cropped and only the middle part of the frame is selected for display, or in the form of a letter box in which a black bar is inserted in the upper and lower parts of the frame, and the frame is reduced so that the user can effectively view the picture formed in wide-format frame mode conventional display. 29. The medium of claim 26, wherein in the markup document, content intended for display is recorded in an area displayed regardless of the aspect ratio of the display, i.e. in the active area, and in another area, insignificant content is recorded or no content is recorded. 30. The medium of claim 29, wherein when displaying a markup document having a first aspect ratio on a display having a second aspect ratio, with a resolution lower than the resolution of the first aspect ratio, the active region is selected using information on specifying a fit region of the synthesized frame , and the selected active area is converted to a predetermined area of the display screen using the window information of the synthesized frame. 31. The medium of claim 25, wherein the frame synthesis information includes at least one of: display screen type information for setting a aspect ratio of a frame in which an AV frame is synthesized with a frame of a marked-up document, mode setting information display for setting the display mode of the AV frame, information for setting the background color for setting the background color of the scene, setting information for the fitting area of the marked-up document for setting the fitting area for the marked-up document, setting information for the marked-up document window Entent for specifying a window in which a frame of a marked-up document is displayed on a display screen, information for specifying an adjustment region AV for specifying an enlargement and reduction area of a required part of an AV frame, and information for specifying a window region of an AV frame for specifying a window in which only AV is displayed on a screen frame. 32. The medium of claim 31, wherein when displaying AV data having a first aspect ratio on a display having a second aspect ratio with a lower resolution than the resolution of the first aspect ratio, the frame synthesis information is set so that the AV data, having the first aspect ratio, issued without conversion. 33. The medium of claim 25, wherein the information about the frame synthesis further includes an object having property variables for controlling the CCC and a program for controlling the CCC based on the object. 34. The storage medium according to claim 33, wherein the property variables include at least one of: a display screen mode for setting a frame aspect ratio in which an AV frame is synthesized with a frame of a marked-up document, a property for setting a background color of a frame, a property for specifying a fitting region of a frame in which an AV frame is synthesized with a frame of a marked-up document, a property for specifying a window in which the synthesized frame is displayed on a display screen, and a property for specifying a fitting region for enlarging and decreasing a required portion of an AV frame. 35. The medium according to clause 34, in which, in response to the conversion of the screen mode by the user and using the source object, the program controls a property defining a fitting region of a synthesized frame, a property specifying a window region of a synthesized frame, and a property specifying a fitting region of an AV frame, according to the mode a display screen including a aspect ratio, a screen aspect ratio and a video output mode, thereby restoring a frame aspect ratio. 36. The medium of claim 35, wherein the variable properties include at least one of: a display screen mode for setting a aspect ratio of a frame in which an AV frame is synthesized with a frame of a marked-up document, a property for setting an display mode of an AV frame , property for specifying the background color of the frame, property for specifying the fitting area of the frame of the marked-up document, property for specifying the window in which the frame of the marked-up document is displayed on the display screen, property for specifying the fitting area for increasing and decreasing the second part of AV block, the property to set the window in which the AV frame is displayed on the display screen. 37. The medium according to clause 36, in which, in response to the conversion of the screen mode by the user, the program, using the source code of the object, controls a property defining a fitting region of a synthesized frame, a property defining a window region of a frame of a marked-up document, a property specifying an adjustment region of an AV frame, and a property defining a window region of the AV frame in accordance with the display screen mode, thereby restoring the aspect ratio of the frame. 38. The medium according to paragraph 24, in which the conversion between the screen format and aspect ratio according to the screen mode includes converting a resolution of 720 × 480 with a pixel aspect ratio of 16 × 9 to a pixel aspect ratio of 1 × 1, the conversion between a resolution of 854 × 480 and 640 × 480 resolution, each of which has a 1 × 1 pixel aspect ratio, 720 × 480 resolution conversion with a 4 × 3 pixel aspect ratio to 1 × 1 pixel format, 720 × 480 resolution conversion with a 4 × 3 pixel aspect ratio1 × 1 pixel ratio and conversion between 720 × 480 resolution with 16 × 9 pixel aspect ratio and 720 × 480 resolution with 4 × 3 pixel aspect ratio. 39. The medium of claim 26, wherein the type of display screen information includes normal 4 × 3, 4 × 3 letter box, wherein the picture is obtained by inserting a black bar in the upper and lower parts of the frame, and the frame is reduced so that the user could effectively view a picture formed in widescreen frame mode on a conventional display, pan & scan 4 × 3, in which the picture is obtained by cropping both sides of the picture formed in widescreen frame mode, and only the middle part of the frame is selected for display, and wide format ny × 16 9. 40. A method of recording audio-video data (AV), including audio data and video data, on a storage medium, the method includes the steps of: (a) recording AV data; (b) recording a markup document intended to be displayed in conjunction with AV data; (c) recording frame synthesis information that describes one of at least two display modes for jointly displaying a frame of a markup document obtained from a markup document and an AV frame obtained from AV data, the display mode including a built-in mode wherein an AV frame is embedded in at least a portion of the frame of the markup document. 41. The method of claim 40, wherein step (c) includes writing a stylesheet file associated with or embedded in the markup document. 42. The method of claim 40, wherein step (c) includes writing a cascading style sheet (CTC) file associated with or embedded in the markup document. 43. The method according to § 42, wherein in step (a) the AV data is recorded in the video directory, in step (b), the marked-up document is recorded in the interactive directory, and in step (c), information about the frame synthesis is recorded in the interactive directory. 44. The method according to § 42, in which information about the synthesis of the frame includes at least one of: information about the type of display screen for setting the aspect ratio of the frame in which the AV frame is synthesized with the frame of the marked-up document, information for specifying a display mode for setting the display mode of the AV frame, information for setting the background color for setting the background color of the frame, information for setting the fitting area for the fitting area of the frame in which the AV frame is synthesized with a frame of the marked-up document, window setting information for setting the window, in torus synthesized picture is displayed on the display screen, and the information domain of the AV adjusting for specifying the zoom area, and reduce a desired portion of AV block. 45. The method of claim 44, wherein the display mode setting information indicates at least one of: an embedded mode in which at least an AV frame is embedded in at least a portion of the frame of the markup document, the mode " picture-in-picture (CVC), in which an AV frame is superimposed on a frame of a markup document, and a background mode in which a frame of a markup document is superimposed on an AV frame. 46. The method according to item 44, in which, in step (b), the content to be displayed is recorded in an area displayed regardless of the aspect ratio of the display, that is, in the active area, and non-essential content is recorded in another area or no content is recorded . 47. The method according to item 46, in which when displaying a markup document having a first aspect ratio on a display having a second aspect ratio having a resolution lower than the resolution of the first aspect ratio, the active region is selected using the information for specifying the fit region of the synthesized frame , and the selected active area is converted to a predetermined area of the display screen using the window information of the synthesized frame. 48. The method of claim 44, wherein the frame synthesis information further includes setting window information of an AV frame for setting a window in which an AV frame is displayed on a display screen. 49. The method according to § 42, in which, in step (c), an object is recorded that has variable properties for controlling the CCC and a program controlling the CCC based on this object. 50. The method according to § 49, in which the property variables include at least one of: a display display mode for setting a frame aspect ratio in which an AV frame is synthesized with a frame of a markup document, a property for setting an display mode of an AV frame , a property for specifying the background color of the frame, a property for specifying the area of the fit of the frame in which the AV frame is synthesized with the frame of the marked-up document, a property for specifying the window in which the synthesized frame is displayed on the display screen, and a property for specifying the fit area and to increase and decrease the required part of the AV frame. 51. The method according to item 50, in which in response to the conversion of the screen mode by the user and using the source object, the program controls a property defining a fitting region of a synthesized frame, a property specifying a window region of a synthesized frame, and a property specifying a fitting region of an AV frame according to a display mode display, thus restoring the aspect ratio of the frame. 52. The method of claim 49, wherein the property variables include at least one of: a display display mode for setting a frame aspect ratio in which an AV frame is synthesized with a frame of a markup document, a property defining an display mode of an AV frame , a property specifying the background color of the frame, a property specifying a fitting area of a frame of a marked-up document, a property specifying a window in which a frame of a marked-up document is displayed on a display screen, a property specifying a fitting area for enlarging and decreasing a desired part AV frame, a property that defines the window in which the AV frame is displayed on the display screen. 53. The method according to paragraph 52, in which in response to the conversion of the screen mode by the user, the program, using the source code of the object, controls a property defining a fitting region of a marked-up document of a frame, a property specifying a window region of a frame of a marked-up document, a property specifying an adjustment region of an AV frame and a property defining an AV frame window according to the display display mode, thereby restoring the aspect ratio of the frame. 54. A method of reproducing audio-video data (AV), including audio data and video data recorded on a storage medium, comprising the steps of: (a) interpreting a markup document for displaying together with AV data; (b) interpreting the frame synthesis information that describes at least two display modes, including the built-in mode, for jointly displaying the frame of the markup document obtained by reproducing the markup document and the AV frame obtained by reproducing the AV data; and (c) displaying an AV frame and a frame of the marked-up document in one of the display modes according to the interpreted frame synthesis information. 55. The method according to item 54, in which step (c) includes displaying by embedding an AV frame in at least part of the frame of the marked-up document. 56. The method according to item 54, in which step (c) includes displaying by using the picture-in-picture (PIC) method for applying an AV frame to a frame of a marked-up document. 57. The method of claim 54, wherein step (c) includes displaying, by overlaying an AV frame and a frame of the marked-up document. 58. The method of claim 54, wherein step (b) includes interpreting a stylesheet file associated with or embedded in the markup document. 59. The method of claim 58, wherein step (b) comprises (b11) interpreting the link tag, in which reference information for calling the cascading style sheet (CCC) file is recorded, and calling the CCC file; and (b12) interpreting the called CCC file. 60. The method of claim 59, wherein step (b12) includes reading display mode setting information specifying an AV frame display mode and setting area fitting information specifying an increase and decrease region of a desired portion of the AV frame. 61. The method of claim 60, wherein step (b12) includes additionally reading information about the type of display screen representing the aspect ratio of the frame, in which the AV frame is synthesized with the frame of the marked-up document, background color setting information for setting the background color of the frame, information for specifying a fitting region for a region for fitting a frame in which an AV frame is synthesized with a frame of a marked-up document, and information for specifying a window defining a window in which the synthesized frame is displayed on a display screen. 62. The method according to § 59, in which step (b12) further includes reading information about the type of display screen representing the aspect ratio of the frame, in which the AV frame is synthesized with the frame of the marked-up document, background color setting information specifying a background color of the frame, information for specifying a fitting region of a marked-up document defining a fitting region for a frame of a marked-up document, information for specifying a window of a marked-up document specifying a window in which the marked-up document is displayed on a display screen, a part of the AV fit, specifying the area of increase or decrease of the required part of the AV frame, and the window specifying information of the AV frame defining a window in which the AV frame is displayed on the display screen. 63. The method of claim 60, wherein step (b) further comprises an step (b13) of interpreting a program programmed based on an object having property variables that control the CCC to control the CCC. 64. The method according to item 63, in which step (b13) further includes increasing / decreasing the outputted AV frame by controlling a property specifying the display mode of the AV frame and a property specifying a fitting region of the AV frame to increase and decrease the required part of the AV frame according to user input using a program using the source object. 65. The method according to item 63, in which step (b13) further includes controlling a property defining a fitting region of the synthesized frame, a property defining a window region of the synthesized frame, and a property defining an adjustment region of the AV frame according to the display mode of the display using the program using the original object in response to the user converting the display mode, thereby restoring the aspect ratio of the frame. 66. The method of claim 63, wherein (b13) further includes controlling a property defining a frame region of a markup document, a property defining a window region of a frame of a markup document, a property defining a fitting region of an AV frame, and a property defining a window region An AV frame according to the display mode of the display using a program using the source code of the object, in response to the user converting the display mode, thereby restoring the aspect ratio of the frame. 67. A method of reproducing AV data including audio and video data having a predetermined aspect ratio recorded on a storage medium and a markup document having a predetermined aspect ratio, and displaying AV data and a markup document, the method includes the steps of: (a) reading information about the synthesis of the frame corresponding to the frame mode, including the aspect ratio set in the playback device, or set by the user; and (b) interpreting the read information about the synthesis of the frame, displaying the AV frame obtained by reproducing the AV data and the frame of the markup document obtained by reproducing the markup document intended to be displayed together with the AV data, and changing the output state of the frame of the markup document in response to change the frame mode. 68. The method of claim 67, wherein step (b) includes: (b1) selecting a default style sheet in the reproducing apparatus based on the set frame mode; (b2) reading frame synthesis information specified in the selected default stylesheet, including fit area specifying information specifying a fit area of an AV frame and a markup document frame, window specifying information defining a window in which the synthesized frame is displayed on a display screen , and information for specifying an AV fit region specifying an area for increasing and decreasing a desired portion of an AV frame; and (b3) checking the stylesheet associated with or inserted into the markup document, displaying the markup document using the frame synthesis information in the default stylesheet if the stylesheet is not in the markup document, and displaying the markup document using the frame synthesis information specified in the corresponding stylesheet if the stylesheet is present in the markup document. 69. The method according to p, in which step (b30) includes: (b31) determining whether the user has changed the frame mode; (b32) if the frame mode has been changed, transmitting control information about the change in the frame mode to the markup document and executing a script therein; and (b33) changing the output state of the frame of the marked-up document in response to a change in the frame mode using the properties of the display screen. 70. The method of claim 69, wherein step (b33) includes, in the built-in interactive mode or the KVK mode, outputting AV data in a first aspect ratio if the AV data having a first aspect ratio is displayed on a display having a second aspect ratio with a lower resolution than the resolution of the first aspect ratio, and in the background of the interactive mode or video mode, the output of AV data in the form of pan & scan, in which both sides of the image formed in widescreen frame mode, are cropped and only the middle part frame is selected for display, or a letter box in which a black bar is inserted in the upper and lower parts of the frame, and the frame is reduced so that the user can effectively view the image formed in the widescreen frame mode on a conventional display. 71. The method of claim 68, wherein step (b) includes (b1) selecting a default style sheet in the reproducing apparatus based on the set frame mode; (b2) reading the frame synthesis information specified in the selected default stylesheet, including the job information of the markup document window specifying a window in which the markup document frame is displayed on the display screen, and the job information of the fit area of the tagged document specifying the fit area frame of the marked-up document, information of setting the AV fitting region, defining an area for increasing and decreasing the required part of the AV frame, and information of specifying the region of the AV window, defining a window in which the AV frame maps the on screen display; and (b3) checking the stylesheet associated with or embedded in the markup document, displaying the markup document using the default frame synthesis information in the default stylesheet if the stylesheet is not in the markup document, and displaying the markup document using frame synthesis information specified in the corresponding stylesheet if the stylesheet is present in the markup document. 72. The method according to p, in which step (b3) includes: (b31) determining whether the user has changed the frame mode; (b32) if the frame mode has been changed, transmitting control information about the change in the frame mode to the markup document and executing a script from it; and (b33) changing the output state of the frame of the marked-up document in response to a change in the frame mode using the properties of the display screen. 73. The method of claim 72, wherein step (b33) includes outputting without converting AV data having a first aspect ratio, using fit region setting information and window area setting information for the frame of the marked-up document and setting area adjustment information and task information window regions for an AV frame that are respectively set when AV data having a first aspect ratio is displayed on a display having a second aspect ratio with a lower resolution than the resolution of the first aspect ratio tions. 74. An apparatus for reproducing AV data including audio and video data recorded on a storage medium, said device including a reader module that reads AV data and a markup document for displaying together with AV data; a decoder that decodes the AV data read by the reader and produces an AV frame; and a controller that interprets the markup document read by the reader, provides a frame of the markup document, interprets the frame synthesis information that describes at least two display modes for displaying the frame of the markup document together with the AV frame, and displays the AV frame and the markup frame document in one of the display modes according to the interpreted information about the synthesis of the frame, and the information about the synthesis of the frame includes at least one of: information specifying the mode is selected The information specifying the display mode of the AV frame, the background color specifying information, the frame background color specifying, the fitting region setting information specifying the frame fitting area in which the AV frame is synthesized with the frame of the marked-up document, window specifying information defining a window in which the synthesized frame is displayed on the display screen, and information of setting the AV fit region defining an area for increasing and decreasing the required part of the AV frame. 75. The apparatus of claim 74, wherein the display mode setting information indicates at least one of: an embedded mode in which at least an AV frame is embedded in at least a portion of the frame of the markup document, the mode " picture-in-picture (CVC), in which an AV frame is superimposed on a frame of a markup document, and a background mode in which a frame of a markup document is superimposed on an AV frame. 76. The device according to p. 74, in which the controller interprets the cascading style sheet (CTC) associated with the marked-up document or embedded in the marked-up document, and interprets the program that controls the CTC, developed on the basis of variable properties that control the CTC. 77. The device according to p, in which the controller controls the property that sets the display mode of the AV frame, and the property that sets the area of fit of the AV frame to increase and decrease the required part of the AV frame using a program that uses the built-in source object according to user input, and increases / reduces the output AV frame. 78. The device according to p. 74, further comprising a mixer that together displays the AV frame and the frame of the marked-up document using the display command according to the frame synthesis information interpreted by the controller. 79. A device for reproducing AV data, including audio and video data recorded on a storage medium, said device includes: a reader module that reads the AV data and a markup document for displaying together with the AV data; a decoder that decodes the AV data read by the reader and produces an AV frame; and a controller that interprets the frame synthesis information corresponding to the frame mode set in the reproducing apparatus or set by the user interprets the markup document for displaying together with the AV data read by the reader using the frame synthesis information, displays the frame of the markup document and changes the output state of the frame of the marked-up document in response to a change in the frame mode, wherein the frame synthesis information includes at least , one of: information on the display type of the display specifying the aspect ratio of the frame in which the AV frame is synthesized with the frame of the marked-up document, information on specifying a display mode specifying the display mode of the AV frame, background color specifying information specifying the background color of the frame, fitting area specifying information defining a frame fitting region in which an AV frame is synthesized with a frame of a marked-up document, window setting information, a window specifying a window in which the synthesized frame is displayed on the display screen, and region setting information Part of the AV fit, specifying the area of increase and decrease of the required part of the AV frame. 80. The device according to p, in which the information sets the display mode indicates at least one of: an embedded mode in which at least an AV frame is embedded in at least part of the frame of the marked-up document, picture mode in the picture (CVC), in which the AV frame is superimposed on the frame of the marked-up document, and the background mode, in which the frame of the marked-up document is superimposed on the AV frame. 81. The device according to p. 80, in which the controller interprets the cascading style sheet (CTC) associated with the marked-up document or built into it, and interprets the program that controls the CTC, developed on the basis of variable properties that control the CTC. 82. The device according to p, in which the controller controls a property defining a fitting region of a synthesized frame, a property specifying a window region of a synthesized frame, and a property specifying a fitting region of an AV frame in a style sheet file interpreted according to a display display property by a program, using the embedded source object in response to a change in the display mode by the user. 83. The device according to p. 80, in which the controller controls that in the built-in interactive mode or KVK mode, if AV data having a first aspect ratio is displayed on a display having a second aspect ratio, with a lower resolution than the resolution of the first aspect ratio, AV data is output by a decoder with the first aspect ratio, and in the background of interactive mode or video mode, AV data is output by a pan & scan decoder in which both sides of the picture are formed in wide format frames, they are cropped and only the middle part of the frame is selected for display, or a letter box in which a black bar is inserted in the upper and lower parts of the frame, and the frame is reduced so that the user can effectively view the picture formed in the widescreen frame mode on a conventional display. 84. The device according to p, in which the information about the synthesis of the frame includes at least one of: information about the display type of the display that defines the aspect ratio of the frame, in which the AV frame is synthesized with a frame of the marked-up document, information about the display mode for setting the display mode of the AV frame, information for setting the background color for setting the background color of the frame, setting information for the fitting area of the marked-up document for setting the fitting area for the marked-up document, setting information for the window of the marked-up document for I specify a window in which the frame of the marked-up document is displayed on the display screen, information on specifying the area of fit of the AV to specify the area of increase and decrease of the required part of the AV frame, and information on specifying the area of the window of the AV frame for specifying the window in which the AV frame is displayed on the display screen. 85. The apparatus of claim 84, wherein the controller controls a property specifying a frame region of a markup document, a property specifying a region of a frame window of a markup document, a property specifying a region of fitting an AV frame, and a property specifying a region of an AV frame window in a stylesheet file interpreted according to the display property of the display using a program using the source code of the object in response to a user changing the screen mode, thereby restoring the aspect ratio of the frame. 86. The device according to claim 85, in which AV data having a first aspect ratio is output by the decoder without conversion, using fit region setting information and frame window area setting information of the markup document and fit area setting information and window area setting information of the AV frame, which respectively, if AV data having a first aspect ratio is displayed on a display having a second aspect ratio, having a lower resolution than the resolution of the first aspect ratio. 87. The device according to p. 79, further comprising a mixer that together displays the AV frame and the frame of the marked-up document using the display command according to the frame synthesis information interpreted by the controller. Priority on points: 10/23/2001 - claims 1-10, 14-17, 19, 22-23, 40-43, 49, 54-60, 63, 74, 76-78; 03/18/2002 - pp. 12, 20, 24-25, 67-69, 79, 87; 05/31/2002 - pp. 11, 13, 18, 21, 26-39, 44-48, 50-53, 61-62, 64-66, 70-73, 74-75, 79-86.

Images