KR101102679B1 - Recording medium, playback apparatus and method, recording method, and computer-readable medium - Google Patents

Abstract

BD-ROM stores video streams and graphics streams. The video stream represents a video. The graphics stream is used to overlay a multi-page menu over a moving image and includes interactive control information (ICS) and graphics data (ODS) used to generate a multipage menu. The PTS attached to the PES packet containing the interactive control information indicates the timing for the first display of the main page of the multipage menu according to the video stream reproduction processing. In addition, the interactive control information includes information (selection_time_out_pts) indicating the timeout when the on-page button of the multi-page menu is automatically activated and information (user_time_out_duration) indicating the timeout when the subpage of the multi-page menu is automatically removed. do.

BDROM, Overlay, Multipage, Menu, Interactive, Buttons

Description

RECORDING MEDIUM, PLAYBACK APPARATUS AND METHOD, RECORDING METHOD, AND COMPUTER-READABLE MEDIUM}

The present invention relates to the field of user interface control. More specifically, the present invention relates to an improvement of a record carrier used for consumer movie distribution as well as in a consumer playback device having a user interface for playback of the record carrier.

The user interface using the menu structure is an essential function for receiving user operations such as the selection of languages and chapters for playback.

When a movie provides multiple user-selectable options, such as chapters, there may be cases where not all options can be provided in a single screen display. Thus, there is a need for a multi-page menu in which a plurality of pages are displayed sequentially in response to a user operation, so that various options are appropriately displayed on each page of the menu.

However, unfortunately if too many pages are displayed, these pages occupy most of the screen, thus preventing viewing the main movie which is also displayed on the screen. This problem can be avoided by repeating the operation of removing each page that the user is no longer interested in. However, the need to continue this cumbersome operation may be another factor that prevents the user from watching a movie.

In addition, the interactive control provided by DVD has the following disadvantages. For each menu to be displayed, access to the DVD needs to be made to read the page information. Because of this access, the menu page cannot be displayed without interruption in video playback. This interruption makes it difficult for the user to concentrate on the movie.

It is an object of the present invention to provide a recording medium supporting the display of a multi-page menu that will not interfere with video playback.

In order to achieve the above object, the recording medium of the present invention is a recording medium in which a video stream and a graphics stream are recorded, the graphics stream including at least one conversation control segment and an object definition segment defining a graphics object. The control segment includes a plurality of page information, time information, and stream model information. The plurality of page information is information defining a screen configuration of a multipage menu, each page information includes one or more button information, and each button information. Is information for realizing an interactive screen configuration on each page constituting a multipage menu by displaying a graphic object in a state of a button member, wherein the time information includes timeout information, and the timeout information is a multipage menu. Out of buttons present within each page of Indicates a time for activating a button member which is in a selected state after a predetermined time elapses, wherein the time information further includes composition timeout information, and the composition timeout information indicates a time for ending conversation control. The stream model information indicates whether the graphics stream is multiplexed with the video stream and recorded on the recording medium, or the graphics stream is recorded on the recording medium without being multiplexed with the video stream. The timeout information and the composition timeout information include It is characterized in that it becomes valid only when the stream is multiplexed with the video stream and recorded on the recording medium.

According to the recording medium having the above-described structure, since the dialogue control segment of the graphics stream multiplexed in the video stream contains time information that defines the display state of the multipage menu accompanying the progression of the moving image, the reproduction of the movie is difficult. Allows you to automatically display multiple pages in the scene from which the scenery is being played. You can also automatically remove this page from the scene when movie playback reaches the climax scene. According to this control, the multi-page menu is displayed without disturbing the movie playback viewing. As a result, the user can enjoy the convenience provided by the multi-page menu while watching movie playback without disturbing display.

In addition, information used to control the multi-page menu operation is included in the graphics stream, which is multiplexed into the video stream. This structure allows the playback device to read the information necessary for the display of the multi-page menu without disturbing the reading of the video stream. Thus, the pages of the multi-page menu are displayed smoothly in synchronization with the video frame rate.

(First embodiment)

Hereinafter, an embodiment of a recording medium according to the present invention will be described. First, the use of a recording medium which is one embodiment of the present invention will be described. 1 shows a usage pattern of a recording medium according to the present invention. In the figure, the BD-ROM 100 is a recording medium according to the present invention. The BD-ROM 100 is used to provide a movie to a home theater system composed of a playback apparatus 200, a remote controller 300, and a television 400.

This concludes the description of the use of the recording medium according to the present invention. Next, the production of a recording medium which is another embodiment of the present invention will be described. The recording medium is implemented by improving the application layer of the BD-ROM. 2 shows a structural example of the BD-ROM 100.

In the figure, the BD-ROM 100 is shown at the fourth level, and the tracks of the BD-ROM are shown at the third level. The track spirals outward from the center of the actual BD-ROM, but in the figure unfolds in a straight line. The track is composed of a lead-in area, a volume area, and a lead-out area. The volume area has a layer model of physical layer, file system layer, and application layer. In the directory structure, the first level represents the format (application format) of the application layer of the BD-ROM.

In the figure, the BD-ROM has a root directory, a BDMV directory under the root directory, and a STREAM directory under the BDMV directory.

The STREAM directory contains AV clips and sub clips. AV clips and sub clips are included as files in the STREAM directory, such as "00001.m2ts", "00002.m2ts", and "00003.m2ts". Each file in the STREAM directory has the file name "xxxxx.m2ts" in a unified format, where x is any integer.

<AV clip structure>

Now, the AV clip will be described. 3 is a diagram schematically showing the structure of an AV clip.

In the figure, the intermediate level represents an AV clip. This AV clip can be generated as follows. The video stream consisting of a plurality of video frames (pictures pj1, pj2, pj3, ...) and the audio stream consisting of a plurality of audio frames, both shown in the upper first level, are all individually transformed into PES packets shown in the lower second level. Is further changed to the TS packet shown in the upper third level. Similarly, both presentation graphics streams (hereinafter referred to as "PG streams") and interactive graphics streams (hereinafter referred to as "IG streams") shown at the lower first level are individually changed to PES packets shown at the lower second level. And the TS packet shown in the lower third level is further changed. These TS packets of video, audio, PG and IG are multiplexed to form an AV packet.

PG and IG streams are data in the stream format used to combine graphics with each picture of the video stream. The data entity executed by the PG and IG streams to superimpose on the picture is called a "graphics object".

A PG stream is a graphics stream used for the presentation of subtitles using graphics objects.

An IG stream is a graphics stream used for interactive display of graphics objects. This concludes the description of the AV clip structure. Next, the AV clip and the sub clip will be described. Sub clips are not multiplexed. Rather, a subclip is a file containing only an IG stream, an audio stream, and text data. The IG stream stored as the sub clip is loaded into the memory in advance for synchronous reproduction with the AV clip. This operation of loading a sub clip into memory in advance is called "preloading".

Next, the IG stream will be described. 4A is a diagram illustrating the structure of an IG stream. At the first level, TS packet strings that make up the AV clip are shown. At the second level, the PES packet strings that make up the graphics stream are shown. The PES packet shown in the second level is formed by concatenating the payload of a TS packet having a preset PID in the TS packet column shown in the first level. The PG stream is not a subject matter of the present invention and no further explanation is provided.

At the third level, the structure of the graphics stream is shown. The graphics stream is composed of functional segments including an Interactive Composition Segment (ICS), a Palette Definition Segment (PDS), an Object Definition Segment (ODS), and an End of Display Set Segment (END). Of these functional segments, ICS is a display synthesis segment, while PDS, ODS, and END are positive segments. Each functional segment corresponds to a PES packet one-to-one or one-to-many. That is, one functional segment is written to the BD-ROM 100 after being changed into a single segment or after being fragmented and changed into multiple PES packets.

Hereinafter, these functional segments will be described one by one.

ICS is a functional segment used to define the interactive display synthesis of graphics. One example of interactive display synthesis is a multi-page menu.

ODS is a run-length encoded graphics object composed of a plurality of run-length data portions. Run-length data represents a column of pixels using a pixel code representing the pixel value and the continuous length of the pixel value. The pixel code is an 8-bit value representing one of the values from 1 to 255. Through the use of this pixel code, the run-length data sets any 256 pixel color of full color (16,777,216 colors).

PDS is a functional segment for storing palette data. The palette data represents a combination of pixel codes and pixel values of 1 to 255. The pixel value used here is composed of a red difference component (Cr value), a blue difference component (Cb value), a brightness component (Y value), and transparency (T value). Colors are created by replacing the pixel code of each part of the run-length data with the pixel values represented by the palette data.

END provides a clear indication that the delivery of the functional segment is complete. END is inserted into the graphics segment as the final segment. This concludes the description of each functional segment.

4B is a diagram illustrating a PES packet carrying a functional segment. As shown in the figure, each PES packet consists of a packet header and a payload. The payload is the entity carrying the functional segment, and the packet header carries the DTS and PTS associated with the functional segment. Hereinafter, the DTS and PTS of the packet header of the PES packet carrying the functional segment will be briefly described as the DTS and PTS of the functional segment.

These various kinds of functional segments define a logical structure as shown in FIG. In the figure, the first level represents Epoch, the second level represents DS (Display Set), and the third level represents the type of DS. The functional segments shown in the third level of FIG. 4A are shown in the fourth level of this figure.

The first level of Epoch refers to one time unit of continuous memory management on the AV clip playback time axis, and also refers to the data group assigned to this time unit. The memory mentioned here includes a graphics plane for storing one screen of graphics objects and an object buffer for storing uncompressed graphics data. Continuous memory management ensures that neither the graphics plane nor the object buffer is emptied in the entire epoch, and graphics clearing and rendering (to free up the means for clearing the entire graphics plane or the entire object buffer) It means that it is performed only within the set rectangular area. The size and position of this rectangular region is fixed in the entire epoch. As long as the clearing and rendering of the graphics is performed within this fixed rectangular region of the graphics plane, continuous playback is guaranteed. In other words, Epoch is a time unit of continuous playback on the AV clip playback time axis. In order to change the graphics clearing / rendering area of the graphics plane, it is necessary to define a point on the playback time axis at which the change is made and to set a new Epoch from that point onwards. In this case, the boundary between two epochs is not continuous.

Continuous playback herein means that graphics clearing and rendering ends with a predetermined number of video frames, respectively. For an IG stream, the number of video frames is 4-5. The number of video frames is determined based on the ratio of the fixed rectangular region to the entire graphics plane and the transfer rate between the object buffer and the graphics plane.

The second level of DS provides one complete display synthesis with a group of functional segments included in the graphics stream. In FIG. 5, the dotted line hk1 shows which Epoch belongs to the second level of DS. DS ₁ , DS ₂ , DS ₃ , ..., and DS _n appear to belong to the first Epoch of the first level.

The third level shows the kind of DS. Epoch's first DS is the "Epoch Start" DS. Each DS except the first one of Epoch is an "Acquisition Point" DS, a "Normal Case" DS, or an "Epoch Continue" DS. Although the DS is shown in the order of "Acquisition Point", "Normal Case", and "Epoch Continue", this order is merely an example and can be arranged in a different order.

The Epoch Start DS provides a "new display" effect and indicates the start of a new Epoch. Thus, Epoch Start DS contains all the functional segments needed for the next screen synthesis. The Epoch Start DS is provided at points where skipping is likely to occur, such as the beginning of a chapter in a movie.

The Acquisition Point DS provides a "display refresh" display effect and is identical in content to the earlier Epoch Start DS. The Acquisition Point DS is not the beginning of Epoch, but includes all the functional segments needed for the next scene synthesis. Thus, the graphics can be displayed reliably when playback starts from the Acquisition Point DS. In other words, Acquisition Point DS allows display synthesis to occur from the midpoint of the Epoch.

An Acquisition Point DS is provided at a point where a skip operation can be made, for example a point that can be designated by a time search. The time search is an operation for finding a playback point corresponding to the time input by the user in minutes / seconds. The time input is in relatively large units, such as 10 minutes and 10 seconds. Thus, Acquisition Point DS is provided at a point that can be designated by a time search made in units of 10 minutes and 10 seconds. By providing the Acquisition Point DS at this point that can be specified by the temporal search, playback of the graphics stream can be smoothly performed when the temporal search is performed.

The Normal Case DS provides a "dispaly update" display effect and only includes the difference from the previous display synthesis. For example, if the DSv is the same in content as the previous DSu but different in display synthesis, then the DSv is a Normal Case DS that contains only ICS or ODS. This eliminates the need to provide overlapping ODSs in the DS, thereby reducing the amount of data stored in the BD-ROM 100. Since the Normal Case DS contains the difference without overlapping data, the display composition cannot be displayed only with the Normal Case DS.

The Epoch Continue DS indicates at the start of an AV clip that one Epoch continues from another AV clip. For example, DS _n includes a composite state field with a value representing "Epoch Continue." In this case, even though the two DSs are in different AV clips, DS _n belongs to the same Epoch as the previous DS _n-1 . Since DS _n and DS _n-1 belong to the same Epoch, there will be no emptying of the graphics plane and object buffer even if there is an AV clip boundary between the two DSs.

In FIG. 5, the dotted line kz1 shows which DS the functional segment of the fourth level belongs to. Since the functional segments shown in Figs. 4A and 5 are the same, it is found that the functional segments shown in Fig. 4A belong to the Epoch Start DS. The functional segments belonging to the Acquisition Point DS are the same as those belonging to the Epoch Start DS. Also, except that some of the functional segments are omitted from the Normal Case DS, the functional segments belonging to the Normal Case DS are the same as those belonging to the Epoch Start DS.

This concludes the description of the logical structure defined by the functional segment. Next, arranging DSs having ICS and ODS on the AV clip playback time axis will be described. Since Epoch is a time unit of continuous memory management and contains one or more DSs, it is important how such DSs are placed on the AV clip playback time axis. Note that the "AV clip reproduction time axis" means the time axis used to define the decoding timing and the reproduction timing of individual pictures multiplexed in the AV clip. Decode timing and playback timing are displayed with a time accuracy of 90 KHz. The DTS and PTS of ICS or ODS in DS show timing based on which synchronization control is implemented. The DS is placed on the AV clip playback time axis by performing synchronous control in association with each DTS and PTS attached to the ICS and the ODS.

Indicates the Epoch within any one of the DS as DS _n DS and _n is assumed to be placed in the AV Clip playback time axis on the basis of the DTS and PTS set as shown in FIG.

6 shows an AV clip playback time axis in which DS _n is arranged. In the figure, the DS _n period starts at the time indicated by the DTS value of the ICS belonging to DS _n (DTS (DS _n [ICS])) and the PTS value of END belonging to DS _n (PTS (DS _n [ICS])) End at the time indicated. Display timing for the first display of the DS _n represents the PTS value of the _{ICS (PTS (DS n [ICS} ])). By adjusting the PTS (DS _n [ICS]) value to correspond to the display timing of the desired picture in the video stream, the first indication of DS _n will be synchronized with the video stream.

The PTS (DS _n [ICS]) value is the sum of the time it takes to decode the ODS (DECODEDURATION) and the time it takes to transmit the decoded graphics object (TRANSFERDURATION). The decoding of the ODS necessary for the first indication is completed within DECODEDURATION. The period mc1 shown in FIG. 6 is a time required for decoding ODS _m which is any one ODS in DS _n . The start of the decoding period mc1 is represented by DTS (ODS _n [ODS _m ]), and the end of the decoding period mc1 is represented by PTS (ODS _n [ODS _m ]).

Epoch is defined by placing all ODS in the Epoch on the AV clip playback time axis as described above. This concludes the discussion on the AV clip playback time axis.

One of the features of the first embodiment is to control the operation of the multi-page menu as the AV playback proceeds. The new structure that implements this feature is in the interactive_composition structure provided by ICS. Hereinafter, the interactive_composition structure will be described.

7A and 7B are diagrams illustrating a relationship between an interactive_composition structure and an ICS. The interactive_composition structure and the ICS may be a one-to-one correspondence as shown in FIG. 7A, or a one-to-many correspondence as shown in FIG. 7B.

The one-to-one correspondence can be applied when the interactive_composition structure is small enough to be included in one ICS.

The one-to-many correspondence is applicable when the interactive_composition structure is too large to be fragmented to be carried by one ICS and stored in multiple ICSs. Since the interactive_composition structure can be fragmented to be stored in multiple ICSs, there is no limit on the size of the interactive_composition structure. As described above, one interactive_composition structure may correspond to multiple ICSs. However, for simplicity, the following description presupposes that the ICS and interactive_composition structure are in a one-to-one correspondence.

8 is a view showing the internal structure of the ICS. ICS includes one interactive_composition structure or a fragment of one interactive_composition structure. As shown on the left side of Fig. 8, the ICS consists of the following fields: "segment_descriptor" indicating a segment type of the ICS; "Video_descriptor" representing the width and height of the video plane in pixels and the frame rate of the associated video stream; " composition_descriptor " indicating information of composition_state and indicating whether the DS type to which the ICS belongs is a Normal Case DS, an Acquisition Point DS, an Epoch Start DS, or an Effect_Sequence; And "interactive_composition_data_fragment" indicating whether the ICS carries the entire interactive_composition structure or a fragment of the interactive_composition structure.

As indicated by arrow cu1, FIG. 8 details the internal structure of the interactive_composition structure. The interactive_composition structure has the following fields. That is, "interactive_composition_length", "stream_model", user_interface_model "," composition_time_out_pts "," selection_time_out_pts "," user_time_out_duration "," page_information (1), (2) for each page of the multi-page menu available for display. .. (i) ... (number_of_page_1) ".

The interactive_composition_length field represents the length of the interactive_composition structure.

The "stream_model" field indicates the type of stream model of the associated interactive_composition structure. The stream model shows how the interactive_composition structure is stored on the BD-ROM and how the data will be processed by the player's buffer (hereinafter referred to as the "synthesis buffer"). Specifically, the stream model can be configured such that (i) the graphics stream is multiplexed and loaded separately into the AV and loaded into the synthesis buffer, or (ii) the graphics stream is stored as a subclip of a file separate from the AV clip and pre-stored in the synthesis buffer. Show if it is loaded. The stream_model field is provided in the interactive_composition structure because the synthesis buffer needs to perform different processing depending on whether the interactive_composition structure is preloaded or multiplexed. 9 is a diagram illustrating a process performed for a "Multiplexed" ICS. In the figure, the video stream multiplexed in the AV clip is shown at the fourth level, and the graphics stream multiplexed in the AV clip is shown at the third level. The graphics stream includes three DSs, namely DS1, DS2, and DS8. The second level represents AV playback processing. The first level represents the content stored in the synthesis buffer at different times of AV playback. When the current playback point reaches the head of DS1 multiplexed in the AV clip, DS1 is loaded into the synthesis buffer indicated by arrow pf1. As a result, the synthesis buffer stores DS1 [ICS]. Then, when the current playback point reaches the head of DS2 multiplexed in the AV clip, DS2 is loaded into the synthesis buffer indicated by arrow pf2. As a result, the synthesis buffer stores DS2 [ICS]. In other words, if stream_model is "Multiplexed", there is more than one interactive_composition structure. The player discards the currently stored interactive_composition structure and loads another interactive_composition structure located at the current playback point. Thus, the synthesis buffer stores one interactive_composition structure at a time.

Such discarding and loading operations are particularly effective during skip operations. When the skip operation is performed, the interactive_composition structure associated with the current playback point is no longer needed. Thus, the playback device discards the interactive_composition structure of the current synthesis buffer. As shown in Fig. 9, when the skip operation am1 is executed, the synthesis buffer discards the content stored at the execution timing am2 of the skip operation. Then, DS8 [ICS] located at the skip destination is loaded into the synthesis buffer as indicated by the arrow pf3.

As described above, in the case of the "Multiplexed" type stream model, a synthesis buffer is needed to discard the stored interactive_composition structure as the AV playback progresses. On the other hand, for the "preload" type stream model, no composition buffer is needed to discard the stored interactive_composition structure. If the AV buffer discards the interactive_composition structure in which the synthesis buffer is stored, the same interactive_composition structure as the discard needs to be reloaded from the BD-ROM. This useless operation of reloading the same interactive_composition structure introduces additional load. 10 is a diagram illustrating the contents of a synthesis buffer. FIG. 10 is similar to FIG. 9 for what appears at each of the first to fourth levels. However, FIG. 10 differs from FIG. 9 for the contents of the synthesis buffer stored at different times. Specifically, even if the current playback point reaches where the DS1 is multiplexed, the ICS of the DS1 is not loaded into the synthesis buffer (indicated by the "x" mark in the figure).

Likewise, even if the current playback point reaches where the DS2 is multiplexed, the ICS of the DS2 is not loaded into the synthesis buffer (indicated by the "x" mark in the figure). Similarly, the content stored in the synthesis buffer is maintained without discarding even if the skip operation is executed. The interactive_composition structure includes a stream_model field for accurately determining whether the controlling entity (graphics controller) discards the stored interactive_composition structure according to the progress of the AV playback or maintains the stored interactive_composition structure regardless of the progress of the AV playback. This concludes the description of the stream_model field.

Returning to Fig. 8, "user_interface_model" indicates the type of user interface model to be used for the interactive_composition structure. user_interface_model represents one of "Always-On U / I" or "Pop-Up U / I". When Always-On U / I is used, the menu appears on the screen and disappears as the AV clip plays. When Pop-Up U / I is used, the menu appears on the screen and disappears in response to user operation.

composition_time_out_pts shows the end time of the Epoch to which the ICS belongs. Interactive controls defined by ICS are no longer valid at the Epoch End. That is, the time point indicated by the composition_time_out_pts field is the end between the effective interactive controllers.

The "selection_time_out_pts" field represents the button selection end time. At the time indicated by the selection_time_out_pts value, the currently selected button is automatically activated. Note that the button is the element that displays the options in the multi-page menu. The selection_time_out_pts field is a valid interaction period for user interaction to activate a button.

The IF statement (if (stream_model == '0b')) shown in the figure means that the "composition_time_out_pts" and "selection_time_out_pts" fields described above are optional functions provided only when the "stream_model" field indicates a "Multiplexed" type. In the case of an ICS of which the stream model is a "Preload" type, neither the "composition_time_out_pts" nor the "selection_time_out_pts" fields are provided.

The user_time_out_duration field represents a timeout in which the page on the screen displayed in response to the user operation is removed. When Always-On U / I is used, pages after the second page (called subpages) are displayed in response to user interaction. Therefore, after the timeout defined by user_time_out_duration, the first page is left on the screen and all subpages are removed from the screen. When Pop-Up I / O is used, not only subpages but all pages of the multi-page menu are displayed corresponding to user operations. Therefore, after user_time_out_duration, all on-screen pages are removed without leaving any pages (No Menu Display).

Next, the meaning of the selection_time_out_pts and composition_time_out_pts fields of the Epoch will be described.

FIG. 11 is a timing chart illustrating functions of selection_time_out_pts and composition_time_out_pts fields of ICS belonging to DS _n when DS _n is Epoch Start DS (n = 1). The timing chart shows that the composition_time_out_pts value specifies the end of the epoch. The interactive display is valid for a period from PTS (DS _n [ICS]) to Epoch END. This period is referred to as the "interactive display period".

selection_time_out_pts specifies the time that precedes the Epoch END. User interaction may occur for a period up to the time specified by the selection_time_out_pts value in the PTS (DS _n [ICS]). This period is called the "effective interaction period". As above, the selection_time_out_pts field defines the end time of a period starting from the first display of the interactive display and available for user interaction. The composition_time_out_pts field defines a period starting from the first display of the interactive display and remaining in the interactive display of the Epoch. This concludes the description of the selection_time_out_pts and composition_time_out_pts fields. Next, the multi-page menu state change defined by the selection_time_out_pts, composition_time_out_pts, and user_time_out_duration fields will be described.

12A illustrates a state change of a multi-page menu based on selection_time_out_pts, composition_time_out_pts, and user_time_out_duration fields. 12A illustrates a state change of a multi-page menu when Pop-Up U / I is used. The multi-page menu shown in the figure has the following three states. That is, No Menu Display, 1st Page Only, and Multi-Page Exist.

1st Page Only displays only the first page of the multi-page menu.

In Multi-Page Exist, the page after the second page (the sub page) is displayed in addition to the first page.

Arrow jt1 represents the change from the No Menu Display state to the 1st Page Only state. This state change is triggered by the event "Pop-Up_On". "Pop-Up_On" is an event generated inside the playback apparatus in response to a user operation for a menu call.

Arrow jt2 represents the change from the 1st Page Only state to the No Menu Display state. This state change is triggered by the event "Pop-Up_Off". "Pop-Up_Off" is an event generated inside the playback apparatus in response to a user operation for removing a menu.

Arrows jt3 and jt4 represent the transition from the 1st Page Only state to the No Menu Display state and from the Multi-Page Exist state to the 1st Page Only state. This state change is triggered by the event "ChangeButtonPage" generated on timeout defined by selection_time_out_pts. ChangeButtonPage is an event generated inside the playback apparatus in response to a user operation for switching a menu page. This event is generated on the premise that a user operation for switching a menu page is made. selection_time_out_pts represents the time for forcibly invalidating a button to receive a user operation for switching a menu page. Therefore, the description of the selection_time_out_pts field implements a state change of "1st Page Only-> Multi-Page Exist-> 1st Page Only".

Arrow jt5 indicates the change from the 1st Page Only state to the No Menu Display state. Arrow jt6 indicates the change from the Multi-Page Exist state to the No Menu Display state. State change jt6 is started by the timeout of user_time_out_duration.

In the figure, the change from the 1st Page Only state jt5 and the Multi-Page Exist state jt6 to the No Menu Display state is defined by the user_time_out_duration field. That is, it is possible to define such a control that the on-screen menu page is automatically removed when the AV playback reaches the climax scene. This control eliminates the menu page from disturbing viewing of the video stream playback.

12B shows the state change of the multi-page menu when Always-On U / I is used. Arrow at1 indicates the change from the No Menu Display state to the 1st Page Only state. This state change is triggered by the event "Epoch Start". "Epoch Start" is an event that indicates that the current playback point has reached the point corresponding to the PTS associated with the interactive_composition structure. The first page shows that as the video stream plays, it is automatically displayed without waiting for any user interaction.

Arrow at2 represents the change from the 1st Page Only state to the Multi-Page Exist state, and arrow at3 represents the change from the Multi-Page Exist state to the 1st Page Only state. This state change is initiated by the event ChangeButtonPage generated at the timeout of the valid interaction period defined by selection_time_out_pts.

Arrow at4 represents the change from the Multi-Page Exist state to the 1st Page Only state. This state change is initiated by the timeout of user_time_out_duration. As is clear from this state change, when Always-On U / I is used, the state change is made to the 1st Page Only state instead of the No Menu Display state at the timeout of user_time_out_duration.

Arrow at5 represents the change from the 1st Page Only state to the No Menu Display state. This state change is started by the time in composition_time_out_pts. Note that composition_time_out_pts represents the end of the epoch.

As is apparent from FIGS. 12A and 12B, the multi-page menu operation is defined by the selection_time_out_pts, user_time_out_duration, and composition_time_out_pts fields provided in the interactive_composition structure.

13-15 show screen displays provided under the control defined as described above. 13 shows a display scenario including a multi-page menu. In this scenario, the multi-page menu is not initially displayed on the screen. The first page of the multi-page menu is displayed when the current playback point reaches point t, and the sub page is further displayed at point t2. If the current playback point reaches point t3, the subpage on the screen is removed leaving only the first page on the screen. The first page is then removed at point t4, leaving the no menu page displayed on the screen.

At the bottom of FIG. 13, an interactive_composition structure is described that achieves the display scenario described above. PTS (DS _n [ICS]) is set to a value corresponding to point t1, selection_time_out_pts is set to a value corresponding to point t2, user_time_out_duration is set to a value corresponding to point t3, and composition_time_out_pts corresponds to point t4 It is set to a value. According to this setting, the multi-page menu performs the state change shown in FIG.

Hereinafter, the setting of the selection_time_out_pts value will be described in detail with reference to specific examples.

14A-14C show display examples defined by selection_time_out_pts. As shown in FIG. 14A, at point t1, the first page of the multi-page menu is overlaid with the picture of the video stream. The picture displayed at the t2 point is a landscape scene and is less important in the story of the AV clip. Since this picture does not display valuable content for the user, the selection_time_out_pts value is set to automatically activate the button displayed on the first page at point t2. As a result, the sub page is overlaid with the landscape screen shown in FIG. 14B, and the composite image shown in FIG. 14C appears on the screen.

In a similar manner, user_time_out_duration will be described with reference to a specific display example. 15A-15D show examples of display defined by user_time_out_duration. In this example, the multi-page menu is in a Multi-Page Exist state where multiple subpages (second, third, and fourth pages) are displayed on the screen as shown in FIG. 15A. In this Multi-Page Exist state, the pages of the multi-page menu are overlaid with the picture contained in the video stream. Here, the image to be displayed at the point t3 is a character image as shown in Fig. 15B. In this case, the plurality of subpages overlaid with the image cover most of the character image as shown in FIG. 15C. As a result, the facial expressions of the character video cannot be seen. To avoid this disturbance, user_time_out_duration is set to a value corresponding to the time just before the point t3. According to this setting, the multi-page menu changes state from the Multi-Page Exist state to the 1st Page Only state. As a result, the composite image as shown in Fig. 15D is displayed at the point t3. Here, the first page is displayed on the screen alone without overly obstructing the character image. Also, since the first page remains on the screen without removing all pages of the multi-page menu, there is no need to call the menu again.

As described above, according to the first embodiment, the ICS multiplexed on the graphics stream includes control information defining the action of the multi-page menu as the AV playback progresses. Accordingly, it is possible to define such a control in which a large number of pages are displayed while playing a less important scene such as a landscape scene. According to this control, a menu page is displayed without interrupting the reproduction of the AV clip as the main content. Thus, the user can concentrate on watching the AV reproduction while enjoying the convenience of the multi-page menu function.

(Second embodiment)

The second embodiment is directed to display composition for displaying pages of a multi-page menu. According to a second embodiment, display composition is designed to display a number of graphical elements called buttons on the screen. In addition, animation effects are displayed on the screen before and / or after removing a menu page.

FIG. 16 is a diagram showing the internal structure of page information relating to any of the multiple pages of the multi-page menu (the x-th page). As shown on the left side of the drawing, the page information x is composed of the following fields. That is, "page_id" representing an identifier that uniquely identifies page x; "UO_mask_table"; "In_effects" for specifying animation effects to be displayed when the page (x) is inserted into the screen; "Out_effects"; which specifies the animation effect displayed after page x is removed from the screen; "Animation_frame_rate_code", which indicates the animation frame rate performed when displaying the animation effect for page (x); "default_selected_button_id_ref"; "default_activated_button_id_ref"; "pallet_id_ref"; And "button_info (1), (2) ... (number_of_button-1)" associated with one of the buttons displayed on the page x, respectively.

The UO_mask_table field represents permission and prohibition of user operation on the page x. If this field is set to a value indicating "prohibited", the corresponding user operation on the playback apparatus is invalid while page x is activated.

The default_selected_button_id_ref field shows whether the default selected button was dynamically or statically determined when starting the display of page x. When this field is set to "0xFF", the default selection button is dynamically determined. In that case, the value held in the Player Status Register (PSR) of the playback apparatus is interpreted first, and the button indicated by the PSR is selected. On the other hand, if this field is set to a value other than "0xFF", the button selected by default is statically determined. In that case, the PSR is overwritten with the default_selected_button_id_ref value, and this field is left with a specific button selected.

The default_activated_button_id_ref field represents a button that is automatically activated at a time defined by the default_selected_button_id_ref field value. When the value of the default_activated_button_id_ref field is set to "FF", the button in the selected state is automatically activated at the time-out. On the other hand, if this field is set to a value of neither "00" nor "FF", the value is interpreted as a valid button number that statically specifies a button that is automatically activated.

The pallet_id_ref field represents an ID associated with a pallet set in a CLUT unit described later.

Each button_info structure is information defining a button displayed on the page (x). By the above fields, each page of the multi-page menu is defined. Next, the internal structure of the button_info structure will be described. In the description, any one button on page x is defined as button (i). In FIG. 16, arrow cx1 shows that the internal structure of button_info (i) is extracted in detail.

Each button displayed on the page has three states: a normal state, a selected state, and an activated state. When the button is in the normal state, the button is simply displayed. When the button is in the selected state, the button is currently focused as a result of user manipulation but is not yet activated. When the button is in an active state, the button is activated. Since each button has these three states, button_info (i) has the following information.

The button_id field represents a value that uniquely identifies button (i) of the interactive_composition structure.

The button_numeric_select_value field is a flag indicating whether button (i) can select numbers.

The auto_action_flag field represents whether button (i) can be automatically activated. When the auto_action_flag field is set to ON (bit value of "1"), button (i) changes to the direct activation state, not the selected state at the time of selection. On the other hand, when the auto_action_flag field is set to OFF (bit value of "0"), the button (i) changes to the selected state instead of the activated state at the time of selection.

The button_horizontal_position field and the button_vertical_position field specify the horizontal and vertical positions of the leftmost pixel of button (i) on the interactive display, respectively.

The neighbor_info structure represents a button that receives a selected state in response to a user operation made to move focus in the up, down, left, and right directions when the button (i) is in the selected state. The neighbor_info structure consists of the upper_button_id_ref, lower_button_id_ref, left_button_id_ref, and right_button_id_ref fields.

The upper_button_id_ref field specifies the button number of the button that receives the selected state when a user operation instructing to move the focus upward while button (i) is in the selected state is made. Upward movement is performed by pressing Move Up key on the remote controller. If this field is set to the same number as button (i), user manipulation of the Move Up key is ignored.

Similarly, each of the lower_button_id_ref field, left_button_id_ref field, and right_button_id_ref field specifies the button number of the button that receives the selected state when a user manipulation instruction to move the focus down, left or right direction is made. Each operation is performed by pressing the Move Down key, Move Left key, and move Right key of the remote controller. If these fields are set to button numbers such as button (i), user operations on these keys are ignored.

The normal_state_info structure defines the normal state of button (i), and is composed of normal_start_object_id_ref, normal_end_object_id_ref, and normal_repeat_flag fields.

The normal_start_object_id_ref field specifies the initial value of the object_id value consecutively assigned to the ODS sequence used to indicate the normal state of the button (i) by animation.

The normal_end_object_id_ref field specifies the final value of the object_id values consecutively assigned to the ODS sequence used to indicate the normal state of the button (i) by animation. When the normal_end_object_id_ref field specifies an ID value such as normal_start_object_id_ref, the static image of the graphics object identified by the ID is displayed as button (i).

The normal_repeat_flag field specifies whether the animation of the button (i) in the normal state is repeated continuously.

The selected_state_info structure defines the selected state of button (i). The selected_state_info structure is composed of selected_state_sound_id_ref, selected_start_object_id_ref, selected_end_object_id_ref, and selected_repeat_flag fields.

The selected_state_sound_id_ref field specifies sound data to be reproduced as a click sound when button (i) is selected. The sound data is specified by the sound_id of the sound data portion contained in the file called sound.bdmv. When this field is set to "0xFF", note data is not related to the selected state of the button (i) and therefore the click sound is not played when the button (i) is changed to the selected state.

The selected_start_object_id_ref field specifies the initial value of the object_id value assigned consecutively to the ODS sequence used to indicate the normal state of button (i) by animation.

The selected_end_object_id_ref field specifies the final value of the object_id value assigned consecutively to the ODS sequence used to indicate the steady state of button (i) with animation. If the selected_end_object_id_ref field specifies an ID value such as selected_start_object_id_ref, the static image of the graphics object identified by the ID is indicated by button (i).

The selected_repeat_flag field specifies whether the animation of the button (i) in the selected state is to be repeated continuously. If selected_start_object_id_ref and selected_end_object_id_ref have the same value, the selected_repeat_flag field is set to a value of "00".

The activated_state_info structure defines the activation state of button (i), and is composed of activated_state_sound_id_ref, activated_start_object_id_ref, and activated_end_object_id_ref fields.

The activated_state_sound_id_ref field specifies sound data to be reproduced as a click sound when button (i) is activated. Sound data is specified by sound_id of the sound data portion contained in the sound.bdmv file. If this field is set to "0xFF", the note data is not related to the activation state of button (i) and therefore the click tone is not played when the button (i) is changed to the activation state.

The activated_start_object_id_ref field specifies the initial value of the object_id value consecutively assigned to the ODS sequence used to indicate the activation state of the button (i) by animation.

The activated_end_object_id_ref field specifies the final value of the object_id value assigned consecutively to the ODS sequence used to indicate the activation state of the button (i) by animation.

The "navigation_command" structure represents a navigation command to be executed when button (i) is activated. A typical example of a navigation command is the SetButtonPage command. The SetButtonPage command instructs the playback device to display the desired page of the multi-page menu along with the desired one of the buttons on the page in the selected state. According to such a navigation command, a content creator can easily describe page conversion in authoring.

This concludes the description of the button_info structure. Hereinafter, as shown in FIG. 17, reference is made to FIG. 18 showing an example of the button_info description for defining the state change of the buttons O-A to O-D. In Fig. 17, arrows hh1 and hh2 indicate a state change defined by the neighbor_info () structure of button_info (1) associated with the button O-A. In button_info (1), the lower_button_id_ref field is set to a value specifying button O-C. Therefore, if a user operation is made to the Move Down key while the button O-A is in the selected state (Fig. 17, up1), the button O-C receives the selected state (sj1). The right_button_id_ref field of button_info (1) is set to a value specifying button O-B. Thus, if user manipulation is made to the Move Right key while the button O-A is in the selected state (FIG. 17, up2), the button O-B receives the selected state (sj2).

Arrow hh3 in Fig. 17 indicates a button state change defined by the neighbor_info () structure of button_info (2) related to the button O-C. In button_info (2), the upper_button_id_ref field is set to a value specifying button O-A. Thus, if a user operation is made to the Move Up key while the button O-C is in the selected state (up3), the button O-A receives the selected state (sj3).

Hereinafter, graphic images of the buttons OA, OB, OC, and OD will be described. DS _n with ICS shown in FIG. 18 includes ODS 11-19 corresponding to the graphic image shown in FIG. The normal_start_object_id_ref and normal_end_object_id_ref fields of button_info (0) specify ODSs 11 and 13, respectively. Thus, the normal state of the button OA is animated by using the ODS 11-13 sequence. Similarly, the selected_start_object_id_ref and selected_end_object_id_ref fields of button_info (0) specify ODS 14 and 16, respectively. Thus, the normal state of the button OA is animated by using the ODS 14-16 sequence. According to this setting, when a user operation is made to make the button OA selected, the graphic image functioning as the button OA is changed from being displayed using the ODS 11-13 to being displayed using the ODS 14-16. Here, when the normal_repeat_flag field of the normal_state_info () structure is set to the value "1", the animated display of ODS 11-13 is repeated as shown by "(A) →" and "→ (A)". Similarly, if the selected_repeat_flag field of the selected_state_info () structure is set to the value "1", the animated display of ODS 14-16 is repeated as shown by "(B) →" and "→ (B)".

As above, the plurality of ODS sets that can be displayed in animation are associated with buttons O-A, O-B, O-C, and O-D. Thus, by the ICS referring to the ODS, such a control is defined in which a character image functioning as a button changes a facial expression in accordance with user manipulation.

This concludes the description of the button_info structure. Next, the animation effect will be described. As shown in Fig. 16, the in-effect field and the out-effect field specify an effect_sequence structure, respectively. 20 is a diagram illustrating an effect_sequence structure. As shown on the left side of the drawing, the effect_sequence structure includes window_info (0), (1), (2) ... (number_of_windows-1); And effect_info (0), (1), (2) ... (number_of_effects-1).

Animation effects can be displayed by updating the display composition at fixed intervals. Each effect_info structure is an information part that defines one display composition. The arrow ec1 shows the details of the internal structure of effect_info. As shown in the figure, the effect_info structure includes an effect_duration representing the fixed period, i.e., the time for which the associated display composition is to be displayed; Pallet_id_ref specifying a pallet to be used for associated display composition; And composition_object (0), (1), (2) ... (number_of_composition_object-1) specifying the details of the display composition.

Each window_info structure defines a window or area of the graphics plane on which display composition is to be made. As indicated by arrow wc1, window_info is extracted to show details. As shown in the figure, window_info is composed of the following fields. "Window_id" that uniquely identifies the window of the graphics plane; "Window_horizontal_position" which specifies the horizontal position of the top left pixel of the window; "Window_vertical_position" which specifies the vertical position of the top left pixel of the window; "Window_width" to specify the width of the window; And "window_height" which specifies the height of the window.

Hereinafter, values that can be set in the window_horizontal_position, window_vertical_position, window_width, and window_height fields will be described. These fields are set to values corresponding to coordinates in the two-dimensional graphics plane with height and width defined by video_height and video_width.

Since the window_horizontal_position field indicates the horizontal address of the graphics plane's pixels, this field should be a value from "1" to a video_width value. Similarly, since the window_vertical_position field indicates the vertical address of the pixel of the graphics plane, this field is set to a value from "1" to a video_height value.

Since the window_width field represents the width of the window of the graphics plane, this field takes a value from "1" to a value calculated by subtracting the window_horizontal_position value from the video_width value. Similarly, since the window_height field indicates the height of the window of the graphics plane, this field takes a value from "1" to a value calculated by subtracting the window_vertical_position value from the video_height value.

As described above, window_info has window_horizontal_position, window_vertical_position, window_width, and window_height fields that define the size and position of the window of the graphics plane.

Hereinafter, a limitation on the window size for implementing a framework representing display composition of graphics at a rate of 24 frames per second will be described. This frame rate corresponds to the video frame rate applied to playing the video stream. According to this framework, graphics objects are displayed in synchronism with the video stream specifically. In order to implement the framework, the window must be cleared and rendered at the video frame rate. Here, consider the required transfer rate from the object buffer to the graphics plane.

First, investigate the limits on the window size. Define Rc as the transfer rate from the object buffer to the graphics plane. In the worst case scenario, clearing and rendering of windows need to be done with Rc. In other words, clearing and rendering need to be performed in half of Rc (Rc / 2).

Therefore, it is necessary to satisfy the following equation.

(Window size) × (Frame rate) ≒ Rc / 2

When the frame rate is 24, RC is expressed by the following equation.

Rc = (window size) × 2 × 24

If the total number of pixels in the graphics plane is 1920 × 1080 and the bit length of the index per pixel is 8 bits, the total capacity of the graphics plane is 2 Mbytes (≒ 1920 × 1080 × 8).

If Rc is 128Mbps and the window size is 1 / A of the graphics plane, the following equation is satisfied.

128,000,000 = 1920 × 1080 × 1 / A × 8 × 2 × 24

1 / A ≒ 0.16 (= 128,000,000 / (1920 × 1080 × 8 × 2 × 24))

Thus, by limiting the window size to 16% of the entire graphics plane, synchronization between animation effects with the video stream is ensured as long as the animation effects are rendered at 128 Mbps.

For example, suppose that the effect_duration representing the window's clearing and rendering speed is 1/2 or 1/4 of the video frame rate. In this case, the window size can be as large as 32% or 64% of the overall graphics plane, even if Rc is the same. That is, the effect_sequence structure has the feature that the effect_duration is determined longer for larger window sizes and shorter for smaller window sizes. This concludes the description of Windows. Next, the window position will be described. As mentioned above, the position and size of the window are fixed through one epoch.

The position and size of the window are fixed during the Epoch period for the following reasons. If the size and position of the window changes, the write address of the graphics plane needs to be changed, which causes overhead. The overhead inevitably reduces the transfer rate from the object buffer to the graphics plane.

There is a limit to the number of graphics objects allowed to be rendered at one time in a window. The number of graphics objects is limited to reduce the overhead incurred when sending decoded graphics objects. Specifically, the overhead referred to here is incurred when setting the address of the edge portion of the graphics plane. This overhead increases if the number of edge portions is larger.

If there is no limit to the number of graphics objects that can be displayed in one window, an unlimited overhead is incurred when the graphics plane transmits the graphics objects, which increases the variation in the transmission load. On the other hand, if the number of graphics objects in one window is limited to two, the transmission rate Rc may be set on the assumption that the number of examples of the overhead is large. Therefore, the minimum criterion of the transmission rate Rc can be easily determined.

Returning to the effect_info structure, the effect_duration is determined by the window size. The following describes how the effect_duration is determined. 21A is a diagram schematically illustrating how the effect_duration is determined. In the figure, the (j + 1) th display composition is displayed after multiple video frames from the indication of the jth display composition. The number of these multiple video frames is effect_duration. In order to calculate the effect_duration, the total data size to be rendered for the display of each display composition must be known. Here, effect_sequence has a number of windows indicated by the number_of_windows field value. Thus, the total size of data that needs to be rendered for display of the jth display composition is equal to the total size of windows (0) to (number_of_windows-1), as indicated by the braces br.

As above, the j th display synthesis has windows (0) to (number_of_windows-1). Therefore, the total data size of the window is divided by the transmission speed of the playback device (128 Mbps) and multiplied by the time accuracy of the PTS (90 Khz) to display the result at 90 KHz. The result is the period during which the jth display synthesis of effect_sequence is displayed. 21B shows an equation for calculating the effect_duration.

In this specification, the operator "ceil ()" denotes a division that returns a value rounded to an integer.

22 is a diagram illustrating a measurement example of an in-effect animation. The in-effect animation displays the image so that the light appears in the palm of the character's image on the screen and the menu slowly rises after the light disappears. The size of the graphics data is largest in the in-effect when the menu is completely visible on the screen (effect (4)). Therefore, window_width and window_height of the window are determined based on the data size of the effect (4). Assume that the window size determined here is about 50% of the total graphics plane. This window size is almost three times larger than the above window size, which is 16% of the graphics plane. As a result, the effect_duration for this in-effect is determined longer so that the display synthesis is properly updated at a rate of 128 Mbps. Each effect_duration of effects (0), (1), (2), and (3) is set relatively long. With this setup, each display composition is rendered every three video frames to ensure that in-effect animations are displayed in succession. The same scheme applies to out-effects. FIG. 23 is a diagram illustrating an out-effect animation in which the window_width, window_height, and effect_duration field values are determined in the above-described manner.

As described above, according to the second embodiment, window_info defines an area of the graphics plane for rendering, and effect_info defines an interval period in which the rendering area is updated. Thus, the period can be adjusted longer when the rendering area is set larger, and shorter when the rendering area is set smaller. This setting ensures continuous display of animation effects as long as the playback device transmits the graphics data at a fixed transmission rate.

(Third embodiment)

A third embodiment of the present invention relates to an improvement in the display of animation effects such as scroll, wipe-in / out, and cut-in / out. will be. The structure for achieving the animation effect is in the composition_object structure shown in FIG. FIG. 24 shows the internal structure of an arbitrary composition_object (i) in detail. As shown in the figure, composition_object (i) is composed of the following fields. That is, "object_id_ref"; "window_id_ref"; object_cropped_flag ";" composition_object_horizontal_position ";" composition_object_vertical_position "; and" cropping_rectangle_info (1), (2) ... (n) ".

The object_id_ref field represents a reference value for the graphics object identifier object_id. The reference value corresponds to object_id which identifies the graphics object used to generate the display composition according to composition_object (i).

The window_id_ref field represents a reference value for the window identifier window_id. The reference value corresponds to window_id which identifies the window in which the display composition is rendered according to composition_object (i).

The object_cropped_flag field represents a flag indicating whether a graphics object cropped in the object buffer is displayed or not. If this field is set to '1', graphics objects cropped to the object buffer are displayed. On the other hand, if this field is set to "0", the cropped graphics object is not displayed.

The composition_object_horizontal_position field represents the horizontal position of the top left pixel of the graphics object of the graphics plane.

The composition_object_vertical_position field represents the vertical position of the top left pixel of the graphics object of the graphics plane.

The cropping_rectangle structure is valid when the object_cropped_flag field is set to "1". In FIG. 24, arrow wd2 shows that the internal structure of cropping_rectangle is extracted in detail. As shown in the figure, the cropping_rectangle structure is composed of the following fields. That is, "object_cropping_horizontal_position"; "object_cropping_vertical_position"; "object_cropping_width"; And "object_cropping_height".

The object_cropping_horizontal_position field represents the horizontal position of the top left corner of the cropping rectangle. The cropping rectangle defines the area of the graphics object to be cropped.

The object_cropping_vertical_position field represents the vertical position of the top left corner of the cropping rectangle.

The object_cropping_width field represents the width of the cropping rectangle.

The object_cropping_height field represents the height of the cropping rectangle.

This concludes the description of the composition_object structure. Next, specific examples of the omposition_object structure will be described.

25 is a diagram illustrating a specific example of an in-effect that displays a Right-Scroll animation effect. The in-effect animation in this example displays the image so that the language selection menu gradually appears from the right edge of the screen. For this in-effect animation, composition_object (0), composition_object (1), composition_object (2), and composition_object (3) are given to points t0, t1, t2, and t, respectively. In addition, the effect_info structure related to each of ICS and DS is defined to include the following window_info structure and composition_object structure.

The setting of each composition_object structure will be described below. 26-29 illustrate example settings of the composition_object structure, respectively. 26 is a diagram illustrating an example of a composition_object (0) structure.

In the figure, the window_horizontal_position and window_vertical_position fields specify the coordinates of the top left pixel LPO of the window of the graphics plane. The window_width and window_height fields specify the width and height of the window.

As shown in the figure, the object_cropping_horizontal_position and object_cropping_vertical_position fields specify the reference point ST1 used to determine the area of the graphics object to be cropped. The reference point ST1 is specified based on a coordinate system having an origin in the upper left corner of the graphics object of the object buffer. The area having the length and width specified by the object_cropping_width and object_cropping_height fields from the reference point ST1 is determined by the cropping rectangle (solid line box in the figure). The cropped portion of the graphics object is rendered in the graphics plane at the position with the top left pixel LPO specified by the window_horizontal_position and window_vertical_position fields. In this example, about one quarter of the language selection menu from the right is rendered in the window of the graphics plane. As a result, the right quarter of the language selection menu is displayed as a composite image superimposed on the video.

27, 28, and 29 are diagrams showing examples of the composition_object (1) structure, the composition_object (2) structure, and the composition_object (30 structure), respectively. The window_info structure shown in each drawing is the same as that shown in FIG. The description is omitted, but the composition_object (1) structure shown in Fig. 27 is different from that shown in Fig. 26. In Fig. 27, the object_cropping_horizontal_position and object_cropping_vertical_position fields are approximately right half of the language selection menu stored in the object buffer. Specifies the coordinates of the top left pixel of the object_cropping_width and object_cropping_height fields specify the height and width of the right half of the language selection menu, similarly, in Figure 28, each field of the composition_object (2) structure together is a language selection menu from the right side. Specifies approximately three quarters of the two in Fig. 29, each field of the composition_object (3) structure is right together. Specifies the entire portion of the language selection menu from .. By rendering the cropped portion of the graphics object shown in Figs. Is overlaid on the video.

As described above, according to the third embodiment of the present invention, the animation effect is easily defined as desired by the composition_object structure. For example, it is easily defined that a graphics object stored in an object buffer is rendered to gradually appear on the screen or gradually disappear from the screen.

(Example 4)

A fourth embodiment of the present invention relates to improvements made through optimization of the ODS order of DS. As described above, the ODS of the DS may be referenced by interactive_composition to indicate an in-effect or out-effect animation or a state of a button. The ODS order of the DS is determined by whether the ODS is used for in-effect animation, out-effect animation, or button state.

Specifically, the ODS of DS is selected from (1) ODS used for display of out-effect animation for Page [0], (2) ODS used for display of steady state of button, and (3) button selected. ODS used to indicate status, (4) ODS used to indicate activation status of button, (5) in-effect for Page [0] and subsequent in-effect and out for Page [1] Classified as an ODS used to indicate -effect. That is, ODSs associated with the same indication are in the same group. ODS groups associated with in-effects are called "in-effect groups". The ODS group associated with each button state is called a "button-state group". ODSs associated with out-effects of Page [0], in-effects of Page [1], and out-effects are called "rest groups".

These ODS groups are arranged in the following order. That is, in-effect group-> steady state group-> selected state group-> active state group-> remaining group. In this way, the ODS order of the DS is determined based on the display object to which the ODS is related.

Next, the order of ODS of DS _n is demonstrated concretely. 30 is a diagram illustrating an ODS order of DSs.

In the figure, ODS ₁ -ODS _g belongs to the ODS group associated with the in-effect for Page [0] (in-effect group).

ODS _{g + 1} -ODS _h belongs to the ODS group associated with the normal state of the button (normal state ODS).

ODS _{h + 1} -ODS _i belongs to the ODS group associated with the selected state of the button (ODS for the selected state).

ODS _{i + 1} -ODSj _j belongs to the ODS group associated with the activation state of the button (ODS for activation state).

ODS _{j + 1} -ODS _k belongs to the ODS group related to the out-effect of Page [0] and to the ODS related to the in-effect and out-effect of the page from Page [1] (the remaining group).

ODS groups are sorted in the following order: in-effect group-> steady state group-> selected state group-> active state group-> remaining group. This order is determined so that the ODS required for the first display of the interactive is read first and the ODS required only after the display update is read later.

Next, the ODS order is described when there are multi-references. The term " multiple-reference " as used herein means that the same object_id is referenced by two or more portions of normal_state_info, selected_state_info, and activated_state_info of the ICS. For example, by multi-reference, a particular graphics object used to render a button in a steady state is commonly used to render another button in a selected state. In other words, graphics objects can be shared to reduce the number of ODS. Here, a problem arises as to which button state the ODS with multi-reference belongs to.

Specifically, if one ODS is related to one button in the normal state as well as other buttons in the selected state, it is necessary to determine whether the ODS belongs to the button state group for the normal state or the button state group in the selected state.

In that case, the ODS is placed in the button state group that appears first in the ICS.

For example, if an ODS is referenced by both a steady state group and a selected state group, the ODS is located in the steady state group (N-ODS) but not in the selected state group (S-ODS). Also, if the ODS is referenced by both the selected state group and the activation state group, the ODS is located in the selected state group (S-ODS) but not in the activation state group (A-ODS). In this way, when each ODS is referenced by two or more different state_info structures, the ODS appears only once in the DS and is located in the first of the button state groups.

The same applies to ODS related to animation effects. If a graphics object is commonly used for in-effects and out-effects for Page [0], the graphics object appears only once in the DS and is located in the in-effect group. Similarly, if a graphics object is commonly used for in-effects for Page [0] and subsequent in-effects or out-effects for Page [1], the graphics object appears only once in the DS and is located in the in-effect group. This concludes the description of ODS order when there are multiple references to ODS.

Because of the possible multi-reference to ODS as described above, DS _n may not include all of the ODS groups described above. For example, DS _n may not include the selected state group because of multi-referencing. In addition, DS _n may not include an in-effect group ODS. This is because in-effects are not essential for the display of interactive displays.

The following describes the ODS order of the button state group (S-ODS) for the selected state. Of the S-ODS, which ODS should be placed first depends on whether the default selection button is determined statically or dynamically. If the default_selected_button_id_ref field of the interactive_composition is set to a valid value other than "00", the default selection button is statically determined. This valid value specifies the button to be selected by default. If the default_selected_button_id_ref field is valid and the ODS associated with the specified default selected button is not in the N-ODS, the ODS is placed at the head of the S-ODS.

On the other hand, when the default_selected_button_id_ref field is set to "00", another button is dynamically determined as the default button according to the state of the playback apparatus.

The default_selected_button_id_ref field is set to a value of "00", for example, when a DS multiplexed AV clip serves as a joining point of multiple playback paths. In that case, different buttons need to be selected by default depending on which playback path is selected. Therefore, there is no need to put a specific ODS in the S-ODS.

FIG. 31 is a diagram showing how the ODS order of S-ODS is different between the case where the default_selected_button_id_ref field is set to "00" and the case where the button B is set to a valid value for specifying the button B. FIG. In the figure, arrow ss1 indicates the ODS order of S-ODS when the default_selected_button_id_ref field specifies button_id identifying button B. The arrow ss2 indicates the ODS order of the S-ODS when the default_selected_button_id_ref field is set to "00". As shown in the figure, when the default_selected_button_id_ref field specifies button B, the ODS (ODS for Button B) associated with the selected state of Button B is located at the head of the S-ODS, and the ODS (Button A, ODS for C, and D). On the other hand, when the default_selected_button_id_ref field is set to "00", the ODS (ODS for Button B) related to the selected state of Button A is located at the head of the S-ODS. As described above, the ODS order of the S-ODS depends on whether or not the default_selected_button_id_ref field value has a value.

According to the fourth embodiment, the ODSs of the DSs are arranged in the order in which they appear in the DSs. Thus, a display composition comprising a plurality of graphic elements can be displayed smoothly.

(Fifth Embodiment)

In the fifth embodiment, a method of giving DS to the time axis of an AV clip will be described. In the fifth embodiment of the present invention, how to set PTS and DTS values will be described.

First, a mechanism for influencing synchronous control based on PTS and DTS of ODS will be described.

The DTS represents the time at which the decoding of the associated ODS should be started with a time accuracy of 90 KHz. PTS represents the deadline for completing decoding.

The decoding of the ODS cannot be completed immediately, it takes a certain period of time. In order to explicitly indicate the start and end time of decoding the ODS, the DTS and PTS indicate the decoding start time and the decoding dead time.

The PTS value indicates the dead time after which the decoding of the associated ODS has been completed and the resulting uncompressed graphics object should be available in the object buffer of the playback device.

Decoding start time of arbitrary ODS belonging to the DS _{j n} represents a time accuracy of 90KHz by _{DTS (DS n [ODS])} . Therefore, the decoding dead time of ODSj is determined by the sum of the DTS (DS _n [ODS]) value and the maximum time that can be decoded.

Where SIZE (ODS _n [ODS _j ]) represents the size of ODS _j after decompression, Rd represents the decoding speed of ODS _j , and the maximum time to decode is ceil (SIZE (ODS _n [ODS _j ])) Let's be.

By converting this maximum time to an accuracy of 90 KHz and adding the result to the DTS of ODS _j, the decoding deadline represented by the PTS is calculated with an accuracy of 90 KHz.

The PTS of ODS _j belonging to DS _n may be expressed by the following equation.

PTS (DS [ODS _j ]) = DTS (DS _n [ODS _j ]) + 90,000 + ceil (SIZE (ODS _n [ODS _j ]) / Rd)

In addition, the relationship between two adjacent ODSs (ODS _j and ODS _{j + 1} ) needs to satisfy the following equation.

PTS (DS _n [ODS _j ]) ≤ DTS (DS _n [ODS _{j + 1} ])

This concludes the description of PTS and DTS in ODS. Next, the PTS of the ICS will be described. ICS before the decoding start time of the first ODS of DS _n (ie, before the time indicated by DTS (DS _n [ODS ₁ ])) and also before the first indication of DS _n is valid (ie, PTS (DS _n [ Before the time indicated by the PDS ₁ ]). Therefore, it is necessary to satisfy the following equation.

DTS (DS _n [ICS]) ≤ DTS (DS _n [ODS ₁ ])

DTS (DS _n [ICS]) ≤ PTS (DS _n [PDS ₁ ])

Next, OTS of ICS of DS _n will be described. The PTS (DS _n [ICS]) value is set to satisfy the following equation.

PTS (DS _n [ICS]) ≥ PTS (DS _n [ICS]) + DECODEDURATION + TRANSFERDURATION

DECODEDURATION represents the time taken to decode the graphics object needed for the first representation of DS _n (ICS). The decoding start time is equal to the original DTS (ICS) value. Where LASTODSPTS represents the PTS associated with the most recently decoded graphics object of the graphics objects required for the first representation of DS _n (ICS), and DECODEDURATION is equal to LASTODSPTS (DS _n )-DTS (DS _n [ICS]). Let's do it.

The LASTODSPTS value takes a different value depending on the default_selected_button_id_ref setting and the ODS order of the DS. 32A, 32B, 33A, 33B, and 33C illustrate different ODS sequences describing the LASTODSPTS setting using the DTS of the ODS.

32A illustrates a case where a button selected as a default is statically determined, that is, a default_selected_button_id_ref field is set to a non-zero value. In this case, LASTODSPTS takes the PTS value of the first ODS in the S-ODS (ie, the value of PTS (DS _n [ODS _{h + 1} )). In the figure, ODS _{h + 1} is contained in a solid line box.

32B illustrates a case where a button selected as a default is dynamically determined, that is, when a default_selected_button_id_ref field is set to "00". In this case, LASTODSPTS takes the PTS value of the last ODS (ie, the value of PTS (DS _n [ODS _i )) of the S-ODS. In the figure, ODS _i is contained in a solid line box.

33A does not include the ODS associated with the selected state. In this case, LASTODSPTS takes the PTS value of the last ODS of the N-ODS (ie, the value of PTS (DS _n [ODS _h )). In the figure, ODS _h is contained in a solid line box.

33B does not include ODS associated with steady state. In this case, LASTODSPTS takes the PTS value of the last ODS in the in-effect ODS (ie, the value of PTS (DS _n [ODS _g )). In the figure, ODS _g is contained in a solid line box.

33C does not include ODS at all. In this case, LASTODSPTS takes a DTS value specific to the ICS of DS _n (ie, the value of DTS (DS _n [ICS])). In the figure, the ICS is enclosed in a solid line box.

Note that the above description applies even when DS _n is not Epoch Start DS. If DS _n is Epoch Start DS, the other description applies.

In the case of the Epoch Start DS, the graphics plane can be completely cleared. The time taken to clear the graphics plane may be longer than the time calculated by LASTODSPTS (DS _n )-DTS (DS _n [ICS]). According to the target decoder model for BD-ROM, graphics decoding and graphics plane clearing are performed by different processing units (the graphics processor performs decoding). Thus, graphics decoding and plane clearing are performed in parallel. Although decoding is completed for the graphics data required for the display of the first display composition, the graphics data is not rendered to the graphics plane if the plane is not cleared. Therefore, DECODEDURATION needs to be set to the same value as the plane clear period. Assume that the graphics plane has the same width and height as the video_width and video_height field values, respectively. In addition, the transfer rate between the object buffer and the graphics plane is 128Mbps. In order to clear the entire graphics plane, the playback device is required to overwrite the graphics plane having a size of 8 x video_width x video_height at a transmission rate of 128 Mbps. If the period of overwriting is indicated at 90 KHz, the time taken to clear the graphics plane (called "PLANECLEARTIME") is calculated by the following equation.

PLANECLEARTIME = ceil ((90,000 × 8 × DS _n [ICS] .video_width

× DS _n [ICS] .video_height) / 128,000,000

Figure 34a is LASTODSPTS (DS _n) - shows the algorithm for obtaining a value from the value DECODEDURATION and PLANECLEARTIME value calculated by the _{DTS (DS n [ICS])} . In this algorithm, LASTODSPTS (DS _n) - DTS to more of (DS _n [ICS]) value and the largest value is determined as PLANECLEARTIME DECODEDURATION value.

As shown in the figure, composition_state field of DS _n (ICS) is, _n DS is not an _{Epoch Start DS (if (DS n} (ICS) .composition_state == EPOCH_START) else), LASTODSPTS (DS n) - DTS ( The DS _n [ICS]) value is determined as the DECODEDURATION value (return (LASTODSPTS (DS _n )-DTS (DS _n [ICS]))). On the other hand, the composition_state field of DS _n (ICS), if DS _n is Epoch Start DS (if (DS _n (ICS) .composition_state == EPOCH_START) else), LASTODSPTS (DS _n )-DTS (DS _n [ICS]) The larger of the value and the PLANECLEARTIME value is determined as the DECODEDURATION value (return (amxLASTODSPTS (DS _n )-DTS (DS _n [ICS]))).

Figure 34b and 34c are PLANECLEARTIME value LASTODSPTS (DS _n) - a view showing an example of a set according to the DECODEDURATION greater than the DTS (DS _n [ICS]) value. (DS _n) value is PLANECLEARTIME _{LASTODSPTS - DTS (DS n [ICS} ]) is greater than the value, as shown in Figure 34b, this is determined in the DECODEDURATION PLANECLEARTIME value. On the other hand, (DS _n) is PLANECLEARTIME value _{LASTODSPTS - DTS (DS n [ICS} ]) if less than the value, as shown in Figure _{34c, LASTODSPTS (DS n) -} DTS (DS n [ICS]) value is DECODEDURATION It is determined by the value.

TRANSFERDURATION represents the time it takes to transfer the graphics data needed for the display of the first display composition from the object buffer to the graphics plane. The first display composition in the DS depends on whether an in-effect is provided to the DS and whether the default selected button is determined statically or dynamically. Thus, TRANSFERDURATION also depends on the first display synthesis. If the first display synthesis is related to an in-effect, the time taken to transmit uncompressed graphics required for the in-effect representation is determined by TRANSFERDURATION.

Here, the in-effect defined by DS _n [ICS] is to introduce Page [0] and is rendered in the number of windows indicated by the number_of_window field value. Thus, the total size of graphics data required for the first display synthesis of the in-effect is equal to the total size of windows (0) to (number_of_windows-1). Thus, to calculate the time it takes to transfer the graphics data required for the display of the first display composition in the in-effect sequence (EFFECTTD), the total window size is divided by the transmission speed (128 Mbps) of the playback device. To express the result as the time accuracy of the PTS (90 KHz), multiply the result by 90 KHz. The equation for calculating EFFECTTD is shown in FIG. 35A.

On the other hand, if the DSn does not have any in-effect, the first display composition for the display of DS _n [ICS] is Page [0] of the multi-page menu. If the button selected by default is statically specified, the multi-page menu is displayed as soon as uncompressed data necessary for the selected state of the button selected by default and the normal state of the other buttons is transferred from the object buffer to the graphics plane.

Here, Page [0] of the multi-page menu associated with DS _n [ICS] includes the number of buttons indicated by the number_of_button field value. Therefore, the data size required for the display of the first display composition is calculated as follows. First, the total size is calculated for the graphics data related to the steady state of all the buttons of the page, which is specified by DS _n (ICS) .Page [0] .Buttons of (0) to (number_of_Button-1). Then, to the total size calculated, the size of graphics data (SBSIZE (DS _n , DS _n [ICS] .PAGE [0] .default_selected_button_id_ref)) related to the selected state of the default selected button of Page [0] is added. Also, from the resulting value, the size of the graphics data related to the steady state of the default selected button (NBSIZE (DS _n , DS _n [ICS] .PAGE [0] .default_selected_button_id_ref) to obtain the data size required for the display of the first display composition. Subtract)).

The calculated data needed for the display of the first display synthesis is divided by the transmission speed of the playback device (128 Mbps) and multiplied by 90 KHz to express the result by the time accuracy (90 KHz) of the PTS. Then, the transmission period for displaying the first page is calculated. 35B shows an equation for calculating PAGEDEFAULTTD (DSn) when no in-effect is provided and the default selected button is statically determined.

When the button selected by default is dynamically determined, the equation shown in Fig. 35B is not applicable because it is not known which button of Page [0] is selected by default. Therefore, TRANSFERDURATION should be calculated for the worst case. The worst case is when the button with the largest size is selected by default among the buttons defined by DS _n (ICS) .Page [0]. Among the buttons of DS _n (ICS) .Page [0], the button having the largest size is represented by LRG {button: button ∈ DS _n [ICS] .Page [0] .Button}.

Then, the data size (maximum data size) required for transmission in the worst case is calculated as follows. First, the total size of all buttons of Page [0] (Page [0] .Button of (0) to (number_of_Button-1)) is calculated. The total size calculated is added to the button size LRG {BSIZE (DS _n , LRG (button: button ∈ DS _n [ICS] .Page [0] .Button})). Also, the maximum data size is subtracted from the result value by subtracting the size of the graphics data LRG {NBSIZE (DS _n , LRG (button: button ∈ DS _n [ICS] .Page [0] .Button})) related to the normal state of the button. Get

The maximum data size calculated by the above method is divided by the transmission speed (128 Mbps) of the playback apparatus, and multiplied by 90 KHz to express the result by the time accuracy (90 KHz) of the PTS. Then, the transmission period for displaying the first page of the multi-page menu is calculated. 35C shows an equation for calculating PAGEDEFAULTTD (DS _n ) when no in-effect is provided and the default selected button is dynamically determined.

36 illustrates an algorithm for selectively determining one of EFFECTTD, PAGEDEFAULTTD, and PAGENODEFAULTTD as TRANSFERDURATION. As shown in the figure, if at least one 0n-effect is provided (if (DS _n [ICS] .PAFE [0] .IN_EFFECT.number_of_effects! = 0)), EFFECTTD is determined to be TRANSFERDURATION (return EFFECTTD (DS). _n )). If no in-effect is provided to introduce Page [0] and the default selected button is not dynamically specified (DS _n [ICS.PAGE [0] .default_selected_button_id_ref == OxFFFF]), PAGENODEFAULTTD is determined to be TRANSFERDURATION (return PAGENODEFAULTTD). (DS _n )). If no in-effect is provided to introduce Page [0] and the default selected button is not dynamically specified (DS _n [ICS.PAGE [0] .default_selected_button_id_ref == OxFFFF]), PAGEDEFAULTTD is determined to be TRANSFERDURATION (return PAGEDEFAULTTD). (DS _n )).

As described above, according to the fifth embodiment of the present invention, the DTS and PTS values of the ICS are optimally determined according to the data size of the ODS. Thus, interactive control is performed smoothly without delay.

(Sixth Embodiment)

A sixth embodiment of the present invention relates to a playback device used for playback of a BD-ROM described in the first to fifth embodiments. 37 shows the internal structure of the playback apparatus. The reproducing apparatus according to the sixth embodiment is industrially manufactured based on the internal structure shown in FIG. The playback apparatus mainly consists of two parts, a system LSI and a driving device. The reproducing apparatus can be produced industrially by mounting these parts to the cabinet and the substrate of the apparatus. The system LSI is an integrated circuit including various processing units to achieve the function of the playback apparatus.

The playback device manufactured by the above-described method includes a BD drive 1, a read buffer 2, a demultiplexer (De-MUX) 3, a video decoder 4, a video plane 5, a P-graphics decoder 6, Presentation plane (7), adder (8), I-graphics decoder (9), interactive graphics plane (10), adder (11), audio decoder (13), color lookup table (CLUT) units (14, 15) , PRS set 16, system clock 17, user_timeout timer 18, selection_timeout timer 19, composition_timeout timer 20, effect_duration timer 21, operation receiver 22, and state controller 23. It is composed.

The BD drive 1 performs loading, reading, and extraction of a BD-ROM. The BD drive 1 accesses the BD-ROM 100.

The read buffer 2 is a first-in first-out memory. Therefore, TS packets read from the BD-ROM are removed from the read buffer 2 in the same order as they arrived.

De-MUX 3 reads TS packets from read buffer 2 and converts them into PES packets. As a result, among the PES packets, a PES packet having a predetermined stream PID is output to one of the video decoder 4, the audio decoder 13, the P-graphics decoder 6, and the I-graphics decoder 9.

The video decoder 4 decodes the PES packet received from the De-MUX 3 and renders the resulting uncompressed image data on the video plane 5.

The video plane 5 is a plane memory for storing uncompressed image data. The term " plane " refers to a memory region of a playback device for storing pixel data of one screen. By providing multiple planes, the playback device adds data stored in each plane pixel by pixel to produce a single video output, whereby multiple graphical images are overlaid onto one composite image. The resolution of video plane 5 is 1920 × 1080. The picture data is stored in the video plane 5 as 16-bit pixel values expressed as YUV values.

The P-graphics decoder 6 decodes the graphics stream read from the BD-ROM or HD, and renders the resulting uncompressed graphics to the presentation graphics plane 7. When the graphics stream is decoded and rendered, subtitles appear on the screen.

The presentation plane 7 is a memory having an area for storing uncompressed graphics of one screen. The resolution of this plane is 1920 × 1080, and uncompressed graphics are stored in the presentation plane 7 as 8-bit pixel data expressed in index color. By converting the index color using the CLUT, uncompressed graphics stored in the presentation plane 7 are displayed.

The adder 8 overlays the uncompressed image data i with the content stored in the presentation plane 7.

The I-graphics decoder 9 decodes the IG stream read from the BD-ROM or HD, and renders the resulting uncompressed graphics into the interactive graphics plane 10.

The uncompressed graphics data decoded by the I-graphics decoder 9 is rendered in the interactive graphics plane 10.

The adder 11 overlays the data of the interactive graphics plane 10 with the output of the adder 8 (i.e., temporary video data created by overlaying content stored in the presentation plane 7 with uncompressed image data). Create a video output.

The audio decoder 13 decodes the PES packet received from the De-MUX 3 and outputs uncompressed audio data.

The CLUT unit 14 converts the index color of the uncompressed graphics stored in the presentation plane 7 into Y, Cr, and Cb values.

The CLUT unit 15 converts the index color of the uncompressed graphics stored in the interactive graphics plane 10 into Y, Cr, and Cb values.

The PRS set 16 is a register set provided in the playback apparatus. The register set includes 64 playback device status registers (PSR) and 4,096 general purpose registers (GPR). 64 playback device status registers indicate the current status of the playback device. Specifically, PSR 5-8 indicates the current playback point. PRS 8 takes a value (current PTM: display time) in the range of 0 to 0xFFFFFFFF representing the current playback point at 45 KHz. PSR 11 indicates the page_id of the current activation page (current page). PSR 10 represents a button (current button) in the selected state of the current page.

System clock 17 generates a clock signal. De-MUX 3 performs conversion of the PES packet in synchronization with the clock signal.

The user_timeout timer 18 is set to the value of the user_time_out_duration field at the time specified by the PTS (DS _n [ICS]). When the value of the user_time_out_duration field is set, the timer 18 starts counting the tick of the system clock towards zero. The timer 18 is reset again to the value of the user_time_out_duration field each time a user operation is received. If no user operation is received before the timer 18 reaches zero, the timer 18 times out.

The selection_timeout timer 19 is set to the value of the selection_time_out_duration field when specified by the PTS (DS _n [ICS]). When the selection_time_out_duration field value is set, the timer 19 starts counting the tick of the system clock towards zero. The timer 18 is reset again to the selection_time_out_duration field value each time a user operation is received. If no user operation is received before the timer 19 reaches zero, the timer 18 times out. When the timer 19 times out, it is known that the valid interaction period shown in Fig. 9 has ended.

The composition_timeout timer 20 is set to the composition_time_out_pts field value at the time specified by the PTS (DS _n [ICS]). When the composition_time_out_pts field value is set, the timer 20 starts counting the tick of the system clock towards zero. The timer 20 is not reset even if a user operation is received. When the timer 20 reaches zero, that is, when the timer 20 times out, it knows that the Epoch END has reached.

The effect_duration timer 21 is set to the value of the effect_duration field at the time specified by PTS (DS _n [ICS]) if DS _n is Epoch Start DS. When the value of the effect_duration field is set, the timer 21 starts counting the tick of the system clock towards zero. The timer 21 is not reset even if a user operation is received. When the timer 20 reaches zero, that is, when the timer 20 times out, it is seen that the next display composition of the animation effect needs to be displayed.

The operation receiving unit 22 receives a user operation performed on the front panel of the remote controller or the playback apparatus, and transmits information indicating the received user operation (hereinafter, this information is referred to as "UO") to the I-graphics decoder 9. Output

The state controller 23 sets a desired value in the PRS in accordance with the instruction from the I-graphics decoder 9. This indication may be given through (i) direct addressing or (ii) indirect addressing. In the case of direct addressing, the I-graphics decoder 9 outputs the value to the appropriate register of the PSR set 16 as soon as it is set. In the case of indirect addressing, the I-graphics decoder 9 outputs a notification of a change in the playback device status or user preference. Upon receiving such notification, the state controller 23 determines the value to be set to reflect the change and sets the determined value in the appropriate register of the PRS set 16. The state control unit 23 determines the value by performing "procedure when the reproduction condition is changed" or "procedure when a change is requested". The procedure performed to set the PSR 11 (current page) and PSR 10 (current button) is described below.

38A is a flowchart of "procedure when the reproduction condition is changed" performed for PSR11. This procedure is performed to set the first page_info structure of ICS to PSR 11 (step S99).

38B is a flowchart of “procedure when a change is requested” performed for PSR 11. Assume that a user operation has been received and a page with page number X is requested to be displayed. In response to the user operation, the state control unit 23 determines whether X is a valid value (step S100). If X is a valid value, PSR 11 is set to the value X (step S101). If X is invalid, PSR 11 does not change (step S102).

The value of PSR 11 changes as described above. Returning to PSR 10, the "procedure when the reproduction condition is changed" or the "procedure when a change is requested" will be described.

39A is a flowchart of "procedure when the reproduction condition is changed" performed for PSR10.

First, the state controller 23 determines whether the default_selected_button_id_ref field value related to the current page is valid (step S111). If the determination in step S111 is YES, the default_selected_button_id_ref field value is set in PSR 10 (step S112).

If the value of the default_selected_button_id_ref field is invalid, then it is determined whether the PSR 10 holds a valid value (step S113). If PSR 10 is valid, PSR 10 does not change so that the current holding value is maintained (step S114). On the other hand, if PSR 10 is invalid, PSR 10 is set to a button_id_ref field value that identifies the first button_info structure of the current page (step S115).

39B is a flowchart of “procedure when a change is requested”, performed for PSR 10. Assume that a user operation is made and a button having the button number X is selected to be selected. In response to the user operation, the state control unit 23 determines whether X is a valid button_id field value (step S116). If X is a valid value, PSR 10 is set to the value X (step S118). If X is an invalid value, PSR 10 does not change and thus the value currently held is maintained (step S117). According to the above procedure, it is assured that PSRs 10 and 11 always retain their current values. This concludes the description of the internal structure of the playback apparatus.

<Internal structure of I-graphics decoder 9>

Next, the internal structure of the I-graphics decoder 9 will be described with reference to FIG. As shown in the figure, the I-graphics decoder is composed of an encoded data buffer 33, a stream graphics processor 34, an object buffer 35, a synthesis buffer 36, and a graphics controller 37.

The encoded data buffer 33 is a buffer for temporarily storing ICS, PDS, and ODS together with their DTS and PTS.

Stream graphics processor 34 decodes the ODS and outputs the resulting non-pressured graphics object to object buffer 35.

The object buffer 35 is a buffer for storing a plurality of uncompressed graphics objects (marked with boxes in the drawing) decoded by the stream graphics processor 34.

The synthesis buffer 36 is a buffer for storing the ICS. The synthesis buffer 36 provides the graphics controller 36 with the page_info structure provided in the ICS and the button_info structure provided in each page_info structure.

The graphics controller 37 decodes the ICS stored in the synthesis buffer 37 and assembles the display composition based on the decoded ICS. That is, the graphics controller 37 reads the graphics object from the object buffer 15 with reference to the page_info structure (current page_info structure) identified by the value of PSR 11, and reads the read graphics object into the interactive graphics plane 10. Render to. The graphics object read here is a sequence of graphics objects specified by the value of the normal_start_object_id_ref field value to the normal_end_object_id_ref field value of each button_info structure related to the current page. For the button_info structure specified by PSR 10, the graphics object sequence specified by the normal_start_object_id_ref field value or the normal_end_object_id_ref field value is read from the object buffer 15. In FIG. 40, arrows bg1, bg2, bg3, and bg4 diagrammatically represent the rendering of the graphics object performed by the graphics controller 37. As a result of the rendering, the page including buttons O-A, O-B, O-C, and O-D is stored in the interactive graphics plane 10 and overlaid with the video.

This concludes the general description of the procedure that the graphics controller 37 performs. The graphics controller 37 also updates the display composition in response to a change in the value of the PSR 10 or PSR 11, a timeout of the timers 18-21, or a user operation received by the synthesis timeout timer 20. The procedure performed by the graphics controller 37 will be described in detail with reference to FIGS. 41-47.

41 is a flowchart of the main routine of the procedure that the graphics controller 37 performs. In the main routine, steps S1-S6 form a loop. At each loop iteration, a determination is made as to whether a particular event has occurred (steps S1-S4), and the display composition of the multi-page menu is updated with successive display composition for the animated display (step S5), Processing is performed accordingly (UO processing) (step S6). If any determination is YES in steps S1-S4, the corresponding step is performed and processing returns to the main routine.

In step S1, a determination is made as to whether the current playback point has reached the specified point in the PTS (DS _n [ICS]). If the determination of step S1 is YES, the above-described "processing when the reproduction condition is changed" is performed. As a result, Page [0], which is the first page of the multi-page menu, is set as the current page (step S7). Then, the user_timeout timer 18, the selection_timeout timer 19, and the composition_timeout timer 20 are all reset (step S8), and the current page is displayed on the screen (step S9). The process then returns to step S1 for the repetition of the next loop.

In step S2, a determination is made whether the user_timeout timer 18 has timed out. If the determination of step S2 is YES, the loops of steps S11-S14 are performed. In each loop iteration, any Page [j] of the multi-page menu is removed from the screen (step S13), followed by the playback of the out-effect animation provided for Page [j] (step S14). The loop is repeated for each page defined in the ICS from page [0] onwards (steps S11 and S12).

In step S3, a determination is made whether the selection_timeout timer 19 has timed out. If the determination of step S3 is YES, the button of the current page is automatically activated (auto-activation: step S10). Processing then returns to step S1 for the next loop iteration.

In step S4, a determination is made as to whether the composition_timeout timer 20 has timed out. If the determination of step S4 is YES, the first page of the multi-page menu, Page [0], is removed from the screen (step S15), followed by the playback of the out-effect animation provided for Page [0] (step S16). ). Processing then returns to step S1 for the next loop iteration.

The first display of the multi-page menu will be described below. The first display is executed through steps S15-S23 shown in FIG. 42 after the state control unit 23 performs the above-described "procedure when the reproduction condition is changed" to set Page [0] to the current page. do. In step S24, an in-effect animation on the current page is performed. The current button is specified by the PSR 10. Thus, in step S25, " procedure when the reproduction condition is changed " is performed for PSR 10 to determine the current button. The process then moves to steps S17-S22.

Steps S17 and S22 form a loop that is repeated for each button_info structure provided in the current page (steps S17 and S18). The button_info structure to be processed in the current loop iteration is specified by button_info (p).

In step S19, a determination is made whether button_info (p) is related to the current button. If the determination of step S19 is YES, step S20 is performed next. If not YES, step S21 is performed next.

In step S21, among the graphics objects of the object buffer 35, it is designated as the graphics object p that the normal_start_object_id_ref field value specifies.

In step S20, it is designated as the graphics object p that the selected_start_object_id_ref field value is specified among the graphics objects in the object buffer 35.

Once the graphics object p is specified in step S20 or S21, the graphics object p is rendered to the interactive graphics plane 10 at the position specified by the button_horizontal_postition and button_vertaical_postition field values (step S22). By repeating the above steps for each button_info structure provided on the current page, the first graphics object of the plurality of graphics objects associated with each button state is rendered in the interactive graphics plane 10 for each button. After repeating the above steps, the CLUT unit 15 is set to display the current page using pallet data specified by the pallet_id_ref field value of the current page (step S23). This concludes the description of the flowchart shown in FIG.

43 is a flowchart of a playback procedure of an in-effect animation. In the flowchart, the variable t represents any of the display synthesis in the effect_sequence defined for the in-effect. Also, the variable u represents any one composition_object of the composition_object used for the effect (t). As shown in the flowchart, variables t and u are initially initialized to "0" (step S30). The effect_duration timer 21 is then set to the value of the effect (t) .effect_duration field (step S31), and the CLUT units 14 and 15 are palette data identified by the value of the effect (t) .pallet_id_ref field for display. Is set to be used (step S32). Then, the loop of steps S33-S40 is performed. This loop is a two-level loop. The first level loop (steps S33-S37) uses the variable u as the control variable, while the second level loop uses the variable t as the control variable.

In the first level loop, the object_cropped_flag field provided in the composition_object (u) structure related to the effect (t) is set to "0" (step S33). If this field is set to "0", no graphics object is displayed on the screen for composition (u) (step S35). On the other hand, if this field is set to "1", the object is cropped according to the object_cropping_horizontal_position, object_cropping_vertical_position, cropping_width, and cropping_height fields of composition_object (u). The cropped portion of the graphics object is rendered in the window identified by the window_id_ref field of composition_object (u) at the position specified by composition_object_horizontal_position and composition_object_vertical_position in composition_object (u) (step S34). Then, the variable u increases by "1". The first level loop is repeated until the variable u is equal to the value of the number_of_composition_object field.

In the second level loop, during each first loop level (steps S33-S37) repetition, the following step is performed. After the effect_duration timeout (step S38), the variable t is increased by "1", and the variable u is initialized to "0" (step S39). The second level loop is repeated until the variable t is equal to the number_of_effect (t) field value (step S40). This concludes the description of the in-effect playback procedure. Note that the out-effect playback procedure is basically the same as the procedure described above, so we won't explain it.

Immediately after playing the in-effect, the current page is displayed and the first display is updated for animated display. The first display composition of the current page is displayed by rendering graphics objects associated with the normal_start_object_id_ref and selected_start_object_id_ref field values provided in each button_info structure to the interactive graphics plane 10. Each button is animated by updating the button image of the interactive graphics plane 10 during each loop iteration of the main routine. Each button image is updated by overwriting the interactive graphics plane 10 with any of the sequence of graphics objects associated with the button (qth graphics object). That is, each button is animated by rendering one graphics object sequence associated with the normal_state_info and selected_state_info fields provided in each button_info structure to the interactive graphics plane 10. Note that the variable q is used to specify individual graphics objects associated with the normal_state_info and selected_state_info fields provided in each button_info structure.

A display update procedure for displaying an animation is described below with reference to FIG. 44. If the first display composition has not been displayed yet, no action is taken and processing returns to the main routine. On the other hand, if the first display composition is displayed, steps S42-S53 are performed. Steps S41-S55 form a loop in which steps S42-S55 are repeated for each button_info structure of the ICS (steps S42 and S43).

In step S44, the variable q is set to a variable animation (p) value corresponding to button_info (p). As a result, the variable q represents the current frame number of button_info (p).

In step S45, a determination is made as to whether button_info (p) corresponds to the button in the currently selected state (i.e., the current button).

If button_info (p) does not correspond to the current button, the variable q is added to the normal_start_object_id_ref field value of button_info (p) to obtain ID (q) (step S46).

If button_info (p) corresponds to the current button, step S47 is performed.

In step S47, a determination is made as to whether the current button is active. If the determination in step S47 is YES, the variable q is added to the activated_start_object_id_ref field value of button_info (p) to obtain ID (q) (step S54). Then, one of the navigation commands related to button_info (p) is executed (step S55).

On the other hand, if the current button is not in the active state, the variable q is added to the selected_start_object_id_ref field value of button_info (p) to obtain ID (q) (step S48).

Once the ID q is acquired, the one identified in the ID q among the graphics objects stored in the object buffer 35 is rendered in the interactive graphics plane 10. The rendering position of the interactive graphics plane 10 is specified by the button_horizontal_postition and button_vertaical_postition fields of button-info (p).

Through loop iteration, the q th of the graphics object related to the selected (or activated) state of the current button is rendered in the interactive graphics plane 10.

In step S50, a determination is made as to whether the sum of the normal_start_object_id_ref field value and the variable q has reached the normal_end_object_id_ref field value. If the sum reaches the value of the normal_end_object_id_ref field, the variable q is increased by "1" and the increased variable q is set to the variable animation (p) (step S51). On the other hand, if the sum has not reached the normal_end_object_id_ref field value, a determination is made as to whether the repeat_flag field is set to "1" (step S52). If the repeat_flag field is set to "1", the variable animation (p) is initialized to "0" (step S53). The above steps are repeated for each button_info structure of the ICS (steps S42 and S43), and then processing returns to the main routine.

Through the above steps S41-S53, each button image displayed on the screen is updated with a new graphics object each time the main routine is performed. Thus, by repeating the main routine, the button image is displayed in animation. When displaying a button as an animation, the graphics controller 37 adjusts the period for displaying each graphics object so as to maintain animation_frame_rate_code. This concludes the description of the procedure for displaying animation.

In step S47 described above, if it is determined that the current button is in the activated state, a navigation command associated with the current button needs to be executed in step S55. 45 is a flowchart of a procedure for executing a navigation command. First, a determination is made as to whether the navigation command is a SetButtonPage command (step S56). If the navigation command is not a SetButtonPage command, the navigation command is simply executed (step S57). On the other hand, if the navigation command is a SetButtonPage command, the state control unit 23 not only sets the button number specified by the number of operations of the navigation command in the PRS 10 but also designates the page number specified by the number of operations of the navigation command as the page number X. (Step S58). Subsequently, the state control unit 23 executes the "procedure when a change is requested" for the PSR11 (step S59). As noted above, PSR 11 holds a value indicating the currently displayed page (ie, the current page). Thus, by performing the " procedure when a change is requested " for the PSR 11, the current page is determined. Subsequently, the state control unit 23 performs the "procedure when the reproduction condition is changed" with respect to the PSR 10 (step S60). This concludes the description of the flowchart shown in FIG. 45.

This concludes the description of the procedure for executing navigation commands. As mentioned above, navigation commands are executed when the associated button is activated. The button state change is displayed in the following procedure in response to a user operation (UO). As shown in the flowchart, a determination is made in steps S61-S64 as to whether a specific event has occurred. The occurrence of each event requires a specific step to be performed. Processing then returns to the main routine. Specifically, in step S61, a determination is made as to whether the UO_mask_table field is set to "1". If this field is set to '1', processing returns to the main routine without performing any step.

In step S62, a determination is made as to whether any of the Move Up, Down, Left, and Right keys of the remote controller is bitten. If any key is pressed, the user_timeout timer 18 and the selection_timeout timer 19 are reset (step S65). Then, another button is designated as the new current button (step S66), followed by a determination as to whether auto_action_flag of the newly specified current button is set to "01" (step S67). If auto_action_flag is not set to "01", the process returns to the main routine. On the other hand, when auto_action_flag is set to "01", the current button (i) is activated (step S69). Then the variable animation (i) is set to "0" (step S70).

In step S63, a determination is made as to whether numeric input has been made. When the number is input, the user_timeout timer 18 and the selection_timeout timer 19 are reset (step S71), and another button is designated as the new current button (step S72). Processing then returns to the main routine.

In step S64, a determination is made as to whether the activation key of the remote controller has been pressed. When the activation key is pressed, the user_timeout timer 18 and the selection_timeout timer 19 are reset (step S68), and the current button (i) is activated (step S69). After the button state change, the variable animation (i) is set to "0" (step S70). Note that step S66 of specifying the new current button described above is performed by calling the subroutine shown in FIG. Hereinafter, the subroutine will be described with reference to the drawings.

47 is a flowchart of the current button change procedure. First, it is determined which of the upper_button_id_ref, lower_button_id_ref, left_button_id_ref, and right_button_id_ref fields in neighbor_info related to the current button corresponds to the pressed key (step S75).

Here, button (Y) means the current button, and button X means the button specified by any one of the upper_button_id_ref, lower_button_id_ref, left_button_id_ref, and right_button_id_ref fields (step S76). Subsequently, the state control unit 23 performs a "procedure when a change is requested" to the PSR 10 (step S77). As a result, PSR 10 is set to the value X.

Thereafter, the variables animation (X) and animation (Y) are set to "0" (step S78), and the process returns to the main routine.

As described above, in the UO processing, the button is activated in response to the UO. However, the button state change to the active state is also made when selection_time_out_pts times out. Hereinafter, a procedure for auto-activation of a button upon timeout of selection_time_out_pts will be described with reference to FIG. 48.

48 is a flowchart of an auto-activation procedure of a button. First, a determination is made as to whether the default_activated_button_id_ref field is set to "00" or "FF" (step S91). If this field is set to "00", the process returns to the main routine without performing any step. On the other hand, if default_activated_button_id_ref is set to "FF", the current button (i) is activated (step S93). Thereafter, the variables animation (X) and animation (Y) are set to "0" (step S94), and the process returns to the main routine.

If the default_activated_button_id_ref field value is neither "00" nor "FF", a button whose default_activated_button_id_ref field value is specified is determined as a new current button (i) (step S92). Therefore, the button specified by the default_activated_button_id_ref field value receives the activated state (step S93). Thereafter, the variables animation (X) and animation (Y) are set to "0" (step S94), and the process returns to the main routine.

Through the above steps, the button in the selected state is automatically activated at the end of the preset period. This concludes the description of the flowchart shown in FIG. 47.

<Turning On / Off the Graphics Display in Pop-Up U / I>

The above description relates to the procedure performed by the I-graphics decoder 9 when the user_interface_model indicates Always-On U / I. In the case where Pop-Up U / I is used, the I-graphics decoder 9 operates as follows. First, similarly to the Always-On U / I case, the I-graphics decoder 9 performs decoding to obtain a decoded graphics object of the object buffer 35. The I-graphics decoder 9 then renders the graphics object to the interactive graphics plane 10 at the time indicated by the PTS (DS _n [ICS]). Up to this point, the I-graphics decoder 9 operates similarly to the case where Always-On U / I is used. However, the processing performed thereafter is different in that the graphics controller 37 does not overlay the page stored in the interactive graphics plane 10, so that the page is not displayed. That is, the graphics controller 37 "turns off" the page by not outputting the data stored in the interactive graphics plane 10 to the CLUT unit 15. With the page not displayed on the screen (ie, turned off), the graphics controller 37 waits for a user operation for Pop-Up_on. In response to the user manipulation for Pop-Up_on, the graphics controller 37 outputs the data stored in the interactive graphics plane 10 to the CLUT unit 15 in which the graphics data is overlaid with the video data. As a result, the page is " turned on " or displayed on the screen. As described above, the graphics controller 37 turns the graphics display on and off to implement a pop-up display.

In subsequent operations, there is no difference between Always-On U / I and Pop-Up U / I. When any button on the main page is activated, the navigation commands associated with the active button are executed. When the selection_timeout timer 19 times out, the current page of the main page is automatically activated and the sub page is displayed on the screen.

When a user operation is made for Pop-Up_off, the graphics controller 37 turns off all on-screen pages, thus leaving no page displayed on the screen.

If the user operation is not made for a certain time, the user_timeout timer 18 counts toward zero. When the user_timeout timer 18 times out, the graphics controller 37 turns off all on-screen pages, thus leaving no page displayed on the screen. The above turn on and turn off procedure is performed to implement the state change shown in FIG. 12A.

As described above, Pop-Up U / I is executed through the turn on and turn off operations.

As described above, the sixth embodiment of the present invention implements the industrial production of the playback apparatus supporting the BD-ROM having the data structure described in the first to fifth embodiments. This is helpful for widespread use of the BD-ROM according to the first to fifth embodiments.

(Example 7)

A seventh embodiment of the present invention relates to a method of manufacturing a BD-ROM. Fig. 49 is a flowchart of the manufacturing method of the BD-ROM according to the first to fifth embodiments.

The manufacturing method includes a data production step (step S201) for recording video, audio, etc., an authoring step (step S202) for generating an application format using an authoring device, and an original master of a BD-ROM. And a pressing step (step S203) of completing the BD-ROM by stamping and bonding.

The BD-ROM authoring step includes the following steps S204-S213.

Hereinafter, steps S204-S213 will be described. In step S240, control information, palette definition information, and graphics are generated. In step S205, control information, palette definition information, and graphics are converted into functional segments. In step S206, the PTS of each ICS is set based on the display timing of the image to be synchronized. In step S207, DTS [ODS] and PTS [ODS] are set based on PTS [ICS]. In step S208, DTS [ICS] and PTS [PDS] are set based on DTS [ODS].

In step S209, the occupancy change of each buffer of the playback device model is graphed. In step S210, a determination is made whether the graphed change satisfies the limitation of the playback apparatus model. If the determination is negative, the DTS and PTS of each functional segment are recorded again in step S211. If the determination is affirmative, the graphics stream is generated in step S212, and the graphics stream is multiplexed into a video stream and an audio stream separately generated in step S213 to form an AV clip. The AV clip is then applied to the Blu-ray Disc read only format to complete the application format.

(Variation)

Although the present invention has been described through the above embodiments, the present invention is not limited to this specific embodiment. This invention can be implemented in any of the following modifications (A)-(L). The invention described in each claim of this specification includes extensions and generalizations of the above embodiments and the following modifications. The degree of extension and generalization depends upon the level of skill in the art when the present invention is made.

(A) The above embodiment describes the case where the BD-ROM is used as a recording medium, but the main feature of the present invention is in the graphics stream recorded on the recording medium, which does not depend on the physical characteristics of the BD-ROM. Do not. Thus, the present invention can be applied to any recording medium capable of recording a graphics stream. Examples of such recording media include optical disks such as DVD-ROM, DVD-RAM, DVD-RW, DVD-R, DVD + RW, DVD + R, CD-R, or CD-RW; Magneto-optical disks such as PD or MO; Semiconductor memory cards such as CompactFlash cards, SmartMedia cards, Memory Stick cards, MultiMediaCards, or PCMCIA cards; Magnetic disks such as flexible disks, SuperDisk, Zip, or Click !; Removable hard disks such as ORB, Jaz, SparQ, SyJet, EZFley, or Microdrive, and non-removable hard disks.

(B) The above embodiment describes a case in which the playback device decodes an AV clip of a BD-ROM and outputs the decoded AV clip to a television. Alternatively, the playback device may have only a CD drive and the remaining components may be provided to the television. In this case, the playback device and the television may be included in a home network connected with an IEEE 1394 connector. Although the above embodiment has described the case where the playback device is connected to a television, the playback device may instead be integrated into the display device. Also, the playback apparatus may include only system LSIs (integrated circuits) that perform essential parts of the processing. Both the reproducing apparatus and the integrated circuit are inventions described in this specification. Therefore, regardless of whether the playback device is associated or the integrated circuit is involved, the manufacturing of the playback device based on the internal structure of the playback device described in the sixth embodiment is the practice of the present invention. In addition, the act of transferring the reproducing apparatus for a fee (that is, for sale) or for a fee (that is, as a gift), leasing, or importing the reproducing apparatus is the practice of the present invention. Similarly, the act of transferring or leasing a playback device using a storefront display, a catalog, or a brochure is an act of practicing the present invention.

(C) Information processing using the program shown in the flowchart is implemented using actual hardware resources. Thus, the program describing the procedure steps shown in the flowchart is an invention in itself. Although all of the above embodiments relate to the case where a program is included in the playback apparatus, the program can be used independently of the playback apparatus. The conduct of the program may include: (1) manufacturing, (2) grants of gratuitous payment, (3) leasing, (4) importation, (5) providing to the public through a two-way telecommunication network, and (6) This includes any acts of transfer or lease using storefront displays, catalogs or brochures.

(D) The time element of the steps executed in time series in each flowchart can be considered an essential element of the present invention. Accordingly, the reproduction method represented by these flowcharts is one invention. If the processing shown in each flowchart is executed by performing the steps in time series to achieve the intended purpose and the intended effect, it can be regarded as an act of implementing the reproducing method of the present invention.

(E) When recording an AV clip on a BD-ROM, an extended header can be added to each TS packet of the AV clip. The extended header is called TP_extra_header, includes arrival_time_stamp and copy_permission_indicator, and has a data length of 4 bytes. . TS packets with TP_extra_header (hereinafter referred to as "EX TS packets") are grouped in units of 32 packets, and each group is recorded in three sectors. One group of 32 EX TS packets has 6,144 bytes (= 32 × 192), which is equal to the size of three sectors of 6144 bytes (= 2048 × 3). 32 EX TS packets included in three sectors are called "Aligned Units".

In a home network connected by an IEEE 1394 connector, the playback apparatus transmits the alignment unit in the following manner. The playback apparatus removes the TP_extra_header from each 32 EX TS packets in the alignment unit, encrypts the body of each TS packet according to the DTCP standard, and outputs the encrypted TS packet. When outputting TS packets, the playback apparatus inserts sync packets between adjacent TS packets. The position at which the sync packet is inserted is based on the time indicated by arrival_time_stamp of the TP_extra_header. The playback device outputs the DTCP_descriptor as well as the TS packet. DTCP_descriptor corresponds to copy_permission_indicator of TP_extra_header. By providing the DTCP_descriptor indicating "repeat prohibited", when the TS packet is used in the home network connected via the IEEE1394 connector, the TS packet can be prevented from being recorded in another device.

(F) The above embodiment relates to the case where an AV clip of a Blu-ray Disc read-only format is used as a digital stream, but the present invention is implemented in a VOB (video object) or DVD-Video recording format in DVD-Video format. can do. The VOB is a program stream obtained according to the ISO / IEC 13818-1 standard and obtained by multiplexing a video stream and an audio stream. In addition, the video stream of the AV clip may be an MPEG4 video stream or a WMV video stream. The audio stream of the AV clip may also be a linear PCM audio stream, a Dolby AC-3 audio stream, an MP3 audio stream, an MPEG-AAA audio stream, or a DTS audio stream.

(G) The movie described in the above embodiment may be obtained by encoding an analog video signal broadcasted by analog broadcasting. In addition, the movie may be stream data composed of a transport stream broadcast by digital broadcasting.

Optionally, the analog / digital video signal recorded on the videotape can be encoded to obtain content. In addition, analog / digital video signals captured directly with a video camera can be encoded to obtain content. Digital works distributed through a distribution server may be applied.

(H) The graphics object described in the above embodiment is run-length encoded raster data. Because run-length encoding is suitable for the compression and decompression of subtitles, run-length encoding is used to compress and encode graphics objects. The subtitle has a characteristic that a continuous length of the same pixel value is relatively long in the horizontal direction, and thus, a high compression ratio can be obtained by performing compression using run-length encoding. Run-length encoding also reduces the load on decompression and is therefore suitable for implementing decoding in software. Nevertheless, the use of run-length encoding for graphics objects is not essential to the invention. For example, the graphics object may be PNG data. Also, the graphics object may be vector data instead of raster data, and the graphics object may be a transparent pattern.

(I) The transmission rate Rc may be determined such that the clearing and rendering of the graphics plane is completed within the vertical regression time. Assume that the vertical regression time is 25% of 1 / 29.93 seconds. At this time, Rc is determined to be 1 Gbps. By determining Rc in this way, the graphics can be displayed smoothly, which has a significant impact on actual use.

In addition, recording synchronized with the line scan can be used with recording in the vertical regression time. This ensures a smooth presentation if the transfer rate Rc is 256Mbps.

(J) The above embodiment relates to the case where the playback apparatus is provided with a graphics plane. Optionally, the playback device may include a line buffer for storing one line of uncompressed pixels. Since the conversion to the video signal is performed for each horizontal column (line), the conversion to the video signal can be performed equally to the line buffer.

(K) In the case of merging points of a plurality of reproduction paths, different buttons need to be selected by default according to the reproduction path selected. Therefore, it is desirable to define such playback control in a static scenario in which a value unique to each playback path is stored in a register of the playback apparatus at the time when the playback path is actually selected. The regeneration procedure can be set so that the button specified by the register value is selected. In this way, different buttons are selected according to the playback path taken.

(L) The graphics plane described in the sixth embodiment preferably has a double buffer structure. If the graphics plane has a double buffer structure, even if large graphics data needs to be rendered, each display composition can be instantaneously displayed by switching between two buffers. Therefore, the double buffer structure is effective when a full-screen size menu needs to be displayed.

The playback device according to the invention is suitable for personal use, for example a home theater system. Since the above embodiment of the present invention discloses an internal structure, a reproducing apparatus having an internal structure can be produced in large quantities. Thus, the reproducing apparatus according to the present invention can be used industrially in quality and has industrial utility.

1 is a view showing a usage pattern of a recording medium according to the present invention.

2 is a diagram illustrating an exemplary structure of a BD-ROM.

3 is a diagram schematically showing the structure of an AV clip.

4A is a diagram illustrating the structure of an interactive graphics stream.

4B is a diagram illustrating a PES packet carrying a functional segment.

5 is a diagram illustrating a logic structure defined by various types of functional segments.

6 is a diagram illustrating an AV clip playback time axis to which DS _n is assigned.

7A and 7B are diagrams illustrating a relationship between an interactive_composition structure and an ICS.

8 is a view showing the internal structure of the ICS.

9 is a diagram illustrating a process performed for ICS when stream_model represents a "Multiplexed" type.

10 is a diagram illustrating a process performed for ICS when stream_model represents a "Preload" type.

FIG. 11 is a timing chart illustrating functions of selection_time_out_pts and composition_time_out_pts fields of ICS belonging to DS _n when DS _n is Epoch Start DS (n = 1).

12A is a diagram illustrating a state change of a multi-page menu when Pop-Up U / I is used.

12B illustrates a state change of a multi-page menu when Always-On U / I is used.

13 is a display scenario incorporating a multi-page menu.

14A-14C illustrate display examples defined by selection_time_out_pts.

15A-15D illustrate display examples defined by user_time_out_duration.

FIG. 16 is a diagram showing the internal structure of page information relating to any of the multiple pages of the multi-page menu (the x-th page).

17 shows button O-A. It is a figure which shows the state change of O-B, O-C, and O-D.

FIG. 18 is a diagram illustrating an example of the button_info description for defining the button state change illustrated in FIG. 17.

19 is a diagram illustrating a graphic image drawn from ODS 11-19.

20 is a diagram illustrating an effect_sequence structure.

21A is a diagram schematically illustrating how the effect_duration is determined.

21B shows an equation for calculating the effect_duration.

22 is a diagram illustrating a specific example of an in-effect animation.

FIG. 23 is a diagram illustrating out_effect displayed according to window_width, window_height, and effect_duration field values.

Fig. 24 is a detailed diagram showing the internal structure of an arbitrary composition_object (i).

25 is a diagram illustrating a specific example of an in-effect displaying a Right-Scroll animation effect.

FIG. 26 is a diagram illustrating an example of a composition_object (0) structure implementing the in-effect shown in FIG. 25.

FIG. 27 is a diagram illustrating an example of a composition_object (1) structure implementing the in-effect shown in FIG. 25.

FIG. 28 is a diagram illustrating an example of a composition_object (2) structure implementing the in-effect shown in FIG. 25.

FIG. 29 is a diagram illustrating an example of a composition_object (3) structure implementing the in-effect shown in FIG. 25.

30 is a diagram illustrating the order of ODS in DS _n .

FIG. 31 is a diagram showing how the order of ODSs in the S-ODS is different between the case where the default_selected_button_id_ref field is set to "00" and the case where it is set to a valid value specifying button B. FIG.

32A shows LASTODSPTS when the default selected button is statically determined.

32B illustrates LASTODSPTS when the default selected button is dynamically determined.

33A illustrates LASTODSPTS when the DS does not include an ODS related to the selected state.

33B illustrates LASTODSPTS when the DS does not include an ODS related to a steady state.

33C shows LASTODSPTS when the DS does not contain ODS at all.

34A is a diagram illustrating an algorithm for obtaining a DECODEDURATION value from a value calculated by LASTODSPTS (DS _n -DTS (DS _n [ICS])) and a PLANECLEARTIME value.

34B and 34C are diagrams illustrating an example of a method of calculating a DECODEDURATION value.

35A is a diagram illustrating an equation for calculating EFFECTTD.

35B is a diagram illustrating an equation for calculating PAGEDEFAULTTD when no in-effect is provided and the default selected button is statically determined.

35C is a diagram illustrating an equation for calculating PAGENODEFAULTTD when no in-effect is provided and a default selected button is dynamically determined.

36 illustrates an algorithm for selectively determining one of EFFECTTD, PAGEDEFAULTTD, and PAGENODEFAULTTD as TRANSFERDURATION.

37 shows the internal structure of the playback apparatus according to the present invention.

38A is a flowchart of "procedure when the reproduction condition is changed" performed by PSR11.

38B is a flowchart of “procedure when a change is requested” performed by PSR 11.

39A is a flowchart of "procedure when the reproduction condition is changed" performed by PSR10.

39B is a flowchart of “procedure when a change is requested” performed by PSR 10.

40 is a diagram showing the internal structure of the I-graphics decoder 9.

41 is a flowchart of the main routine of the procedure that the graphics controller 37 performs.

42 is a flowchart of the procedure for the first indication.

43 is a flowchart of a procedure for reproduction of an in-effect animation.

44 is a flowchart of a display update procedure for a display button in an animation.

45 is a flowchart of a procedure for executing a navigation command.

46 shows a procedure for processing a UO.

47 is a flowchart of the current button change procedure.

48 is a flowchart of a procedure for auto-activation of a button.

Fig. 49 is a flowchart of the production process of the BD-ROM according to the first to fifth embodiments.

Claims (11)

A recording medium that records video streams and graphics streams. The graphics stream includes one or more conversation control segments and an object definition segment defining graphics objects, The conversation control segment includes a plurality of page information, time information, and stream model information. The plurality of page information is information defining a screen configuration of the multipage menu, each page information includes one or more button information, and each button information constitutes a multipage menu by displaying a graphics object in a state of a button member. Information that realizes interactive screen composition on each page, The time information includes timeout information, The timeout information indicates a time of activating a button member which is in a selected state among the button members existing in each page of the multipage menu after a predetermined time elapses. The time information further includes composition timeout information, The composition timeout information indicates a time at which conversation control ends. The stream model information, Is the graphics stream multiplexed with the video stream and recorded on the record carrier, Indicates that the graphics stream is recorded on the recording medium without being multiplexed with the video stream, Wherein the timeout information and the composition timeout information are valid only when a graphics stream is multiplexed with a video stream and recorded on a recording medium. delete delete delete A playback device that plays video and graphics streams. A video decoder for decoding a video stream to obtain a moving picture; A graphics decoder for decoding a graphics stream to obtain a graphics object, The graphics stream includes one or more conversation control segments and an object definition segment defining graphics objects, The conversation control segment includes a plurality of page information, time information, and stream model information. The plurality of page information is information defining a screen configuration of the multipage menu, each page information includes one or more button information, and each button information constitutes a multipage menu by displaying a graphics object in a state of a button member. Information that realizes interactive screen composition on each page, The time information includes timeout information, The timeout information indicates a time for activating a button member which is in a selected state among the displayed button members after a predetermined time elapses, The time information further includes composition timeout information, The composition timeout information indicates a time at which conversation control ends. The stream model information, Is the graphics stream multiplexed with the video stream and recorded on the record carrier, Indicates that the graphics stream is recorded on the recording medium without being multiplexed with the video stream, The timeout information is valid only when the graphics stream is multiplexed with the video stream and recorded on the recording medium. The graphics decoder controls timeout based on the timeout information, the composition timeout information, and the stream model information, wherein the stream model information is recorded on a recording medium in which a graphics stream is multiplexed with a video stream. In this case, the button member being selected from among the displayed button members is activated based on the time indicated by the timeout information, and the conversation control is terminated based on the time indicated by the composition timeout information. Regeneration device. delete delete delete A recording method in which a video stream and a graphics stream are recorded. A creation step of creating application data including a video stream and a graphics stream; A recording step of recording the created data on a recording medium; The creation step is A first substep of encoding a material of a moving picture to obtain the video stream; A second substep of creating at least one conversation control segment and an object definition segment defining a graphics object to obtain said graphics stream, The conversation control segment describes a plurality of page information, time information, and stream model information. The plurality of page information is information for defining the screen configuration of the multipage menu, each page information includes one or more button information, and each button information constitutes a multipage menu by displaying a graphics object in a state of a button member. Information that realizes interactive screen composition on each page. The second substep includes a procedure of defining, in time information, a time point at which the display state of the multipage menu is to be transitioned among the playback time axes of the video stream, In the second substep, a plurality of page information, time information, and stream model information are described in a conversation control segment. The time information defined by the second substep includes timeout information, The timeout information indicates a time for activating a button member which is in a selected state among the button members existing in each page of the multipage menu after a predetermined time elapses. The time information further includes composition timeout information, The composition timeout information indicates a time at which conversation control ends. The stream model information, Is the graphics stream multiplexed with the video stream and recorded on the record carrier, Indicates that the graphics stream is recorded on the recording medium without being multiplexed with the video stream, And the timeout information and the composition timeout information are valid only when a graphics stream is multiplexed with a video stream and recorded on a recording medium. A computer-readable recording medium recording a program for causing a computer to play a video stream and a graphics stream. Decoding a video stream to obtain a moving picture; Decoding the graphics stream to obtain a graphics object, The graphics stream contains one or more conversation control segments and an object definition segment that defines the graphics objects. Each conversation control segment includes a plurality of page information, time information, and stream model information. The plurality of page information is information defining a screen configuration of the multipage menu, each page information includes one or more button information, and each button information constitutes a multipage menu by displaying a graphics object in a state of a button member. Information that realizes interactive screen composition on each page, The time information includes timeout information, The timeout information indicates a time for activating a button member which is in a selected state among the displayed button members after a predetermined time elapses, The time information further includes composition timeout information, The composition timeout information indicates a time at which conversation control ends. The stream model information, Is the graphics stream multiplexed with the video stream and recorded on the record carrier, Indicates that the graphics stream is recorded on the recording medium without being multiplexed with the video stream, The timeout information is valid only when the graphics stream is multiplexed with the video stream and recorded on the recording medium. The step of decoding the graphics stream is to control a timeout based on the timeout information, the composition timeout information, and the stream model information, wherein the stream model information is multiplexed with the video stream and the recording medium. Is recorded on the basis of the time indicated by the timeout information, and the dialog control is performed based on the time indicated by the composition timeout information. And terminating the computer readable recording medium. A playback method for playing video streams and graphics streams. Decoding a video stream to obtain a moving picture; Decoding the graphics stream to obtain a graphics object, The graphics stream contains one or more conversation control segments and an object definition segment that defines the graphics objects. The conversation control segment includes a plurality of page information, time information and stream model information. The plurality of page information is information for defining the screen configuration of the multipage menu, each page information includes one or more button information, and each button information constitutes a multipage menu by displaying a graphics object in a state of a button member. Information that realizes interactive screen composition on each page, The time information includes timeout information, The timeout information indicates a time for activating a button member which is in a selected state among the displayed button members after a predetermined time elapses, The time information further includes composition timeout information, The composition timeout information indicates a time at which conversation control ends. The stream model information, Is the graphics stream multiplexed with the video stream and recorded on the record carrier, Indicates that the graphics stream is recorded on the recording medium without being multiplexed with the video stream, The timeout information is valid only when the graphics stream is multiplexed with the video stream and recorded on the recording medium. The step of decoding the graphics stream is to control the timeout based on the timeout information, the composition timeout information, and the stream model information. Is recorded on the basis of the time indicated by the timeout information, and the dialog control is performed based on the time indicated by the composition timeout information. The playback method characterized in that the termination.

Images