JP2009003370A - Information playback apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique for suppressing delay of screen constitution due to decode completion waiting. <P>SOLUTION: An information playback apparatus comprises: a decode means of decoding a graphic object; a storage means of storing the decoded graphic object; a graphic screen construction processing means which performs graphic screen construction processing of drawing a plurality of graphic objects on prescribed positions on a graphic plane in a prescribed order based on layout information of the plurality of graphic objects and performs drawing order altering processing of deferring the drawing of the graphic object incapable of setting the decode in time, in the graphic screen construction processing; and an output means of outputting the graphic plane on which the plurality of graphic objects are drawn by the graphic screen construction processing means. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a playback technique in advanced content defined by, for example, the HD DVD standard.

  In recent years, DVD video discs having high image quality and high functions and video players for reproducing the discs have been widely used. However, in the past few years, content such as menu screens and privileged video including the main title has become a more attractive content provision environment for users by expanding the content, such as more colorful menus and improved interactivity. Requested by suppliers.

Accordingly, advanced content has been proposed as a menu rich in color and highly interactive content, and there are information recording media having advanced content and information reproducing apparatuses for reproducing advanced content (for example, see Patent Document 1). . The advanced content includes audio, still images (including background images) animation, character fonts, moving images, etc., and the data of these advanced content is stored in an information recording medium in an encoded state. . An information playback apparatus for playing back advanced content includes an advanced control player (Advanced Content Player) as a playback system model for playing back advanced content. The advanced control player is composed of a data access manager (Data Access Manager), a data cache (Data Cache), a navigation manager (Navigation Manager), a presentation engine (Presentation Engine), an AV renderer (AV Renderer), etc. .
JP2007-48348

  One screen of the above-described advanced content is composed of, for example, a plurality of objects. That is, a plurality of objects necessary for the configuration of one screen are decoded, and the plurality of decoded objects are drawn on one plane to form one screen. The plurality of objects are drawn in a predetermined order at predetermined positions based on the layout information. At this time, if there is an object waiting for decoding among a plurality of objects, drawing is temporarily stopped, and drawing is resumed after waiting for decoding to be completed. This causes a delay in screen construction.

  An object of the present invention is to provide a technique for suppressing delay in screen construction due to completion of decoding.

  An information reproducing apparatus according to an embodiment of the present invention includes a decoding unit that decodes a graphic object, a storage unit that stores the decoded graphic object, and a plurality of graphic objects based on layout information of the plurality of graphic objects. A graphic screen construction process for executing a graphic screen construction process for drawing in a predetermined order on a predetermined position on the graphic plane, and a drawing order changing process for postponing the drawing of a graphic object that cannot be decoded in time in this graphic screen construction process And an output means for outputting the graphic plane on which the plurality of graphic objects are drawn by the graphic screen construction processing means.

  According to the present invention, it is possible to provide a technique for suppressing delay in screen construction due to decoding completion waiting.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram showing a schematic configuration of an HD-DVD video player (advanced control player ACP) compatible with an advanced HD video title set (AHDVTS).

  The advanced control player ACP includes a data access manager 31, a data cache 35, a navigation manager 22, a presentation engine 36, and an AV renderer 44.

  The data access manager 31 is a module that accesses the persistent storage 28, the network server 29, the HD-DVD disc 30, and the like and performs operations such as reading and writing files based on instructions from the data cache 35 and the like. The data access manager 31 includes a persistent storage manager 32, a network manager 33, and a disk manager 34.

  The persistent storage manager 32 is a module that performs operations such as reading / writing and deleting files in the persistent storage 28 based on an instruction from a higher-level module. The network manager 33 is a module that downloads a file from the network server 29 or uploads a file based on an instruction from a higher module. The disk manager 34 is a module that reads a file stored in the HD-DVD disk 30 based on an instruction from a higher module.

  The data cache 35 is a buffer that temporarily stores the read file and the like, and the encoded image data and the like are stored in the data cache 35. The capacity of the data cache 35 is, for example, 64 Mbytes. The data cache 35 includes a file cache and a streaming buffer. The file cache operates as a cache when the navigation manager 22 or the presentation engine 36 reads a file. The streaming buffer is used for buffering video data when a secondary video player 41 (secondary video player) to be described later performs streaming reproduction of the video data on the network server 29.

  The navigation manager 22 is a module that performs overall control of advanced content, reproduction processing of contents described in a markup language or script language (for example, ECMA script), processing operation corresponding to control information from a remote controller, and the like. It is. The navigation manager 22 includes a file cache manager 24, a playlist manager 25, a parser 23, an advanced application manager 26, and a user interface engine 27. It is comprised including.

  Upon receiving an instruction from the playlist manager 25 or the advanced application manager 26, the file cache manager 24 controls the data access manager 31 to transfer a desired file from the HD-DVD disk 30 or the network server 29 to the data cache 35. This module is loaded and managed.

  The playlist manager 25 is a module that reads out the configuration information of the content from the playlist (Playlist) at the start of playback of the advanced content, and performs initialization control of each module. The playlist manager 25 is also a module that controls a title timeline.

  The advanced application manager 26 is a central module that performs overall control of playback of advanced content. The advanced application manager 26 includes a declarative engine and a programming engine.

  The declarative engine is a module that controls timing according to a description in a markup language. The declarative engine is also a module that controls the presentation engine 36 according to the description of the markup language, and performs graphic display and character display.

  The programming engine is a module that interprets and executes a script language described in an ECMA script. The programming engine can perform player control, graphic drawing, file operation, and the like by calling an API (Application Interface) defined in the HD-DVD standard from an ECMA script. The programming engine controls the presentation engine 36, thereby realizing graphic drawing and player control instructed by the ECMA script via the API.

  The user interface engine 27 is a module that controls a cursor. The user interface engine 27 is also a module that transmits control information and the like as events from the remote controller to the advanced application manager 26.

  The presentation engine 36 is a module that decodes graphic data, video data, audio data, or the like and creates a final graphic image, video frame image, or the like. The presentation engine 36 sends the created graphic image, video frame image, and the like to the AV renderer 44. The presentation engine 36 includes an advanced application presentation engine 37, a pixel buffer 38, a font rendering system 39, an advanced subtitle player 40, a secondary video player 41, A primary video player 42 and a decoder engine 43 are included.

  As shown in FIG. 2, the advanced application presentation engine 37 includes a sound decoder 47, a graphic decoder 48, and a layout manager 49. The advanced application presentation engine 37 displays images in various formats (for example, PNG (Portable Network Graphics), MNG (Multiple-Image Network Graphics), JPEG (Joint Photographic Experts Group), etc.) in accordance with instructions from the navigation manager 22. This is a module that reads out from the data cache 35, decodes it, creates a final output image on the graphic plane, and outputs it to the AV renderer 44. The advanced application presentation engine 37 is also a module that converts the WAV file read from the data cache 35 into LPCM (Linear Pulse Code Modulation) data and outputs it to the AV renderer 80.

  The graphic decoder 48 performs processing for decoding an image of the above-described format and processing for registering or deleting the decoded image in the pixel buffer 38.

  The layout manager 49 constructs a final display image on the graphic plane. Therefore, the layout manager 49 reads and draws the decoded image registered in the pixel buffer 38 in accordance with the layout information sent from the advanced application manager 26. The layout manager 49 sends a character font drawing instruction to the font rendering system 39. Then, the layout manager 49 sends the completed display screen to the AV renderer 44.

  The advanced subtitle player 40 generates an output image on the sub-picture plane according to the description of the markup language in the advanced subtitle by the same processing as the layout manager 49, and sends the completed output screen to the AV renderer 44.

  The primary video player 42 and the secondary video player 41 are modules that perform playback control as video players. The primary video player 42 and the secondary video player 41 analyze TMAP (TimeMap) during reproduction. The primary video player 42 and the secondary video player 41 read out necessary locations from the data access manager 31 based on the TMAP analysis result, and classify them into video image data, audio data, sub-picture data, or the like. The primary video player 42 and the secondary video player 41 output the classified data to each decoder in the decoder engine 43.

  The decoder engine 43 decodes video image data, audio data, and the like encoded by the MPEG-2 method or the like. The decoder engine 43 outputs the decoded data to the AV renderer 44 as final image data or PCM (Pulse Code Modulation) data.

  As shown in FIG. 3, the display screen in the HD-DVD standard includes a main video plane (Main Video Plane) and a sub-picture plane (Subpicture Plane) in the conventional DVD standard, a sub-video plane (Sub Video Plane), and a graphic. A plane (Graphic Plane) and a cursor plane (Cursor Plane) are added. These five planes are synthesized with the main video plane at the bottom, and then superimposed in the order of the sub video plane, sub picture plane, graphic plane, and cursor plane. A screen obtained by combining the five planes is a final output screen.

  The output screen is constructed and updated every frame. On the other hand, the graphic plane is repeatedly constructed and updated at a cycle specified by a tick base (tickBase) and a tick base divider (tickBaseDivisor) described later. Therefore, the graphic plane update cycle differs from the output screen. For this reason, the following processing is performed in drawing a graphic plane. That is, two graphic planes, a display (Front) graphic plane and a drawing (Back) graphic plane, are prepared. While the display graphic plane is used for screen display, drawing is performed on the drawing graphic plane. When this drawing is completed, the display graphic plane and the drawing graphic plane are switched. For this process, the graphic plane uses two surfaces.

  Here, with reference to FIG. 3, the graphic screen construction processing of the advanced content will be described.

  The advanced application manager 26 controls and controls the playback of advanced content. The presentation engine 36 that performs screen display and the like performs processing such as screen creation and decoding in accordance with instructions from the advanced application manager 26. The advanced application manager 26 realizes a playback operation by repeating event processing necessary for playback of advanced content and final generation of the next screen in synchronization with an application tick described later. ing.

  In the HD-DVD video player, in order to control the playback speed and timing of advanced content, a periodic synchronization signal called an application tick is generated and sent to each module. The advanced application manager 26 reproduces the advanced content at the designated speed and timing by synchronizing with the application tick.

  On the other hand, a unique time called an application clock is engraved in synchronization with the application tick. The time of the application clock is reset to “0” when playback of the advanced content is started. The application clock is used, for example, when describing an animation corresponding to the time of advanced content.

  Normally, application ticks are also used for time increments in the application clock, so they are specified by values such as 50 fps and 60 fps. The cycle of application ticks is specified by an attribute called tick base in the playlist file. “fps” is a unit used for indicating a screen update interval, and indicates how many times the screen is updated per second. That is, how many times a series of operations for updating the screen is repeated per second.

  If there are many images constituting the graphic screen, even if the application tick is specified as 60 fps, for example, it may be impossible in terms of performance to update the graphic screen 60 times per second. Therefore, the advanced application manager 26 does not always perform processing for each application tick, but performs a series of processing in synchronization with application ticks thinned out according to a rate specified by an attribute called a tick base visor. ing.

  As shown in FIG. 4B, for example, when the tick base is “60” and the tick base divider is “4”, the application tick is chopped 60 times per second. One of the four application ticks is the start timing of the periodic process. Therefore, the advanced application manager 26 repeats a series of processes at a cycle of 15 times per second.

  In the example shown in FIG. 4A, an application tick handler is executed at each application tick. However, the advanced application manager 26 performs processing once for the number of ticks designated by the tick base divider. Therefore, the advanced application manager 26 performs actual processing only when the remainder obtained by dividing the application clock by the tick base divider is “0”.

  Processing for one cycle in the advanced application manager 26 includes ECMA script event processing, markup evaluation, scheduling event processing, rendering processing for rendering the next graphic screen, and the like. In the rendering process, the graphics plane is filled with a transparent color and cleared, and then the graphics of the application having a small z order (zOrder) are sequentially overwritten. These rendering processes are performed by the presentation engine 36 under the instruction of the advanced application manager 26. When all these processes are completed, the completed graphic plane is sent to the AV renderer 44 and reflected on the output screen.

  Next, the decoding and drawing timing will be described with reference to FIGS. In general, it takes time to decode an encoded image such as PNG or JPEG. For this reason, in order to perform animation at a high speed, it is necessary to control all necessary images in advance. In the HD-DVD standard, such control can be described in content. Specifically, in addition to the parameter “style: visibility” that specifies whether to display the screen, a parameter “style: display” for instructing the HD-DVD video player to start decoding is prepared. . Actually, the timing at which these parameters change is the timing at which the parameter changes are actually applied, so the HD-DVD video player starts the operation for the new parameters from the previous cycle. For example, in the example of FIG. 5, since “style: visibility” is “visible” in the frames “m + 5” and “m + 6”, it is necessary to display during this period. However, in practice, there is a delay of one frame because it is a double buffer to suppress flicker. Therefore, the presentation engine 36 issues a drawing instruction with frames of “m + 4” and “m + 5”. In the case of decoding, since “style: display” becomes “auto” in the frame of “m + 2”, it is necessary to complete the decoding by the frame of “m + 2”. Therefore, the presentation engine 36 issues a decoding instruction in the “m + 1” frame processing.

  In the case shown in FIG. 5, it takes time for decoding, and it takes about two cycles. However, by giving a decoding instruction three cycles ago, the actual drawing becomes as specified by “style: visibility”.

  Thus, by setting the time difference between the decoding instruction by “style: display” and the display start timing by “style: display”, the display delay due to the decoding time can be eliminated.

  As described above, when the time difference between decoding and display set in the content is sufficiently large, most HD-DVD video players can prevent display delay due to decoding. However, since it ultimately depends on the processing speed of the HD-DVD video player, even if decoding is started before display, display delay cannot always be prevented reliably.

  Further, as shown in FIG. 6, when decoding and display start are performed at the same time, the display is delayed by three cycles.

  Next, the drawing order of HD-DVD images will be described.

  In the advanced content defined by HD-DVD, there can be a plurality of applications that display a screen according to a file called markup described in XML. A Z order is defined for each application, and the Z order starts from 0. The Z order defined for each application is unique, and there is no multiple application in which the same Z order is defined. Further, the Z order is not discontinuous. The display screen of the application in which the Z order 0 is defined exists at the bottom. That is, the display screen of the application in which the Z order 0 is defined is drawn first. The Z order of each application is specified by “zOrder” (layout order information) in the <ApplicationSegment> tag of the playlist file.

  The Z order is also defined for objects (graphic objects) such as a plurality of images possessed by each application. The Z order defined for objects such as a plurality of images possessed by a predetermined application indicates the vertical display relationship between the objects in the predetermined application. The Z order of each object is specified by “style: zIndex” (layout order information) of the markup.

  In HD-DVD image display and graphic drawing, there is α indicating transparency in addition to R (red), G (green), and B (blue) as color expressions. With the α indicating the transparency, the image can be drawn as if it is translucent. The presentation engine 36 α blends each object with respect to the graphic plane in order from the bottom. That is, the presentation engine 36 draws all images in order from the bottom.

  FIG. 7 shows an example of image drawing by a plurality of advanced applications. Here, as described above, in the application having the small Z order, the elements are overwritten in order from the element having the small Z index (zIndex). That is, an element for rendering the “star” image “star.png”, an element for rendering the “moon” image “moon.png”, and an image “sun.png” for the “sun” Processing is executed in the order of the elements. Through this series of processing, the graphic plane includes a “star” image, a “moon” image, and a “sun” image from the bottom, a “star” image, a “moon” image, and a “sun” image. It is drawn in the order of. Further, the element processing for rendering the “heart” image “heart.png” is executed.

  As described above, the presentation engine 36 has to draw each object in order from the bottom. However, it is not always necessary to follow the Z order for images that do not overlap with other images (images that do not depend on other images). For an image having no dependency relationship with other images, the same result as in the case of following the Z order can be obtained without following the Z order (order changing process). The decoding by the graphic decoder 48 and the layout by the layout manager 49 can be executed in parallel (parallel processing). By using this parallel processing and executing the order changing process, the drawing efficiency can be improved.

  The presentation engine 36 executes the above-described order change process. That is, the presentation engine 36 optimizes the drawing order. Specifically, the presentation engine 36 postpones the rendering of an image that has not been decoded (an image that cannot be decoded in time), and has no overlap with the image that has been decoded and is being postponed. Draw the image first. As a result, the delay in waiting for decoding is minimized and drawing is made more efficient.

  The layout manager 49 included in the presentation engine 36 constructs an application markup screen on the graphic plane and outputs it to the AV renderer 44. The layout manager 49 instructs the graphic decoder 48 and the font rendering system 39 to decode necessary objects. Further, the layout manager 49 controls the graphic controller via the lower graphic driver API to draw. The layout manager 49 basically constructs a final image by rectangular filling of the graphic plane or α blending of the image on the pixel buffer 38 to the graphic plane. The layout manager 49 draws a plurality of objects on the graphic plane based on the markup language description (layout information of each object).

  For example, when the object m to be drawn m (m <n) -th among all n objects to be drawn on the graphic plane is a decoding incomplete object (for example, an object in the middle of decoding), the layout manager 49, the drawing of the object m is postponed. In this case, the layout manager 49 registers the object m in the drawing suspension processing list so that the object m can be drawn later.

  Subsequently, the layout manager 49 verifies the situation of the object m + 1 to be drawn m + 1. If the verification finds that the object m + 1 is a decoding complete object but overlaps with the object registered in the drawing suspension processing list, the layout manager 49 also delays drawing the object m + 1. In this case, the layout manager 49 also registers the object m + 1 in the drawing suspension processing list so that the object m + 1 can be drawn later. In this way, all objects are verified.

  For example, if it is determined by verification that the object m + 2 is a decoding completion object and does not overlap the object m and the object m + 1 registered in the drawing suspension processing list, the layout manager 49 adds the object to the drawing suspension processing list. Drawing of the object m + 2 is started before the registered object m and object m + 1.

  When the verification of the object n, which is the final object, is completed and the object n is drawn or the object n is registered in the drawing suspension processing list, the process proceeds to the processing of the object whose drawing has been postponed. That is, the process shifts to processing of an object registered in the drawing suspension processing list. For example, it is assumed that object m and object m + 1 are registered in the drawing suspension processing list. If the decoding of the object m is completed, the object m is drawn. Subsequently, if the decoding of the object m + 1 is completed, the object m + 1 is drawn. If the decoding of the object m has not been completed, the process waits for the decoding of the object m without shifting to the drawing of the object m + 1. The reason why the object m and the object m + 1 are registered in the drawing suspension processing list is that the object m + 1 cannot be drawn unless the object m is drawn because at least part of the object m and the object m + 1 is overlapped. is there.

  Thus, drawing of all n objects on the graphic plane is completed. That is, the graphic screen to be finally output is completed. The application thread (Application Thread) resets the drawing suspension processing list before starting the next processing.

  With reference to FIG. 7 to FIG. 9, a case of a drawing order (no efficiency by order change) and a drawing order (with efficiency by order change) will be described. FIG. 8 is a flowchart showing an example of a drawing process without applying efficiency by changing the order. FIG. 9 is a flowchart illustrating an example of a drawing process with application of efficiency by order change.

  Assume that the decoded data of “star.png”, “sun.png”, and “heart.png” exists in the pixel buffer 38, and the decoded data of “moon.png” does not exist in the pixel buffer 38. That is, it is necessary to render “moon.png” after decoding the data of “moon.png”. Further, “heart.png” is an object that does not overlap any other object.

  In the rendering process without application of efficiency by changing the order shown in FIG. 8, rendering is performed in the order of “star.png”, “moon.png”, “sun.png”, “heart.png”. That is, the drawing process is executed while waiting for the decoding to be completed. In this case, the sum of the total drawing time and the decoding waiting time of “moon.png” is a substantial total drawing time.

  On the other hand, in the rendering process with the application of efficiency by changing the order shown in FIG. 9, rendering is performed in the order of “star.png”, “heart.png”, “moon.png”, “sun.png”. That is, the object waiting for decoding and the object overlapping the object waiting for decoding are registered in the drawing suspension processing list, and the object that has been decoded and does not overlap other objects is drawn first. The decoding by the graphic decoder 48 and the layout by the layout manager 49 can be executed in parallel. That is, it is assumed that decoding of “moon.png” is completed while “heart.png” is being drawn by parallel processing of drawing and decoding. In this case, the total drawing time becomes the actual total drawing time as it is.

  Next, an example of the drawing suspension processing list will be described with reference to FIG. A drawing suspension processing list is arranged on a memory managed by the layout manager 49. The postponed drawing processes are sequentially registered in the drawing suspension processing list. The drawing processing information registered in the drawing pending processing list includes an operation ID, a source rectangle, a source surface ID, a source color, a destination rectangle, a destination surface ID, an option flag, and a global α.

  The operation ID includes BLT (Bit Block Transfer), Fill Rectangle, or Clear Rectangle. The option flags include global α valid, horizontal flip, vertical flip, or repeat. Note that “with horizontal flip” is a function for designating the reverse display of the image in the horizontal direction. The presence of vertical flip is a function for designating reverse display of an image in the vertical direction.

  The drawing order change described above can be applied not only to the graphic plane but also to a drawing area. As a result, the drawing API (Drawing API) can also be improved in efficiency by changing the drawing order.

  As shown in FIG. 11, a drawing API is defined in the ECMA script. With this drawing API, various graphics and the like can be drawn in the drawing area. As shown in FIG. 12, the entity of the drawing area is created by a bitmap in the pixel buffer 38 in the same manner as a PNG image or the like. At the time of rendering, the created bitmap is drawn with an α blend on the graphic plane in accordance with the description of the markup, like an image or the like.

  There are two methods for drawing in a drawing area with the drawing API of the ECMA script. One is to prepare a drawing suspension processing list for each drawing area, as in the previous graphic plane. An object that cannot be drawn immediately during decoding or an object that overlaps with an object registered in the drawing hold processing list is registered in the drawing hold processing list without drawing. The drawing API is executed before the markup screen of each application is constructed. For this reason, before starting the construction of the markup image, the drawing pending processing list processing in the drawing area may be executed again. When the image being decoded is used as a source, it is necessary to wait for the decoding. Therefore, the drawing pending processing list is scanned multiple times, except for the last one, as shown above. By drawing an object that does not overlap the drawing area of the object that cannot be executed in advance, the drawing order and the start timing can be optimized. Eventually, when drawing the drawing area on the graphic plane at the stage of markup image construction, the drawing pending list of the drawing area is checked. The drawing area drawing instruction is registered in the drawing hold processing list of the graphic screen construction in the same manner as the image being decoded. Finally, if there is a drawing area at the stage of processing a request remaining in the drawing hold processing list for constructing the graphic screen, the drawing hold processing list in this drawing area is also scanned. In this case, when there is a source image that has not been decoded, the completion of decoding is awaited.

  In the case of a drawing area, there is a capture function. When the capture function is executed, before the capture function is processed, the drawing of the object registered in the drawing hold processing list in the drawing area, the completion of decoding as necessary, and the clearing of the drawing hold processing list are executed.

  In the case shown in FIG. 12, “drawRectangleCoord ()” is executed in the script processing. As a result, a rectangular image “fish.png” is laid. For this reason, drawing processing cannot be executed until decoding of “fish.png” is completed. Therefore, the drawing order is optimized up to drawing API drawing executed in the script processing.

  As described above, the drawing performance of the HD-DVD video player can be improved.

  Note that the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention in the implementation stage. In addition, the embodiments may be appropriately combined as much as possible, and in that case, the combined effect can be obtained. Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, the problem described in the column of the problem to be solved by the invention can be solved, and the effect described in the column of the effect of the invention Can be obtained as an invention.

It is a figure which shows schematic structure of the HD-DVD video player (advanced control player ACP) corresponding to an advanced HD video title set (AHDVTS: Advanced High Definition Video Title Set). It is a figure which shows schematic structure of the advanced application presentation engine which comprises the HD-DVD video player shown in FIG. It is a figure which shows the outline | summary of the output image generation by the HD-DVD video player shown in FIG. It is a figure for demonstrating the graphic screen construction process of advanced content. It is a figure for demonstrating the decoding process and the drawing process to a graphic plane. It is a figure for demonstrating the decoding process (case where a decoding process is not in time) and the drawing process to a graphic plane. It is a figure for demonstrating a drawing order change. It is a figure which shows an example of the drawing process of the case where a drawing order change is not applied. It is a figure which shows an example of the drawing process of the case where the drawing order change is applied. It is a figure which shows an example of a drawing suspension process list. It is a figure which shows an example of drawing API. It is a figure which shows an example of the drawing process to a drawing area by an ECMA script.

Explanation of symbols

22 ... Navigation manager, 23 ... Parser, 24 ... File cache manager, 25 ... Playlist manager, 26 ... Advanced application manager, 27 ... User interface engine, 31 ... Data access manager, 32 ... Persistent storage manager, 33 ... Network manager 34 ... Disk manager, 35 ... Data cache, 36 ... Presentation engine, 37 ... Advanced application presentation engine, 38 ... Pixel buffer, 39 ... Font rendering system, 40 ... Advanced subtitle player, 41 ... Secondary video player, 42 ... Primary video Player, 43 ... Decoder engine, 44 ... AV renderer, 45 ... La Fick rendering engine, 49 ... layout manager

Claims (6)

Decoding means for decoding graphic objects;
Storage means for storing the decoded graphic object;
Based on the layout information of a plurality of graphic objects, a graphic image construction process is performed for drawing the plurality of graphic objects to a predetermined position on the graphic plane in a predetermined order. Graphic image construction processing means for executing a drawing order changing process to postpone drawing;
Output means for outputting the graphic plane on which the plurality of graphic objects are drawn by the graphic image construction processing means;
An information reproducing apparatus comprising: The graphic image construction process detects overlapping of each graphic object based on layout information of a plurality of graphic objects, and sequentially draws each graphic object decoded based on the layout information of the plurality of graphic objects on a graphic plane. , A process for managing the overlap-dependent relationship between the graphic objects decoded based on the overlap detection,
The drawing order changing process is a process of drawing a graphic object that cannot be decoded in time, and drawing a graphic object that has been decoded and has no overlap dependency with another post-delay graphic object.
The information reproducing apparatus according to claim 1. The graphic image construction process detects and manages an overlap dependency between graphic objects based on layout information of a plurality of graphic objects, and sequentially decodes each graphic object decoded based on the layout information of the plurality of graphic objects. It is a process of drawing on the graphic plane,
The drawing order changing process registers the graphic object m in the list and delays the drawing of the graphic object m registered in the list when the m-th graphic object m to be drawn cannot be decoded in time. When the drawing area of the graphic object m + 1 to be drawn m + 1 is verified and it is found that even if the graphic object m + 1 is a decoding completion object, it overlaps with the graphic object m registered in the list, The graphic object m + 1 is registered in the list, and the graphic object m + 1 registered in the list is also drawn later to verify the drawing area of the graphic object m + 2 to be drawn second. If it is found that the graphic object m + 2 is a decoding completion object and does not overlap both the graphic object m and the graphic object m + 1 registered in the list, the graphic registered in the list A process of drawing the graphic object m + 2 before the object m and the graphic object m + 1;
The information reproducing apparatus according to claim 1.   The graphic image construction processing means postpones the drawing processing when the image used as the source in the drawing processing by the drawing API is not in time in the drawing image generation processing to the drawing area by the drawing API of the ECMA script. The information reproducing apparatus according to claim 1, wherein the drawing order optimization is also applied to the drawing API.   2. The information reproducing apparatus according to claim 1, wherein the decoding process by the decoding unit, the drawing process by the graphic image construction processing unit and the drawing order changing process can be executed in parallel. Decoding means for decoding a graphic object included in each of a plurality of applications;
Storage means for storing the decoded graphic object;
Based on the Z order information of each application and the Z order information of each graphic object included in each application, a graphic screen construction process for drawing each graphic object at a predetermined position on the graphic plane in a predetermined order is executed. Graphic screen construction processing means for executing a drawing order changing process to postpone drawing of graphic objects that cannot be decoded in time in the construction process;
Output means for outputting the graphic plane on which the plurality of graphic objects are drawn by the graphic screen construction processing means;
An information reproducing apparatus comprising:

Images