RU2298844C2 - Device for reproducing audio/video data in interactive mode and method for processing user input - Google Patents

Abstract

FIELD: device for reproducing audio/video data in interactive mode, method for processing user input.

SUBSTANCE: in invention, information storage environment is used, which includes audio/video data and markup document, used for reproduction of audio/video data in interactive mode. Markup document includes first event information about occurrence of even by means of key, corresponding to user action, to inform, by default, the machine for reproducing audio/video, which reproduces audio/video data.

EFFECT: efficient control over interactive content with usage of user input device having limited number of buttons.

9 cl, 12 dwg

Description

FIELD OF THE INVENTION

The present invention relates to an apparatus for reproducing audio / video data in an interactive mode, a method for processing user input, and an information storage medium for it.

State of the art

Digital versatile discs (DVDs), which are capable of reproducing audio / video data interactively based on a personal computer (PC), are sold on the market. On interactive DVDs, audio / video data is recorded in accordance with DVD-Video standards in addition to markup documents to support the interactive function. Audio / video data recorded on an interactive DVD can be displayed in two modes: in video mode, in which audio / video data is displayed in the same way as regular DVD-Video data, and in interactive mode, in which audio / video image from audio / video data is embedded in the image window specified in the markup document, for display together with the markup document. For example, in the case when the audio / video data is the title of the film, the title of the film is shown in the screen image window, and various additional pieces of information, such as scripts, graphics, photographs of actors and actresses, etc. are displayed in the rest of the screen. Alternatively, various additional information may be displayed synchronously with the title (audio / video data). For example, when a particular actor or actress appears in the caption, a markup document containing information about him or her may be displayed.

Interactive mode requires two playback machines, i.e. a playback machine for interpreting and presenting the markup document; and an audio / video playback machine for reproducing DVD-Video audio / video data. In other words, in interactive mode, there are two large areas over which the user can navigate, i.e. Layout document and DVD-Video data. Since these two areas are controlled and moved in different ways, it is preferable that the control button and navigation button exist separately. In the case of a traditional interactive DVD, the browser built into the PC acts as a playback machine for reproducing the markup document, and the PC user input device, i.e. a keyboard with a relatively large number of input buttons and a mouse capable of pointing to anywhere in the markup document act like navigation buttons.

However, in the case when it is desirable to implement a household device controlled by a user input device, for example, a remote control with a limited number of buttons, and supporting an interactive mode, the use of separate navigation buttons is inefficient.

Disclosure of invention

The present invention provides a device that reproduces audio / video data interactively by efficiently processing user input using a user input device having a limited number of buttons, a user input processing method and an information storage medium in which information is stored for it.

The playback device manages the user input in a certain way, which allows the creator of the interactive content to create interactive content with which the user can subsequently effectively interact. In addition, the method provides user input processing, and information for it is stored in the information storage medium.

According to an aspect of the present invention, the information storage medium includes audio / video data and a markup document necessary for reproducing audio / video data in an interactive mode. The markup document includes first event information for informing, by default, the audio / video playback machine that reproduces the audio / video data about the occurrence of an input event by means of a key corresponding to a user action.

The first event information may include event registration information for checking whether the user has performed an action, and event processing information for processing the event by controlling the operation of the audio / video playback machine when an input event by a key occurs.

Event recording information can be recorded using an input event by clicking, defined in the markup document, and event processing information can be created by a function so that the audio / video playback machine can perform an operation corresponding to the input event by clicking, or the event recording information can be recorded using the input event tracking block by means of a key to check whether an input event has occurred by means of a key, and the information is processed events can be recorded using the input event processing unit by means of a button to control the operation of the audio / video playback machine.

The audio / video playback machine can be informed about the occurrence of an input event by means of a key through the SAW machine, which interprets and executes the markup document.

The markup document may include second event information to prohibit informing the audio / video playback machine that decodes the audio / video data of the occurrence of the input event by the key.

According to another aspect of the present invention, the method provides for user input processing in an interactive mode in which reproduced audio / video data is displayed using a markup document. When an input event occurs by means of a key corresponding to a user’s action, the SAW machine, which interprets and executes a markup document, is informed about the occurrence of an input event by means of a key. By default, the SAW machine informs the audio / video playback machine of the occurrence of an input event by the key, and the audio / video playback machine plays back the audio / video data.

According to another aspect of the present invention, the method provides user input processing in an interactive mode in which reproduced audio / video data is displayed using a markup document. The audio / video playback machine, which decodes the audio / video data, is informed by default of the occurrence of an input event by means of a key corresponding to a user action. When a second event occurs using the second event information recorded in the markup document, it is forbidden to inform the audio / video playback machine of the occurrence of an input event by means of a key.

According to another aspect of the present invention, an apparatus reproduces audio / video data interactively. The device includes an audio / video playback machine that reproduces audio / video data, and a SAW machine that interprets and executes the markup document. When an input event occurs by means of a key corresponding to a user’s action, the UAW machine informs, by default, the audio / video playback engine of the occurrence of an input event by means of a key.

When a second event occurs using the second event information recorded in the markup document, the SAW machine may not inform the audio / video playback machine of the occurrence of an input event by means of a key.

The SAW machine may include an interface processing unit that informs the audio / video playback machine of the occurrence of an input event by means of a key.

Additional aspects and advantages of the invention are set forth in part in the description which follows and in part are apparent from the description or may be learned by practice of the invention.

Brief Description of the Drawings

Figure 1 is a generalized view of a reproduction system according to an embodiment of the present invention.

Figure 2 is a top view of the remote control 400 of the remote control shown in figure 1.

FIG. 3 is a block diagram of a reproducing apparatus 200 shown in FIG.

FIG. 4 is a partial block diagram illustrating in more detail an embodiment of the operation of the advanced audio / video (SAW) machine 3 shown in FIG. 3.

5 is an example of an interactive screen according to an embodiment of the present invention.

6A and 6B are an illustration of “predetermined operation information of an ASW machine 3 and an audio / video playback machine 4” according to an embodiment of the present invention.

7 is a flowchart illustrating an operation of a method for processing user input in an interactive mode according to an embodiment of the present invention.

FIG. 8 is a flowchart illustrating an operation of a method for processing user input online, according to another embodiment of the present invention.

FIG. 9 is a flowchart illustrating an operation of a method for processing user input online, according to another embodiment of the present invention.

10 is a flowchart illustrating operations of a method for processing user input in an interactive mode, according to another embodiment of the present invention.

11 is a flowchart illustrating an operation of a method for processing user input interactively, according to another embodiment of the present invention.

The implementation of the invention

The term "interactive content" refers to any content that is displayed or can be displayed to the user in an interactive mode. In other words, the term “interactive content” refers to content that can be displayed through audio / video data, markup documents, program codes and / or resource files inserted into or attached to markup documents. For example, when playing DVD-Video data interactively, the interactive content is generally split into DVD-Video content (audio / video content) and markup documents. The markup document is written in a markup language such as XML, HTML, etc. In other words, a markup document indicates a markup resource that includes A.png, A.jpg and A.mpeg attached to A.xml, as well as A.xml itself. Thus, the markup document acts as the application required to play the audio / video data interactively, and as the interactive content displayed to the user through the audio / video data.

1 shows a generalized view of a reproduction system according to an embodiment of the present invention. 1, a reproducing system includes a DVD 300 as an information storage medium, a reproducing apparatus 200, a television 100 as a display device, and a remote control 400 as a user input device. The remote control 400 receives a user control command, and then transmits a user control command to the playback device 200. The reproducing apparatus 200 reproduces the audio / video data recorded on the DVD 300 in an interactive manner. When the DVD 300 is loaded into the DVD drive included with the reproducing apparatus 200 and the user selects an interactive mode, the reproducing apparatus 200 reproduces the corresponding audio / video data interactively using the corresponding markup document, and then transmits the corresponding audio / video data to the television 100. The television 100 displays an audio / video image generated by audio / video data that was reproduced in conjunction with a markup image generated by a document markup by embedding audio / video in the markup image. Interactive mode is a mode in which the audio / video image is displayed in the image window specified in the markup document, i.e. the audio / video image is embedded in the markup image. In this case, the audio / video image is formed by reproducing DVD-Video data recorded on the DVD 300 using the playback device 200, and then displayed on the television 100. The markup image is formed by interpreting and implementing the markup document recorded on the DVD 300 using the device 200 playback, followed by display on the TV 100. The markup image into which the audio / video image is embedded, i.e. An image displayed interactively is called an interactive image. "Video mode" is a mode in which audio / video data is reproduced according to the traditional DVD-Video standards, i.e., only the audio / video image generated by the playback corresponding to the audio / video data is displayed. According to the embodiment shown in FIG. 1, the reproducing apparatus 200 supports an interactive mode, a video mode, and a full screen mode, which is a sub-mode of the interactive mode. Full-screen mode is a display mode defined in Korean Patent Application No. 02-7031, entitled "Information Storage Medium on which Mode Display Information is Recorded , and Playing Back Apparatus and Method therefor "), filed February 7, 2002 by the applicant of the present invention. Full screen mode is a mode in which the audio / video image is enlarged and occupies the entire screen in interactive mode. In addition, according to the embodiment shown in FIG. 1, the reproducing apparatus 200 can retrieve a markup document from a network.

Figure 2 shows a top view of the remote control 400 of the remote control shown in figure 1. 2, a remote control 400 includes various function keys. The TV button 41 is used to view the broadcast signal received from an external source using the television 100. The DVD ′ button 42 is used to view the video title according to the embodiment shown in FIG. 2, wherein the video title is audio / video data transmitted from playback device 200 using a television 100. The 43 digit / special character keys used to select the channels are located at the top of the remote control 400. The Setup button 44 is the key used to call up the on-screen display (ONE) menu for setting the playback device 200, the 45 H / E key is the language switch key, the 46 SP key is the space bar, and the DEL key 47 ′ Is the delete key. Button 48 'Screen' is a key used to convert the display mode of the audio / video image into interactive mode, i.e. from embedding mode to full screen mode, the 49 ′ Menu ′ button is the key used to bring up the menu screen, and the 50 ′ Content ′ button is the key used to download predefined information from the Internet. Positions 52, 53, 54, and 55 denote an up key, a left key, a down key, and a right key, respectively, which are direction keys for moving focus or highlighted information in an interactive image. 51 OK button is a key for selecting elements of a markup document containing focus or highlighted information or a menu.

Positions 56, 57, 58, 59, 60 and 61 indicate a preview key, a “next” key, a fast rewind key, a stop key, a play / pause key and a fast forward key, respectively, which are keys for playing a video title. When playing a video title, the user can switch the audio language using the 62 'Audio' button, the subtitle language using the 63 'Subtitle' button, and the image angle using the 64 'Angle' button.

The “Focus change” button 65 is used to switch between areas of the interactive image, i.e. to move the focus from the audio / video image to the markup image or from the markup image to the audio / video image. When the user presses the “Focus change” button 65, the user input corresponding to the pressed button is processed according to an embodiment of the present invention. A detailed description of this process is given below.

The 66 'Return' button is used to navigate among hierarchies in a hierarchical menu. The 67 'Exit' button is used to go from the menu screen to the video title playback screen. The remote control 400 shown in FIG. 2 was used by way of example for the specific control of a DVD 300 on which a video title is recorded. Therefore, the specific function keys of the remote control 400 and the number of function keys may vary. In addition, some function keys can be placed in the ONE menu. Alternatively, some ONE menu items may be implemented as function keys.

FIG. 3 shows a block diagram of a reproducing apparatus 200 shown in FIG. 3, the reproducing apparatus 200 includes a reader 2, a WAV machine 3, an audio / video reproducing machine 4, and a mixer 7.

The reader 2 reads the audio / video data, i.e. DVD-Video data and a markup document according to this embodiment, with the DVD 300 in accordance with a control signal coming from the ASU machine 3. The markup document contains at least one of the first event information, the second event information and the third event information as event information according to an embodiment of the present invention. The first event information is used to control the audio / video image interactively, i.e. the action of the machine 4 playback audio / video data playback DVD-Video. The second event information is used to prohibit the transmission of user input to the audio / video playback machine 4. The third event information is used to control the operation of the ASW machine 3 in case of transfer or prohibition of sending user input to the audio / video playback machine 4.

The first event occurs when the first event information is used, the second event occurs when the second event information is used, and the third event occurs when the third event information is used.

The audio / video reproducing machine 4 reproduces the read audio / video data. According to an embodiment, since the audio / video data is recorded as DVD-Video data, the audio / video reproducing machine 4 is implemented as a DVD-Video data reproducing machine for reproducing DVD-Video data. The audio / video reproducing machine 4 communicates with the SAW machine 3 through an application programming interface (API). In other words, the audio / video playback machine 4 informs the SAW machine 3 about the property of its operating state in response to a request made by the SAW machine 3, and transmits a start signal to the SAW machine 5. For example, when a Star Wars movie is shown interactively, the start signal informs the SAW machine 3 before or after the point in time at which the battle scene is to be displayed, that the quiz corresponding to the battle scene is displayed in the audio / video image.

In addition, when a key input event occurs due to a user pressing a specific key on the remote control 400, the audio / video playback machine 4 receives the key input event through the SAW machine 3. In other words, when the user presses a certain key of the remote control 400, an input event by a key occurs, and the audio / video playback machine 4 is informed of the input event by the key, which allows the audio / video playback machine 4 to control the DVD-Video data using the event input using the key. When the first event occurs, the audio / video playback machine 4 performs the operation specified by the first event. However, as described previously, upon the occurrence of the second event, the audio / video reproducing machine 4 cannot be informed of the occurrence of an input event by means of a key from the user.

The UAV machine 3 is an interpretation machine that checks, interprets, and executes markup documents written in a markup language, a scripting language, and / or other programming languages. According to an embodiment, the WAV machine 3 checks, interprets, and uploads a markup document for interactively reproducing DVD-Video data that is recorded on the DVD 300 interactively. In particular, when the first event information is recorded in the markup document, and the first event occurs using the first event information, the SAW machine 3 informs the audio / video playback machine 4 of the occurrence of the first event. When an input event occurs by means of a key corresponding to a user’s action, the ASW machine 3 can inform, by default, the audio / video playback machine 4 of the occurrence of an input event by a key. In the case when the second event information is recorded in the markup document, and the second event occurs using the second event information, the ASM machine 3 may prohibit the audio / video playback machine 4 from informing of the occurrence of an input event by means of a key corresponding to the user's action. In addition, in the case where the third event information is recorded in the markup document, and the third event occurs using the third event information, when user input is sent directly to the audio / video playback machine 4 or the transfer is prohibited, the ASM machine 3 performs an operation corresponding to the third event.

The SAW machine 3 may include various plug-ins. Plug-ins allow you to open files of various formats contained in the markup document or attached to it. For example, the WAV machine 3 may call WINDOWS MEDIA PLAYER to play audio / video data in the format of this player. In addition, the SAW machine 3 can be connected to the network to extract the necessary information, for example, markup documents, etc. The mixer 7 mixes and outputs the DVD-Video stream reproduced in the interpreted markup document. Then, the interactive image including the markup image 22 of the audio / video image 21 is displayed on the television 100.

Figure 4 shows a partial block diagram illustrating in more detail the operation of the machine 3 SAW shown in figure 3. According to figure 4, the machine 3 UAW includes a block 15 analysis and interpretation, decoder 25 and block 35 processing the interface. When an input event occurs by means of a key corresponding to a user action, the processing unit of the interface 35 is informed of the occurrence of an input event by a key corresponding to a user action and informs, by default, the audio / video playback machine 4 of the occurrence of an input event by a key.

The analysis and interpretation unit 15 analyzes the markup document and interprets the markup document and script codes recorded in the markup document. Script codes are used to dynamically manage objects contained in a markup document interactively. An event serves as a trigger signal for activating (function) an event handler for managing objects. In other words, according to an embodiment, the analysis and interpretation unit 15 interprets the event information recorded in the markup document in the markup language and / or scripting language, and transmits the corresponding command to the interface processing unit 35 for processing the event in accordance with the interpreted event information.

The interface processing unit 35 converts the trigger signal transmitted from the audio / video playback engine 4 into an event that can be interpreted by the analysis and interpretation unit 15, the state from the audio / video playback engine 4 into a property that can be understood by the analysis and interpretation unit 15 , and a command from the analysis and interpretation unit 15 to a control command that can be processed by the interface processing unit 35 or understood by the audio / video reproducing machine 4.

According to an embodiment, upon the occurrence of the first event using the first event information for interactively controlling the audio / video image, the processing unit of the interface 35 informs the audio / video reproducing machine 4 of the occurrence of the first event. In addition, when an input event occurs by means of a key corresponding to a user’s action, the interface processing unit 35 transmits a control command to the audio / video reproducing machine 4 along path A using the API InputRCKey command, which has a key code (KeyCode) assigned to the remote control 400 control as a parameter. In addition, when a second event occurs using the second event information, the interface processing unit 35 does not inform the audio / video reproducing machine 4 of the occurrence of an input event by a key, even in the event of an input event by a key corresponding to a user action. In addition, when user input for managing a markup document interactively, i.e. the third event, using the third event information, the interface processing unit 35 transfers the user input to the analysis and interpretation unit 15, which allows the analysis and interpretation unit 15 to perform an operation corresponding to the user input.

The decoder 25 decodes and visualizes the interactive content in accordance with the command transmitted from the block 15 analysis and interpretation. The term “visualizes” refers to controlling the layout of the pages of a markup document and the output of audio / video data.

Below, events according to an embodiment of the present invention will be described in more detail. The first event information includes event registration information for checking whether the user performs an action corresponding to the first event and event processing information for processing the first event by controlling the audio / video playback machine 4. In this case, the first event information is recorded in the markup document, so that the first event occurs, the event registration information is used to register the first event, and the event processing information is used to process the first event.

<Example 1 of the implementation of the first event>

The registration of the first event is implemented by the input event tracking unit by means of a key to check whether an input event has occurred by means of the key, and the first event is processed by the input event processing unit by means of a key to control the operation of the audio / video playback machine 4.

<Example 2 of the implementation of the first event>

The registration of the first event is realized by a click input event specified in the markup language, and the processing of the first event is implemented by a function to allow the audio / video playback machine 4 to perform an operation corresponding to the click event. In this case, the processing unit or the function of input events by means of the key serves to transmit a control command corresponding to the key or button pressed by the user to the audio / video reproducing machine 4.

The source codes of the markup document according to Example 1 of the implementation of the first event are presented as follows:

<? xmlversion = "1.0" encoding = "UTF-8"?> <! DOCTYPE html PUBLIC "- // DVD // DTD XHTML DVD-HTML 1.0 // EN" "http://www.dvdforum.org/envideo/dtd/dvdhtml-1-0.dtd"> <html> <head> <title> Example 1 </title> <script type = "text / javascript"> function RcKeyEventHandler (evt) { if (evt.keyCode == 12) dvdVideo.lnputRCKey (12); } </script> <script type = "text / javascript"> function setupEventHandler () { // eventHandler is registered to bodyNode and interactive Contents bodyNode.addEventListener ("rckeypress", RcKeyEvenfrtandler, true); } </script> </head> <body id = "bodyNode" onload = "setupEventHandler ()" </body> </html>

In the markup document, according to Example 1 of the implementation of the first event, the event registration information is written in JavaScript as follows:

<script type = "text / javascript"> function setupEventHandler () { // eventHandler is registered to bodyNode and Interactive Contents bodyNode.addEventListener ("rckeypress", RcKeyEventHandler, true); } </script>

As can be seen in the above event registration information, upon the occurrence of the event rckeypress, i.e. when the user presses a certain key of the remote control 400, the function 'RcKeyEventHandler' is called.

The event processing information is written in JavaScript as follows:

<script type = "text / javascript"> function RcKeyEventHandler (evt) { if (evtkeyCode == 12) dvdVideo.InputRCKey (12); } </script>.

As can be seen in the above event processing information, the function 'RcKeyEventHandler' executes dvdVideo.InputRCKey (12) when the key code is 12. In other words, when the code assigned to the key pressed by the user is 12, the SAW machine 3 transmits the corresponding control command to the machine 4 reproducing audio / video using the dvdVideo.InputRCKey API command, so that the audio / video reproducing machine 4 performs a playback control operation assigned to the key code 12.

In other words, by registering an input event with the key of the remote control 400 in the body of the markup document, when the user presses the key of the remote control 400, the ASM machine 3 is informed of the occurrence of the input event by the key and informs the audio / video playback machine 4 of the occurrence of the input event by means of a key. Playback of DVD-Video data can be controlled by a method in which a control command corresponding to a pressed key is transmitted to the audio / video playback machine 4 when the creator of the markup document selects one of the keys of the remote control 400, and the user presses the selected key.

The source codes of the markup document according to Example 2 of the implementation of the first event are presented as follows:

<? xml version = "1.0" encoding = "UTF-8"?> <! DOCTYPE html PUBLIC "- // DVD // DTD XHTML DVD-HTML 1.0 // EN" "http://www.dvdforum.org/envideo/dtd/dvdhtml-1-0.dtd"> <html> <head> <title> Example 2 </title> <script type = "text / javascript"> <- function Btn_PlayPause () { dvdVideo.InputRCKey (12); } -> </script> </head> <body> <table border = "0" width = "720" height = "480"> <tr> <td widths-277 "height =" 184 "align =" left "valign = 'top"> <object data = "dvd:" width = "277" height = "184" border = "0" /> </td> <td width = "443" height = "480" align = "left" valign = "top" rowspan = "2"> <img src = "b1.png" width = "443" height = "400 border =" 0 "/> <button name = "PlayPause" value = "PLAY / PAUSE" onclick = "Btn_PlayPause ()"> </td> </tr> <tr> <td width = "277" height = "296"> <img src = "b2.png" width = "277" height = "296" border = "0" /> </td> </tr> </table> </body> </html>

In the markup document according to Example 2 of the implementation of the first event, the event registration information is written in the markup language as follows:

<button name = "PlayPause" value = "PLAY / PAUSE" Onclick = "Btn_PlayPause ()">

In other words, as shown in FIG. 5, upon the occurrence of an input event by clicking in the interactive image that is displayed using the markup image 16, which includes the audio / video image 26 and the play / stop key 36, i.e. the user presses the play / stop key 36, the function ′ Btn_PlayPause () ′ is called.

The event processing information is written in JavaScript as follows:

<script types = "text / javascript"> <- function Btn_PlayPause () { dvdVideo.InputRCKey (12); } -> </script>

As can be seen from the above event processing information, the function 'Btn_PlayPause' executes the API command dvdVideo.InputRCKey (12). In other words, when the user presses the play / stop key 36 displayed in the interactive image, the SAW machine 3 transmits the corresponding control command to the audio / video playback machine 4 using the dvdVideo.InputRCKey API command, so that the audio / video playback machine 4 performs an operation playback control assigned to the key code 12.

Playback of DVD-Video data can be controlled according to the intention of the creator of the interactive content using the method whereby the dvdVideo.InputRCKey (keyCode) API command is connected to the onclick () event of the button in the markup document, therefore, the control command corresponding to the button is transmitted to the playback machine 4 audio / video when the user clicks the button.

As described above, when the audio / video reproducing machine 4 is informed of the occurrence of an input event by a key corresponding to the user’s action by recording the first event information in the markup document, the interactive content creator can transmit the user input to the audio / video reproducing machine 4.

Without using the method according to which the first event information is recorded in a markup document for processing an input event by a key from a user, the SAW machine 3 can transmit a control command corresponding to the input event by a default key to the audio / video reproducing machine 4 through an API command for processing the event input using the key.

The second event according to an embodiment of the present invention is implemented through the API command EnableRCKInput (). The EnableRCKInput () API command is used as the interface between the audio / video playback engine 4 and the SAW machine 3, which supports the playback of interactive content recorded on the DVD 300 and is defined as follows:

{object} .EnableRCKeyInput (x)

1. The essence

This command is used to prohibit the transmission of user input to the audio / video playback machine 4. In this embodiment, the {object} is dvdVideo.

2. Parameter

x = 0: disable

x = 1: allow

3. Return value

Number Title Description 0 Ok Successfully -one Common mistake Unknown error condition

When the second event occurs, i.e. EnableRCKeyInput (0), using the second event information recorded in the markup document in a scripting language, the transmission of user input to the ASU machine 3 is allowed, and the audio / video playback machine 4 is prohibited. For example, if the creator of the interactive content wants to change the layout of the markup document according to a specific user input, he creates a markup document containing the second event information to generate an EnableRCKeyInput API command preventing the user from transmitting the user input to the audio / video playback machine 4.

The following is an example of a document that records the second event information:

<? xmlversion = "1.0" encodjng = "UTF-8"?> "! DOCTYPE html PUBLIC" - // DVD // DTD XHTML DVD-HTML 1.0 // EN " "http: //www.dvdforum.oiig/envideo/dtd/dvdhtml-1-0.dtd"> <html> <head> <title> Prevent Default </title> <script type = "text / javascript"> function RcKeyEventHandler (evt) { switch (evt.keyCode) { case 23: evt.preventDefault (); case 24: evt.preventDefault (); case 25: evt.preventDefauft (); case 26: evt.preventDefault (); case 27: evt.preventDefault (); } } </script> <script type = "text / iavascript"> function setupEventHandler () { // eventHandler is registered to bodyNode and Interactive Contents bodyNode.addEventListener ("rckeypress", RcKeyEventHandter, true); } </script> </head> <body id = bodyNode "onload =" sefaipEvenfl-land (er () " </body> </html>

From the above markup document, it can be seen that the audio / video reproducing machine 4, which processes the markup document in which the second event information is recorded, does not perform operations corresponding to user inputs, i.e. the direction key inputs 52, 53, 54 and 55, in which default operations are specified.

In this case, the content creator may additionally record third event information that determines the operation of the ASU machine 3 in accordance with the desired user inputs.

The third event information allows the SAW machine 3 to receive user input and perform a specific operation, although the user input is directly transmitted to the audio / video playback machine 4. Below, with reference to FIGS. 6A and 6B, it will be shown that the third event information does not specify any default operations except for the OK key 51 and the direction keys 52, 53, 54 and 55. Thus, even when any user enters a command other than the OK key 51 and the direction keys 52, 53, 54, and 55, the SAW machine 3 does not work. However, the creator of the markup document may write the third event information to the markup document so that the specified default operations are not performed. As a result, although the user presses the 51 ′ OK ′ key and the direction keys 52, 53, 54 and 55, the focus and the highlighted information do not move.

Each of FIGS. 6A and 6B illustrates “predetermined information about the operations of the SAW machine 3 and the audio / video playback machine 4”.

The “predetermined information about the operations of the SAW machine 3 and the AV machine 4” determines the operation of the AV machine 4 and / or the SAV machine 3 when the user presses the keys of the remote control 400, i.e. an input event occurs using the RCKeyEvent key corresponding to the user’s action. As described above, in the case where the operations of the audio / video reproducing machine 4 and the SAW machine 3 are determined in accordance with the keys of the remote control 400, it is very likely that the creator of the reproducing device and the creator of the contents exist separately. Even in this case, the reproducing device and the content created according to the “predetermined information about the operations of the SAW machine 3 and the audio / video playback machine 4” most likely coincide. In addition, even if there are several creators of the content, when the content is created using a user input processing method in accordance with the present invention based on “predetermined information about operations of the SAW machine 3 and the audio / video playback machine 4”, the content may coincide with the machine 4 play audio / video and be suitable for further interactive management of audio / video content and layout of content.

From FIGS. 6A and 6B, it can be seen that the default operations of the ASU machine 3 are not fully defined. The creator of the interactive content can create a markup document using a scripting language so that the UAV machine 3 performs the necessary operations. The keyCode property indicates specific key codes for keys pressed by the user, and the keyName property indicates the names of the keys pressed. The descriptions of the operation of the audio / video playback machine 4 are based on "DVD-Video Specifications for Read Only Disc / Part 3. Video Specifications Version 1.0".

Notes 1), 2), 3), 4), 5), 6), 7) and 8) are explained below.

Note 1) keys for which the default operations of the UAV machine 3 are not set can be used as connecting keys that can directly focus specific elements by using the 'keyCode' or 'keyName' property as the value of the 'accesskey' property (“access key” ) in the markup document.

Note 2) for the key 48 ′ Screen ′, the default operations of the machine 3 SAW are not specified. If a markup document is created in which script codes are written to support full-screen mode in interactive mode (implementation mode), the following operations will be specified.

{object} .FullScreen (x)

1. The essence

DVD-Video data is set to embed mode or full screen mode. In this embodiment, the {object} is dvdVideo.

2. Parameter

x = 0: set to deployment mode

x = 1: set to full screen

3. Return value

Number Title Description 0 Ok Successfully -one Common mistake Unknown error condition

Note 3) the focus moves to the object element from the elements of the markup document embedding the DVD-Video data, and returns to the state for navigating through the DVD-Video data. In other words, the highlighted information can be moved with the direction keys 52, 53, 54 and 55 shown in FIG. 2, and then the corresponding menu can be selected using the 51 ′ OK ′ key, or DVD-Video data can be navigated using the DVD playback control keys . An example of a method of navigating DVD-Video data is described in detail in Korean Patent Application No. 02-37515 entitled "Focusing Method in Interactive mode, and Apparatus and Information Storage Medium Therefor ") filed June 27, 2002 by the applicant of the present invention.

After navigating through the DVD-Video data, the focus moves to the previously focused element of the markup document.

Note 4) the play / stop key 60 is consistent with the following algorithm for playing DVD-Video data and pausing the playback of DVD-Video data. When the action of the machine 4 play audio / video, i.e. DVD-Video data playback stops, the first chain of DVD-Video data playback programs is played. When playing DVD-Video data, the operation 'Pause_On ()' is performed. When DVD-Video data playback is paused, the Pause_Off () operation is performed. The Pause_On () and Pause_Off () operations are user operation functions defined in "DVD-Video Specifications for Read Only Disc / Part 3. Video Specifications Version 1.0".

Note 5) the title is played by moving from the current title part number (PTT) to the previous PTT number. If the PTT number by one less than the current PTT number does not exist in the title, the last PTT number of the previous part of the title is played. The title is reproduced by moving from the first PTT number, which is the lowest title number, to the last PTT number, which is the highest title number. PTT numbers are described in detail in "DVD-Video Specifications for Read Only Disc / Part 3. Video Specifications Version 1.0."

Note 6) the title is played by moving from the current PTT number to the next PTT number. If there is no PTT number greater than the current PTT number in the title, the first PTT number of the next part of the title is played. The title is reproduced by moving the last PTT number, which is the highest title number, to the first PTT number, which is the lowest title number.

Note 7) a sub-image is modified. The sub-image is mainly set so that it is not displayed on the screen. Thus, if the user wishes to display the sub-image on the screen, the user must change the default settings on the playback device 200 to display the sub-image. Then, a particular sub-image stream is displayed having one of the numbers 0 to 31 of the sub-image stream specified in the reproducing apparatus 200. Whenever the user presses the Subtitle key 63, a sub-image stream is displayed that has a sub-image stream number obtained by adding 1 to the number of a particular sub-image stream. However, the sub-image stream always has a zero sub-image stream number after the last sub-image stream number. Sub-image modification is described in detail in "DVD-Video Specifications for Read Only Disc / Part 3. Video Specifications Version 1.0."

Note 8) the image angle is changed. The default condition is set to display the image starting from angle number 1. Whenever the user presses the “angle” key 64 to change the current angle, the angle number obtained by adding 1 to the current angle number is displayed. When the user repeatedly presses the “angle” key 64, when the last angle number is displayed, the last angle number is changed to angle number 1. The angle change is explained in detail in "DVD-Video Specifications for Read Only Disc / Part 3. Video Specifications Version 1.0."

Note 9) audio preferences are being changed. The basic conditions for the default audio settings are set so as not to turn on or select the audio stream. After an audio stream is selected, an audio stream having an audio stream number obtained by adding 1 to the current audio stream number is displayed whenever the user presses the “audio” key 62. When the user repeatedly presses the “audio” key 62 while playing back the last audio stream, the last audio stream is changed to the audio stream number 1. The change in the audio stream is described in detail in “DVD-Video Specifications for Read Only Disc / Part 3. Video Specifications Version 1.0”.

The following are the key operations of 'RCKeyEvent':

Interface RCKeyEvent: UIEvent { const unsigned long VK_0 = 0; // key code "0", name keys "0" Const unsigned long VK_1 = 1; //"one" const unsigned long VK_2 = 2; // "2" const unsigned long VK_3 = 3; // "3" const unsigned long VK_4 = 4; //"four" const unsigned long VK_5 = 5; //"5" const unsigned long VK_6 = 6; // "6" const unsigned long VK_7 = 7; // "7" const unsigned long VK_8 = 8; //"8" const unsigned long VK_9 = 9; //"9" const unsigned long VK_A = 10; // key code "10", name A keys const unsigned long VK_B = 11; //"AT" const unsigned long VK_PLAY_PAUSE = 12; // "Play / Pause" const unsigned long VK_STOP = 13; //"Stop" const unsigned long VK_FF = 14; // "Fast forward forward" const unsigned long VK_FR = 15; // "Fast forward back " const unsigned long VK_SKIP_PREV = 16; //"Previous" const unsigned long VK_SKIP_NEXT = 17; //"Following" const unsigned long VK_SUBTITLE = 18; //"Subtitle" const unsigned long VK_ANGLE = 19; //"Angle" Const unsigned long VK_AUDIO 20; //"Audio" const unsigned long VK_ROOTMENU = 21; // "Horse menu" const unsigned long VK_TITLEMENU = 22; // "Title menu" const unsigned long VK_UP = 23; //"Up" const unsigned long VK_LEFT = 24; // "Left" const unsigned long VU_RIGHT = 25; // "Right" const unsigned long VK_DOWN = 26; //"Way down" const unsigned long VK_OK = 27; // "OK" const unsigned long VK_RETURN = 28; //"Return" const unsigned long VK_EXIT = 29; //"Exit" const unsigned long VK_CQNTENT_INFO = 30; //"Content" const unsigned long VK_SCREEN_MODE = 31; //"Screen" const unsigned long VK_FOCUS_CHANGE = 32; //"Change focus " readonly attribute unsigned long keyCode; readonly attribute DOMString keyName; void initRCKeyEvent (in DOMString typeArg, in boolean canBubbleArg, in boolean cancelableArg, in unsigned long keyCode, In unsigned long keyName);

A method for processing user inputs interactively according to an embodiment of the present invention will be described below based on the above structure.

7 is a flowchart illustrating an operation of a method for processing user input interactively according to an embodiment of the present invention. 7, in step 701, a determination is made whether the key input event occurs as a first event according to the first event information recorded in the markup document, or via a specific key of the remote control 400 pressed by the user. If it is determined in operation 701 that an input event occurs by means of a key, then in operation 702, the audio / video reproducing machine 4 is informed of the occurrence of an input event by means of the key through the SAW machine 3. In operation 703, a determination is made whether a second event occurs. If it is determined in operation 703 that a second event is occurring, then in operation 704, the ASW machine 3 prohibits directly informing the audio / video playback machine 4 of the occurrence of an input event by means of a key.

Meanwhile, if, in operation 703, the input event by means of the key coincides with the second event information recorded in the markup document, so that a second event occurs, then in operation 704, the WAV machine 3 transmits a control command corresponding to the second event to the audio / video playback machine 4.

FIG. 8 is a flowchart illustrating an operation of a method for processing user input online, according to another embodiment of the present invention. 8, in step 801, a determination is made whether the key input event occurs as a first event according to the first event information recorded in the markup document or via a specific key of the remote control 400 pressed by the user. If it is determined in step 801 that an input event is occurring by means of a key, then in operation 802, the audio / video playback machine 4 is informed of the occurrence of an input event by means of the key through the WAV machine 3. At operation 803, a determination is made whether a third event occurs. If it is determined in operation 803 that a third event is occurring, then in operation 804, the ASM machine 3 performs a certain operation corresponding to the third event.

FIG. 9 is a flowchart illustrating an operation of a method for processing user input interactively according to another embodiment of the present invention. According to Fig.9, in operation 901, the user presses a specific key on the remote control 400. In operation 902, an input event is triggered by a key. In operation 903, the interface processing unit 35 of the ATC machine 3 processes an input event by a key by transmitting a playback control command corresponding to the key input event to the audio / video reproducing machine 4.

10 is a flowchart illustrating an operation of a method for processing user input interactively according to another embodiment of the present invention. 10, in operation 1001, the user presses a specific key on the remote control 400. In operation 1002, an input event by a key occurs, and the interface unit 35 of the ASW machine 3 is informed of the occurrence of an input event by the key, and the interface unit 35 of the interface of the ASU machine 3 informs the audio / video playback machine 4 of the occurrence of the input event by the key. In operation 1003, the audio / video reproducing machine 4 performs an operation corresponding to an input event by a key. For example, when the user presses the “fast forward” key 61, the audio / video playback machine 4 performs the operation “FORWARD_SCAN (SPEED)” according to the “predetermined operation information of the SAW machine 3 and the audio / video playback machine 4” illustrated in FIG. 6A and 6B.

11 is a flowchart illustrating the operations of a method for processing user input interactively according to another embodiment of the present invention. According to FIG. 11, in operation 1101, the user clicks on a button created in the markup document. In operation 1102, an input event occurs by a click. In step 1103, the interface processing unit 35 of the ASR machine 3 processes the input event by clicking by transmitting a playback control command corresponding to the input event by clicking the click of the audio / video playback machine 4.

The above method of processing user input online can be implemented as a computer program. Codes and code segments of a computer program can be easily compared with a computer program. In addition, the computer program is stored in a computer-readable medium and is read and executed by the computer so that a method for processing user input in an interactive mode is implemented. Computer-readable media may include magnetic recording media, optical recording media, and carrier wave media.

Although only a few embodiments of the present invention have been shown and described, it will be apparent to those skilled in the art that this embodiment is subject to change without departing from the spirit and principles of the invention, the scope of which is set forth in the claims and their equivalents.

Industrial application

As described above, the present invention provides a method for efficiently processing interactive content using a limited user input device in an interactive mode, and an apparatus and information storage medium for it. Accordingly, user input can be transmitted to the SAW machine, after which the SAW machine can transmit a playback control command corresponding to the user input to the audio / video playback machine, or user input can be transmitted directly to the audio / video playback machine without transmission through the air traffic control machine. As a result, the markup or audio / video content can be interactively controlled interactively.

In other words, in the present invention, it is possible to use the traditional modes and definitions for user inputs used by the markup document viewer to interpret and display the markup document, for example, by a browser. In addition, user inputs can be efficiently processed interactively. Therefore, the user can conveniently navigate through the interactive image (markup image and audio / video image) or control the object (contained in the markup document) displayed in the interactive image, without being hindered by typing.

Claims (24)

1. A method for processing user input in an interactive mode in which reproduced audio / video data is displayed using a markup document, the method comprises the steps of upon the occurrence of an input event by means of a key corresponding to the user’s action, inform the SAW machine, which interprets and executes the markup document, about the occurrence of an input event by means of the key and inform, by default, by the SAW machine, an audio / video playback machine that reproduces audio / video data about the occurrence of an input event by a key. 2. The method according to claim 1, in which at the stage of informing the SAW machine about the occurrence of an input event by means of a key, an input event is created using the key using the event information recorded in the markup document, and at the stage of informing the audio / video playback machine about the occurrence of the input event by the keys transmit a playback control command corresponding to the input event by the key to the audio / video playback engine for processing the input event by the key. 3. The method according to claim 1, in which at the stage of informing the SAW machine about the occurrence of an input event by means of a key, an input event by means of a key is created using a click event that occurs as a result of clicking on a button created in a markup document, and the click input event is the first event information recorded in the markup document , and in the step of informing the audio / video playback machine of the input event, a playback control command corresponding to the click input event is transmitted by the key to the audio / video playback machine for processing the input event by click. 4. A method for processing user input in an interactive mode in which reproduced audio / video data is displayed using a markup document, the method comprises the steps of inform, by default, the audio / video playback machine that decodes the audio / video data about the occurrence of an input event by means of a key corresponding to a user’s action, and when the second event occurs, using the second event information recorded in the markup document, it is forbidden to inform the audio / video playback machine of the occurrence of an input event by means of a key. 5. A device for playing audio / video data in an interactive mode, the device comprises an audio / video playback machine that reproduces audio / video data, and A UAV machine that interprets and executes a markup document, in which, upon the occurrence of an input event by means of a key corresponding to the user's action, the ASW machine informs, by default, the audio / video playback engine of the occurrence of an input event by means of the key. 6. The device according to claim 5, in which the SAW machine allows an input event to occur via a key using the first event information recorded in the markup document. 7. The device according to claim 5, in which the SAW machine generates an API command for controlling the audio / video playback machine in response to an input event by means of a key corresponding to a user action. 8. The device according to claim 5, in which when the second event occurs using the second event information recorded in the markup document, the SAW machine does not inform the audio / video playback machine of the occurrence of the input event by means of the key. 9. The device according to claim 5, in which upon the occurrence of an input event by means of a key using the first event information, the SAW machine transmits a playback control command corresponding to the input event by the key to the audio / video playback machine for processing the input event by the key. 10. The device according to claim 5, in which upon the occurrence of an input event by clicking using the first event information, the SAW machine transmits a playback control command corresponding to the input event by clicking to the audio / video playback engine for processing the input event by clicking. 11. The device according to claim 5, in which the SAW machine contains an interface processing unit that informs the audio / video playback machine of the occurrence of an input event by means of a key. 12. The playback device containing a reader for reading audio / video data, an UAW machine connected to a reader, mixer, and an audio / video playback machine, and the UAW machine outputs an input event signal via a key to an audio / video playback machine in accordance with a user input, receives a start signal from an audio / video playback machine, sends a control signal to the audio / video playback machine and receives, verifies, interprets and executes the markup document and sends the interpreted markup document to the mixer in accordance with the signal for OSCAL, an audio / video playback machine connected to the SAW machine, a mixer, and a reader, so that after receiving the input event signal by means of a key from the SAW machine and determining the time needed to start the markup document, send a start signal to the SAW machine and control the playback of DVD data Video in accordance with the input event signal by means of a key from the SAW machine, and a mixer connected to the SAW machine and an audio / video playback machine for mixing and outputting a DVD-Video stream that was reproduced using an interpreted markup document. 13. The playback device according to item 12, in which the audio / video data includes DVD-Video data and a markup document. 14. The playback device according to item 12, in which the playback device operates in one of: interactive mode, video mode and full screen mode, which is a sub-image of the interactive mode. 15. The playback device according to item 12, in which the playback device retrieves the markup document from the network. 16. The playback device according to item 12, in which one of: when the first event information is recorded in the markup document and the first event occurs using the first event information, the SAW machine informs the audio / video playback machine of the occurrence of the first event, when an input event by means of a key corresponding to a user’s action occurs, the SAW informs, by default, the audio / video playback engine of the occurrence of an input event by means of a key when the second event information is recorded in the markup document and the second event occurs using the second event information, the SAW machine prohibits informing the audio / video playback machine of the occurrence of an input event by means of a key corresponding to the user action of the second event, and when the third event information is recorded in the markup document and the third event occurs using the third event information, when user input is sent directly to the audio / video playback machine or its transfer is prohibited, the SAW machine performs an operation corresponding to the third event. 17. The playback device according to item 12, in which the machine SAW contains analysis and interpretation unit, an interface processing unit connected to receive user input to an analysis and interpretation unit, to an audio / video playback machine and to a decoder, and a decoder connected to an analysis and interpretation unit and to an interface processing unit. 18. A method for processing user input online, comprising the steps of determining whether an input event has occurred by means of a key as the first event corresponding to the first event information recorded in the markup document, or by means of a specific remote control key pressed by the user, inform in case of the occurrence of an input event by means of a key the audio / video playback machine of the occurrence of an input event by means of a key through the SAW machine, determine whether a second event has occurred, prohibit, by the SAW machine, in the event of a second event, directly inform the audio / video playback machine of the occurrence of an input event by means of the key and transmitted by the SAW machine if the input event by means of the key matches the second event information recorded in the markup document, as a result of which the second event occurs, the control command corresponding to the second event, the audio / video playback machine. 19. A method of processing user input online, comprising the steps of determining whether an input event has occurred by means of a key as the first event corresponding to the first event information recorded in the markup document, or by means of a specific remote control key pressed by the user, inform in case of the occurrence of an input event by means of a key the audio / video playback machine of the occurrence of an input event by means of a key through the SAW machine, determining whether user input is sent directly to the audio / video playback machine or if it is prohibited to be forwarded, considering this as the next event, and carry out by means of the machine SAW in the event of the next event a predetermined operation corresponding to the next event. 20. A method for processing user input online, comprising the steps of receiving an input signal from a predetermined key of the remote control to trigger an input event by the key, and process the input event by means of the key by transmitting the playback control command corresponding to the input event by the key to the audio / video playback engine by the processing unit of the interface of the UAW machine. 21. A method for processing user input online, comprising the steps of: receiving an input signal from a predetermined key of the remote control to trigger an input event by means of a key, inform the processing unit of the interface of the machine SAW on the occurrence of an input event by means of inform through the processing unit of the interface of the machine SAW car audio / video about the occurrence of an input event by means of a key perform, by the audio / video playback machine, an operation corresponding to an input event by a key. 22. A method for processing user input online, comprising the steps of: receiving an input signal from a click on a button created in a markup document to trigger an input event by clicking, and process the input event by clicking by transmitting a playback control command corresponding to the input event by clicking to the audio / video playback engine by the processing unit of the interface of the SAW machine. Priorities: 08/26/2002 - pp. 1-15, 17-18, 20-22. 11/25/2002 - pp.16, 19.

Images