WO2009002005A1 - Method for controlling the selection of object in interactive bifs contents - Google Patents

Method for controlling the selection of object in interactive bifs contents Download PDF

Info

Publication number
WO2009002005A1
WO2009002005A1 PCT/KR2008/001689 KR2008001689W WO2009002005A1 WO 2009002005 A1 WO2009002005 A1 WO 2009002005A1 KR 2008001689 W KR2008001689 W KR 2008001689W WO 2009002005 A1 WO2009002005 A1 WO 2009002005A1
Authority
WO
WIPO (PCT)
Prior art keywords
bifs
keynavigator
node
cursor
cursor key
Prior art date
Application number
PCT/KR2008/001689
Other languages
French (fr)
Inventor
Young-Kwon Lim
Jong-Youn Kim
Ju-Kyung Park
Eun-Hye Choi
Yoon-Jin Lee
Jin-Wook Kim
Woo-Hyun Hwang
Original Assignee
Net & Tv Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Net & Tv Inc. filed Critical Net & Tv Inc.
Publication of WO2009002005A1 publication Critical patent/WO2009002005A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438—Window management, e.g. event handling following interaction with the user interface
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Definitions

  • the present invention relates to interactive contents authored in ISO/IEC MPEG-4 BIFS (Binary Format for Scenes) and, more particularly, to an object selection control method for interactive BIFS contents wherein selection of a BIFS scene object is controlled within limited paths pre- specified by the BIFS content author.
  • Data broadcasting is a major means to provide multimedia functions to existing video and audio-centric broadcasts in digital broadcasting including high definition television (HDTV) and digital multimedia broadcasting (DMB) as representatives.
  • Digital TV digital TV
  • DMB digital multimedia broadcasting
  • Data broadcasting through digital TV (DTV) is actively utilized for games, news and electronic commerce, and DMB is starting to deliver a data service based on MPEG-4 BIFS as part of efforts to provide a service differentiated from existing broadcasts.
  • DMB in which broadcasts are mostly delivered through mobile terminals, provides much more pervasive data contents than DTV broadcasting because of mobility and personalization. That is, in the DMB environment, unlike the DTV environment where all family members view a broadcast together, broadcast services are delivered mostly to mobile terminals carried by individual persons, in which case services can be highly personalized and users can freely interact with their desired contents irrespective of other persons. Owing to characteristics of broadcasting environments, a user accesses broadcasts through a small display window and headphone, and can view broadcasts in a state isolated from the outside with an increased feeling of immersion. In the DMB environment, compared to the DTV environment where only a remote controller is used, various input interfaces such as a keypad, pen input device and trackball are provided, and the user has a higher level of content accessibility and manipulabil ity.
  • GUI graphic user interface
  • BIFS contents provide, as illustrated in FIG. 1, a menu composed of a plurality of BIFS scene objects including a series of BIFS events to run a Web page or to pop up a submenu.
  • the BIFS scene objects may be a geometrical figure such as a circle or rectangle or be one of various objects such as a button, text, image, graphic object, video and audio that can form an MPEG-4 scene.
  • a personal computer, handset or special-purpose terminal supporting the syntax of MPEG-4 BIFS can run the authored BIFS contents for its user.
  • cursor keys provided at the keypad including the 'up 1 , 'down' ,' left ', 'right ', 'select' and 'quit' keys
  • the user can navigate BIFS scene objects, select a desired one of them, and trigger a BIFS event registered at the selected BIFS scene object by pressing the 'select' cursor key.
  • the user can enjoy the interactive BIFS contents by watching the result of processing the BIFS event such as popping up a submenu or running a web page.
  • the cursor is moved from the current BIFS scene object to another BIFS scene object on the basis of geometrical relations such as sizes and locations between BIFS scene objects adjacent to the current BIFS scene object.
  • ⁇ io> the cursor is moved from the current BIFS scene object to another BIFS scene object according to the sequence described in the extensible MPEG-4 textual format-A (XMT-A) for BIFS scene description.
  • XMT-A extensible MPEG-4 textual format-A
  • the cursor 'up' key moves the cursor from the current BIFS scene object to an adjacent BIFS scene object in the 'up' direction
  • the cursor 'down' key moves the cursor from the current BIFS scene object to an adjacent BIFS scene object in the 'down' direction
  • the cursor 'left' key moves the cursor from the current BIFS scene object to an adjacent BIFS scene object in the 'left' direction
  • the cursor 'right' key moves the cursor from the current BIFS scene object to an adjacent BIFS scene object in the 'right' direction.
  • the 'select' cursor key triggers an event registered at the current BIFS scene object, and the 'quit' cursor key moves the cursor from the current BIFS scene object to a BIFS scene object at the higher layer or to the previous BIFS scene object.
  • terminals of users may produce, in response to the same cursor key manipulation sequence, different results in navigation between and selection of BIFS scene objects depending upon implementations of the cursor key manipulation algorithm, and hence navigation between and selection of BIFS scene objects may be not made according to the intention of the content author.
  • This problem can distort the intention of the author of the BIFS contents, cause unnaturalness and inconvenience to users during interaction with the BIFS contents, and make it difficult to provide consistent and reliable rich media services.
  • Fig. 1 is representations illustrating existing object selection methods for BIFS contents.
  • the initial scene of a BIFS content is illustrated by the scene A of FIG. 1, in which case although the author intended to place the black rectangular cursor on a 'l.game information' button 1, the black rectangular cursor is placed on a '2. join' button 2 because of the property of a cursor key manipulation algorithm implemented on the terminal.
  • the scene B of FIG. 1 illustrates a scene displayed when a BIFS event is triggered by selecting a 1 I. game information' button 3, in which case although the author intended to place the black rectangular cursor on a '5. current score 1 button 4, the black rectangular cursor is moved to a '8. impressive scene 1 button 5.
  • FIG. 1 illustrates a scene displayed when a '8. impressive scene 1 button 5 is selected, in which case although the author intended to move the cursor on a '5. view now' button 6, the cursor is placed on a 'x' button 7.
  • the scene D of FIG. 1 illustrates a scene displayed when the 'right' cursor key is pressed while the cursor is placed on a '5. cheering photo' button 8, in which case although the author intended to move the cursor on a '7. join' button 10, the cursor is placed on a 'x 1 button 9.
  • Fig. 2 is a real picture illustrating the initial scenes of a BIFS content run on mobile phones of different types. It can be identified that, because of different implementations of the cursor key manipulation algorithm, for the same BIFS content, the position of a black rectangular cursor 20 of the left mobile phone is different from that of a black rectangular cursor 30 of the right mobile phone.
  • the present invention has been made in view of the above problems, and it is an object of the present invention to provide an object selection control method for interactive BIFS contents, wherein KeyNavigator nodes are newly defined and added to the syntax of existing MPEG-4 BIFS, and navigation between BIFS scene objects and selection of a desired BIFS scene object can be made within limited paths pre-specified by the content author using the revised MPEG-4 BIFS, thereby accurately reflecting the intention of the content author at the time of authoring and providing consistent and reliable BIFS contents to terminal users.
  • the present invention provides an object selection control method in object selection for an interactive BIFS content that supports user inputs through a plurality of direction cursor keys, a 'selection' cursor key and 'quit' cursor key, and the syntax of MPEG-4 BIFS, including: describing a plurality of BIFS scene objects in accordance with the syntax of MPEG-4 BIFS to compose a scene of the BIFS content; and setting at least two KeyNavigator nodes, each of which includes a field value specifying the identifier of a pointed BIFS scene object, and field values specifying the identifiers of other KeyNavigator nodes as a destination for moving in response to each cursor key input, in order to control navigation between the BIFS scene objects and selection of a desired BIFS scene object within limited paths pre-specified by the content author.
  • the object selection control method may further include: running the BIFS content including the set KeyNavigator nodes, and specifying a BIFS scene object pointed by the initial KeyNavigator node; receiving, while the BIFS scene object is specified, a cursor key to navigate, point to, or select the BIFS scene objects; and moving the cursor to a second KeyNavigator node preset corresponding to the received cursor key, and moving further the cursor to or specifying a BIFS scene object pointed by the second KeyNavigator node, or selecting the pointed BIFS scene object to thereby process a pre-registered event.
  • the object selection control method of the present invention includes authoring an interactive BIFS content using KeyNavigator nodes, and playing back the authored interactive BIFS content by running the same.
  • Authoring interactive BIFS content includes describing scene objects and setting KeyNavigator nodes, and playing back the interactive BIFS content includes running the BIFS content, receiving a cursor key, and selecting a BIFS scene object.
  • Fig. 1 is representations illustrating existing object selection methods for interactive BIFS contents
  • Fig. 2 is a real picture illustrating the initial scenes of a BIFS content run on mobile phones of different types!
  • Fig. 3 is a flow chart illustrating an object selection control method for interactive BIFS contents according to a preferred embodiment of the present invention.
  • Fig. 4 is an example of a BIFS scene tree in the XMT-A format including KeyNavigator nodes of the present invention. [Best Mode]
  • Fig. 3 is a flow chart illustrating an object selection control method for interactive BIFS contents according to an embodiment of the present invention.
  • the preferred embodiment of the present invention includes:
  • a scene object describing step (SlO) of describing a plurality of BIFS scene objects in accordance with the syntax of MPEG-4 BIFS to compose a scene of the BIFS content;
  • a KeyNavigator node setting step (S20) of setting at least two KeyNavigator nodes, each of which includes a field value specifying the identifier of a pointed BIFS scene object, and field values specifying the identifiers of other KeyNavigator nodes as a destination for moving in response to each cursor key input, in order to control navigation between the BIFS scene objects and selection of a desired BIFS scene object within limited paths pre-specified by the content author;
  • the definition of the KeyNavigator node includes the definition of a node interface and node binary syntax.
  • the node interface defines the structure and function of a node, and is described in compliance with the MPEG-4 BIFS node interface description format.
  • the node binary syntax defines a bit string corresponding to the binary representation of a node in a scene tree described in the extensible MPEG-4 textual format-A (XMT-A), and is described in compliance with BIFS node coding tables.
  • XMT-A extensible MPEG-4 textual format-A
  • IFS node coding table is represented by a node table illustrated in Table 1 and a node definition type table illustrated in Table 2. Specific meaning of Table 1 and Table 2 can be found in published ISO/IEC MPEG-4 BIFS standards documents, and a detailed description thereof is omitted.
  • a node ID is a unique identification number assigned to each node constituting a scene, and can be a value between 0 and 4,294,967,295 according to the ISO/IEC MPEG-4 BIFS specification, in which case a value of Oxffffffff denotes an undefined ID.
  • the 'left' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'left' cursor key
  • the 'right' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'right' cursor key.
  • the 'up' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'up' cursor key
  • the 'down' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'down' cursor key.
  • the 'select' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'select' cursor key
  • the 'quit' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'quit' cursor key.
  • the node coding table of a KeyNavigator node of the present invention is defined by a node table illustrated in Table 3 and a node definition type table illustrated in Table 4.
  • BIFS contents are mostly described in the XMT-A format, a BIFS scene description scheme, Fig. 4 illustrates a BIFS scene tree in the XMT-A format including KeyNavigator nodes of the present invention.
  • Fig. 4 Five circular BIFS scene objects are used in total.
  • a Circle object is represented by a Circle node
  • each Circle object represented by a Circle node has a size of 30X30 pixels and is displayed by a Shape node on the screen.
  • BIFS scene objects located at coordinates (0.0, 0.0), (0.0, 50.0), (-50.0, 0.0), (50.0, 0.0) and (0.0, -50.0) on the screen using the translation nodes, and labeled as Shape_l, Shape_2, Shape_3, Shape_4 and Shape_5, respectively.
  • Individual Shape nodes are children nodes of the Transform2D node, and place the Circle objects at their coordinates using the translation fields.
  • scene composition elements such as these Circle objects are generally referred to as 'BIFS scene objects'.
  • each KeyNavigator node includes a field value specifying the identifier of a pointed BIFS scene object, and field values specifying the identifiers of other KeyNavigator nodes as a destination for moving in response to each cursor key input.
  • ⁇ 65> For example, five KeyNavigator nodes are included in the case of Fig. 4.
  • the cursor can be placed on a desired BIFS scene object as intended by the content author.
  • the KeyNavigator node uses 'KeyNavigator' as the node name, and includes seven fields of a 'nodeld' field, 'left' field, 'right' field, 'up' field, 'down' field, 'select' field and 'quit' field.
  • the BIFS content running step (S30) the BIFS content including at least two KeyNavigator nodes is run, and a BIFS scene object pointed by the initial KeyNavigator node is specified.
  • the initial KeyNavigator node is Key_l
  • the BIFS scene object pointed by the initial KeyNavigator node is Shape_l.
  • the cursor is moved to a second KeyNavigator node preset corresponding to the received cursor key, and then the cursor is further moved to a BIFS scene object pointed by the second KeyNavigator node, the pointed BIFS scene object is specified, or the pointed BIFS scene object is selected to thereby process a pre-registered event .
  • the node specified by Key_l points to a Circle object of a 30.0X30.0 size located at the coordinates (0.0, 0.0) and specified by Shape_l. From the Circle object having Shape_l, the cursor moves to a KeyNavigator node pointed by the ' left ', 'right ', 'down' or 'up' field in response to pressing the ' left ', 'right ', "down' or 'up' cursor key.
  • the cursor moves to the KeyNavigator node defined as Key_3 upon pressing the 'left' cursor key, and then moves to the KeyNavigator node defined as Key_l upon pressing the 'left' cursor key as indicated by the 'right' field of the KeyNavigator node defined as Key_3.
  • the remaining KeyNavigator nodes behave according to their defined field values.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Social Psychology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Software Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An object selection control method for BIFS contents is disclosed. For an interactive BIFS content, user inputs through a plurality of cursor keys and the syntax of MPEG-4 BIFS are supported. KeyNavigator nodes are set so that each KeyNavigator node includes a field value specifying a pointed BIFS scene object, and field values specifying other KeyNavigator nodes as a destination for moving in response to each cursor key input. The BIFS content is run, and a BIFS scene object pointed by the initial KeyNavigator node is specified. A cursor key to navigate, point to, or select the BIFS scene objects is received. Then, the cursor is moved to a second KeyNavigator node corresponding to the received cursor key, or a pointed BIFS scene object is selected to thereby process a pre-registered event. Hence, selection of a BIFS scene object can be controlled within pre-specif ied limited paths.

Description

[DESCRIPTION!
[Invention Title]
Method for Controlling the Selection of Object in Interactive BIFS Contents
[Technical Field]
<i> The present invention relates to interactive contents authored in ISO/IEC MPEG-4 BIFS (Binary Format for Scenes) and, more particularly, to an object selection control method for interactive BIFS contents wherein selection of a BIFS scene object is controlled within limited paths pre- specified by the BIFS content author.
[Background Art]
<2> Data broadcasting is a major means to provide multimedia functions to existing video and audio-centric broadcasts in digital broadcasting including high definition television (HDTV) and digital multimedia broadcasting (DMB) as representatives. Data broadcasting through digital TV (DTV) is actively utilized for games, news and electronic commerce, and DMB is starting to deliver a data service based on MPEG-4 BIFS as part of efforts to provide a service differentiated from existing broadcasts.
<3> It is expected that DMB, in which broadcasts are mostly delivered through mobile terminals, provides much more pervasive data contents than DTV broadcasting because of mobility and personalization. That is, in the DMB environment, unlike the DTV environment where all family members view a broadcast together, broadcast services are delivered mostly to mobile terminals carried by individual persons, in which case services can be highly personalized and users can freely interact with their desired contents irrespective of other persons. Owing to characteristics of broadcasting environments, a user accesses broadcasts through a small display window and headphone, and can view broadcasts in a state isolated from the outside with an increased feeling of immersion. In the DMB environment, compared to the DTV environment where only a remote controller is used, various input interfaces such as a keypad, pen input device and trackball are provided, and the user has a higher level of content accessibility and manipulabil ity.
<4> Although the DMB environment has advantages in use of data contents over the DTV environment, it experiences difficulties in authoring interactive data contents. Because MPEG-4 BIFS acting as the current standard for DMB data broadcasting has been developed on the basis of Virtual Reality Markup Language (VRML), a language for developing 3-dimensional virtual-reality applications based on personal computers, target contents and development approaches are different between virtual reality and broadcasting. For example, in most broadcast contents, graphic objects are arranged on top of a fixed-size video layer, and a change in points in time and object movement are confined to a limited extent, unlike virtual-reality contents where the user navigates an infinite virtual space.
<5> For broadcast contents, a technique is needed to handle contents on a fixed screen area through a graphic object, in which case a graphic user interface (GUI) is expected to become one of the strongest interaction tools. However, there is no node supporting GUI concepts in MPEG-4 BIFS. As a result, to provide a GUI including a button to BIFS contents authored in MPEG-4 BIFS being a scene description language, the appearance of a BIFS scene object to be provided with a GUI is modeled first, and nodes such as a TouchSensor node, TimeSensor node and Interpolator node are used to listen to and handle events for the BIFS scene object for GUI support.
<6> Most BIFS contents provide, as illustrated in FIG. 1, a menu composed of a plurality of BIFS scene objects including a series of BIFS events to run a Web page or to pop up a submenu. The BIFS scene objects may be a geometrical figure such as a circle or rectangle or be one of various objects such as a button, text, image, graphic object, video and audio that can form an MPEG-4 scene.
<7> A personal computer, handset or special-purpose terminal supporting the syntax of MPEG-4 BIFS can run the authored BIFS contents for its user. Using cursor keys provided at the keypad including the 'up1, 'down' ,' left ', 'right ', 'select' and 'quit' keys, the user can navigate BIFS scene objects, select a desired one of them, and trigger a BIFS event registered at the selected BIFS scene object by pressing the 'select' cursor key. Thereby, the user can enjoy the interactive BIFS contents by watching the result of processing the BIFS event such as popping up a submenu or running a web page.
<8> In existing object selection methods, when the user moves the cursor from the current BIFS scene object to another BIFS scene object using cursor keys, the user mostly use the following schemes.
<9> In a first scheme, the cursor is moved from the current BIFS scene object to another BIFS scene object on the basis of geometrical relations such as sizes and locations between BIFS scene objects adjacent to the current BIFS scene object.
<io> In a second scheme, the cursor is moved from the current BIFS scene object to another BIFS scene object according to the sequence described in the extensible MPEG-4 textual format-A (XMT-A) for BIFS scene description.
<π> Here, it is normally expected that the cursor 'up' key moves the cursor from the current BIFS scene object to an adjacent BIFS scene object in the 'up' direction, the cursor 'down' key moves the cursor from the current BIFS scene object to an adjacent BIFS scene object in the 'down' direction, the cursor 'left' key moves the cursor from the current BIFS scene object to an adjacent BIFS scene object in the 'left' direction, and the cursor 'right' key moves the cursor from the current BIFS scene object to an adjacent BIFS scene object in the 'right' direction. Further, it is expected that the 'select' cursor key triggers an event registered at the current BIFS scene object, and the 'quit' cursor key moves the cursor from the current BIFS scene object to a BIFS scene object at the higher layer or to the previous BIFS scene object.
<i2> However, in existing object selection methods, terminals of users may produce, in response to the same cursor key manipulation sequence, different results in navigation between and selection of BIFS scene objects depending upon implementations of the cursor key manipulation algorithm, and hence navigation between and selection of BIFS scene objects may be not made according to the intention of the content author. This problem can distort the intention of the author of the BIFS contents, cause unnaturalness and inconvenience to users during interaction with the BIFS contents, and make it difficult to provide consistent and reliable rich media services.
<i3> Fig. 1 is representations illustrating existing object selection methods for BIFS contents. The initial scene of a BIFS content is illustrated by the scene A of FIG. 1, in which case although the author intended to place the black rectangular cursor on a 'l.game information' button 1, the black rectangular cursor is placed on a '2. join' button 2 because of the property of a cursor key manipulation algorithm implemented on the terminal. The scene B of FIG. 1 illustrates a scene displayed when a BIFS event is triggered by selecting a 1I. game information' button 3, in which case although the author intended to place the black rectangular cursor on a '5. current score1 button 4, the black rectangular cursor is moved to a '8. impressive scene1 button 5. The scene C of FIG. 1 illustrates a scene displayed when a '8. impressive scene1 button 5 is selected, in which case although the author intended to move the cursor on a '5. view now' button 6, the cursor is placed on a 'x' button 7. The scene D of FIG. 1 illustrates a scene displayed when the 'right' cursor key is pressed while the cursor is placed on a '5. cheering photo' button 8, in which case although the author intended to move the cursor on a '7. join' button 10, the cursor is placed on a 'x1 button 9.
<i4> Fig. 2 is a real picture illustrating the initial scenes of a BIFS content run on mobile phones of different types. It can be identified that, because of different implementations of the cursor key manipulation algorithm, for the same BIFS content, the position of a black rectangular cursor 20 of the left mobile phone is different from that of a black rectangular cursor 30 of the right mobile phone.
<i5> As described above, existing object selection methods for different terminals may produce different results depending upon the implementation of the cursor key manipulation algorithm, and thus cursor movement paths and positions may be not represented as intended by the author at the time of BIFS content authoring. This prevents delivery of consistent BIFS content services, and may degrade the quality of services and cause inconvenience to users.
[Disclosure] [Technical Problem]
<i6> The present invention has been made in view of the above problems, and it is an object of the present invention to provide an object selection control method for interactive BIFS contents, wherein KeyNavigator nodes are newly defined and added to the syntax of existing MPEG-4 BIFS, and navigation between BIFS scene objects and selection of a desired BIFS scene object can be made within limited paths pre-specified by the content author using the revised MPEG-4 BIFS, thereby accurately reflecting the intention of the content author at the time of authoring and providing consistent and reliable BIFS contents to terminal users. [Technical Solution]
<17> To accomplish the above object, the present invention provides an object selection control method in object selection for an interactive BIFS content that supports user inputs through a plurality of direction cursor keys, a 'selection' cursor key and 'quit' cursor key, and the syntax of MPEG-4 BIFS, including: describing a plurality of BIFS scene objects in accordance with the syntax of MPEG-4 BIFS to compose a scene of the BIFS content; and setting at least two KeyNavigator nodes, each of which includes a field value specifying the identifier of a pointed BIFS scene object, and field values specifying the identifiers of other KeyNavigator nodes as a destination for moving in response to each cursor key input, in order to control navigation between the BIFS scene objects and selection of a desired BIFS scene object within limited paths pre-specified by the content author.
<18> The object selection control method may further include: running the BIFS content including the set KeyNavigator nodes, and specifying a BIFS scene object pointed by the initial KeyNavigator node; receiving, while the BIFS scene object is specified, a cursor key to navigate, point to, or select the BIFS scene objects; and moving the cursor to a second KeyNavigator node preset corresponding to the received cursor key, and moving further the cursor to or specifying a BIFS scene object pointed by the second KeyNavigator node, or selecting the pointed BIFS scene object to thereby process a pre-registered event.
<i9> The object selection control method of the present invention includes authoring an interactive BIFS content using KeyNavigator nodes, and playing back the authored interactive BIFS content by running the same. Authoring interactive BIFS content includes describing scene objects and setting KeyNavigator nodes, and playing back the interactive BIFS content includes running the BIFS content, receiving a cursor key, and selecting a BIFS scene object.
<20> It is known in the art that authoring of an interactive BIFS content and playback of the interactive BIFS content may be performed on an identical appliance, but are normally performed separately on different appliances.
[Advantageous Effects]
<22> According to the present invention wherein KeyNavigator nodes are newly defined and added to the syntax of existing MPEG-4 BIFS, and navigation between BIFS scene objects and selection of a desired BIFS scene object can be made within limited paths pre-specified by the content author using the revised MPEG-4 BIFS, even when terminals carried by their users employ different cursor key manipulation algorithms, the terminals can always produce identical results in movements and selections in response to the same cursor keys, thereby accurately reflecting the intention of the content author at the time of BIFS content authoring and providing consistent and reliable BIFS contents to terminal users. [Description of Drawings]
<23> Fig. 1 is representations illustrating existing object selection methods for interactive BIFS contents;
<24> Fig. 2 is a real picture illustrating the initial scenes of a BIFS content run on mobile phones of different types!
<25> Fig. 3 is a flow chart illustrating an object selection control method for interactive BIFS contents according to a preferred embodiment of the present invention; and
<26> Fig. 4 is an example of a BIFS scene tree in the XMT-A format including KeyNavigator nodes of the present invention. [Best Mode]
<27> Hereinafter, an object selection control method for interactive BIFS contents according to a preferred embodiment of the present invention is described with reference to the drawings.
<28> Fig. 3 is a flow chart illustrating an object selection control method for interactive BIFS contents according to an embodiment of the present invention.
<29> As illustrated in Fig. 3, in an object selection method for an interactive BIFS content that supports user inputs through a plurality of direction cursor keys, a 'selection' cursor key and 'quit' cursor key, and the syntax of MPEG-4 BIFS, the preferred embodiment of the present invention includes:
<30> a scene object describing step (SlO) of describing a plurality of BIFS scene objects in accordance with the syntax of MPEG-4 BIFS to compose a scene of the BIFS content;
<3i> a KeyNavigator node setting step (S20) of setting at least two KeyNavigator nodes, each of which includes a field value specifying the identifier of a pointed BIFS scene object, and field values specifying the identifiers of other KeyNavigator nodes as a destination for moving in response to each cursor key input, in order to control navigation between the BIFS scene objects and selection of a desired BIFS scene object within limited paths pre-specified by the content author;
<32> a BIFS content running step (S30) of running the BIFS content including the set KeyNavigator nodes, and specifying a BIFS scene object pointed by the initial KeyNavigator node;
<33> a cursor key receiving step (S40) of receiving, while the BIFS scene object is specified, a cursor key to navigate, point to, or select the BIFS scene objects; and
<34> a scene object selecting step (S50) of moving the cursor to a second KeyNavigator node preset corresponding to the received cursor key, and moving further the cursor to or specifying a BIFS scene object pointed by the second KeyNavigator node, or selecting the pointed BIFS scene object to thereby process a pre-registered event.
<35> First, background information regarding the ISO/IEC MPEG-4 BIFS standard specification related to the present invention is provided, and then the steps of the preferred embodiment are described.
<36> To navigate or select BIFS objects through cursor key manipulation according to the object selection control method of the present invention, KeyNavigator nodes are necessary. However, the syntax of current MPEG-4 BIFS does not support the KeyNavigator nodes to be used herein. Therefore, the applicant of the present application defines the KeyNavigator nodes, adds the same to the existing syntax of MPEG-4 BIFS, and will submit a contribution document describing the KeyNavigator nodes of the present invention to the ISO/IEC MPEG-4 standards committee to let the KeyNavigator nodes to be reflected in the MPEG-4 BIFS standard specification.
<37> Next, fields of the KeyNavigator node of the present invention specifying the operational attributes thereof, and the behavior thereof are described in detail .
<38> According to the ISO/IEC MPEG-4 BIFS standard specification, the definition of the KeyNavigator node includes the definition of a node interface and node binary syntax. The node interface defines the structure and function of a node, and is described in compliance with the MPEG-4 BIFS node interface description format.
<39> The node binary syntax defines a bit string corresponding to the binary representation of a node in a scene tree described in the extensible MPEG-4 textual format-A (XMT-A), and is described in compliance with BIFS node coding tables. Hence, the node interface of BIFS is described as follows.
<40> node_name { <41> field_label field_type field_name default_field_value <42> }; <43> In turn, the IFS node coding table is represented by a node table illustrated in Table 1 and a node definition type table illustrated in Table 2. Specific meaning of Table 1 and Table 2 can be found in published ISO/IEC MPEG-4 BIFS standards documents, and a detailed description thereof is omitted.
[Table 1]
Figure imgf000011_0001
[Table 2]
Figure imgf000011_0002
<44> <45> The node interface of the KeyNavigator node of the present invention is described as follows in compliance with the BIFS node interface description format. Functions of the fields are also described in detail.
<46> KeyNavigator { <47> field SFInt32 nodeId Oxffffffff <48> field SFInt32 left Oxffffffff <49> field SFInt32 right Oxffffffff <50> field SFInt32 up Oxffffffff <51> field SFInt32 down Oxffffffff <52> field SFInt32 select Oxffffffff <53> field SFInt32 Quit Oxffffffff <54> }; <55> Here, 'KeyNavigator' denotes a node name, the 'nodeld' field denotes the node identifier (node ID) of a BIFS scene object (for example, a geometrical figure) pointed by the 'KeyNavigator' node. A node ID is a unique identification number assigned to each node constituting a scene, and can be a value between 0 and 4,294,967,295 according to the ISO/IEC MPEG-4 BIFS specification, in which case a value of Oxffffffff denotes an undefined ID.
<56> The 'left' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'left' cursor key, and the 'right' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'right' cursor key. The 'up' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'up' cursor key, and the 'down' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'down' cursor key. The 'select' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'select' cursor key, and the 'quit' field denotes the ID of a KeyNavigator node to which the cursor is to be moved upon pressing the 'quit' cursor key.
<57> The node coding table of a KeyNavigator node of the present invention is defined by a node table illustrated in Table 3 and a node definition type table illustrated in Table 4.
Figure imgf000013_0001
[Tale 3]
Figure imgf000013_0002
<58> <59> On the basis of the above background information, processing steps of the preferred embodiment of the present invention are described below in connection with Fig. 3 and Fig. 4. For the purpose of description, processing steps of the preferred embodiment of the present invention in Fig. 3 are described in comparison with operation procedures of an implementation example in Fig. 4.
<60> As described previously, after the KeyNavigator node of the present invention is newly defined and added to the existing syntax of MPEG-4 BIFS, at the scene object describing step (SlO), a plurality of BIFS scene objects are described in accordance with the syntax of MPEG-4 BIFS to compose a scene of a BIFS content.
<6i> BIFS contents are mostly described in the XMT-A format, a BIFS scene description scheme, Fig. 4 illustrates a BIFS scene tree in the XMT-A format including KeyNavigator nodes of the present invention.
<62> In Fig. 4, five circular BIFS scene objects are used in total. In MPEG-4 BIFS, a Circle object is represented by a Circle node, and in Fig. 4, each Circle object represented by a Circle node has a size of 30X30 pixels and is displayed by a Shape node on the screen.
<63> More specifically, five Circle objects of the same size of 30x30 are created as BIFS scene objects, located at coordinates (0.0, 0.0), (0.0, 50.0), (-50.0, 0.0), (50.0, 0.0) and (0.0, -50.0) on the screen using the translation nodes, and labeled as Shape_l, Shape_2, Shape_3, Shape_4 and Shape_5, respectively. Individual Shape nodes are children nodes of the Transform2D node, and place the Circle objects at their coordinates using the translation fields. In the description, scene composition elements such as these Circle objects are generally referred to as 'BIFS scene objects'.
<64> At the KeyNavigator node setting step (S20), to control navigation between BIFS scene objects and selection of a desired BIFS scene object within limited paths pre-specified by the content author, at least two KeyNavigator nodes are set so that each KeyNavigator node includes a field value specifying the identifier of a pointed BIFS scene object, and field values specifying the identifiers of other KeyNavigator nodes as a destination for moving in response to each cursor key input.
<65> For example, five KeyNavigator nodes are included in the case of Fig. 4. By setting KeyNavigator nodes, the cursor can be placed on a desired BIFS scene object as intended by the content author.
<66> As described above, according to the preferred embodiment of the present invention, the KeyNavigator node uses 'KeyNavigator' as the node name, and includes seven fields of a 'nodeld' field, 'left' field, 'right' field, 'up' field, 'down' field, 'select' field and 'quit' field.
<67> At the BIFS content running step (S30), the BIFS content including at least two KeyNavigator nodes is run, and a BIFS scene object pointed by the initial KeyNavigator node is specified. In the case of Fig. 4, the initial KeyNavigator node is Key_l, and the BIFS scene object pointed by the initial KeyNavigator node is Shape_l.
<68> At the cursor key receiving step (S40), while the BIFS scene object is specified, a cursor key to navigate, point to, or select the BIFS scene objects is received.
<69> Finally, at the scene object selecting step (S50), the cursor is moved to a second KeyNavigator node preset corresponding to the received cursor key, and then the cursor is further moved to a BIFS scene object pointed by the second KeyNavigator node, the pointed BIFS scene object is specified, or the pointed BIFS scene object is selected to thereby process a pre-registered event .
<70> For example, in the case of Fig. 4, the node specified by Key_l points to a Circle object of a 30.0X30.0 size located at the coordinates (0.0, 0.0) and specified by Shape_l. From the Circle object having Shape_l, the cursor moves to a KeyNavigator node pointed by the ' left ', 'right ', 'down' or 'up' field in response to pressing the ' left ', 'right ', "down' or 'up' cursor key. From the KeyNavigator node defined as Key_l, the cursor moves to the KeyNavigator node defined as Key_3 upon pressing the 'left' cursor key, and then moves to the KeyNavigator node defined as Key_l upon pressing the 'left' cursor key as indicated by the 'right' field of the KeyNavigator node defined as Key_3. The remaining KeyNavigator nodes behave according to their defined field values.
<7i> As a consequence, using KeyNavigator nodes, the content author can provide users with consistent object navigation paths as intended at the time of authoring.
<72> Terms or words used herein are defined in consideration of their functions in the present invention, and may be interpreted differently according to intensions of those skilled in the art or practices in the art. Accordingly, the meaning of specific terms or words should be construed in accordance with the spirit of the invention. In the specification, the present invention has been described through preferred embodiments. In consideration of technical difficulties of the present invention, other embodiments and changes may be made with ease by those skilled in the art. Hence, it is evident that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.

Claims

[CLAIMS] [Claim 1]
<74> An object selection control method in object selection for an interactive BIFS content supporting user inputs through a plurality of direction cursor keys, a 'selection' cursor key and 'quit' cursor key, and supporting the syntax of MPEG-4 BIFS, the method comprising:
<75> describing a plurality of BIFS scene objects in accordance with the syntax of MPEG-4 BIFS to compose a scene of the BIFS content; and
<76> setting at least two KeyNavigator nodes, each KeyNavigator node including a field value specifying an identifier of a pointed BIFS scene object, and field values specifying identifiers of other KeyNavigator nodes as a destination for moving in response to each cursor key input, so as to control navigation between the BIFS scene objects and selection of a desired BIFS scene object within limited paths pre-specified by a content author. [Claim 2]
<77> The object selection control method according to claim 1, further comprising:
<78> running the BIFS content including the at least two KeyNavigator nodes and specifying a BIFS scene object pointed by an initial KeyNavigator node;
<79> receiving, while the pointed BIFS scene object is specified, a cursor key to navigate, point to, or select the BIFS scene objects; and
<80> moving the cursor to a second KeyNavigator node preset corresponding to the received cursor key, and moving further the cursor to or specifying a BIFS scene object pointed by the second KeyNavigator node, or selecting the pointed BIFS scene object to thereby process a pre-registered event. [Claim 3]
<8i> The object selection control method according to claim 1 or 2, wherein each KeyNavigator node comprises a 'nodeld' field indicating a node identifier of a BIFS scene object pointed by the KeyNavigator node,
<82> a 'left' field indicating an identifier of a KeyNavigator node to which the cursor is to be moved upon pressing the 'left' cursor key, <83> a 'right' field indicating an identifier of a KeyNavigator node to which the cursor is to be moved upon pressing the 'right' cursor key,
<84> an 'up' field indicating an identifier of a KeyNavigator node to which the cursor is to be moved upon pressing the 'up' cursor key, and a 'down' field indicating an identifier of a KeyNavigator node to which the cursor is to be moved upon pressing the 'down' cursor key. [Claim 4]
<85> The object selection control method according to claim 3, wherein the KeyNavigator node further comprises a 'select' field indicating an identifier of a KeyNavigator node to which the cursor is to be moved upon pressing the 'select' cursor key, and a 'quit' field indicating an identifier of a KeyNavigator node to which the cursor is to be moved upon pressing the 'quit' cursor key.
PCT/KR2008/001689 2007-06-22 2008-03-26 Method for controlling the selection of object in interactive bifs contents WO2009002005A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020070061703A KR100891984B1 (en) 2007-06-22 2007-06-22 Method for Controlling the Selection of Object in Interactive BIFS Contents
KR10-2007-0061703 2007-06-22

Publications (1)

Publication Number Publication Date
WO2009002005A1 true WO2009002005A1 (en) 2008-12-31

Family

ID=40185791

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2008/001689 WO2009002005A1 (en) 2007-06-22 2008-03-26 Method for controlling the selection of object in interactive bifs contents

Country Status (2)

Country Link
KR (1) KR100891984B1 (en)
WO (1) WO2009002005A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040054653A1 (en) * 2001-01-15 2004-03-18 Groupe Des Ecoles Des Telecommunications, A French Corporation Method and equipment for managing interactions in the MPEG-4 standard
JP2005045400A (en) * 2003-07-24 2005-02-17 Canon Inc Object generating device and method therefor
KR20060063566A (en) * 2004-12-06 2006-06-12 한국전자통신연구원 Apparatus and method for storing link information of dmb interactive contents, and dmb receiving terminal system using it
KR20070075873A (en) * 2006-01-16 2007-07-24 엘지전자 주식회사 Digital multimedia receiver and method for displaying sensor node thereof

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100652460B1 (en) 2005-06-20 2006-12-01 엘지전자 주식회사 Mobile communcation terminal for receiving broadcasts and method for electronic commercial transaction using the same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040054653A1 (en) * 2001-01-15 2004-03-18 Groupe Des Ecoles Des Telecommunications, A French Corporation Method and equipment for managing interactions in the MPEG-4 standard
JP2005045400A (en) * 2003-07-24 2005-02-17 Canon Inc Object generating device and method therefor
KR20060063566A (en) * 2004-12-06 2006-06-12 한국전자통신연구원 Apparatus and method for storing link information of dmb interactive contents, and dmb receiving terminal system using it
KR20070075873A (en) * 2006-01-16 2007-07-24 엘지전자 주식회사 Digital multimedia receiver and method for displaying sensor node thereof

Also Published As

Publication number Publication date
KR100891984B1 (en) 2009-04-08
KR20080112800A (en) 2008-12-26

Similar Documents

Publication Publication Date Title
US8826343B2 (en) Method of providing key frames of video in mobile terminal
KR101193698B1 (en) Client-server architectures and methods for zoomable user interface
US8885057B2 (en) Performing camera control using a remote control device
CN108055589A (en) Smart television
JP2012069138A (en) Control framework with zoomable graphical user interface for organizing, selecting, and launching media items
KR20160135435A (en) Display device and controlling method thereof
CN104285194A (en) Remotely configuring windows displayed on display device
US8922615B2 (en) Customizing input to a videoconference using a remote control device
US20130155171A1 (en) Providing User Input Having a Plurality of Data Types Using a Remote Control Device
US20130154923A1 (en) Performing Searching for a List of Entries Using a Remote Control Device
KR20160013888A (en) Apparatus and method for displaying a program guide
CN104053062A (en) Electronic displays having paired canvases
CN104581415A (en) Intelligent television set and tabletop switching method thereof
EP2213096A2 (en) Common user interface structure
US9531981B2 (en) Customized mute in a videoconference based on context
KR20170129398A (en) Digital device and controlling method thereof
WO2001038960A1 (en) Method and apparatus for selecting on-demand content in a media-on-demand system
US10547891B2 (en) Apparatuses systems, and methods for adding functionalities to control buttons on a remote control device
EP4380163A1 (en) Livestreaming method and apparatus, storage medium, and electronic device
JP5851844B2 (en) Method and apparatus for transmitting control user interface of digital broadcasting system
TWI496468B (en) A mehtod and system for audio/video selection and playback
WO2009002005A1 (en) Method for controlling the selection of object in interactive bifs contents
CN113661715B (en) Service management method, interaction method, display equipment and mobile terminal for projection hall
CN112399225B (en) Service management method for projection hall and display equipment
US20130155172A1 (en) User Interface for a Display Using a Simple Remote Control Device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08723725

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 30/03/10)

122 Ep: pct application non-entry in european phase

Ref document number: 08723725

Country of ref document: EP

Kind code of ref document: A1