AU2014268193B2 - Apparatus and method for remote control in a short-range network, and system supporting the same - Google Patents

Apparatus and method for remote control in a short-range network, and system supporting the same Download PDF

Info

Publication number
AU2014268193B2
AU2014268193B2 AU2014268193A AU2014268193A AU2014268193B2 AU 2014268193 B2 AU2014268193 B2 AU 2014268193B2 AU 2014268193 A AU2014268193 A AU 2014268193A AU 2014268193 A AU2014268193 A AU 2014268193A AU 2014268193 B2 AU2014268193 B2 AU 2014268193B2
Authority
AU
Australia
Prior art keywords
cui
application
ruic
remote device
capability
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
AU2014268193A
Other versions
AU2014268193A1 (en
Inventor
Sung-Oh Hwang
Bo-Sun Jung
Ji-Eun Keum
Jun-Hyung Kim
Ho-Yeon Park
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2010290258A external-priority patent/AU2010290258B2/en
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority to AU2014268193A priority Critical patent/AU2014268193B2/en
Publication of AU2014268193A1 publication Critical patent/AU2014268193A1/en
Application granted granted Critical
Publication of AU2014268193B2 publication Critical patent/AU2014268193B2/en
Ceased legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

A method for remote control of an application execution device in a network system, comprising: collecting, from a remote device that remotely controls the application execution device using a control user interface (CUI), information about capability of the 5 remote device; sending a CUI request requesting a CUI to be used for remotely controlling a currently executed application and the information about the capability of the remote device to an application server; receiving a CUI matching the capability of the remote device from the application server in response to the CUI request; and sending the received CUI to the remote device. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 [Fig. 13] J >l4= cc tnY 0 -t2 0 aU LO 0w: < -E CD oU - -o - - cli 0 03-1 - 0 0l CO 1 -+ I DI coo c< 0 9 C5a I _ _ 0 :5 a cu i a w _0 Cd) a L clic

Description

1 [DESCRIPTION] [Invention Title] APPARATUS AND METHOD FOR REMOTE CONTROL IN A SHORT-RANGE 5 NETWORK, AND SYSTEM SUPPORTING THE SAME [Related Application] This application is a divisional application of Australian application no. 2010290258 the disclosure of which is incorporated herein by reference. Most of the disclosure of that 0 application is also included herein, however, reference may be made to the specification of application no. 2010290258 as filed or accepted to gain further understanding of the invention claimed herein. [Technical Field] 5 The present invention generally relates to an apparatus and method for matching a User Interface (UI), for remote control in a short-range network. More particularly, the present invention relates to an apparatus and method for enabling operation of a Control UI (CUI) matching the capability of a device in a short-range network. 0 [Background Art] Many industrial standardization organizations have been conducting extensive research to increase the performance of home networking based on a short-range network, such as Digital Living Network Alliance (DLNA), a Home Audio-Video Interoperability (HAVi), and Universal Plug and Play (UPnP). 5 In a home network, one device can control another device by Remote User Interface (RUI) technology. According to the RUI technology based on client-server architecture, an RUI Client (RUIC) fetches a UI from an RUI Server (RUIS) and allows a user to control the RUIS through the UI in the RUIC. 30 Accordingly, there exists a need for developing a method for receiving a UI from an RUIS in order to control the RUIS in an RUIC. [Summary of Invention] 35 An aspect of exemplary embodiments of the present invention is to provide an apparatus and method for providing an RUI so that a remote device can control an RUIS or an RUIC through the RUI. Another aspect of exemplary embodiments of the present invention provides an 40 apparatus and method for enabling an RUIS to provide an RUI matching the capability of a remote device. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 2 A further aspect of exemplary embodiments of the present invention provides an apparatus and method for enabling a remote third device to receive a CUI matching the capability of the remote third device from an RUIS, so that the remote third device can control a remote UI device through the CUI. 5 In accordance with an aspect of exemplary embodiments of the present invention, there is provided a method for remote control of an application execution device in a network system, comprising: collecting, from a remote device that remotely controls the application execution 0 device using a control user interface (CUI), information about capability of the remote device; sending a CUI request requesting a CUI to be used for remotely controlling a currently executed application and the information about the capability of the remote device to an application server; 5 receiving a CUI matching the capability of the remote device from the application server in response to the CUI request; and sending the received CUI to the remote device. In accordance with another aspect of exemplary embodiments of the present invention, 0 there is provided an application execution device for performing remote control in a network system, comprising: a controller for collecting, from a remote device that remotely controls the application execution device using a control user interface (CUI), information about capability of the remote device; and 5 a transceiver for sending a CUI request requesting a CUI to be used for remotely controlling a currently executed application and the information about the capability of the remote device to an application server, and receiving a CUI matching the capability of the remote device from the application server in response to the CUI request. 30 In accordance with a further aspect of exemplary embodiments of the present invention, there is provided a remote device for performing remote control in a network system, the remote device comprising: a transmitter for sending information about capability of the remote device to the application execution device if the remote device is connected to an application 35 execution device, and a receiver for receiving a control user interface (CUI) matching the capability of the remote device transmitted from the an application server providing the application through the application execution device; wherein the CUI is obtained by the application execution device from the 40 application server in response to a CUI request of the application execution device, wherein the CUI is used for remotely controlling a currently executed application by the application execution device. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 3 In accordance with a further aspect of exemplary embodiments of the present invention, there is provided a method for performing remote control in a network system, comprising: 5 sending information about capability of the remote device to the application execution device if the remote device is connected to an application execution device, and receiving a control user interface (CUI) matching the capability of the remote device transmitted from the an application server providing the application through the 0 application execution device; wherein the CUI is obtained by the application execution device from the application server in response to a CUI request of the application execution device, wherein the CUI is used for remotely controlling a currently executed application by the application execution device. 5 [Description of Drawings] Objects, features and advantages of certain exemplary embodiments of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: 0 FIG. 1 is a block diagram of a short-range network system to which the present invention is applied; FIGs. 2 and 3 are block diagrams of short-range network systems having an embedded 5 server outside an RUIC according to embodiments of the present invention; FIG. 4 illustrates interfaces in the architecture of FIG. 1; FIG. 5 is a block diagram of a short-range network system according to an embodiment 30 of the present invention; FIG. 6 illustrates an operation for sending capability information in the short-range network system according to an embodiment of the present invention; 35 FIGs. 7 and 8 are flowcharts illustrating methods for providing a capability-matching CUI in the short-range network system according to embodiments of the present invention; FIG. 9 is a diagram illustrating a signal flow for providing a CUI matching the capability of a third RUIC to the third RUIC, when an RUI has already been rendered in an RUIC 40 according to an embodiment of the present invention; FIG. 10 is a diagram illustrating a signal flow for providing a CUI matching the capability 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 4 of a third RUIC to the third RUIC, when an RUI has already been rendered in an RUIC according to another embodiment of the present invention; FIG. 11 is a diagram illustrating a signal flow for providing a CUI matching the capability 5 of a third RUIC to the third RUIC, when an RUI has already been rendered in an RUIC according to another embodiment of the present invention; FIG. 12 is a diagram illustrating a signal flow for providing a CUI matching the capability of a third RUIC to the third RUIC, when an RUI has already been rendered in an RUIC 0 according to another embodiment of the present invention; FIG. 13 is a diagram illustrating a signal flow for providing a CUI matching the capability of a third RUIC to the third RUIC, when an RUI is not rendered in an RUIC according to an embodiment of the present invention; 5 FIG. 14 is a diagram illustrating a signal flow for providing a CUI matching the capability of a third RUIC to the third RUIC, when an RUI has already been rendered in an RUIC according to a further embodiment of the present invention; 0 FIG. 15 describes APIs and an interface according to an embodiment of the present invention; FIGs. 16 and 17 describe APIs according to an embodiment of the present invention; 5 FIG. 18 describes interfaces and messages for implementing an IPTV service in an OITF by a third RUIC according to an embodiment of the present invention; and FIG. 19 describes interfaces and messages for requesting a CUI to control a DAE application currently being executed in an OITF by a third RUIC according to an 30 embodiment of the present invention. Throughout the drawings, the same drawing reference numerals will be understood to refer to the same elements, features and structures. 35 [Mode for Invention] The matters defined in the description such as a detailed construction and elements are provided to assist in a comprehensive understanding of exemplary embodiments of the invention. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without 40 departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted for clarity and conciseness. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 5 In accordance with embodiments of the present invention as set forth below, a Remote User Interface Client (RUIC) refers to a device that sends a Remote User Interface (RUI) and control information to a client in a client-server architecture system. The RUIC may be a set-top box that controls an Internet Protocol TV (IPTV), etc. 5 The RUIC receives Uls that can be rendered in the RUIC and Control Uls (CUls) that can control the rendered Uls from a Remote User Interface Server (RUIS). The RUIC and/or the RUIs rendered in the RUIC are controlled through the CUls. 0 In an embodiment of the present invention, a third device, which is a remote control RUIC device, controls an RUIC through a CUI. The CUI may be received from the RUIC or the RUIS. The third device may be any of a mobile device (e.g. a portable phone), a portable device (e.g. a small-size display equipped with a communication function), etc. The following description is made with the appreciation that the term 'remote control 5 RUIC device' is used interchangeably with the terms 'third device', 'third RUIC', or 'third RUIC device'. FIG. 1 is a block diagram of a general short-range network system to which embodiments of the present invention are applied, that is, an architecture that enables 0 control of an RUIC through a third RUIC. Referring to FIG. 1, an RUIC 100 communicates with an RUIS 101 according to a preset protocol via a first interface 103 (I/F 1). The RUIC 100 receives an RUI and control information from the RUIS 101 based on a protocol configured for I/F 1. The 5 control information may include a CUI as well as control information needed for controlling an RUI rendered in the RUIC 100. An embedded server 105 of the RUIC 100 extracts the CUI from the control information received from the RUIS 101 and sends the CUI to a third RUIC 102, for controlling the 30 RUIC 100. The CUI is rendered in the third RUIC 102 so that a user of the third RUIC 102 may control the RUIC 100 through the CUI. The embedded server 105 is a logical entity that may reside inside or outside the RUIC 100. 35 In the illustrated cases of FIGs. 2 and 3, the embedded server 105 is configured outside an RUIC 201. Especially, the embedded server 105 may be an embedded server functional entity that resides within a Consumer Electronics Association-2014 (CEA-2014) RUIS 202, a DLNA RUIS 303, or an Open IPTV Forum Terminal Function 40 (OITF) 300 of the Open IPTV Forum, for communication with a mobile/portable device. In addition, the embedded server 105 may even incorporate the function of a remote control plug-in 203 into it. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 6 The RUIC 100 or an RUI rendered in the RUIC 100 may be controlled via a second interface 104 (I/F 2) between the RUIC 100 and the third RUIC 102 according to UPnP or HyperText Transfer Protocol (HTTP), using a CUI rendered in the third RUIC 102. 5 FIG. 4 illustrates the interfaces in the architecture of FIG. 1. It is noted from FIG. 4 that a protocol needs to be defined for the third RUIC 102 to notify the RUIS 101 of the capability of the third RUIC 102. 0 Referring to FIG. 4, the third RUIC 102 may fetch a CUI matching its capability from the RUIC 100, through capability exchange with the embedded server 105 of the RUIC 100. This is possible because a protocol was defined for I/F 2 between the third RUIC 102 and the RUIC 100. 5 However, there is no specified method for enabling the third RUIC 102 to send information about its capability to the RUIS 101. As a consequence, the third RUIC 102 cannot fetch a CUI matching its capability from the RUIS 101. Therefore, protocols will be defined for I/F 1 and a third interface 108 (I/F 3) such that 0 the RUIS 101 may provide the third RUIC 102 with a CUI matching the capability of the third RUIC 102 in accordance with embodiments of the present invention. A detailed description will be given of an apparatus and method for allowing a third RUIC to receive a CUI matching its capability from an RUIS, for controlling an RUI 5 rendered in an RUIC according to an embodiment of the present invention. FIG. 5 is a block diagram of a short-range network system according to an embodiment of the present invention. Specifically, FIG. 5 illustrates interfaces through which a third RUIC 502 sends information about its capability to an RUIS 509 through an RUIC 500. 30 Referring to FIG. 5, the third RUIC 502 sends information about its capability to an embedded server 506 of the RUIC 500 via I/F 2. The embedded server 506 in turn sends the received capability information to a remote control plug-in 508 via a fourth interface 510 (I/F 4). 35 The remote control plug-in 508 stores the capability information. A first browser 505 (Browser 1) instructs the remote control plug-in 508 to download a CUI through communication with an RUI rendered by Browser 1 by sending a CUI download command to the remote control plug-in 508 via a fifth interface 511 (1/F 5). 40 Upon receipt of the CUI download command from Browser 1, the remote control plug-in 508 converts the stored capability information into a format transmittable through a sixth 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 7 interface 152 (I/F 6). When needed, the format of the stored capability information may not be converted. I/F 6 is defined between the RUIC 500 and the RUIS 509. The remote control plug-in 508 sends an HTTP message requesting CUI download to 5 the RUIS 509 via I/F 6. A header of the HTTP message includes the capability information converted to a user-agent value. As stated before, the capability information may not be converted, when needed. FIG. 6 illustrates an operation for sending capability information in the short-range 0 network system according to an embodiment of the present invention. In FIG. 6, capability information about the third RUIC 502 is sent to the RUIS 509 through the RUIC 500. Referring to FIG. 6, the third RUIC 502 sends its capability information to the RUIC 500. 5 Table 1 below illustrates an exemplary format of capability information included in an HTTP Header. [Table 1] User-Agent: CE-HTML/1.0 (<capabilities>) 0 Upon receipt of the capability information expressed as a User-Agent value illustrated in Table 1, the RUIC 500 provides the received capability information to the remote control plug-in 508. The remote control plug-in 508 converts the capability information into a format transmittable to the RUIS 509 (e.g. User-Agent A-). 5 For example, if the capability information is sent in a format defined by the OIPF, a header structure defined by the OIPF may be modified to include the converted capability information in the HTTP Header, as illustrated in Table 2. [Table 2] User-Agent: OIPF/1.1.0 (<capabilities>; [<vendorName>]; [<modelName>]; [<softwareVersion>]; <hardwareVersion>]; <reserved>) [<appName>[/<appVersion>]] 30 The capability information illustrated in Table 1 is included in the capability information having the configuration illustrated in Table 2. For example, the capability information may be included in a <reserved> field illustrated in Table 2. 35 If capability information 600 taking the form of User-Agent A sent from the third RUIC 502 to the RUIC 500 is configured in the same format as capability information 601 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 8 taking the form of User-Agent A- sent from the RUIC 500 to the RUIS 509, the capability information 600 may be sent from the RUIC 500 to the RUIS 509 without being changed in format and contents. 5 FIGs. 7 and 8 are flowcharts illustrating methods for providing a capability-matching CUI in a short-range network system according to embodiments of the present invention. That is, FIGs. 7 and 8 illustrate operations for providing a third RUIC with a CUI matching the capability of the third RUIC through an RUIC by an RUIS. 0 Specifically, FIG. 7 is a flowchart illustrating a CUI providing operation in the case where a third RUIC is currently connected to an RUIC, and FIG. 8 is a flowchart illustrating a CUI providing operation in the case where a third RUIC is not currently connected to an RUIC, and requests a CUI when the third RUIC is connected to the RUIC later. 5 Referring to FIG. 7, an RUIC requests an RUI to an RUIS in step 700. The RUIS sends the requested RUI to the RUIC. In step 701, the RUIC renders the RUI. The RUI monitors the existence of a third RUIC currently connected to the RUIC in step 702. In the absence of a currently connected third RUIC, no further CUI request process 0 associated with the RUI is proceeded in step 703. When the third RUIC is connected to the RUIC later and requests a CUI, the operation illustrated in FIG. 8 is performed. On the other hand, in the presence of a third RUIC currently connected to the RUIC in step 702, the RUIC requests capability information to the third RUIC and receives the 5 capability information from the third RUIC in step 704. In step 705, the RUIC requests a CUI matching the capability of the third RUIC to the RUIS. Then the RUIS sends the CUI to the RUIC. 30 The RUIC sends the CUI to the third RUIC in step 706. Referring to FIG. 8, if the third RUIC is not currently connected to the RUIC at the moment the RUI is rendered in the operation of FIG. 7 but later it is connected to the RUIC and requests a CUI to the RUIC, the RUIC receives the CUI request from the third 35 RUIC while the RUI is being rendered in step 710. In step 711, the third RUIC sends its capability information to the RUIC. In step 712, the RUIC sends a CUI request along with the capability information to the RUIS. Then the RUIS extracts a CUI matching a capability indicated by the capability 40 information and sends the CUI to the RUIC. The RUIC sends the CUI to the third RUIC in step 713. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 9 FIG. 9 is a diagram illustrating a signal flow for sending a CUI matching the capability of a third RUIC to the third RUIC, when an RUI is rendered in an RUIC according to an embodiment of the present invention. 5 Referring to FIG. 9, upon receipt of an RUI rendering command from a third terminal or a traditional remote control, an RUIC 901 requests an RUI to an RUIS 902. Then the RUIC 901 receives the RUI from the RUIS 902 and renders the received RUI in its browser 905. While being rendered, the RUI asks a remote control plug-in 904 0 whether there is a third RUIC currently connected to the RUIC 901 through a isRCExist method. The remote control plug-in 904 in turn asks an embedded server 903 whether there is a currently connected third RUIC. Then the embedded server 903 checks the presence or 5 absence of a connected third RUIC. In the presence of a connected third RUIC 900, the embedded server 903 sends a message requesting capability information to the third RUIC 900. The third RUIC 900 sends its capability information along with a CUI request message to the embedded 0 server 903. If the third RUIC 900 has a history of accessing the embedded server 903 and sending an HTTP message to the embedded server 903, the embedded server 903 internally stores a User-Agent value set in the HTTP header of the HTTP message at the time. 5 When the third RUIC 900 is disconnected from the embedded server 903, the stored User-Agent value is deleted. Until the connection between the third RUIC 900 and the embedded server 903 is released, the third RUIC 900 is in a state where it can receive a notification from the 30 embedded server 903. In this state, upon receipt of a command to monitor the presence of the connected third RUIC 900 from the remote control plug-in 904, the embedded server 903 determines whether it has the User-Agent value. When detecting the User-Agent value, the 35 embedded server 903 sends the User-Agent value to the remote control plug-in 904. The remote control plug-in 904 stores the received User-Agent value internally and sends a value 'true' indicating the presence of the currently connected third RUIC 900 to the RUI 906. The order of the value 'true' transmission and the capability information 40 storing may be changed. Upon receipt of the value 'true', the RUI 906 sends a getCUI command to the remote 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 10 control plug-in 904, requesting a CUI for use in controlling the RUI 906. The remote control plug-in 904 converts the format of the capability information suitably for the RUIS 902 and sends the converted capability information along with a CUI 5 request to the RUIS 902. Then a CUI is downloaded at an appropriate position in the embedded server 903, for transmission to the third RUIC 900. To simplify the implementation of the embodiment of the present invention, the process from calling an isRCExist method to returning the value 'true' to the RUI 906 may not be 0 performed. Instead, if the third RUIC 900 has a history of accessing the RUIC 901 and sending an HTTP message to the RUIC 901 at least once, the User-Agent value is kept in the RUIC 901. When the RUI 906 calls a getCUI method from the remote control plug-in 904, the remote control plug-in 904 requests a CUI associated with the RUI 906 to the RUIS 902 by simply using the User-Agent value or converting the format of the 5 User-Agent value. Upon completion of the CUI download, the remote control plug-in 904 sends an onCompleteReceiveCUI event to the RUI 906, indicating that the CUI download has been completed. Then the RUI 906 sends a sendCUI command to the remote control 0 plug-in 904, instructing the remote control plug-in 904 to send the CUI to the third RUIC 900. Upon receipt of the command, the remote control plug-in 904 sends a CUI send command to the embedded server 903. The embedded server 903 then sends the CUI 5 or a URL of the CUI to the third RUIC 900. In case of receiving the URL of the CUI, the third RUIC 900 receives the CUI matching its capability at the URL and renders the received CUI. 30 FIG. 10 is a diagram illustrating a signal flow for providing a CUI matching the capability of a third RUIC to the third RUIC, when an RUI has already been rendered in an RUIC according to another embodiment of the present invention. Referring to FIG. 10, as an RUI is rendered in the browser 905 of the RUIC 901, it is 35 determined whether there is a currently connected third RUIC 900. In the absence of the currently connected third RUIC 900, no further CUI-associated process is proceeded. Upon receipt of a CUI request message including capability information about the third 40 RUIC 900 from the third RUIC 900 later, the embedded server 903 sends the capability information to the remote control plug-in 904. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 11 The remote control plug-in 904 stores the received capability information and then sends an onCUIRequest event indicating the reception of the CUI request to the RUI 906 currently being rendered in the browser 905. The RUI 906 then sends a getCUI command requesting a CUI for controlling the RUI 906 to the remote control plug-in 5 904. The remote control plug-in 904 converts the format of the capability information about the third RUIC 900 into a format transmittable to the RUIS 902 and sends the converted capability information along with a CUI download request to the RUIS 902. Thereafter, 0 the remote control plug-in 904 downloads a CUI from the RUIS 902 and stores the CUI at an appropriate location. The subsequent operation is performed in the same manner as illustrated in FIG. 8. FIG. 11 is a diagram illustrating a signal flow for providing a CUI matching the capability 5 of a third RUIC to the third RUIC, when an RUI has already been rendered in an RUIC according to another embodiment of the present invention. In accordance with the embodiment of the present invention illustrated in FIG. 11, the RUIC sends a CUI to the third RUIC in a forwarding scheme, not in a download 0 scheme. Referring to FIG. 11, the RUI 906 requests the remote control plug-in 904 to receive a CUI from the RUIS 902. The remote control plug-in 904 then requests the CUI to the RUIS 902. The RUIS 902 encapsulates the contents of the requested CUI in a body of 5 an HTTP message and sends the HTTP message to the remote control plug-in 904. The remote control plug-in 904 extracts the contents of the CUI from the received HTTP message and sends the extracted contents of the CUI to the RUI 906. The RUI 906 commands the remote control plug-in 904 to send the contents of the CUI to the third 30 RUIC 900 through an embedded Web server 903. The contents of the CUI may be modified by the RUI 906, the remote control plug-in 904, or the embedded Web server 903, when needed. Signaling 1000 of onCompleteReceivingCUI and sendCUI may not be performed 35 according to situations. For example, in the case where the remote control plug-in 904 requests a CUI to the RUIS 902 and receives a response from the RUIS 902, if it is not necessary to notify the RUI 906 of what the response is about, the signaling 1000 is not performed. In this case, the remote control plug-in 904 sends the contents of the CUI extracted from the HTTP message received from the RUIS 902 to the embedded Web 40 server 903. Then the embedded Web server 903 sends the received contents of the CUI to the third RUIC 900. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 12 FIG. 12 is a diagram illustrating a signal flow for providing a CUI matching the capability of a third RUIC to the third RUIC, when an RUI has already been rendered in an RUIC according to another embodiment of the present invention. 5 In accordance with the embodiment of the present invention illustrated in FIG. 11, the RUIC sends a CUI to the third RUIC in a forwarding scheme, not in a download scheme. Referring to FIG. 12, as an RUI is rendered in the browser 905 of the RUIC 901, it is 0 determined whether there is a currently connected third RUIC 900. In the absence of the currently connected third RUIC 900, no further CUI-associated process is proceeded. Upon receipt of a CUI request message including capability information about the third 5 RUIC 900 from the third RUIC 900 later, the embedded server 903 sends the capability information to the remote control plug-in 904. The remote control plug-in 904 stores the received capability information and then sends an onCUIRequest event indicating the reception of the CUI request to the RUI 0 906 currently being rendered in the browser 905. The RUI 906 then sends a getCUI command requesting a CUI for controlling the RUI 906 to the remote control plug-in 904. Then the remote control plug-in 904 requests a CUI to the RUIS 902. The RUIS 902 5 encapsulates the contents of the requested CUI in a body of an HTTP message and sends the HTTP message to the remote control plug-in 904. The remote control plug-in 904 extracts the contents of the CUI from the received HTTP message and sends the extracted contents of the CUI to the RUI 906. The RUI 906 30 commands the remote control plug-in 904 to send the contents of the CUI to the third RUIC 900 through the embedded Web server 903. The contents of the CUI may be modified by the RUI 906, the remote control plug-in 904, or the embedded Web server 903, when needed. 35 The signaling 1000 of onCompleteReceivingCUI and sendCUI may not be performed according to situations. For example, in the case where the remote control plug-in 904 requests a CUI to the RUIS 902 and receives a response from the RUIS 902, if it is not necessary to notify the RUI 906 of what the response is about, the signaling 1000 is not performed. In this case, the remote control plug-in 904 sends the contents of the CUI 40 extracted from the HTTP message received from the RUIS 902 to the embedded Web server 903. Then the embedded Web server 903 sends the received contents of the CUI to the third RUIC 900. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 13 FIG. 13 is a diagram illustrating a signal flow for an operation for sending a CUI matching a service requested by a DLNA device according to an embodiment of the present invention. The requested service is an IPTV service. The IPTV service may be 5 requested to an OITF through a DLNA device (+RUIPL+) according to the Open IPTV Forum standard. Referring to FIG. 13, a DLNA device (+RUIPL+) 1200 requests an IPTV service to an OITF 1201 through a predefined Universal Resource Identifier (URI). The DLNA device 0 (+RUIPL+) 1200 also sends its capability information along with a service request message, when requesting the IPTV service. DLNA functions (+RUISRC+) 1203 store the capability information and command a Declarative Application Environment (DAE) browser 1205 to receive a DAE application 5 matching the IPTV service from an IPTV applications server 1202 and execute the DAE application. When a DAE application 1206 matching the IPTV service is executed in the DAE browser 1205 in response to the command, the DAE application 1206 provides a 0 getCUI method along with a URI of a CUI to a remote control plug-in 1204. Then the remote control plug-in 1204 retrieves the stored capability information from the DLNA functions (+RUISRC+) 1203 and processes the capability information such that it can be sent to the IPTV applications server 1202. When needed, the capability information may not be processed. 5 Meanwhile, the remote control plug-in 1204 sends the processed (or non-processed) capability information to the IPTV applications server 1202 using the URI parameter set in the getCUI method, and receives a CUI from the IPTV applications server 1202. The CUI may be received in two schemes. 30 In the case where a CUI is received in a download scheme, the remote control plug-in 1204 downloads a compressed file including CUls from the IPTV applications server 1202 to the DLNA functions 1203 and decompresses the downloaded compressed file, and indicates an accessible location to the DAE application 1206 in the form of a URL 35 corresponding to the decompressed directory, using an onCompleteReceivingCUI event function. The DAE application 1206 generates a new URI by attaching the received prefix URI to the name of a CUI included in an internally stored CUI list. The DLNA device 1200 may 40 access the CUI of the OITF 1201 using the new URI. The new URI is sent to the DLNA device 1200 through a sendCUI method. The DLNA 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 14 device 1200 calls the URI and receives the CUI from the DLNA functions 1203 in the OITF 1201. On the other hand, in the case where a CUI is received from the IPTV applications 5 server 1202 in a forwarding scheme, the DAE application 1206 receives the HTML contents of a CUI from the IPTV applications server 1202 through a getCUI method. The DAE application 1206 modifies the HTML contents, when needed, and then sends the modified HTML contents to the DLNA device 1200 through a sendCUI method. If the HTML contents do not need to be modified, the DAE application 1206 may simply send 0 the HTML contents to the DLNA device 1200 through the sendCUI method. The DLNA device 1200 renders the received HTML contents on its screen. As described above, HTML contents are included in sendCUI in the forwarding scheme, 5 whereas a URI value is included in sendCUI in the download scheme. FIG. 14 is a diagram illustrating a signal flow for receiving a CUI matching an IPTV service going on in an OITF through a DLNA device (+RUIPL+) according to a further embodiment of the present invention, which is applicable to the Open IPTV Forum 0 standard. Referring to FIG. 14, it is assumed herein that an IPTV service is going on by the DAE application 1206 in the OITF 1201. In this state, a user requests a CUI to the OITF 1201 through a predefined URI using an ITF Remote Control Function (IRCF) of the DLNA 5 device 1200 in order to control the on-going IPTV service. Herein, the DLNA device 1200 sends its capability information along with a CUI request message to the DLNA functions 1203. The capability information is stored in the DLNA functions 1203. The DLNA functions 1203 notify the remote control plug-in 1204 of the reception of the 30 CUI request from the DLNA device 1200. The remote control plug-in 1204 in turn notifies the DAE application 1206 of the reception of the CUI request through an onCUIRequest event function. The DAE application 1206 commands the remote control plug-in 1204 to receive the CUI from the IPTV applications server 1202 through a getCUI method. The DLNA functions 1203 use the stored capability information to 35 receive the CUI from the IPTV applications server 1202. The subsequent process is performed in the same manner as illustrated in FIG. 12 and will not be described herein in detail. FIG. 15 describes Application Programming Interfaces (APIs) and an interface 40 according to an embodiment of the present invention, which are applicable to DAE SPEC of the Open IPTV Forum standard. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 15 As to Property (Event), when a third RUIC requests a CUI for a DAE application being executed in an OITF, a remote control plug-in generates an onCUIRequest callback event function to the DAE application. A device handle value for the currently connected third RUIC is also sent as a parameter to the DAE application. Before the 5 onCUIRequest callback event function is generated to the DAE application, the OITF stores capability information about the third RUIC received along with a CUI request from the third RUIC. The capability information is used when a getCUI method is called later to receive an appropriate CUI that can be rendered in the third RUIC from an IPTV applications server. 0 An onCompleteReceivingCUI callback event function is generated to the remote control plug-in by the DAE application. The onCompleteReceivingCUI callback event function requests a CUI download by a getCUI method. When a CUI is completely downloaded from the IPTV application server to the OITF and ready to be sent to the third RUIC, the 5 remote control plug-in sends a prefix of a URI through which the downloaded CUI is accessible to the DAE application. A parameter cuiPrefixURI sent along with the onCompleteReceivingCUI callback event function is expressed as a URI (e.g. /cui/playercontroller/001/) through which the third 0 RUIC can access a directory having the downloaded CUI. If the name of a CUI that the DAE application has is friendscodcontroller.html, a combination of cuiPrefixURI and the name of the CUI may be sent to the third RUIC (e.g. /cui/playercontroller/001/friendscodcontroller.html). 5 Regarding Method, there is a Boolean isRCExist method for, in the presence of the capability information about the third RUIC, sending the capability information to the remote control plug-in. If a value 'true' is returned, this means that the third RUIC is currently connected to the OITF and the capability information is successfully stored in 30 the remote control plug-in of the OITF. Otherwise, a value 'false' is returned to the DAE application (RUI). In case of a getConnectedRemoteDeviceHandle method similar in function to the 35 isRCExist method, when the DAE application calls it, it delivers an integer device handle value by which to adjust the connected third RUIC to the DAE application. In the absence of a connected third RUIC, an undefined value or a null value is returned. The DAE application commands the remote control plug-in to download a CUI from the 40 IPTV applications server through the getCUI method. The DAE application also sends a URL for downloading as a parameter to the remote control plug-in. Then the remote control plug-in sends to the IPTV applications server a download request message 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 16 along with the capability information about the third RUIC, stored in the OITF. The getCUlmethod is asynchronous. When the DAE application calls the getCUI method, a value 'true' or 'false' indicating success or failure of the getCUI method 5 execution is directly returned to the DAE application. That is, although the download is being performed between the remote control plug-in and the IPTV applications server, the DAE application can perform a process shortly after calling the getCUI method. Upon completion of the download between the remote control plug-in and the IPTV applications server, the afore-described onCompleteReceivingCUI event is sent to the 0 DAE application. When the DAE application sends to the remote control plug-in the device handle value specific to the third RUIC currently connected to the OITF along with the URI information by which a CUI is accessible by calling a sendCUI method, the remote 5 control plug-in sends the URI information as a second parameter to the third RUIC identified by the device handle value as a first parameter. Thus the third RUIC can fetch the CUI from the OITF using the URI information. HTTP uses an interface defined in the OITF DAE SPEC as an interface between the 0 remote control plug-in and an RUIS and writes the capability information about the third RUIC at a location designated for writing capability information. Basically, other information about the third RUIC is also written together, such as vendorName, modelName, softwareVersion, hardwareVersion, applicationName, and applicationVersion. 5 If such information (i.e. vendorName, modelName, softwareVersion, hardwareVersion, applicationName, and applicationVersion of the third RUIC) cannot be sent together with the capability information about the third RUIC, for example, when the third RUIC has not sent the information about vendorName, modelName, softwareVersion, 30 hardwareVersion, applicationName, and applicationVersion, this information may be replaced with information about the OITF. Because the information about vendorName, modelName, softwareVersion, hardwareVersion, applicationName, and applicationVersion of the third RUIC is optional, a field designed for the capability information and the other information about the third RUIC may carry only the capability 35 information. Meanwhile, the other information about the third RUIC is marked with [] in the description of the interface between the remote control plug-in and the IPTV applications server in FIG. 10. [ ] means optional. FIGs. 16 and 17 illustrate properties and methods for the APIs described in FIG. 15 40 according to an embodiment of the present invention, which are applicable to the specification of the Open IPTV Forum standard. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 17 FIG. 18 describes interfaces and messages for implementing an IPTV service in an OITF by a third RUIC according to an embodiment of the present invention, which are applicable to the PROTOCOL specification of the Open IPTV Forum standard. 5 The protocol is required to send an RUI (an IPTV service) from an IPTV applications server to an OITF and to render the RUI in the OITF, through a third RUIC in the flowcharts of FIGs. 9 to 12. FIG. 18 describes three steps. First, an HTTP request message is sent to an OITF 0 through a CUI rendered in a third RUIC. Specifically, in Step 1, the HTTP request message may be sent through a URI set in a GET or POST method. In Step 2, the CUI waits until receiving a response to the HTTP request message. In Step 3, the OITF sends information about a URI of a new CUI to the third RUIC. The format of the HTTP response message is illustrated in Step 3 of FIG. 16. The URI information about the CUI 5 is included in an HTTP Response Body. FIG. 19 describes interfaces and messages for requesting a CUI to control a DAE application currently being executed in an OITF by a third RUIC according to an embodiment of the present invention, which are applicable to the PROTOCOL 0 specification of the Open IPTV Forum standard. FIG. 19 describes three steps. First, a third RUIC sends an HTTP request message requesting a CUI for controlling a DAE application currently being executed in an OITF through a CUI rendered in the third RUIC. Specifically, in Step 1, the HTTP request 5 message may be sent through a URI set in a GET method. In Step 2, the CUI waits until receiving a response to the HTTP request message. In Step 3, the OITF sends information about a URI of the requested CUI to the third RUIC. The format of the HTTP response message is illustrated in Step 3 of FIG. 17. The URI information about the CUI is included in an HTTP Response Body. 30 As is apparent from the above description of the present invention, since a remote third device can receive a CUI matching the capability of the third device from an RUIS, the performance of a short-range network can be maximized. 35 Exemplary embodiments of the present invention can also be embodied as computer-readable codes on a computer-readable recording medium. The computer-readable recording medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer-readable recording medium include, but are not limited to, read-only memory 40 (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet via wired or wireless transmission paths). The computer-readable recording 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 18 medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. Also, function programs, codes, and code segments for accomplishing the present invention can be easily construed as within the scope of the invention by programmers skilled in the art to 5 which the present invention pertains. While the invention has been shown and described with reference to certain exemplary embodiments of the present invention thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing 0 from the spirit and scope of the present invention as defined by the appended claims and their equivalents. In the claims which follow and in the preceding description of the invention, except where the context requires otherwise due to express language or necessary implication, 5 the word "comprise" or variations such as "comprises" or "comprising" is used in an inclusive sense, i.e. to specify the presence of the stated features but not to preclude the presence or addition of further features in various embodiments of the invention. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014

Claims (20)

1. A method for remote control of an application execution device in a network system, comprising: 5 collecting, from a remote device that remotely controls the application execution device using a control user interface (CUI), information about capability of the remote device; sending a CUI request requesting a CUI to be used for remotely controlling a currently executed application and the information about the capability of the remote 0 device to an application server; receiving a CUI matching the capability of the remote device from the application server in response to the CUI request; and sending the received CUI to the remote device. 5
2. The method of claim 1, wherein the currently executed application is an application executed before the application execution device discovers the remote device.
3. The method of claim 1, wherein the currently executed application is an 0 application executed after the application execution device discovers the remote device.
4. The method of claim 2, wherein the collection comprises receiving the information about the capability of the remote device along with a CUI request from the remote device. 5
5. The method of claim 3, wherein the collection comprises receiving the information about the capability of the remote device along with a predetermined application service request from the remote device. 30
6. An application execution device for performing remote control in a network system, comprising: a controller for collecting, from a remote device that remotely controls the application execution device using a control user interface (CUI), information about capability of the remote device; and 35 a transceiver for sending a CUI request requesting a CUI to be used for remotely controlling a currently executed application and the information about the capability of the remote device to an application server, and receiving a CUI matching the capability of the remote device from the application server in response to the CUI request. 40
7. The application execution device of claim 6, wherein the currently executed application is an application executed, before the first entity discovers the remote device. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 20
8. The application execution device of claim 6, wherein the currently executed application is an application executed, after the first entity discovers the remote device. 5
9. The application execution device of claim 7, wherein the first entity receives the information about the capability of the remote device along with a CUI request from the remote device.
10. The application execution device of claim 8, wherein the first entity receives the 0 information about the capability of the remote device along with a predetermined application service request from the remote device.
11. A remote device for performing remote control in a network system, the remote device comprising: 5 a transmitter for sending information about capability of the remote device to the application execution device if the remote device is connected to an application execution device, and a receiver for receiving a control user interface (CUI) matching the capability of the remote device transmitted from the an application server providing the application 0 through the application execution device, wherein the CUI is obtained by the application execution device from the application server in response to a CUI request of the application execution device, wherein the CUI is used for remotely controlling a currently executed application by the application execution device. 5
12. The remote device of claim 11, wherein the currently executed application is an application executed before the first entity discovers the remote device.
13. The remote device of claim 11, wherein the currently executed application is an 30 application executed after the first entity discovers the remote device.
14. The remote device of claim 12, wherein the information about the capability of the remote device is transmitted along with a CUI request to the application execution device. 35
15. The remote device of claim 13, wherein the information about the capability of the remote device is transmitted along with a predetermined application service request from the remote device. 40
16. A method for performing remote control in a network system, comprising: sending information about capability of the remote device to the application execution device if the remote device is connected to an application execution device, 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014 21 and receiving a control user interface (CUI) matching the capability of the remote device transmitted from the an application server providing the application through the application execution device, 5 wherein the CUI is obtained by the application execution device from the application server in response to a CUI request of the application execution device, wherein the CUI is used for remotely controlling a currently executed application by the application execution device. 0
17. The method of claim 16, wherein the currently executed application is an application executed before the first entity discovers the remote device.
18. The method of claim 16, wherein the currently executed application is an application executed after the first entity discovers the remote device. 5
19. The method of claim 17, wherein the information about the capability of the remote device is transmitted along with a CUI request to the application execution device. 0
20. The method of claim 18, wherein the information about the capability of the remote device is transmitted along with a predetermined application service request from the remote device. 5965957_1 (GHMatters) P89506.AU.1 SARAHVV 26/11/2014
AU2014268193A 2009-09-01 2014-11-26 Apparatus and method for remote control in a short-range network, and system supporting the same Ceased AU2014268193B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2014268193A AU2014268193B2 (en) 2009-09-01 2014-11-26 Apparatus and method for remote control in a short-range network, and system supporting the same

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR10-2009-0082237 2009-09-01
KR10-2009-0096927 2009-10-12
AU2010290258A AU2010290258B2 (en) 2009-09-01 2010-09-01 Apparatus and method for remote control in a short-range network, and system supporting the same
AU2014268193A AU2014268193B2 (en) 2009-09-01 2014-11-26 Apparatus and method for remote control in a short-range network, and system supporting the same

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
AU2010290258A Division AU2010290258B2 (en) 2009-09-01 2010-09-01 Apparatus and method for remote control in a short-range network, and system supporting the same

Publications (2)

Publication Number Publication Date
AU2014268193A1 AU2014268193A1 (en) 2014-12-11
AU2014268193B2 true AU2014268193B2 (en) 2015-07-09

Family

ID=52016214

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2014268193A Ceased AU2014268193B2 (en) 2009-09-01 2014-11-26 Apparatus and method for remote control in a short-range network, and system supporting the same

Country Status (1)

Country Link
AU (1) AU2014268193B2 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040236442A1 (en) * 2000-03-13 2004-11-25 Microsoft Corporation Remote controlled system with computer-based remote control facilitator
US20080243998A1 (en) * 2007-03-30 2008-10-02 Samsung Electronics Co., Ltd. Remote control apparatus and method
US20090210488A1 (en) * 2008-02-20 2009-08-20 Samsung Electronics Co., Ltd. Remote user interface proxy apparatus and method of processing user interface components thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040236442A1 (en) * 2000-03-13 2004-11-25 Microsoft Corporation Remote controlled system with computer-based remote control facilitator
US20080243998A1 (en) * 2007-03-30 2008-10-02 Samsung Electronics Co., Ltd. Remote control apparatus and method
US20090210488A1 (en) * 2008-02-20 2009-08-20 Samsung Electronics Co., Ltd. Remote user interface proxy apparatus and method of processing user interface components thereof

Also Published As

Publication number Publication date
AU2014268193A1 (en) 2014-12-11

Similar Documents

Publication Publication Date Title
AU2010290258B2 (en) Apparatus and method for remote control in a short-range network, and system supporting the same
EP2215782B1 (en) Method for controlling home network device using universal web application and apparatus thereof
US8441369B2 (en) Remote user interface system and method
US8640031B2 (en) Method and apparatus for controlling remote user interface in a home network
KR101612553B1 (en) Apparatus and method for interfacing between a remote user interface server and a remote user interface client
US8560497B2 (en) Inter-home sharing apparatus and method using home network device
EP2507937B1 (en) Method and apparatus for providing remote user interface list
US8836482B2 (en) Method and apparatus for controlling remote user interface client through the third remote user interface client
US9405557B2 (en) Method and apparatus for providing a remote control user interface
JP5678184B2 (en) Remote user interface management apparatus and method and system therefor
KR100754221B1 (en) Service requesting method between network devices, network device capable of performing the method, and storage medium thereof
KR101698354B1 (en) Apparatus and method for controlling a plurality of remote user interface servers in a home network
AU2014268193B2 (en) Apparatus and method for remote control in a short-range network, and system supporting the same
JP6728218B2 (en) Method and apparatus for communication between devices in multimedia system
KR100348623B1 (en) Message transmission/reception method for home network
WO2015093192A1 (en) Device to be controlled, control device, and information apparatus

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)
MK14 Patent ceased section 143(a) (annual fees not paid) or expired