US20110154205A1 - Rui server, rui client and control method thereof - Google Patents

Rui server, rui client and control method thereof Download PDF

Info

Publication number
US20110154205A1
US20110154205A1 US12/904,580 US90458010A US2011154205A1 US 20110154205 A1 US20110154205 A1 US 20110154205A1 US 90458010 A US90458010 A US 90458010A US 2011154205 A1 US2011154205 A1 US 2011154205A1
Authority
US
United States
Prior art keywords
information
rui
vertical
horizontal
mode
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/904,580
Inventor
Dong-uk Kim
Eun-Jung Kang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Assigned to SAMSUNG ELECTRONICS CO., LTD. reassignment SAMSUNG ELECTRONICS CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KANG, EUN-JUNG, KIM, DONG-UK
Publication of US20110154205A1 publication Critical patent/US20110154205A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/12Arrangements for remote connection or disconnection of substations or of equipment thereof
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/04Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/161Indexing scheme relating to constructional details of the monitor
    • G06F2200/1614Image rotation following screen orientation, e.g. switching from landscape to portrait mode
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00Transmission systems of control signals via wireless link
    • G08C2201/30User interface
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0492Change of orientation of the displayed image, e.g. upside-down, mirrored
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00Aspects of data communication
    • G09G2370/02Networking aspects
    • G09G2370/027Arrangements and methods specific for the display of internet documents
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00Aspects of data communication
    • G09G2370/04Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00Aspects of data communication
    • G09G2370/04Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
    • G09G2370/042Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller for monitor identification
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00Aspects of data communication
    • G09G2370/16Use of wireless transmission of display information

Definitions

  • Apparatuses and methods consistent with the exemplary embodiments relate to a remote user interface (RUI) server, an RUI client and a method of controlling the same, and more particularly, to an RUI server and an RUI client and a method of controlling the same, which transmit and receive an user interface (UI) of a website.
  • RUI remote user interface
  • DLNA digital living network alliance
  • HAVi home audio-video interoperability
  • UPN universal plug and play
  • a remote user interface (RUI) technique is employed when a device controls a function of another device.
  • RUI remote user interface
  • the RUI technique is based on a client-server architecture.
  • An RUI client may receive an UI from an RUI server, and a user in the RUI client may use the UI to control the RUI server by the RUI technique.
  • an UPnP device may provide an UI of a CE-HTML type webpage, and a user may remotely control an application of the UPnP device through the CE-HTML type webpage.
  • CE-HTML is a special version of HTML. based on HTML.
  • one or more exemplary embodiments provide an RUI server and an RUI client and a method of controlling the same, capable of easily changing a horizontal and a vertical UI.
  • the exemplary embodiments are also to provide an RUI server and an RUI client and a method of controlling the same, which provide an accurate and clean UI without change of the UI by the RUI client.
  • a remote user interface (RUI) server including: a communication unit which communicates with an RUI client through a network; and a controller which control the communication unit to transmit UI information comprising horizontal UI information and vertical UI information through the communication unit.
  • the controller may control the communication unit to transmit one UI page comprising a horizontal UI page and a vertical UI page.
  • the controller may control the communication unit to transmit horizontal UI address information and vertical UI address information to the RUI client.
  • the controller may perform a profile matching with the RUI client if the RUI client is connected thereto, and may control the communication unit to transmit the horizontal UI address information and the vertical UI address information to the RUI client when the profile matching is performed.
  • the controller may insert one of the horizontal UI address information and the vertical UI address information into UI information comprising the other of the horizontal and vertical UI address information, and may controls the communication unit to transmit the UI information having both horizontal and vertical UI address information to the RUI client.
  • an RUI client including: a communication unit which communicates with an RUI server and receives UI information comprising horizontal UI information and vertical UI information; a sensor which senses a user selection of selecting one of a horizontal mode for displaying an RUI horizontally and a vertical mode for displaying an RUI vertically; and a controller which displays an RUI on a display unit in one of the horizontal mode and the vertical mode according to the user selected one of the horizontal UI information and the vertical UI information.
  • a method of controlling an RUI server which communicates with an RUI client including: starting the communication with the RUI client; and transmitting UI information having horizontal UI information and vertical UI information to the RUI client.
  • a method of controlling an RUI client including a sensor including: receiving UI information having horizontal UI information and vertical UI information; sensing a user selection of one of a horizontal mode for displaying an RUI horizontally and a vertical mode for displaying an RUI vertically; and displaying an RUI on the display unit in one mode of the horizontal mode and the vertical mode based on the horizontal UI information and the vertical UI information corresponding to the user selection.
  • FIG. 1 is a schematic view showing an UI providing system in accordance with an exemplary embodiment
  • FIG. 2 is a control block diagram of the UI providing system shown in FIG. 1 ;
  • FIG. 3 is a control flowchart showing a method of controlling the UI providing system shown in FIG. 2 ;
  • FIG. 4 shows an UI page provided from an RUI server shown in FIG. 3 ;
  • FIG. 5 shows how a selected area is applied in accordance with the exemplary embodiment
  • FIG. 6 is a control flowchart showing another method of controlling the UI providing system shown in FIG. 2 ;
  • FIG. 7 is a control flowchart showing still another method of controlling the UI providing system shown in FIG. 2 .
  • FIG. 1 is a schematic view showing a user interface (UI) providing system in accordance with an exemplary embodiment
  • FIG. 2 is a control block diagram of the UI providing system shown in FIG. 1
  • the remote user interface (RUI) providing system of the present embodiment which provides an RUI, may include an RUI server 100 and an RUI client 200 .
  • RUI remote user interface
  • Various RUI techniques such as CEA-2014, XHT (expandable home theater), WiDex (widget description exchange service), and RDP (Remote Desktop Protocol) have been examined.
  • the RUI is a mechanism for enabling the RUI client 200 to perform a rendering and a control of an RUI server's application.
  • the application is not executed by the RUI client 200 , but by the RUI server 100 .
  • the RUI client 200 may control the RUI server 100 by using UI information received therefrom.
  • the UI information which indicates components constituting an UI transmitted from the RUI server 100 to the RUI client 200 , is a collective term for all types of data such as icons, pull-down menus, buttons, scrollbars, windows, texts, A/V data (audio, video, and pictures), UI address or the like.
  • the RUI server 100 may include a television or, preferably, an internet protocol (IP) TV and a computer system or a personal terminal.
  • the RUI server 100 may include a large format display (LFD), a table top display (TPD) or the like.
  • the RUI server 100 may provide an UI page of a web server 120 to the RUI client 200 .
  • the RUI client 200 which typically includes a rectangular display unit 220 , may include a portable personal terminal that can be easily carried by a user.
  • the RUI client 200 may include a monitor or a pivotable television as the second display unit 220 .
  • the RUI server 100 may include a first communication unit 110 , the web server 120 , a first display unit 130 , and a first controller 140 which controls the first communication unit 110 , the web server 120 , the first display unit 130 and the like.
  • the RUI client 200 may include a second communication unit 210 , the second display unit 220 , a sensor 230 , and a second controller 240 which controls the second communication unit 210 , the second display unit 220 , the sensor 230 and the like.
  • the first communication unit 110 and the second communication unit 210 may perform the discoveries of the RUI server 100 and the RUI client 200 under the controls of the first controller 140 and the second controller 240 , and receive and transmit various control signals and UI information having an UI page between the RUI server 100 and the RUI client 200 .
  • the first communication unit 110 and the second communication unit 210 may respectively include communication modules corresponding to various communication methods such as Bluetooth, Wi-Fi (wireless fidelity), zigbee, IR communication, RF communication, and wired communication.
  • middleware such as UPnP, HAVi, java intelligent network infra-structure (JINI), video electronics standards association (VESA), and digital living network alliance (DLNA) may support a home networking capable of sharing digital contents such as music, picture, and video stored in an electronic apparatus such as a computer, a home electric product, and a portable terminal.
  • the first communication unit 110 and the second communication unit 210 in accordance with the present exemplary embodiment may perform communication of the RUI based on the Internet and the UPnP network according to a web-based protocol standard and a CEA-2004 standard defining a frame work.
  • CEA-2004 is the acronym for web-based consumer electronics association's-2004.
  • the web server 120 may provide a web-based UI page to the RUI client 200 .
  • Each of the first display unit 130 and the second display unit 220 may include a plasma display panel, an organic light-emitting panel made of an organic material, a liquid panel having a liquid layer or the like to display an image signal and further include a panel actuator which actuates such a panel.
  • the RUI server 100 when the RUI server 100 is a television, the RUI server 100 may include the first display unit 130 .
  • the first display unit 130 may not belong to essential components and thus be omitted.
  • the second display unit 220 may display an UI page received from the RUI server 100 .
  • the sensor 230 in the RUI client 200 may sense a user selection of selecting one of a horizontal mode for displaying the RUI horizontally and a vertical mode for displaying the RUI vertically.
  • the sensor 230 may also include a gyrosensor which senses a direction in which the second display unit 220 is moved vertically or horizontally by a user or a user input unit such as a touch panel which senses a user's input.
  • the configuration of the sensor 230 is not limited to a specific hardware. Information sensed through the sensor 230 may be transferred to the second controller 240 .
  • the second controller 240 may discover the RUI server 100 according to the RUI standard such as CEA-2014 through the second communication unit 210 and then start the communication with the RUI server 100 .
  • the detailed description related to such discovery will be omitted.
  • the second controller 240 may include a control point.
  • the discovery may be performed by such an external control point and UI information may also be transmitted to the RUI client 200 through the control point.
  • the first controller 140 may transmit UI information having horizontal and vertical UI information to the RUI client 200 .
  • FIG. 3 is a control flowchart showing a method of controlling the UI providing system shown in FIG. 2 .
  • an UI providing method will be described with reference to FIG. 3 .
  • the RUI server 100 and the RUI client 200 may first discover each other to start the communication with each other (S 10 ).
  • a profile matching is performed between the RUI server 100 and the RUI client 200 (S 20 ).
  • Information related to the second display unit 220 e.g., usable resolution, the number of pixels, UI profile and the like may be transferred to the RUI server 100 .
  • an UI based on such profile matching may be transmitted to the RUI server 100 .
  • the RUI server 100 may transmit to the RUI client 200 UI information having horizontal and vertical UI information corresponding to the requested UI page (S 40 ).
  • the RUI server 100 of the present exemplary embodiment may transmit to the RUI client 200 UI page I having both a horizontal and a vertical UI page II and III as shown in FIG. 4 .
  • the RUI server 100 may transmit to the RUI client 200 one HTML script including information related to the horizontal and the vertical UI page.
  • a function for changing any one of the horizontal and the vertical UI page to the other UI page may be included in a script, e.g., java script.
  • the second controller 240 may generate and display an UI page according to a user selection (S 50 ). For example, when the UI page is requested, if a display mode of the second display unit 220 is a horizontal mode, the second controller 240 may select and display the horizontal UI page II of the transmitted UI page I.
  • the second controller 240 may include a HTML web browser for rendering and displaying the transmitted UI.
  • the second controller 240 may generate the vertical UI page III corresponding to the changed vertical mode to display it on the second display unit 220 (S 70 ).
  • the second controller 240 may call a function in form of a script corresponding to the horizontal or the vertical mode.
  • the displayed UI page may be changed by the called function.
  • the profile matching is performed, if one UI page I is received, a UI page corresponding to the display mode selected by a user may be displayed without an additional interaction with the RUI server 100 even though the display mode is changed by the user.
  • the RUI client 200 since the RUI client 200 merely re-generates the UI page by using the given information without adjusting or changing the resolution of the UI page, it is possible to display the high-quality UI page having high reliability.
  • a UI profile is not able to be changed after an optimized UI profile information is selected considering a second display unit. Accordingly, even though a user changes a display mode, a UI page according to the fixed UI profile is provided to the RUI client. Therefore, an inadequate display mode may be displayed. Specifically, an upper or a lower end of the UI page may be cut in a horizontal mode and a left or a right end of the UI page may be cut in a vertical mode. Alternatively, the UI page may be extended in a vertical or a horizontal direction. As a result, it is difficult for the user to display a clean high-quality UI page.
  • the RUI server 100 of the present exemplary embodiment may provide the RUI client 200 with both the horizontal UI page corresponding to the horizontal mode and the vertical UI page corresponding to the vertical mode.
  • the RUI client 200 may selectively generate and display any one of the horizontal and the vertical UI page as the UI page according to a user's request. In other words, the RUI client 200 may display an UI page desired by a user without additionally adjusting a resolution by using received UI information.
  • the second controller 240 may apply a selected area to the changed mode (S 80 ).
  • FIG. 5 shows how the selected area is applied.
  • an area A that was selected or actuated in the horizontal mode may become an area B that is maintained to be selected or actuated even though the UI page is changed.
  • an icon “+” that has been actuated in the horizontal mode, i.e., in the horizontal UI page may also be being actuated in the vertical mode, i.e., in the UI page.
  • the second controller 240 may apply a selected area to the changed display mode such that a user is able to keep performing a work or a control that has been performed even if the display mode is changed.
  • FIG. 6 is a control flowchart showing a method of controlling the UI providing system shown in FIG. 2 , according to another exemplary embodiment.
  • the stage S 10 where the discovery between the RUI server 100 and the RUI client 200 is performed to start the communication and the stage S 20 where the profile matching therebetween is performed are also carried out as shown in FIG. 3 .
  • the first controller 140 may transmit to the RUI client 200 horizontal UI address information and vertical UI address information, i.e., both URLs related to a horizontal UI page and a vertical UI page (S 100 ). In other words, the first controller 140 may transmit to the RUI client 200 all address information related to the two UI pages instead of transmitting thereto only one of the horizontal and the vertical UI address information according to the related art method.
  • the second controller 240 may request an UI page based on the horizontal UI address information (S 120 ).
  • the RUI server 100 may transmit to the RUI client 200 UI information having the horizontal UI page information (S 130 ). Then, the second controller 240 may display a horizontal UI page based on the transmitted UI information.
  • the RUI client 200 may request an UI page based on the vertical UI address information (S 140 ). Then, the RUI server 100 may transmit to the RUI client 200 UI information having the vertical UI page information (S 150 ).
  • the second controller 240 may call a function in a script. Then, the called function may request an UI page in an URL adequate for the changed mode. At this time, the RUI server 100 may not perform additional operation or control except for providing the UI page of the requested URL.
  • the second controller 240 may apply a selected area to the changed mode.
  • the RUI server 100 may additionally transmit information related to the selected area.
  • the second controller 240 may also change the selected area based on the information.
  • FIG. 7 is a control flowchart showing still another method of controlling the UI providing system shown in FIG. 2 .
  • the first controller 140 may insert any one of the vertical UI address information and horizontal UI address information into the other UI address information and transmit it to the RUI client 200 .
  • the RUI server 100 may transmit a horizontal UI page and insert vertical UI address information into UI information related to the horizontal UI page before transmitting it thereto.
  • the RUI server 100 may insert a vertical UI URL into a HTML script related the horizontal UI page and transmit it to the RUI client 200 .
  • the RUI client 200 may request an UI page based on the received vertical UI address information (S 170 ). Then, the RUI server 200 may transmit a vertical UI page (S 180 ).
  • the RUI server 100 may transmit a vertical UI page and insert horizontal UI address information into UI information related to the vertical UI page before transmitting it thereto.
  • the RUI server 100 may transmit all information to the RUI client 200 to provide an UI with a high reliability without additional control or manipulation of the RUI client 200 and the RUI server 100 .
  • an RUI server and an RUI client and a method of controlling the same, capable of easily changing a horizontal and a vertical UI.
  • an RUI server and an RUI client and a method of controlling the same, which provide an accurate and clean UI without change of the UI by the RUI client.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)

Abstract

Disclosed are a remote user interface (RUI) server including a communication unit which communicates with an RUI client through a network; and a controller which controls the communication unit to transmit user interface (UI) information having horizontal UI information and vertical UI information.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This application claims priority from Korean Patent Application No. 10-2009-0126611, filed on Dec. 18, 2009 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference.
  • BACKGROUND
  • 1. Field
  • Apparatuses and methods consistent with the exemplary embodiments relate to a remote user interface (RUI) server, an RUI client and a method of controlling the same, and more particularly, to an RUI server and an RUI client and a method of controlling the same, which transmit and receive an user interface (UI) of a website.
  • 2. Description of the Related Art
  • Studies for improving home network technology have been pursued by many industry standard groups such as a digital living network alliance (DLNA), a home audio-video interoperability (HAVi) and a universal plug and play (UPnP).
  • In the home network, a remote user interface (RUI) technique is employed when a device controls a function of another device. In brief, the RUI technique is based on a client-server architecture. An RUI client may receive an UI from an RUI server, and a user in the RUI client may use the UI to control the RUI server by the RUI technique.
  • Having the CEA-2014 standard serve as the RUI standard defines an UPnP network and a frame work and a protocol for an RUI on the Internet. According to the CEA-2014 standard, an UPnP device (RUI server) may provide an UI of a CE-HTML type webpage, and a user may remotely control an application of the UPnP device through the CE-HTML type webpage. CE-HTML is a special version of HTML. based on HTML.
  • SUMMARY
  • Accordingly, one or more exemplary embodiments provide an RUI server and an RUI client and a method of controlling the same, capable of easily changing a horizontal and a vertical UI.
  • The exemplary embodiments are also to provide an RUI server and an RUI client and a method of controlling the same, which provide an accurate and clean UI without change of the UI by the RUI client.
  • According to an exemplary embodiment, there is provided a remote user interface (RUI) server including: a communication unit which communicates with an RUI client through a network; and a controller which control the communication unit to transmit UI information comprising horizontal UI information and vertical UI information through the communication unit.
  • The controller may control the communication unit to transmit one UI page comprising a horizontal UI page and a vertical UI page.
  • The controller may control the communication unit to transmit horizontal UI address information and vertical UI address information to the RUI client.
  • The controller may perform a profile matching with the RUI client if the RUI client is connected thereto, and may control the communication unit to transmit the horizontal UI address information and the vertical UI address information to the RUI client when the profile matching is performed.
  • The controller may insert one of the horizontal UI address information and the vertical UI address information into UI information comprising the other of the horizontal and vertical UI address information, and may controls the communication unit to transmit the UI information having both horizontal and vertical UI address information to the RUI client.
  • According to an exemplary embodiment, there is provided an RUI client including: a communication unit which communicates with an RUI server and receives UI information comprising horizontal UI information and vertical UI information; a sensor which senses a user selection of selecting one of a horizontal mode for displaying an RUI horizontally and a vertical mode for displaying an RUI vertically; and a controller which displays an RUI on a display unit in one of the horizontal mode and the vertical mode according to the user selected one of the horizontal UI information and the vertical UI information.
  • According to an exemplary embodiment, there is provided a method of controlling an RUI server which communicates with an RUI client, the method including: starting the communication with the RUI client; and transmitting UI information having horizontal UI information and vertical UI information to the RUI client.
  • According to an exemplary embodiment, there is provided a method of controlling an RUI client including a sensor, the method including: receiving UI information having horizontal UI information and vertical UI information; sensing a user selection of one of a horizontal mode for displaying an RUI horizontally and a vertical mode for displaying an RUI vertically; and displaying an RUI on the display unit in one mode of the horizontal mode and the vertical mode based on the horizontal UI information and the vertical UI information corresponding to the user selection.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above and/or other aspects will become apparent and more readily appreciated from the following description of the exemplary embodiments, taken in conjunction with the accompanying drawings, in which:
  • FIG. 1 is a schematic view showing an UI providing system in accordance with an exemplary embodiment;
  • FIG. 2 is a control block diagram of the UI providing system shown in FIG. 1;
  • FIG. 3 is a control flowchart showing a method of controlling the UI providing system shown in FIG. 2;
  • FIG. 4 shows an UI page provided from an RUI server shown in FIG. 3;
  • FIG. 5 shows how a selected area is applied in accordance with the exemplary embodiment;
  • FIG. 6 is a control flowchart showing another method of controlling the UI providing system shown in FIG. 2; and
  • FIG. 7 is a control flowchart showing still another method of controlling the UI providing system shown in FIG. 2.
  • DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS
  • Below, exemplary embodiments will be described in detail with reference to accompanying drawings so as to be easily realized by a person having ordinary knowledge in the art. The exemplary embodiments may be embodied in various forms without being limited to the exemplary embodiments set forth herein. Descriptions of well-known parts are omitted for clarity, and like reference numerals refer to like elements throughout.
  • FIG. 1 is a schematic view showing a user interface (UI) providing system in accordance with an exemplary embodiment, and FIG. 2 is a control block diagram of the UI providing system shown in FIG. 1. The remote user interface (RUI) providing system of the present embodiment, which provides an RUI, may include an RUI server 100 and an RUI client 200. Various RUI techniques such as CEA-2014, XHT (expandable home theater), WiDex (widget description exchange service), and RDP (Remote Desktop Protocol) have been examined. The RUI is a mechanism for enabling the RUI client 200 to perform a rendering and a control of an RUI server's application. Herein, the application is not executed by the RUI client 200, but by the RUI server 100.
  • The RUI client 200 may control the RUI server 100 by using UI information received therefrom. The UI information, which indicates components constituting an UI transmitted from the RUI server 100 to the RUI client 200, is a collective term for all types of data such as icons, pull-down menus, buttons, scrollbars, windows, texts, A/V data (audio, video, and pictures), UI address or the like.
  • As shown in FIGS. 1 and 2, the RUI server 100 may include a television or, preferably, an internet protocol (IP) TV and a computer system or a personal terminal. Alternatively, the RUI server 100 may include a large format display (LFD), a table top display (TPD) or the like. The RUI server 100 may provide an UI page of a web server 120 to the RUI client 200. The RUI client 200, which typically includes a rectangular display unit 220, may include a portable personal terminal that can be easily carried by a user. The RUI client 200 may include a monitor or a pivotable television as the second display unit 220.
  • As shown in FIG. 2, the RUI server 100 may include a first communication unit 110, the web server 120, a first display unit 130, and a first controller 140 which controls the first communication unit 110, the web server 120, the first display unit 130 and the like. The RUI client 200 may include a second communication unit 210, the second display unit 220, a sensor 230, and a second controller 240 which controls the second communication unit 210, the second display unit 220, the sensor 230 and the like.
  • The first communication unit 110 and the second communication unit 210 may perform the discoveries of the RUI server 100 and the RUI client 200 under the controls of the first controller 140 and the second controller 240, and receive and transmit various control signals and UI information having an UI page between the RUI server 100 and the RUI client 200. The first communication unit 110 and the second communication unit 210 may respectively include communication modules corresponding to various communication methods such as Bluetooth, Wi-Fi (wireless fidelity), zigbee, IR communication, RF communication, and wired communication.
  • In the meantime, middleware such as UPnP, HAVi, java intelligent network infra-structure (JINI), video electronics standards association (VESA), and digital living network alliance (DLNA) may support a home networking capable of sharing digital contents such as music, picture, and video stored in an electronic apparatus such as a computer, a home electric product, and a portable terminal. The first communication unit 110 and the second communication unit 210 in accordance with the present exemplary embodiment may perform communication of the RUI based on the Internet and the UPnP network according to a web-based protocol standard and a CEA-2004 standard defining a frame work. Here, CEA-2004 is the acronym for web-based consumer electronics association's-2004.
  • The web server 120 may provide a web-based UI page to the RUI client 200.
  • Each of the first display unit 130 and the second display unit 220 may include a plasma display panel, an organic light-emitting panel made of an organic material, a liquid panel having a liquid layer or the like to display an image signal and further include a panel actuator which actuates such a panel. As shown in FIG. 1, when the RUI server 100 is a television, the RUI server 100 may include the first display unit 130. However, the first display unit 130 may not belong to essential components and thus be omitted. The second display unit 220 may display an UI page received from the RUI server 100.
  • The sensor 230 in the RUI client 200 may sense a user selection of selecting one of a horizontal mode for displaying the RUI horizontally and a vertical mode for displaying the RUI vertically. The sensor 230 may also include a gyrosensor which senses a direction in which the second display unit 220 is moved vertically or horizontally by a user or a user input unit such as a touch panel which senses a user's input. The configuration of the sensor 230 is not limited to a specific hardware. Information sensed through the sensor 230 may be transferred to the second controller 240.
  • The second controller 240 may discover the RUI server 100 according to the RUI standard such as CEA-2014 through the second communication unit 210 and then start the communication with the RUI server 100. The detailed description related to such discovery will be omitted. In the RUI client 200 of the present exemplary embodiment, the second controller 240 may include a control point. Of course, in the case that the control point is separated from the RUI client 200, the discovery may be performed by such an external control point and UI information may also be transmitted to the RUI client 200 through the control point.
  • If the communication with the RUI client 200 is started, the first controller 140 may transmit UI information having horizontal and vertical UI information to the RUI client 200.
  • FIG. 3 is a control flowchart showing a method of controlling the UI providing system shown in FIG. 2. Hereinafter, an UI providing method will be described with reference to FIG. 3.
  • As described above, the RUI server 100 and the RUI client 200 may first discover each other to start the communication with each other (S10).
  • After such a discovery operation, a profile matching is performed between the RUI server 100 and the RUI client 200 (S20). Information related to the second display unit 220, e.g., usable resolution, the number of pixels, UI profile and the like may be transferred to the RUI server 100. Then, an UI based on such profile matching may be transmitted to the RUI server 100.
  • If the RUI client 200 requests an UI page (S30), the RUI server 100 may transmit to the RUI client 200 UI information having horizontal and vertical UI information corresponding to the requested UI page (S40). The RUI server 100 of the present exemplary embodiment may transmit to the RUI client 200 UI page I having both a horizontal and a vertical UI page II and III as shown in FIG. 4. In other words, the RUI server 100 may transmit to the RUI client 200 one HTML script including information related to the horizontal and the vertical UI page. In one HTML script, a function for changing any one of the horizontal and the vertical UI page to the other UI page may be included in a script, e.g., java script.
  • The second controller 240 may generate and display an UI page according to a user selection (S50). For example, when the UI page is requested, if a display mode of the second display unit 220 is a horizontal mode, the second controller 240 may select and display the horizontal UI page II of the transmitted UI page I. The second controller 240 may include a HTML web browser for rendering and displaying the transmitted UI.
  • Thereafter, if the display mode is changed by a user (S60), i.e., the display mode is changed to a vertical mode, the second controller 240 may generate the vertical UI page III corresponding to the changed vertical mode to display it on the second display unit 220 (S70). The second controller 240 may call a function in form of a script corresponding to the horizontal or the vertical mode. Then, the displayed UI page may be changed by the called function. In accordance with the present exemplary embodiment, when the profile matching is performed, if one UI page I is received, a UI page corresponding to the display mode selected by a user may be displayed without an additional interaction with the RUI server 100 even though the display mode is changed by the user. In addition, since the RUI client 200 merely re-generates the UI page by using the given information without adjusting or changing the resolution of the UI page, it is possible to display the high-quality UI page having high reliability.
  • According to a related art method, when the profile matching between an RUI server and an RUI client is performed, a UI profile is not able to be changed after an optimized UI profile information is selected considering a second display unit. Accordingly, even though a user changes a display mode, a UI page according to the fixed UI profile is provided to the RUI client. Therefore, an inadequate display mode may be displayed. Specifically, an upper or a lower end of the UI page may be cut in a horizontal mode and a left or a right end of the UI page may be cut in a vertical mode. Alternatively, the UI page may be extended in a vertical or a horizontal direction. As a result, it is difficult for the user to display a clean high-quality UI page.
  • The RUI server 100 of the present exemplary embodiment may provide the RUI client 200 with both the horizontal UI page corresponding to the horizontal mode and the vertical UI page corresponding to the vertical mode. The RUI client 200 may selectively generate and display any one of the horizontal and the vertical UI page as the UI page according to a user's request. In other words, the RUI client 200 may display an UI page desired by a user without additionally adjusting a resolution by using received UI information.
  • If the display mode is changed, the second controller 240 may apply a selected area to the changed mode (S80). FIG. 5 shows how the selected area is applied. As shown in FIG. 5, if the display mode is changed from the horizontal mode to the vertical mode, an area A that was selected or actuated in the horizontal mode may become an area B that is maintained to be selected or actuated even though the UI page is changed. In other words, an icon “+” that has been actuated in the horizontal mode, i.e., in the horizontal UI page may also be being actuated in the vertical mode, i.e., in the UI page. The second controller 240 may apply a selected area to the changed display mode such that a user is able to keep performing a work or a control that has been performed even if the display mode is changed.
  • FIG. 6 is a control flowchart showing a method of controlling the UI providing system shown in FIG. 2, according to another exemplary embodiment. In even the present exemplary embodiment, the stage S10 where the discovery between the RUI server 100 and the RUI client 200 is performed to start the communication and the stage S20 where the profile matching therebetween is performed are also carried out as shown in FIG. 3.
  • If the profile matching is performed or the RUI client 200 requests an UI page, the first controller 140 may transmit to the RUI client 200 horizontal UI address information and vertical UI address information, i.e., both URLs related to a horizontal UI page and a vertical UI page (S100). In other words, the first controller 140 may transmit to the RUI client 200 all address information related to the two UI pages instead of transmitting thereto only one of the horizontal and the vertical UI address information according to the related art method.
  • If the horizontal mode is selected by a user (S110), the second controller 240 may request an UI page based on the horizontal UI address information (S120).
  • According to the request of the RUI client 200, the RUI server 100 may transmit to the RUI client 200 UI information having the horizontal UI page information (S130). Then, the second controller 240 may display a horizontal UI page based on the transmitted UI information.
  • Thereafter, if the display mode is changed (S60), the RUI client 200 may request an UI page based on the vertical UI address information (S140). Then, the RUI server 100 may transmit to the RUI client 200 UI information having the vertical UI page information (S150).
  • In accordance with the present exemplary embodiment, if an event for changing the display mode is generated by a user, the second controller 240 may call a function in a script. Then, the called function may request an UI page in an URL adequate for the changed mode. At this time, the RUI server 100 may not perform additional operation or control except for providing the UI page of the requested URL.
  • In addition, in the present exemplary embodiment, if the display mode is changed, the second controller 240 may apply a selected area to the changed mode. When transmitting to the UI information having the vertical UI page information, the RUI server 100 may additionally transmit information related to the selected area. The second controller 240 may also change the selected area based on the information.
  • FIG. 7 is a control flowchart showing still another method of controlling the UI providing system shown in FIG. 2.
  • When the profile matching is performed or the RUI client 200 requests an UI page, the first controller 140 may insert any one of the vertical UI address information and horizontal UI address information into the other UI address information and transmit it to the RUI client 200.
  • For example, when the display mode of the second display unit 220 is the horizontal mode, if a user requests an UI page (S30), the RUI server 100 may transmit a horizontal UI page and insert vertical UI address information into UI information related to the horizontal UI page before transmitting it thereto. In other words, the RUI server 100 may insert a vertical UI URL into a HTML script related the horizontal UI page and transmit it to the RUI client 200.
  • Then, if the display mode is changed (S60), the RUI client 200 may request an UI page based on the received vertical UI address information (S170). Then, the RUI server 200 may transmit a vertical UI page (S180).
  • If the RUI client 200 requests an UI page when the display mode of the second display unit 220 is the vertical mode, the RUI server 100 may transmit a vertical UI page and insert horizontal UI address information into UI information related to the vertical UI page before transmitting it thereto.
  • In the exemplary embodiment, when RUI transmission is performed, if a user changes the display mode, the RUI server 100 may transmit all information to the RUI client 200 to provide an UI with a high reliability without additional control or manipulation of the RUI client 200 and the RUI server 100.
  • As described above, there is provided an RUI server and an RUI client and a method of controlling the same, capable of easily changing a horizontal and a vertical UI.
  • In addition, there is provided an RUI server and an RUI client and a method of controlling the same, which provide an accurate and clean UI without change of the UI by the RUI client.
  • Although a few exemplary embodiments have been shown and described, it will be appreciated by those skilled in the art that changes may be made in these exemplary embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.

Claims (20)

1. A remote user interface (RUI) server comprising:
a communication unit which communicates with an RUI client through a network; and
a controller which controls the communication unit to transmit user interface (UI) information comprising horizontal UI information and vertical UI information to the RUI client.
2. The server of claim 1, wherein the controller controls the communication unit to transmit one UI page comprising a horizontal UI page and a vertical UI page to the RUI client.
3. The server of claim 1, wherein the controller controls the communication unit to transmit horizontal UI address information and vertical UI address information to the RUI client.
4. The server of claim 3, wherein the controller performs a profile matching with the RUI client if the RUI client is connected thereto, and controls the communication unit to transmit the horizontal UI address information and the vertical UI address information to the RUI client when the profile matching is performed.
5. The server of claim 3, wherein the controller inserts one of the horizontal UI address information and the vertical UI address information into UI information comprising the other of the horizontal and vertical UI address information, and controls the communication unit to transmit the UI information having both horizontal and vertical UI address information to the RUI client.
6. A remote user interface (RUI) client comprising:
a communication unit which communicates with an RUI server and receives user interface (UI) information comprising horizontal UI information and vertical UI information;
a sensor which senses a user selection of selecting one of a horizontal mode for displaying an RUI horizontally and a vertical mode for displaying an RUI vertically; and
a controller which displays an RUI on a display unit in one of the horizontal mode and the vertical mode, according to the user selected one of the horizontal UI information and the vertical UI information.
7. The client of claim 6, wherein the communication unit receives one UI page comprising a horizontal UI page and a vertical UI page, and the controller displays one of the horizontal UI page and the vertical UI page according to the user selection.
8. The client of claim 6, wherein the communication unit receives horizontal UI address information and vertical UI address information, and the controller requests an UI page corresponding to the one of horizontal UI address information and vertical UI address information, based on the user selection.
9. The client of claim 8, wherein the vertical UI information is included with the horizontal UI information when a user selects a horizontal mode, and the controller requests an UI page based on the vertical UI address information when the horizontal mode is changed to the vertical mode.
10. The client of claim 8, wherein the horizontal UI information is included with the vertical UI information when a user selects a vertical mode, and the controller requests an UI page based on the horizontal UI address information when the vertical mode is changed to the mode.
11. The client of claim 6, wherein the controller applies an area actuated in the RUI before a mode change to the RUI after the mode change, when one of the horizontal mode and the vertical mode is changed to the other mode.
12. A method of controlling a remote user interface (RUI) server which communicates with an RUI client, the method comprising:
starting communication with the RUI client; and
transmitting user interface (UI) information comprising horizontal UI information and vertical UI information to the RUI client.
13. The method of claim 12, wherein the transmitting UI information to the RUI client comprises transmitting one UI page comprising a horizontal UI page and a vertical UI page.
14. The method of claim 12, wherein the transmitting UI information to the RUI client comprises transmitting horizontal UI address information and vertical UI address information to the RUI client.
15. The method of claim 14, wherein the transmitting UI information to the RUI client comprises inserting one of the horizontal UI address information and the vertical UI address information into the UI information comprising the other UI address information.
16. A method of controlling a remote user interface (RUI) client comprising a sensor, the method comprising:
receiving UI information comprising horizontal UI information and vertical UI information;
sensing a user selection of one of a horizontal mode for displaying an RUI horizontally and a vertical mode for displaying an RUI vertically; and
displaying an RUI on the display unit in one mode of the horizontal mode and the vertical mode based on the horizontal UI information and the vertical UI information corresponding to the user selection.
17. The method of claim 16, wherein the receiving UI information comprises receiving one UI page comprising a horizontal UI page and a vertical UI page, and
the displaying the RUI comprises displaying the horizontal UI page and the vertical UI page corresponding to the user selection.
18. The method of claim 16, wherein the receiving UI information comprises receiving horizontal UI address information and vertical UI address information, and
the displaying of the RUI comprises requesting an UI page based on the one of the horizontal UI address information and the vertical UI address information which corresponds to the user selection.
19. The method of claim 18, wherein the vertical UI information and the horizontal UI information are respectively included in different UI information, and
the displaying the RUI comprises requesting an UI page based on the UI address information of the other of the horizontal UI information and the vertical UI information when one of the horizontal mode and the vertical mode is changed to the other mode.
20. The method of claim 16, further comprising applying an area actuated in the RUI before a mode change to an RUI after a mode change when one of the horizontal mode and the vertical mode is changed to the other mode.
US12/904,580 2009-12-18 2010-10-14 Rui server, rui client and control method thereof Abandoned US20110154205A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020090126611A KR20110069991A (en) 2009-12-18 2009-12-18 Rui server, rui client and control method of the same
KR10-2009-0126611 2009-12-18

Publications (1)

Publication Number Publication Date
US20110154205A1 true US20110154205A1 (en) 2011-06-23

Family

ID=43836686

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/904,580 Abandoned US20110154205A1 (en) 2009-12-18 2010-10-14 Rui server, rui client and control method thereof

Country Status (3)

Country Link
US (1) US20110154205A1 (en)
EP (1) EP2336995A3 (en)
KR (1) KR20110069991A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120185543A1 (en) * 2011-01-18 2012-07-19 Samsung Electronics Co., Ltd. Apparatus and method for sharing information on a webpage
US20120226992A1 (en) * 2011-03-04 2012-09-06 Sony Corporation Remote user interface media adapter in network bridge
US20120299811A1 (en) * 2011-05-27 2012-11-29 Sony Corporation Transferring rui from one device to another
US20150193187A1 (en) * 2014-01-08 2015-07-09 Samsung Electronics Co., Ltd. Method and apparatus for screen sharing

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9357272B2 (en) 2012-08-03 2016-05-31 Intel Corporation Device orientation capability exchange signaling and server adaptation of multimedia content in response to device orientation
US9699272B2 (en) 2012-09-29 2017-07-04 Oracle International Corporation Mechanism for initiating behavior in a native client application from a web client application via a custom URL scheme
DE102014216887B3 (en) * 2014-08-26 2015-11-05 Siemens Aktiengesellschaft Method for connecting a mobile operator terminal to a device to be operated
CN106297225A (en) * 2015-05-20 2017-01-04 天脉聚源(北京)科技有限公司 The remote control thereof of a kind of home controller and system
CN106937100B (en) * 2017-01-23 2019-10-18 福建星网锐捷通讯股份有限公司 A kind of video image projecting method and system based on Miracast

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060062362A1 (en) * 2004-09-22 2006-03-23 Davis Franklin A System and method for server assisted browsing
US20090207184A1 (en) * 2008-02-14 2009-08-20 Nokia Corporation Information Presentation Based on Display Screen Orientation
US20100115020A1 (en) * 2008-10-31 2010-05-06 Hochmuth Roland M Saving A Layout Of Display(s) Of A Remote Computer
US20100218113A1 (en) * 2009-02-25 2010-08-26 Oracle International Corporation Flip mobile list to table
US20100302278A1 (en) * 2009-05-28 2010-12-02 Apple Inc. Rotation smoothing of a user interface

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060062362A1 (en) * 2004-09-22 2006-03-23 Davis Franklin A System and method for server assisted browsing
US20090207184A1 (en) * 2008-02-14 2009-08-20 Nokia Corporation Information Presentation Based on Display Screen Orientation
US20100115020A1 (en) * 2008-10-31 2010-05-06 Hochmuth Roland M Saving A Layout Of Display(s) Of A Remote Computer
US20100218113A1 (en) * 2009-02-25 2010-08-26 Oracle International Corporation Flip mobile list to table
US20100302278A1 (en) * 2009-05-28 2010-12-02 Apple Inc. Rotation smoothing of a user interface

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120185543A1 (en) * 2011-01-18 2012-07-19 Samsung Electronics Co., Ltd. Apparatus and method for sharing information on a webpage
US20120226992A1 (en) * 2011-03-04 2012-09-06 Sony Corporation Remote user interface media adapter in network bridge
US8990704B2 (en) * 2011-03-04 2015-03-24 Sony Corporation Remote user interface media adapter in network bridge
US20120299811A1 (en) * 2011-05-27 2012-11-29 Sony Corporation Transferring rui from one device to another
US8769110B2 (en) * 2011-05-27 2014-07-01 Sony Corporation Transferring RUI from one device to another
US20150193187A1 (en) * 2014-01-08 2015-07-09 Samsung Electronics Co., Ltd. Method and apparatus for screen sharing
US10121449B2 (en) * 2014-01-08 2018-11-06 Samsung Electronics Co., Ltd. Method and apparatus for screen sharing

Also Published As

Publication number Publication date
KR20110069991A (en) 2011-06-24
EP2336995A3 (en) 2014-01-15
EP2336995A2 (en) 2011-06-22

Similar Documents

Publication Publication Date Title
US20110154205A1 (en) Rui server, rui client and control method thereof
EP1655665B1 (en) Method and system for identifying a device on a universal plug and play network and playing content using the device
JP5916822B2 (en) Apparatus and method for interface between remote user interface server and remote user interface client
US9158395B2 (en) Method and system for controlling other devices using a remote user interface
JP6564770B2 (en) System, method, and medium for presenting media content
US10008108B2 (en) Method and apparatus for controlling home network system using mobile terminal
US20070258718A1 (en) Method and system for extending internet protocol remote control to non-internet protocol devices
US7991873B2 (en) UI display apparatus and method for displaying, on a screen, an icon representing a device connected to a network
US9137292B2 (en) Remote management of DLNA system
KR100781508B1 (en) Method for providing user-adapted service environment and apparatus for the same
US20110119713A1 (en) Display apparatus, client terminal and control method thereof
US20110126231A1 (en) Mobile device, av device and method of controlling the same
EP2530947A2 (en) Apparatus and method for performing web browsing using remote controller
JP2009146146A (en) Information processor and home network system
JPH10191463A (en) Electric device and its control method
AU2010306890A1 (en) Smartphone to control internet TV system
US20070078987A1 (en) Multi-mode remote user interface server
US20120233552A1 (en) Personalizing the user experience
JPWO2012169157A1 (en) Supported device, support device, inter-device guide system, recording medium, and integrated circuit
AU2011314469B2 (en) Method and apparatus for accessing device based on intuitive selection
US20100042678A1 (en) Method and apparatus for providing/receiving user interface using user interface directory
EP2464137A2 (en) Display apparatus and contents searching method thereof
KR20130114475A (en) Image display apparatus and method for operating the same
JP2015106827A (en) Electronic apparatus and video display method thereof, and video display program
CN103607625A (en) A system realizing multi-screen cooperation based on a hypertext markup language and a method thereof

Legal Events

Date Code Title Description
AS Assignment

Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KIM, DONG-UK;KANG, EUN-JUNG;REEL/FRAME:025140/0690

Effective date: 20101001

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION