EP2248039A2 - Umschaltung zwischen anwendungsanzeigen - Google Patents

Umschaltung zwischen anwendungsanzeigen

Info

Publication number
EP2248039A2
EP2248039A2 EP09712355A EP09712355A EP2248039A2 EP 2248039 A2 EP2248039 A2 EP 2248039A2 EP 09712355 A EP09712355 A EP 09712355A EP 09712355 A EP09712355 A EP 09712355A EP 2248039 A2 EP2248039 A2 EP 2248039A2
Authority
EP
European Patent Office
Prior art keywords
auxiliary display
bridge
information
look
host
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP09712355A
Other languages
English (en)
French (fr)
Other versions
EP2248039A4 (de
Inventor
Itay Sherman
Eyal Bychkov
Yaron Segalov
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Modu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Modu Ltd filed Critical Modu Ltd
Publication of EP2248039A2 publication Critical patent/EP2248039A2/de
Publication of EP2248039A4 publication Critical patent/EP2248039A4/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/12Use of codes for handling textual entities
    • G06F40/14Tree-structured documents
    • G06F40/143Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/452Remote windowing, e.g. X-Window System, desktop virtualisation

Definitions

  • the field of the present invention is electronic devices that are coupled together in a multi-source system.
  • a standalone device is generally fully operative by itself, and can be selectively configured by a user.
  • the SAD may or may not have its own user interface for setting its configuration.
  • an external host such as a PC computer, is used to configure the SAD. Selection of a configuration generally affects functionality of the SAD, since different configurations correspond to different features.
  • the driver method is used in cases where a user runs an application that controls the client behavior from a PC host, such as an MP3 player connected to a PC computer.
  • the host SAD is loaded at the time of connecting the host with the client, or pre-loaded beforehand, with a software stack referred to as a "driver".
  • the driver instructs the host how to send commands to the client.
  • Drivers may be implemented at different software levels, from low level operating system (OS) drivers to application level drivers with user interfaces.
  • a host SAD loaded with a driver is able to control the client SAD, and to configure operations of the client SAD using a communication channel between the host and the client.
  • OS operating system
  • the screen method is used in cases where a user browses a configuration screen at a designated IP address, such as a router or a printer connected to a PC computer. According to the screen method, the host SAD displays a graphics screen that includes information transferred from the client SAD. The host itself is unaware of the content displayed on its screen to the user, or of the actions performed by the user.
  • the screen method generally uses internal browsers that are installed in host SADs, and obviates the need for OEMs to develop their own dedicated OS drivers.
  • a look & feel refers to visual elements that are presented in a user interface, and include inter alia font, background color, menu design, position and shape of buttons and other controls, and arrangement of various options.
  • aspects of the present invention overcome drawbacks of conventional multi- source systems, and provide methods and systems for inter-connecting two or more SADs that communicate with one another, in such a way as to maintain a unified user interface look & feel.
  • a user experiences the same-looking interface when he switches from a host configuration screen to a client configuration screen. Both screens have the same look & feel, and a client SAD appears transparent to the user and does not appear as a foreign device.
  • a client SAD is aware of the specific host SAD connected thereto, and adapts its screen graphics to the host's user interface. As such, the same user interface displays both host and client configurations and a unified look & feel is maintained.
  • the present invention is of particular advantage with multi-source systems where a client SAD is connected to one of multiple host SAD's. Methods of the present invention ensure that the user experiences a homogenous look & feel in each host SAD source, when he navigates from the host configuration screen to the client configuration screen.
  • the present invention provides methods and systems for on-line configuration of controlled software, which flexibly support a client connected to one of multiple hosts yet retain the same operational control over the client, and which adapt the look & feel so as to integrate the client control software in the host software environment in a homogeneous way.
  • a host SAD is used to configure the multi-source system, and the host user interface is maintained as a fixed point of reference for the user. Adaptation to the host user interface is carried out in each client SAD.
  • the present invention is advantageous for a network of auxiliary display devices connected to a computer.
  • the present invention introduces a bridge device that displays information on the bridge device screen according to the look & feel of auxiliary display devices connected thereto.
  • the present invention enhances the SideShowTM architecture of Microsoft, by enabling a bridge device to display a plurality of display device's information, and by enabling one display device to display another display device's information, with the look & feel of the other display device.
  • a bridge system for auxiliary display devices connected to a computer including a computer running a plurality of mini-programs, each mini-program sending information of a specific nature from the computer to a corresponding auxiliary display device, for presentation to a user, a plurality of auxiliary display devices, each auxiliary display device including an auxiliary screen and each auxiliary display device having look & feel display parameters, for receiving information from the corresponding plurality of mini-programs, and for displaying the received information on the auxiliary screens according to the corresponding look & feel parameters, and at least one bridge device coupled to the computer, each bridge device coupled to at least one of the auxiliary display devices, each bridge device including a bridge screen, and each bridge device receiving information from a corresponding at least one of the mini-programs, forwarding the received information to the at least one of the auxiliary display devices, and displaying the received information on the bridge screen according to the look & feel display parameters of the at least one of the auxiliary display devices.
  • a method for managing auxiliary display devices connected to a computer including receiving XML information of a specific nature from a mini-program running on a computer, and receiving look & feel parameters from an auxiliary display device that displays information in a display format conforming to the look & feel parameters, for presentation to a user, transforming the XML information to a BMP image conforming to the look & feel parameters of the auxiliary display device, transmitting the BMP image to the auxiliary display device for presentation to the user, receiving an indication of an action performed by the user on the auxiliary display device in response to viewing the BMP image, generating a second BMP image based on the received indication, conforming to the look & feel parameters of the auxiliary display device, and further transmitting the second BMP image to the auxiliary display device for further presentation to the user.
  • a method for managing auxiliary display devices connected to a computer including receiving XML information of a specific nature from a mini-program running on a computer, and receiving look & feel parameters from an auxiliary display device that displays information in a display format conforming to the look & feel parameters, for presentation to a user, transforming the XML information to a BMP image conforming to the look & feel parameters of the auxiliary display device, transmitting the BMP image to the auxiliary display device for presentation to the user, receiving additional XML information from the mini-program, generating a second BMP image based on the additional XML information, conforming to the look & feel parameters of the auxiliary display device, and further transmitting the second BMP image to the auxiliary display device for further presentation to the user.
  • FIGS. IA and IB, FIGS. 2A and 2B, and FIGS. 3 A and 3B are displays of various configuration screens for a host SAD and a client SAD connected together within a multi- source system, wherein the host and client screens are controlled so as to have the same look & feel, in accordance with an embodiment of the present invention
  • FIG. 4 is a simplified block diagram of a multi-source system with a uniform interface for configuring a host and a client, in accordance with an embodiment of the present invention
  • FIGS. 5A, 5B and 5C are simplified flowcharts of three embodiments of a method for controlling a configuration interface for a client SAD so as to conform to the look & feel of a configuration interface for a host SAD, in accordance with an embodiment of the present invention
  • FIG. 6 is an illustration of button keys for a multi-source system that have different key assignments for host mode and client mode, but a common look & feel user interface for setting host and client configuration parameters, in accordance with an embodiment of the present invention
  • FIG. 7 is a prior art block diagram of auxiliary display devices connected to a computer
  • FIG. 8 is a simplified block diagram of auxiliary display devices and bridge devices connected to a computer, in accordance with an embodiment of the present invention.
  • FIG. 9 is a simplified flow chart of a method for generating a display on a bridge device according to look & feel parameters of an auxiliary display device.
  • FIG. 10 is a simplified flow chart of a method for a client to control the display information sent to it by a host, in accordance with an embodiment of the present invention.
  • aspects of the present invention relate to multi-source systems with interconnected standalone devices (SADs), where one of the SADs serves as a host device, and is used to configure itself and to configure the client devices in the system.
  • the client devices adapt the look & feel of their configuration screens so as to conform to the look & feel of the host configuration screen.
  • the host interface look & feel thereby serves as a fixed and familiar point of reference for a user of the multi-source system.
  • the look & feel of an interface relates to visual elements that a user experiences when he interacts with the interface.
  • the look & feel includes inter alia: • screen size (pixel width and height);
  • background color and background pattern e.g., BMP or JPG image, or multiple images for animation
  • menu type e.g., scroll with items selected marked by highlight or zoom
  • transitional entry effects e.g., flip, zoom
  • screen and button topology e.g., location of specific buttons on the screen, such as the X button at the top-right corner of a window for closing the window
  • menu topology e.g., location of items in a specific menu
  • screen template e.g., usage and position of general progress keys, such as Next, Back, Cancel and Enter.
  • look & feel parameters may be defined in an XML document.
  • Such an XML document make, for example, take the form provided below.
  • FIGS. IA and IB 5 FIGS. 2A and 2B, and FIGS. 3 A and
  • FIG. IA is a media player, such as an MP3 player
  • the client shown in FIG. IB is a cell phone.
  • Shown in FIG. IA is a sample interface for the host.
  • the screen shown in FIG. IA corresponds to the host configuration screen, before the client is connected to the host, and the screen shown in FIG. IB corresponds to the client configuration screen, after the client is connected to the host. It is noted that both screens have the same look & feel. Specifically, when the client SAD is attached to the host SAD, the font size, type and color remain the same, and the screen size and background color remain the same.
  • the screen template is preserved for two "soft-keys" 110 and 120 and a bar 130 above them that includes their corresponding function names.
  • Soft keys are multifunction keys that use part of a display to identify their function at any moment. Soft-keys are generally located directly below the display.
  • FIG. IA soft keys 110 and 120 correspond respectively to Vol. Up and Vol. Down functions, as indicated by bar 130; and in FIG. IB soft keys 110 and 120 correspond respectively to Call and End functions, respectively, as indicated by bar 130.
  • the host shown in FIG. 2A is a digital camera, and the client shown in FIG. 2B is another electronic device. Shown in FIG. 2A is a sample interface for the host. Again, in accordance with the present invention, the look & feel of FIG. 2B (client configuration) is the same as that of FIG. 2A (host configuration). As may be seen in FIGS. 2A and 2B, the look & feel of the configuration interface includes a left panel 210 and a right panel 220. The left panel 210 is created by the host. When the client is attached to the host, the left panel may be altered by the host. Thus in FIG. 2B the left panel includes a control element 230 in the shape of a star, for toggling between host mode and client mode.
  • the right panel 220 is controlled by the host when the host mode is running, and controlled by the client when the client mode is running. In either case, the content displayed in the right panel conforms to the look & feel parameters for the host.
  • the "look parameters" of the right panel including inter alia the dimensions of the right panel, its background color, its font type, size and color, and its menu header and location, are the same in FIGS. 2 A and 2B.
  • the "feel" parameters of the right panel including inter alia assignment of client options 1, 2 and 3 to corresponding host buttons and the jog dial options, are also the same in FIGS. 2A and 2B.
  • the host shown in FIG. 3 A is a GPS navigator, and the client shown in FIG. 3B is another electronic device. Shown in FIG. 3A is a sample interface for the host. Again, in accordance with the present invention, the look & feel of FIG. 3B (client configuration) is the same as that of FIG. 3 A (host configuration). For example, it is noted that the "X" remains in the top right corner when the client is attached to the host.
  • FIG. 4 is a simplified block diagram of a multi-source system with a uniform interface for configuring a host and a client, in accordance with an embodiment of the present invention. Shown in FIG. 4 is a host SAD
  • Client SAD 450 includes a CPU 460, an optional display 470 and an optional power source 480.
  • Client SAD also includes a configuration program 490, which enables a user to select configuration settings for client
  • Host SAD 400 and client SAD 450 communicate via respective communication modules 405 and 455 over a communication channel 415.
  • Communication channel 415 may be a physical or a wireless channel.
  • Host look & feel parameters 440 are transmitted by communication module 405 over communication channel 415, and received by communication module 455. In turn, the look & feel parameters are transmitted to configuration program 490.
  • Configuration program 490 has a default screen look & feel. In accordance with an embodiment of the present invention, configuration program 490 adapts its look & feel accordingly, so as to conform to look & feel parameters 440 of host SAD 400.
  • Configuration program 490 generates a graphics screen image that conforms to look & feel parameters 440.
  • the graphics screen image is transmitted to communication module 455, which transmits it further to communication module 405 over communication channel 415.
  • the graphics image is then transmitted to host display 420, for display to a user.
  • the commands are transmitted via communication channel 415 back to configuration program 490, which generates successive graphics screen images in response to the user commands.
  • the successive graphics screen images are transmitted to display 420 for further display to the user. Reference is now made to FIG.
  • FIG. 5 A which is a simplified flowchart of a first embodiment of a method for controlling a configuration interface for a client SAD so as to conform to the look & feel of a configuration interface for a host SAD, in accordance with an embodiment of the present invention.
  • the flowchart of FIG. 5A is divided into three columns.
  • the leftmost column indicates steps performed by a user who is operating a multi- source system including the host SAD and the client SAD.
  • the middle column indicates steps performed by the host SAD, and the rightmost column indicates steps performed by the client SAD.
  • the client device is attached to the host device.
  • the host transfers its own look & feel parameters to the client.
  • the host look & feel parameters may be specified in an XML document.
  • the host may also transfer requisite font files, for fonts specified in the look & feel parameters.
  • the client adapts the look & feel of its configuration program according to the host look & feel parameters.
  • the client configuration program
  • I generates a configuration screen, in the form of a bitmap image, that conforms to the look & feel of the host configuration screen.
  • the host receives the bitmap image of the configuration screen from the client, and at step 518 the host displays the bitmap image, which conforms to the host look & feel.
  • the user interface displayed by the host preserves a unified look & feel, even when being used to configure the client.
  • the host displays its own configuration options and the client configuration options on the same screen, and with a common look & feel.
  • the host may display both configurations at the same time, or may switch between host options and client options, but in each case the same visual user interface is presented to the user.
  • the user interacts with the system and issues a command, the response to which may require a change in the display screen.
  • the host sends the client notification of the user command.
  • the client configuration program generates a new bitmap image for a configuration screen, in response to the user command, as appropriate.
  • the host receives the new configuration screen, in the form of the new bitmap image, from the client.
  • the host displays the altered screen, which again conforms to the look & feel of the host. The method then returns to step 521, as the user continues to interact with the system.
  • FIG. 5B which is a simplified flowchart of a second embodiment of a method for controlling a configuration interface for a client SAD so as to conform to the look & feel of a configuration interface for a host SAD, in accordance with an embodiment of the present invention.
  • the flowchart of FIG. 5B is divided into three columns.
  • the leftmost column indicates steps performed by a user who is operating a multi- source system including the host SAD and the client SAD.
  • the middle column indicates steps performed by the host SAD, and the rightmost column indicates steps performed by the client SAD.
  • the method of FIG. 5B uses a web interface for a user to configure the client device.
  • the client device is attached to the host device.
  • the host device transfers is look & feel parameters to the client device.
  • the host may also transfer requisite font files, for fonts specified in the look & feel parameters.
  • the client configuration program sets it parameters according to the host look & feel parameters.
  • the client configuration program generates a web page, which conforms to the host look & feel parameters.
  • the client device uploads the web page to a URL on a web server.
  • the host using a web browser installed therein, browses the URL and renders and displays the web page. Referring back to FIG.
  • host device 400 includes a web browser 445, which browses and renders web pages stored in a web server 495.
  • the web pages are generated by configuration program 490 so as to comply with host look & feel parameters 440, and are uploaded to web server 495.
  • a user who is viewing the web page displayed at step 551 issue a user command.
  • the host sends the user command to the client.
  • the client configuration program generates a new web page, in response to the user command, as appropriate.
  • the client uploads the web page to a URL on the web server.
  • the host browses the URL and renders and displays the new web page. The method then returns to step 554, as the user continues to interact with the system.
  • FIG. 5C is a simplified flowchart of a third embodiment of a method for controlling a configuration interface for a client SAD so as to conform to the look & feel of a configuration interface for a host SAD, in accordance with an embodiment of the present invention.
  • the flowchart of FIG. 5 C is divided into three columns.
  • the leftmost column indicates steps performed by a user who is operating a multi- source system including the host SAD and the client SAD.
  • the middle column indicates steps performed by the host SAD, and the rightmost column indicates steps performed by the client SAD.
  • the client device is attached to the host device.
  • the client transfers its configuration program to the host, thus enabling the host to generate the appropriate user interfaces.
  • the host sets parameters of the client's configuration program corresponding to the host look & feel parameters.
  • the host by itself generates a screen image for client configuration, running the client's configuration program.
  • the host displays the screen image.
  • a user who is viewing and interacting with the user interface issues a command.
  • the host generates a new screen image, in response to the user command, as appropriate, running the client's configuration program.
  • the host displays the new screen image. The method then returns to step 584, as the user continues to interact with the system. It will thus be appreciated by those skilled in the art that the methods of FIGS.
  • 5 A, 5B and 5 C enable a host SAD in a multi-source system to display both host configuration settings and client configuration settings on the host screen, simultaneously, with a uniform look & feel. As such, a user of the system experiences a homogeneous interface, and it is transparent to the user that two different SADs are operating.
  • TABLES IA and IB Shown in TABLES IA and IB are example button key assignments for a host mode and a client mode, respectively, within a multi-source system.
  • TABLES IA and IB correspond to FIGS. IA and IB, respectively, where the host is an MP3 player running in media player mode, and the client is a cell phone running in dialer mode.
  • the buttons of the system are labeled Bl - B 15, together with a TOUCH button on the touch screen displayed with a question mark.
  • the buttons have one assignment of functions in host mode and another assignment of functions in client mode.
  • Button B8, for example, is assigned a play function in TABLE IA, and is assigned a function to enter the numeral "8" in TABLE IB.
  • buttons Bl - B12 correspond to the four rows of three buttons on the keypad, in the order from top left to bottom right.
  • Buttons B13 and B 14 correspond to the soft keys 110 and 120 in FIGS. IA and IB.
  • Button Bl 5 corresponds to the speaker button. It is also noted that buttons B4, B6, B13 and B 14 have dual functions, corresponding to a short duration press and a long duration press. Key-press and key-release events may be analyzed so as to distinguish between long duration short duration presses.
  • the key assignments When running in host mode, the key assignments correspond to media player key assignments, as in TABLE IA. However, when running in client mode, the key assignments correspond to conventional cell phone key assignments, as in TABLE IB. It may be seen from TABLE IA that in host mode, buttons B5 and Bl 5 are not used, and long button presses are not distinguished from short presses.
  • the host key assignments such as shot indicated in TABLE IA, are used. Switching between host mode and client mode niay be performed, for example, using a toggle switch such as control element 230 in FIG. 2B.
  • the client sends the host a list of user functions it supports, such as the various functions indicated in TABLE IB. The host then assigns the functions to buttons, and sends the client the key assignments.
  • the graphic image displayed on the host screen, or a portion of the graphic image that is assigned to the client is generated by the client and transmitted to the host for display.
  • the button press event is sent to the client, and translated by the client according to the key assignment for that button.
  • the client If the user presses a touch screen, then the X-Y coordinates of the press location are send to the client.
  • the client In response, the client generates a new graphic image, conforming to the look & feel parameters that the client received from the host.
  • the new graphic image is transmitted to the host for display, thus completing a cycle of user input and screen display in response to the input. Generally, several such cycles are performed in an interactive session.
  • the host may do the analysis to make the distinction and pass the result (long press or short press) to the client.
  • the host may send the key- press and key-release events to the client, and the client then determines the type of press (long or short) from these events.
  • FIG. 7 is a prior art block diagram of auxiliary display devices connected to a computer. Shown in FIG. 7 is a computer 710 with an input device 720 such as a keyboard or mouse. Computer 710 is connected to multiple auxiliary display devices 731 - 739. Each auxiliary display device is used to display information stored on computer 710, such as e-mail messages, calendar reminders, or such other notifications.
  • Auxiliary display devices 731 — 739 include inter alia mobile phones, GPS navigators, remote controls with built-in screens, keyboards with built- in screens, wearable display devices, music players, digital picture frames, game stations, home entertainment systems, and such other consumer electronic (CE) devices.
  • CE consumer electronic
  • An auxiliary display device may be embedded within computer 710, such as an in-lid attached laptop display.
  • An auxiliary display device may be a separate peripheral device connected to computer 710 by a wired or wireless connection, including inter alia USB, Bluetooth, TCP/IP or other such data communication protocols, existing now or to be developed in the future.
  • An auxiliary display device may also be a designated area within a main screen of computer 710.
  • Such gadgets include (i) a calendar gadget that periodically retrieves data from a calendar application such as Microsoft Outlook ® , and sends the data to an auxiliary display device, (ii) a weather gadget that retrieves data from a web service and updates an auxiliary display device with weather information in designated locales, and (iii) an instant messaging gadget that provides presence information regarding a user's buddies on an auxiliary display device.
  • auxiliary display devices 731 - 739 require that auxiliary display devices 731 - 739 be able to interpret the Simple Content Format (SCF) and, optionally the iCalendar data format.
  • SCF defines a set of XML elements and attributes that allow content, dialog and menu pages to be sent to auxiliary devices 731 - 739.
  • SCF enables extended custom content types to be defined.
  • Auxiliary display devices 731 - 739 may be powered even when computer 710 is in a low-power mode such as standby mode or hibernate mode.
  • Auxiliary display devices 731 - 739 behave as client devices, which receive their data from their corresponding gadgets running on computer 710, which behaves as a host. This is indicated in FIG. 7 by referring to display devices 731 - 739 as client #1 - client #9, respectively, and by referring to computer 710 as host computer.
  • the designation of a device as host or client in FIG. 7 relates to the display of information.
  • a host device sends display information to a client device, which the client device displays on its screen.
  • Display devices 731 - 739 do not manipulate data that they display, and such data remains within the auxiliary display devices and is not transmitted elsewhere. Moreover, if an auxiliary display device has an internal application, then such application is not shared with other devices. As such, display devices 731 - 739 are dumb terminals.
  • FIG. 8 is a simplified block diagram of auxiliary display devices and bridge devices connected to a computer, in accordance with an embodiment of the present invention. Shown in FIG. 8 is a computer 810 with an input device 820 such as a keyboard or mouse, and auxiliary display devices 831 - 839. FIG. 8 also includes two devices 841 and 842, referred to as bridges, with respective input devices 851 and 852.
  • Bridges 841 and 842 are connected directly to computer 810 and connected directly to one another.
  • Auxiliary display devices are arranged so that devices 831 - 833 are connected to bridge 841, device 834 - 836 are connected to bridge 842, and devices 837 — 839 are connected directly to computer 810.
  • Bridges own two types of gadgets; namely, (i) gadgets generated from their own internal running applications, and (ii) gadgets inherited from other devices.
  • bridge 841 owns its own gadgets, as well as gadgets inherited from host computer 810 and from bridge 842.
  • Auxiliary display devices generally do not own gadgets, and can only display information from gadgets that are presented to them.
  • Bridge devices 841 and 842 combine capabilities of host computer 810 and client devices 831 - 839. As clients, bridge devices 841 and 842 receive display information from other devices and present the display information on their own screens. As hosts, bridge devices 841 and 842 act as source of display information for display on client device screens. For example, bridge 841 may receive display information from computer 810 or from clients 842 and 843 and display such information on its own screen; and conversely, bridge 841 may transmit display information to computer 810 or to clients 842 and 843 for display on their screens. Display information transmitted by bridge 841 may be generated by bridge 841 be internal applications running on device 841, or may be information received from other devices. Moreover, bridge 841 can combine display information that is generates from its internal applications with display information that it receives from remote devices, the latter referred to as "inherited notifications", so as to create single display information for devices that connect to bridge 841.
  • computer 810 connects to bridges 841 and 842 via wireless links.
  • display information is rendered as a bitmap image, it is cumbersome to transmit bitmap images over wireless links, due to their large sizes.
  • computer 810 transmits display information to bridges 841 and 842 in a compressed XML format.
  • Auxiliary display devices 831 - 839 generally have limited CPU power and limited software resources, and may only support simpler data, such as BMP image data.
  • bridges 841 and 842 transform the display information they receive in compressed XML format to a BMP format, for forwarding to display devices 831 - 839.
  • such transformation uses look & feel parameters appropriate to each corresponding display device, as described hereinabove with reference to FIGS. 5A - 5C.
  • the XML -> BMP transformation performed by bridges 841 and 842 uses configuration information provided by each corresponding target display device, such as the sample XML document described hereinabove, in transforming the compressed XML data to a BMP image for the target display device.
  • Bridges 841 and 842 may split their displays to include both display information provided by computer 810, as well as display information generated from internal applications running on bridges 841 and 842.
  • each bridge device maintains an assignment table that holds data defining which devices owns which gadget and which client performs an operation that requires a change of display.
  • General notifications such as a new e-mail message transmitted by an e-mail gadget, are distributed to all clients 831 - 839 that use this e-mail gadget.
  • TABLE II is a sample assignment table maintained by bridge, device 841.
  • FIG. 9 is a simplified flow chart of a method for generating a display on a bridge device according to look & feel parameters of an auxiliary display device.
  • a user connects a bridge, such as bridge 841, to an auxiliary display device, such as client 831, and to a PC computer, such as computer 810.
  • the bridge receives look & feel configuration parameters from client 831, and XML display information from the gadget installed on computer 810 for device 831.
  • the bridge transforms the XML display information along with display information generated by applications internal to the bridge, to generate a BMP image for display on the client device, wherein the BMP image conforms to the client device's look & feel parameters.
  • the client device displays the BMP image received from the bridge on its client screen.
  • the user interacts with the client device and performs an action that requires a change in display.
  • a notification is received from the gadget for device 831.
  • the method proceeds to step 930 where the bridge generates a new BMP accordingly, as appropriate.
  • the cycle of user interaction/new notifications ⁇ --> new BMP image continues.
  • each host device in FIG. 8 may define which gadgets it wishes to expose to devices connected to it. The host device further designates whether each connected device either (i) has permission to further export the gadget display information to devices that are connected to it, or else (ii) is limited to displaying the gadget display information only on its own display.
  • Such an extended display configuration is set up using a utility presented to the user referred to herein as a gadget configuration utility, or as a "gadget configuration gadget".
  • a bridge device such as bridge 841 is a host and, as such has its own gadget configuration utility.
  • the bridge presents the user with bridge internal applications that generate display information, and gadgets provided by hosts connected to the bridge, for those gadgets for which the bridge is permitted to forward their display information.
  • bridge 841 presents the user with its internal applications that generate display information, and with those gadgets for host 810 and bridge 842, for which host 810 and bridge 842 are permitted to forward the gadget's display information to bridge 841.
  • a client such as auxiliary display device 831
  • a host may define its own configuration utility as a gadget, which in turn enables the client to control the display information sent to it by the host.
  • FIG. 10 is a simplified flow chart for a method for a client to control the display information sent to it by a host, in accordance with an embodiment of the present invention.
  • a host device arranges its self-owned (internal) gadgets and its inherited (external) gadgets into a gadget configuration gadget.
  • the host device's gadget configuration gadget is sent to client auxiliary displays.
  • a user of the client selects desired gadgets in a configuration display window.
  • the user's selections are sent to the host, which alters its data content accordingly, and sends requested notifications to the client.
  • auxiliary display devices 834 - 836 display gadgets on host computer 810, on bridge 841 and on bridge 842, via bridge 842; and at step 1030 the user can select some or all of these gadgets.
  • auxiliary display devices as bridges
  • client devices in prior art architectures behave as passive isolated displays.
  • client 831 is a GPS device
  • client 832 is an audio player
  • client 833 is a mobile phone
  • each client device 831, 832 and 833 is able to review the other clients' displays.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Digital Computer Display Output (AREA)
EP09712355.8A 2008-02-19 2009-02-19 Umschaltung zwischen anwendungsanzeigen Withdrawn EP2248039A4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US6617908P 2008-02-19 2008-02-19
PCT/IL2009/000193 WO2009104185A2 (en) 2008-02-19 2009-02-19 Application display switch

Publications (2)

Publication Number Publication Date
EP2248039A2 true EP2248039A2 (de) 2010-11-10
EP2248039A4 EP2248039A4 (de) 2013-06-12

Family

ID=40954653

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09712355.8A Withdrawn EP2248039A4 (de) 2008-02-19 2009-02-19 Umschaltung zwischen anwendungsanzeigen

Country Status (3)

Country Link
US (1) US9448814B2 (de)
EP (1) EP2248039A4 (de)
WO (1) WO2009104185A2 (de)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8316308B2 (en) 2007-06-08 2012-11-20 Google Inc. Adaptive user interface for multi-source systems
US8457118B2 (en) 2010-05-17 2013-06-04 Google Inc. Decentralized system and method for voice and video sessions
US8599105B2 (en) 2010-07-02 2013-12-03 Nokia Corporation Method and apparatus for implementing a multiple display mode
CN108845782B (zh) 2012-09-10 2021-11-30 三星电子株式会社 连接移动终端和外部显示器的方法和实现该方法的装置
US20140075377A1 (en) 2012-09-10 2014-03-13 Samsung Electronics Co. Ltd. Method for connecting mobile terminal and external display and apparatus implementing the same
US9769227B2 (en) 2014-09-24 2017-09-19 Microsoft Technology Licensing, Llc Presentation of computing environment on multiple devices
US10448111B2 (en) 2014-09-24 2019-10-15 Microsoft Technology Licensing, Llc Content projection
US10025684B2 (en) 2014-09-24 2018-07-17 Microsoft Technology Licensing, Llc Lending target device resources to host device computing environment
US10635296B2 (en) 2014-09-24 2020-04-28 Microsoft Technology Licensing, Llc Partitioned application presentation across devices

Family Cites Families (97)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU690099B2 (en) 1993-03-04 1998-04-23 Telefonaktiebolaget Lm Ericsson (Publ) Modular radio communications system
US5625673A (en) 1994-09-22 1997-04-29 Lucent Technologies Inc. Modular communication apparatus
US5893037A (en) 1994-12-09 1999-04-06 Eastman Kodak Company Combined electronic/silver-halide image capture system with cellular transmission capability
US5907815A (en) 1995-12-07 1999-05-25 Texas Instruments Incorporated Portable computer stored removable mobile telephone
FI111309B (fi) 1996-01-03 2003-06-30 Nokia Corp Tietoliikenneverkkoon radioteitse liitettävä päätelaite
JP3345019B2 (ja) * 1996-03-29 2002-11-18 松下電器産業株式会社 インタラクティブな再生進行の性能を向上させた記録媒体の記録方法、再生装置および再生方法
JP3098455B2 (ja) 1997-05-14 2000-10-16 邦彦 小池 携帯電話機
JP3048964B2 (ja) 1997-06-24 2000-06-05 邦彦 小池 電話送受信ユニット及び移動体通信端末
US6847334B2 (en) * 1998-06-29 2005-01-25 William Hayhurst Mobile telecommunication device for simultaneously transmitting and receiving sound and image data
US6300947B1 (en) 1998-07-06 2001-10-09 International Business Machines Corporation Display screen and window size related web page adaptation system
US6188917B1 (en) 1998-09-16 2001-02-13 Nokia Mobile Phones Limited Portable telecommunications assembly having user hand-hold, and associated method
US6934461B1 (en) * 1999-01-05 2005-08-23 Interval Research Corporation Low attention recording, with particular application to social recording
US6690947B1 (en) 1999-03-25 2004-02-10 Kantan Inc. Methods and apparatus for a flexible wireless communication and cellular telephone system
US6516202B1 (en) 1999-08-12 2003-02-04 Handspring, Inc. Mobile computer system designed for wireless communication expansion
US7194752B1 (en) * 1999-10-19 2007-03-20 Iceberg Industries, Llc Method and apparatus for automatically recognizing input audio and/or video streams
US7020704B1 (en) * 1999-10-05 2006-03-28 Lipscomb Kenneth O System and method for distributing media assets to user devices via a portal synchronized by said user devices
US6760415B2 (en) 2000-03-17 2004-07-06 Qwest Communications International Inc. Voice telephony system
US6477357B1 (en) 2000-03-24 2002-11-05 Qwest Communications International, Inc. Customizable wireless device having stackable modules
US6898283B2 (en) 2000-05-05 2005-05-24 Nokia Mobile Phones Ltd. Exchangable housing cover for a portable radio communication device
WO2001096995A1 (fr) * 2000-06-07 2001-12-20 Mitsumi Electric Co., Ltd. Dispositif d'interface, dispositif d'interface usb pour equipement electronique et equipement electronique pourvu d'un mecanisme d'interface
US7058356B2 (en) * 2000-06-15 2006-06-06 Benjamin Slotznick Telephone device with enhanced audio-visual features for interacting with nearby displays and display screens
US6834192B1 (en) * 2000-07-03 2004-12-21 Nokia Corporation Method, and associated apparatus, for effectuating handover of communications in a bluetooth, or other, radio communication system
US6907264B1 (en) 2000-08-09 2005-06-14 Lucent Technologies Inc. Methods and apparatus for modularization of real time and task oriented features in wireless communications
US6640113B1 (en) 2000-09-08 2003-10-28 Mobigence, Inc. Touch sensitive display integrated with a handheld radiotelephone
US20020090980A1 (en) 2000-12-05 2002-07-11 Wilcox Russell J. Displays for portable electronic apparatus
US20020151327A1 (en) 2000-12-22 2002-10-17 David Levitt Program selector and guide system and method
US7277927B2 (en) 2001-04-13 2007-10-02 Earthlink, Inc. Systems and methods for saving internet content into a handheld internet appliance
US6798647B2 (en) 2001-07-16 2004-09-28 Hewlett-Packard Development Company, L.P. Portable computer with integrated PDA I/O docking cradle
US6999792B2 (en) 2001-09-20 2006-02-14 Peter Warren Input-output device with universal phone port
US7747338B2 (en) * 2006-08-18 2010-06-29 Xerox Corporation Audio system employing multiple mobile devices in concert
US7324857B2 (en) * 2002-04-19 2008-01-29 Gateway Inc. Method to synchronize playback of multicast audio streams on a local network
US7577462B2 (en) 2002-05-29 2009-08-18 Khyber Technologies Corporation Portable data entry device with a detachable host PDA
US7085542B2 (en) 2002-05-30 2006-08-01 Motorola, Inc. Portable device including a replaceable cover
IL153183A (en) * 2002-06-04 2010-05-17 Aposense Ltd Agents for imaging and diagnostic methods using them
US7280650B2 (en) * 2002-08-28 2007-10-09 Intel Corporation Method and apparatus to manage a conference
US20040052501A1 (en) * 2002-09-12 2004-03-18 Tam Eddy C. Video event capturing system and method
US7477919B2 (en) * 2002-09-19 2009-01-13 Peter Warren Handheld input/output device providing enhanced user interface for a mobile telephone
US7275244B1 (en) 2003-03-18 2007-09-25 Microsoft Corporation System and method for incrementally saving web files to a web server using file hash values
US20040233930A1 (en) 2003-05-19 2004-11-25 Modular Computing & Communications Corporation Apparatus and method for mobile personal computing and communications
US7571014B1 (en) * 2004-04-01 2009-08-04 Sonos, Inc. Method and apparatus for controlling multimedia players in a multi-zone system
US7194259B2 (en) 2003-09-05 2007-03-20 Sony Ericsson Mobile Communications Ab Remote control device having wireless phone interface
US7515937B2 (en) * 2003-09-25 2009-04-07 Lee Joseph C Wafer mobile phone platform system
US20050091359A1 (en) * 2003-10-24 2005-04-28 Microsoft Corporation Systems and methods for projecting content from computing devices
US7146191B2 (en) 2004-01-16 2006-12-05 United States Thermoelectric Consortium Wireless communications apparatus and method
US10417298B2 (en) 2004-12-02 2019-09-17 Insignio Technologies, Inc. Personalized content processing and delivery system and media
AU2004201587B2 (en) * 2004-04-16 2006-04-27 Forge Research Pty Limited A system and method for representation of business information
US20060003804A1 (en) 2004-05-25 2006-01-05 Unication Co., Ltd. Radio signal relaying apparatus
US20050276570A1 (en) 2004-06-15 2005-12-15 Reed Ogden C Jr Systems, processes and apparatus for creating, processing and interacting with audiobooks and other media
US20060031878A1 (en) * 2004-07-30 2006-02-09 Pulitzer J H Method of delivering synchronized content to an A/V telecommunication device
US20060033809A1 (en) * 2004-08-10 2006-02-16 Mr. Jim Robinson Picture transmission and display between wireless and wireline telephone systems
KR100582888B1 (ko) * 2004-09-22 2006-05-25 삼성전자주식회사 정보 공유가 가능한 호스트 기기 및 주변기기, 그의문자정보 공유 방법 및 문자정보 공유 시스템
US8719874B2 (en) * 2004-09-28 2014-05-06 Sony Corporation System and method of streaming audio from a common video device
US7409022B2 (en) * 2004-10-01 2008-08-05 Mitsubishi Electric Research Laboratories, Inc. Synchronizing clocks in wireless personal area networks
US7634780B2 (en) * 2004-11-23 2009-12-15 Microsoft Corporation Method and system for exchanging data between computer systems and auxiliary displays
WO2006068003A1 (ja) 2004-12-24 2006-06-29 Masahiro Izutsu 携帯情報通信装置、携帯情報通信装置用接続ユニット及び携帯情報通信装置用外部入出力ユニット
US20060190321A1 (en) 2004-12-27 2006-08-24 Martins Nicho Eurico P Method and computing system for games, lottery and/or advertising campaign events using SMS or multimedia messages
US7784065B2 (en) * 2005-02-07 2010-08-24 Microsoft Corporation Interface for consistent program interaction with auxiliary computing devices
JP4693466B2 (ja) 2005-04-06 2011-06-01 東芝ソリューション株式会社 レポートチェック装置、レポート作成装置、記憶媒体、プログラム
US9031907B2 (en) 2005-04-19 2015-05-12 Blackberry Limited Integration of push services with applications
US20060242590A1 (en) * 2005-04-21 2006-10-26 Microsoft Corporation Simple content format for auxiliary display devices
US20070004450A1 (en) * 2005-06-30 2007-01-04 Parikh Jay G Mobile handheld electronic device with a removable cellphone
US7285067B2 (en) * 2005-06-30 2007-10-23 Fisher Dynamics Corporation Rotary recliner
US20080152165A1 (en) * 2005-07-01 2008-06-26 Luca Zacchi Ad-hoc proximity multi-speaker entertainment
KR100630190B1 (ko) 2005-07-22 2006-10-02 삼성전자주식회사 이동 통신 단말의 기본화면 설정 방법
US20070053653A1 (en) * 2005-09-06 2007-03-08 Opentv, Inc. Method and system to control operation of a media playback device
US8494491B2 (en) 2005-09-28 2013-07-23 Research In Motion Limited System and method for provisioning a mobile wireless communications device to display account or device-specific characteristics
US20070079030A1 (en) 2005-09-30 2007-04-05 Intel Corporation Auxiliary display and storage unit
JP4118294B2 (ja) 2005-10-18 2008-07-16 株式会社ウィルコム 移動通信用の無線通信モジュール
US20070139514A1 (en) 2005-12-19 2007-06-21 Marley Robert P Television set-top video phone system
US20070195158A1 (en) 2006-02-23 2007-08-23 Kies Jonathan K Apparatus and methods for managing video calls on a wireless device
US20070226734A1 (en) 2006-03-03 2007-09-27 Microsoft Corporation Auxiliary display gadget for distributed content
KR100754210B1 (ko) * 2006-03-08 2007-09-03 삼성전자주식회사 복수개의 유무선 통신 기기를 이용한 다채널 음악 재생방법 및 장치
US20080019522A1 (en) * 2006-06-21 2008-01-24 Motorola, Inc. Method For Managing A Communication Session in a Communication Network
US20080009325A1 (en) 2006-07-10 2008-01-10 Research In Motion Limited Menu interface for mobile communications device
KR100761698B1 (ko) * 2006-07-12 2007-09-28 삼성전자주식회사 이동통신단말기에서 동기화 장치 및 방법
TW200805111A (en) * 2006-07-14 2008-01-16 Asustek Comp Inc Method for controlling the function of application software and computer readable recording medium for storing program thereof
US7894511B2 (en) * 2006-07-21 2011-02-22 Motorola Mobility, Inc. Multi-device coordinated audio playback
US7657227B2 (en) * 2006-08-03 2010-02-02 International Business Machines Corporation Method and system for dynamic display connectivity based on configuration information via RFID tag
US8887040B2 (en) 2006-08-10 2014-11-11 Qualcomm Incorporated System and method for media content delivery
US20080056285A1 (en) * 2006-08-29 2008-03-06 Quinn Liam B Method and system for connecting wireless personal area network (WPAN) devices through display systems
US7603385B2 (en) * 2006-11-20 2009-10-13 Microsoft Corporation Device constellation management
JP2008172766A (ja) * 2006-12-13 2008-07-24 Victor Co Of Japan Ltd 電子機器の制御方法及び制御装置
US20080168368A1 (en) * 2007-01-07 2008-07-10 Louch John O Dashboards, Widgets and Devices
WO2008099384A2 (en) * 2007-02-13 2008-08-21 Modu Ltd. Modular wireless communicator
US9301339B2 (en) * 2007-03-01 2016-03-29 Broadcom Corporation Method and system for multiple HCI transport for bluetooth host controllers
US8316308B2 (en) * 2007-06-08 2012-11-20 Google Inc. Adaptive user interface for multi-source systems
GB0712879D0 (en) * 2007-07-03 2007-08-08 Skype Ltd Video communication system and method
US8655266B2 (en) * 2007-12-17 2014-02-18 Cisco Technology, Inc. System and method for using mobile media players in a peer-to-peer network
US20090210491A1 (en) * 2008-02-20 2009-08-20 Microsoft Corporation Techniques to automatically identify participants for a multimedia conference event
US20090286570A1 (en) * 2008-05-15 2009-11-19 Sony Ericsson Mobile Communications Ab Portable communication device and method of processing embedded visual cues
US8254905B2 (en) * 2008-07-07 2012-08-28 Cisco Technology, Inc. Service monitoring and disconnection notification in a wireless gateway device
US20100041330A1 (en) * 2008-08-13 2010-02-18 Sony Ericsson Mobile Communications Ab Synchronized playing of songs by a plurality of wireless mobile terminals
US8463875B2 (en) * 2009-08-20 2013-06-11 Google Inc. Synchronized playback of media players
US8451312B2 (en) * 2010-01-06 2013-05-28 Apple Inc. Automatic video stream selection
US8949346B2 (en) * 2010-02-25 2015-02-03 Cisco Technology, Inc. System and method for providing a two-tiered virtual communications architecture in a network environment
US8457118B2 (en) * 2010-05-17 2013-06-04 Google Inc. Decentralized system and method for voice and video sessions
US20120314777A1 (en) * 2011-06-13 2012-12-13 Ati Technologies Ulc Method and apparatus for generating a display data stream for transmission to a remote display

Also Published As

Publication number Publication date
WO2009104185A2 (en) 2009-08-27
EP2248039A4 (de) 2013-06-12
US20090207097A1 (en) 2009-08-20
US9448814B2 (en) 2016-09-20
WO2009104185A3 (en) 2010-03-11

Similar Documents

Publication Publication Date Title
US10402076B2 (en) Adaptive user interface for multi-source systems
US9448814B2 (en) Bridge system for auxiliary display devices
US10613701B2 (en) Customizable bladed applications
CN102725727B (zh) 用于在外围计算机装置上提供应用程序接口部分的方法和设备
JP2007011531A (ja) インタフェース制御プログラム、インタフェース制御方法、インタフェース制御装置、プラグインプログラム
KR101803906B1 (ko) 복수의 플랫폼이 설치된 화상형성장치 및 그 어플리케이션 실행 방법
EP2790142A1 (de) Endgerätevorrichtung, Server und Steuerverfahren
US20020078445A1 (en) Internet appliance for interactive audio/video display using a remote control unit for user input
CN102203712B (zh) 信息处理装置和信息处理方法
JP5448344B2 (ja) 情報処理装置およびプログラム
CN111787117A (zh) 数据传输方法及显示设备
CN111782606A (zh) 显示设备、服务器和文件管理方法
CN111787115B (zh) 服务器、显示设备和文件传输方法
CN119364094B (zh) 一种显示设备和基于本机按键的控制方法
CN118283374A (zh) 一种显示设备及基于虚拟按键的控制方法
CN117707363A (zh) 显示设备和应用程序窗口显示方法
JP2007249370A (ja) 表示制御装置、情報処理装置、表示制御方法及び表示制御プログラム
CN105320400A (zh) 管理电子装置虚拟控制界面的方法及其装置
CN114296665A (zh) 显示设备及外接设备
CN121056668A (zh) 显示设备和显示方法
CN117278788A (zh) 防止蓝牙设备干扰的方法及显示设备
CN117608709A (zh) 显示设备和显示方法
CN117979074A (zh) 一种模式参数设置方法及显示设备
JP2013008239A (ja) 表示コンテンツ出力装置、表示コンテンツ出力装置の制御方法、電子機器、情報提供サーバ、通信システム、制御プログラム、および記録媒体
JP2009116830A (ja) 情報処理装置及び画面表示方法

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20100726

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA RS

RIN1 Information on inventor provided before grant (corrected)

Inventor name: SHERMAN, ITAY

Inventor name: BYCHKOV, EYAL

Inventor name: SEGALOV, YARON

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20130510

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GOOGLE INC.

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 9/44 20060101AFI20130503BHEP

17Q First examination report despatched

Effective date: 20170209

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: GOOGLE LLC

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20190326

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230522