US20040135819A1 - Computer remote control - Google Patents

Computer remote control Download PDF

Info

Publication number
US20040135819A1
US20040135819A1 US10/688,269 US68826903A US2004135819A1 US 20040135819 A1 US20040135819 A1 US 20040135819A1 US 68826903 A US68826903 A US 68826903A US 2004135819 A1 US2004135819 A1 US 2004135819A1
Authority
US
United States
Prior art keywords
cursor
application
display
user
displayed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/688,269
Inventor
Shalong Maa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US10/688,269 priority Critical patent/US20040135819A1/en
Publication of US20040135819A1 publication Critical patent/US20040135819A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B1/00Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/06Receivers
    • H04B1/16Circuits
    • H04B1/20Circuits for coupling gramophone pick-up, recorder output, or microphone to receiver
    • H04B1/202Circuits for coupling gramophone pick-up, recorder output, or microphone to receiver by remote control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242Synchronization processes, e.g. processing of PCR [Program Clock References]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4131Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/4143Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a Personal Computer [PC]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof
    • H04N21/42646Internal components of the client ; Characteristics thereof for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/47815Electronic shopping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests

Definitions

  • the present invention pertains generally to user-friendly computer interface system and, in particular, to remote-control computer interface system that allows a user to conveniently interact with a computer-window operating system and any application program supported or executed thereby using a handheld remote-control device.
  • the conventional mouse-window type desktop computer system has the very unique and important user-interface feature of allowing a user to use a mouse to conveniently, quickly, easily, and very precisely place a cursor (i.e., an input-device indicator) at or move it to any position on a display of the computer system.
  • a cursor i.e., an input-device indicator
  • the failures of the prior art computer remote control systems result, in part, from the facts that, (i) Almost all of the existing desktop computer application programs are designed based on such a user-interface feature; (ii) It is very difficult to match such user-interface feature of mouse-window type desktop computer system using other type of input device (e.g. remote-control device) for cursor control, regardless of how complex the input device is made; and (iii)
  • the prior art fails to take full advantage of the flexibilities of software programming of a computer system.
  • the solution thereto is to modify the user-interface of the desktop computer system such that, a user can use an input device to fully and conveniently interact with the conventional desktop-window computer system without being required to always use the input device to quickly and very precisely place the cursor at or move it to any position on the display of the computer system. This is accomplished by taking full advantage of the flexibilities of software programming of a computer system according to the present invention.
  • the computer interface system of the present invention will cause such a display item to be displayed within said predefined area on said display, and in the meantime, also cause the cursor to be displayed within said predefined area; Thus, it is not necessary for the user to use the input device to move the cursor from another position to said predefined area on the display.
  • the user-interface system of the present invention allows a use to fully interact with a widow-desktop computer system using both mouse and handheld remote-control device as input device, since the mouse-based and remote-control-based window-desktop user-interface modes, according to the present invention, may only have minor differences, and a user can easily switch the two modes with click of a button.
  • FIG. 1 is a schematic representation of an exemplary multimedia home entertainment computer system for implementing the methods of the present, wherein an exemplary simplified TV broadcasting and client-server network system for providing synchronized interactive contents to the multimedia home entertainment system is also illustrated.
  • FIG. 2 is a diagrammatic representation of an exemplary handheld remote-control device for interacting with the multimedia home entertainment system of FIG. 1 using the computer remote-control methods of the present invention.
  • FIG. 3 illustrates an exemplary window desktop display according to the present invention.
  • FIGS. 4 - 6 and 8 - 9 are displays of exemplary computer windows for illustrating methods of using the remote-control device of FIG. 2 to interact with the multimedia system of FIG. 1 according to the present invention.
  • FIG. 7 is a schematic illustration of an exemplary virtual rectangle for arranging application-tool buttons of an application program so as to provide instruction for displaying the application-tool buttons within an application-tool window of FIG. 6 according to the present invention.
  • FIGS. 10 - 12 are simplified exemplary diagrams for illustrating the CMFT video image compression method according to another aspect of the present inventions.
  • FIGS. 1 - 9 there are shown new and novel computer remote-control methods, apparatus, and systems embodying the concepts of the present invention. While the present invention is susceptible to embodiments in various forms, there is provided detailed description of the presently preferred embodiments, with the understanding that the present disclosure is to be regarded as exemplifications, and does not limit the invention to the specific embodiments illustrated. In some instances, for purposes of explanation and not for limitation, specific reference or other numbers, diagrams, or dimensions, etc., may be set forth in order to provide a thorough understanding of the invention. In other instances, detailed descriptions of well-known elements or electronic circuitry or computer or network components are omitted so as to not obscure the depiction of the invention with unnecessary details. In case when alternate arrangements of an element or component are described or displayed, like parts or components may be assigned with the same numerical reference numbers.
  • a home entertainment system may include an Internet enabled multimedia client computer 30 , and a hand-held remote control device 710 for control of all other elements of the entertainment system.
  • the entertainment system may also include other type of electronic devices, such as a toy figure, a CD or DVD player, a sound system, etc., that are controlled by the computer 30 and by the remote control 710 ;
  • these electronic devices controlled by the computer 30 and by the remote control 710 are represented generally by the device 702 .
  • the computer system 30 is provided with a display 900 , such as a computer monitor or a large screen TV, and may include a TV turner component such that both the computer/Internet contents received from a web site 300 and TV programs or streaming videos 270 received from a TV broadcasting center 208 can be displayed on the display 900 .
  • the computer 30 is connected to the web site 300 via the Internet 800 .
  • the streaming video 270 may also be transmitted to the computer 30 from the web site 300 through the Internet.
  • the Web site 300 and the TV broadcasting system 208 are provided with synchronization systems 202 and 210 respectively such that the TV contents provided by the broadcasting system 208 can be made interactive.
  • the Web site 300 usually includes a Web server processing system for serving or providing Web content such as a video or video clip or a HTML document requested by the client computer 30 ; in a standard request-response process for viewing a graphical content by the client, the client system 30 specifies the URL or IP address of said content in a request, which is forwarded to the corresponding Web site 300 supporting such content; in response thereto, the Web server 300 will send the requested content to the client 30 .
  • the Web site 300 also includes application or programming system and database system for implementing a business entity's various business applications.
  • the remote control 710 includes computer and Internet/web-browser operation buttons and display-control/scrolling means (as described below), a conventional number/letter button assembly 720 for TV-channel selection, TV-channel changing buttons 72 U and 72 D for increasing and decreasing the current TV channel number respectively, a TV channel return button 72 R, and conventional volume control buttons 71 U and 71 D and a mute button 71 M.
  • a conventional VCR-, CD-, or DVD-type media-player operation assembly that includes “play”, “fast forward”, “fast reverse”, “pause”, and “stop” buttons, etc. may also be included on the remote control device 710 .
  • the foregoing conventional TV control buttons may also be employed for interacting with other components of the multimedia system of FIG. 1, and that, some of said “conventional” TV control buttons may also be used for computer operations.
  • the number/letter buttons 720 may also be used to provide access to a computer application program, as described in details herein below; and
  • the channel return button 72 R may be used for controlling the currently active computer-TV window by switching the display content therein back to the previously viewed TV channel, etc.
  • the remote control 710 may (optionally) includes a device-selection button 71 A for selecting which device (i.e., e.g., whether it is the TV, VCR, AC, DVD, or e-Toy, or the currently active window of the Computer system 30 , etc.) is to be currently controlled by the remote control 710 and/or by the computer 30 .
  • a device-selection button 71 A for selecting which device (i.e., e.g., whether it is the TV, VCR, AC, DVD, or e-Toy, or the currently active window of the Computer system 30 , etc.) is to be currently controlled by the remote control 710 and/or by the computer 30 .
  • the basic concepts of computer remote control of the present invention include, (i) a simple remote control operation will instruct an active window to display a display item, such as a listing of application buttons or links (e.g., a toolbar, a bookmark listing, or a menu, etc.), and in the meantime, causing the cursor to be displayed on such display item so as to facilitate the user's desired action of easily browsing through and clicking on one of the application buttons or links so listed; (ii) a limited number of press-button combinations on the remote control 710 will provide unlimited shortcut means for easy access to the user's desired applications or commands; and (iii) the press-buttons of the remote control 710 are arranged in such a way that they provide a user with intuitive means to interact with window-based computer multimedia system.
  • a simple remote control operation will instruct an active window to display a display item, such as a listing of application buttons or links (e.g., a toolbar, a bookmark listing, or a menu, etc.), and in the meantime,
  • the remote control 710 includes a display buttons 71 Q for display control, such, for examples, as opening/closing a window on the display 900 , or displaying or expanding a menu (see below), etc., by interacting with the Computer operation system 30 via wireless signals, and that (ii) the function of TV channel selection and other conventional TV operations are the default functions provided by the number buttons assembly 720 , since almost all users already have extensive experience of using a remote-control device to interact with TV. For examples, (i) in order to display TV channel 7 within a new TV-window 913 (i.e., window No. 6 or VI) on the display 900 (see FIG.
  • a new TV-window 913 i.e., window No. 6 or VI
  • a user will depress the display button 71 Q and then the number button “6” of the remote control 710 for opening a new window 913 on the display 900 , then the user can press the number button “7” for displaying the TV channel 7 within the TV-window 913 ; and (ii) if the user presses the number button “7” without depressing the button 71 Q or any other functional button there-before, the current active window will be switched to TV channel No. 7.
  • each window or TV-window displayed on the display 900 of the multimedia system 30 is provided with a simple window ID so as to facilitate remote control by a user.
  • the windows 913 , 912 , and 914 are provided with, respectively, an ID 92 C (i.e., a bar and a dot on right for indicating ID No. 6 , which is similar to “VI”), an ID 92 A (i.e., three dot, or III), and an ID 92 D (i.e., a bar for indicating ID No. 5 , similar to “V”), for indicating that they are window No. 6 , 3 , and 5 respectively.
  • an ID 92 C i.e., a bar and a dot on right for indicating ID No. 6 , which is similar to “VI”
  • ID 92 A i.e., three dot, or III
  • an ID 92 D i.e., a bar for indicating ID No. 5 , similar to “V”
  • window IDs 92 A, 92 C, and 92 D may also service the purpose of indicating the currently “active” window, i.e., the window currently controlled by the remote control 710 , by, for example, highlighting or brightening the ID of the active window (e.g., In FIG. 3, the currently active window is widow 912 , as indicated by the window ID 92 A).
  • other methods such for example as highlighting the frame of a Window, may also be used for indicating the currently active window, and (ii) other commonly used ID methods can be employed for the purpose of window identification.
  • the window IDs can also allow a user to easily switch from one window to another window displayed on the display 900 , or to close a window, using the remote control device 710 .
  • two or more remote control devices may be provided for control of different windows displayed on the same display 900 and supported or controlled by the same computer system 30 , in which case the computer and the remote control devices may be provided with device-identification systems/components such that a window opened by one remote control device will not response to control signals transmitted from other remote control device(s).
  • the computer and the remote control devices may be provided with device-identification systems/components such that a window opened by one remote control device will not response to control signals transmitted from other remote control device(s).
  • a multimedia system is provided with more than one remote-control devices, one or more of these remote-control device may be provided with higher control priority (the master remote control), i.e., a window opened by a non-master remote control can be controlled by a master remote control device, while a window opened by a master remote control will not response to a non-master remote control device.
  • a cancel or close button 74 C may be provided on the remote control 710 such that, for examples, (i) the combination of depressing the cancel/close button 74 C and then the display button 71 Q will close the current active window; (ii) if the currently active window is the TV-window 913 and the user wants to close the TV-window 912 (window ID No.
  • the user may then have two options, including: (a) using the combination of depressing the cancel/close button 74 C and then the number button “3” on the remote control 710 , or (b) switching from the TV-window 913 to the TV-window 912 by pressing the “Disp” button 71 Q and the number button “3”, then closing the now active window 912 by the combination of depressing cancel/close button 74 C and then the display button 71 Q.
  • the TV signals 270 transmitted from the broadcast center 208 may include display instructions as to how many TV-windows are desired for a current TV program 901 displayed on the display 900 , and/or the default size, position, and content of each such TV-window.
  • a web page or web content associated and/or in synchronization with the current TV program may (i) provide sub-content information relating to the TV program (e.g., stats information or different camera angle for a live sport event), and/or (ii) include web links or application links that are related to the TV program.
  • Such a web page/content associated with the current TV program may be displayed within a separate window on the display 900 ; clicking through any web/application link therein using the remote control 710 will cause the associated contents be displayed within a designated or newly opened Window.
  • the TV-computer operation system 30 is a web-browser based operation system, i.e., the full functionality of a conventional web browser is integrated or incorporated into the basic functionality of the operation system 30 . Accordingly, the remote control 710 is provided with short-cut press buttons for interacting with the web-browser functions of the TV-computer system 30 .
  • the remote control 710 includes a “bookmark” button 73 X, as shown in FIG. 2, for adding a web page into the bookmark list (or the like) of the computer system 30 's web browser.
  • the bookmark function of the remote control 710 can be used to provide users with interactive TV experience if a TV program on the display 900 is provided with a synchronized web page/content by the web site 300 .
  • the computer 30 receives the bookmark signal from the remote control 710 , it will contact the web site 300 for obtaining the web page associated or synchronized with the current TV program and/or the URL or IP address thereof, and add such URL or IP address to the bookmark listing of the web browser, such that a user may later have access to interactive information provided thereby.
  • depressing the “bookmark” button 73 X will cause the web browser of the computer 30 to bookmark a Web page associated and/or synchronized with the current TV program 901 , regardless of whether such web page is displayed within a window; and that (ii) if the currently active window on the display 900 displays a web page or web content, regardless of whether such web page/content is related to any TV content shown within any other windows on the display 900 , depressing the “bookmark” button 73 X will cause the web browser to bookmark such web page or web content so displayed.
  • a user's computer may not be connected to the Internet while, for example, watching a TV program on the display 900 , and thus it would be impossible to immediately obtain the URL or IP address of the web page associated or synchronized with the current TV program;
  • the information stored in the bookmark file of the computer 30 in response to receiving a bookmark signal from the remote control device 710 may only includes the name or channel number of the current TV program and the current timestamp; Then when the user later wants to have access to the associated web page to learn more information about such particular section of the TV program, the web site server 300 used for providing interactive contents for the TV program will be able to obtain such web page and sent it to back to the client 30 base on the TV-channel and the timestamp information received from the client computer 30 .
  • the remote control 710 further includes a “buy” button 73 B for facilitating online purchasing by activating an online identity-authentication/purchasing application installed in the computer 30 .
  • a “buy” button 73 B for facilitating online purchasing by activating an online identity-authentication/purchasing application installed in the computer 30 .
  • a web page shown within a window on the display 900 includes a “purchase” item available for online purchasing
  • the “buy” button 73 B to activate said online identity-authentication/purchasing application, it will cause the client computer 30 to contact the web site that supports such e-commerce transactions.
  • the related confirmation information such as the price, name, shipping address, credit card account information, etc., and/or simple instructions
  • the user can then press the “buy” button 73 B again or a “go” button 74 G (see below) on the remote control 710 to complete the transaction;
  • the system 30 may require that the user provide password information using, for example, the number buttons 720 on the remote control 710 before completing the purchasing process. If the current web page does not include any “purchase” item available for online purchasing, a brief message such as “no item available for online purchasing” may be displayed in response to user pressing the “buy” button 73 B.
  • the web page or content associated or synchronized with a TV program and provided by a web site may also include TV-display instruction for instructing the TV-computer system 30 as to the desired size, position, and background color, etc. of the TV windows designated for the TV program and/or for any of its sub-contents.
  • TV-display instruction may be included in a HTML- or XML-type ⁇ tag> at the header or body section of such web page.
  • the remote control 710 also includes a “Go” button 74 G for interacting with or for activating a computer application program, a “cursor float” control button 74 F for controlling the “floating status” of an input-device indicator or cursor 920 on the display 900 (See FIG. 4), and a cursor control assembly 740 .
  • the assembly 740 includes a vertical rolling wheel 74 V and a pair of horizontal rolling wheels 74 R and 74 L.
  • the vertical rolling wheel 74 V is provided for controlling vertical-only content scrolling or cursor movement or the like on the display 900 ; the two horizontal rolling wheels 74 R and 74 L are provided for controlling horizontal-only content scrolling or cursor movement or the like.
  • the main reason for having two horizontal rolling wheels 74 R and 74 L instead of one in the FIG. 2 example is for the purpose of providing geometric symmetry only.
  • the remote device 710 may be provided with only one horizontal rolling wheel.
  • the rolling wheels 74 V, 74 R and 74 L of the FIG. 2 example shall be understood as one full rolling mechanism for providing the full function of content scrolling and/or for placing the input device indicator, or the cursor 920 of FIG.
  • the conventional mouse has at least one full rolling mechanism, such as the trackball underneath the convention mouse.
  • Some of the mouse-type input device such as the so-called “intelli-mouse” marketed by Microsoft Corp., has two rolling mechanism, including a conventional trackball located at the underneath and a small rolling wheel on top of the mouse.
  • the basic functions of the computer mouse as an input device includes: (i) cursor movement, i.e., moving the cursor to any position on a computer display, (ii) scrolling, i.e., scrolling contents displayed within a window if the window does not provide enough space for displaying the entire content of an application program; (iii) execution, i.e., executing or “clicking on/through” an display item, such as a command button, a link, an icon, a shortcut, a menu, etc., currently located by the cursor, which is accomplished by the “left click” button of the conventional computer mouse; (iv) command listing, i.e., providing a listing of commands or other items or properties associated with the display item currently located by the cursor, which is accomplished by the “right click” button of the conventional computer mouse; and (v) text-cursor control, i.e., placing the text-typing cursor at an desired position—the conventional window system employs a two-cursor system in a text-
  • the “Go” button 74 G of the remote-control device 710 provide the foregoing function of executing or “clicking on/through” of the conventional mouse;
  • the rolling wheels 74 V and 74 R/ 74 L provide the foregoing function of cursor movement and/or text-cursor control.
  • Another button 74 K is provided on the device 7 1 0 for providing the foregoing function of command listing or “right clicking” of the conventional mouse. Since a full rolling mechanism usually requires substantial space, it is preferred that a single full rolling mechanism, i.e., the rolling wheels 74 V and 74 R/ 74 L of the FIG.
  • a vertical scrolling bar/rod or stick that can be operated by a user's thumb may be provided on the remote control 710 for providing content scrolling. This is accomplished by providing the cursor 920 and the rolling mechanism of the remote control device 710 with various “cursor-control/scrolling modes”.
  • the controlling and/or arrangement of such cursor-control/scrolling mode shall be based on (i) the type of user inputs received from the remote control 710 , and/or on (ii) the type of application or contents displayed within the current window;
  • the assignment of such cursor-control mode to each window content may be done either manually by a user or automatically by the computer interface system based on the type of contents or application within the window. For example, if the current window is a very long web page, the computer interface system may automatically assign the default cursor-control/scrolling mode of such application to a “fast-scrolling local” mode (see below).
  • cursor-mode-control system of the present invention provides an important advantage of allowing user to have easy access to display items/contents on the display 900 , as described in detailed herein below. Since the cursor icon 920 is for indicating the functioning and user's manipulation of a user-input device, the status of the cursor may be reflected or indicated by the shape and/or color of the cursor icon 920 .
  • the cursor 920 on the display 900 is provided with three basic floating status or modes, including a “floating mode”, a “local mode” and a “text-cursor mode”, which are related to the “depth” (or “floating depth”) of the cursor movement and are controlled by the button 74 F of the remote control device 710 .
  • pressing the button 74 F will cause the cursor 920 to switch between said floating and local modes—i.e., the interface system will ignore the text-cursor mode; If the current application area located by the cursor 920 is a text field for text input, pressing the button 74 F will cause the cursor 920 to switch among said floating, local, and text-cursor modes.
  • the floating statuses of the cursor are defined as follows: (i) If the cursor 920 is in said floating mode, a user may cause the cursor 920 to move freely throughout the entire display area of the display 900 by operating the rolling wheels 74 V or 74 L/ 74 R of the remote control, in which case, the cursor 920 is not restricted within a specific Window or application area on the display; (ii) If the cursor 920 is in said local mode, the cursor will provide scrolling and/or cursor movement functions for the respective local window application area (see below for details), and the cursor will usually be restricted within a local application window; (iii) The “text-cursor mode” is the conventional text cursor of a text field for text input; operating the rolling wheels 74 V or 74 R/ 74 L will move such text cursor within a text field; the conventional text-selection function may be provided by operating the rolling wheels 74 V or 74 R/ 4 L after double-clicking or while holding the Go button 74 G (similar to holding
  • the cursor 920 is also provided with three modes relating to cursor/scrolling movement, including a “continuous mode”, a “leaping mode”, and a “fast-scrolling mode”—the status of the cursor 920 may be switched among these three modes by clicking a control button 74 U on the remote control device 710 .
  • the “continuous mode” is the conventional mode for continuous cursor movement;
  • the “leaping mode” is for causing the cursor 920 to leap among the executable items displayed, i.e., the cursor will skip those non-executable item, so as to allow user to quickly locate the executable items displayed;
  • the term “executable item” means an item displayed that can allow a user to execute a desired command or a program or an action, by click on the item, or to input text, such as a web link, an application icon or shortcut on the desktop, a file/folder icon or shortcut, an application-tool button, a text field for text input, etc.; and
  • the “fast-scrolling mode” is for providing the function of fast scrolling of any display contents within a window or sub-window.
  • cursor-control/scrolling mode available, including: continuous floating, continuous local, continuous text-cursor, leaping floating, leaping local, leaping text-cursor, fast-scrolling local, fast-scrolling floating, and fast-scrolling text-cursor modes.
  • cursor-control/scrolling mode may also be provided, depending the nature or character of each individual application program.
  • Some of these modes may never be use or be ignored by the computer interface system—i.e., when in the floating mode, the interface system may ignore the fast-scrolling mode; when in the text-cursor mode, the leaping mode may be ignored by the interface system, etc.
  • the computer interface system of the present invention will determined the optimal cursor-control/scrolling mode for each application or content within a window; or Alternatively, a user may set the cursor-control/scrolling mode for each application manually.
  • the interface system may set its default cursor-control/scrolling mode to the “continuous text-cursor” mode, and ignore all the leaping modes, and regards the “local mode” and the “continuous mode” as the same; (ii) if the contents within a window are application-tool buttons of an application program, the interface system may set its default cursor-control/scrolling mode to the “continuous local” or “leaping local” mode (see below), and ignore the text-cursor mode; (iii) If the application is a relatively short web page that is displayed fully within a window, the interface system may set its default cursor-control mode to the “leaping floating” mode; etc.
  • control of any new or application-specific cursor-control/scrolling modes added for a specific application program may be provided by “Double clicking” the button 74 F;
  • the remote-control device 710 may be provided with another button for control of any new cursor-control/scrolling modes added for a specific application program.
  • the rolling wheel 74 V and the button 74 F may be combined such that clicking on the wheel 74 V will provide the same effect as depressing the button 74 F, so as to reduce number of button on the remote-control device 710 .
  • each window on the display 900 is provided with at least three “display modes”, including: (i) a full-screen mode—i.e., full-screen display of the window without showing any toolbar, (ii) a full-screen toolbar mode—i.e., full-screen display of the window with the showing of some or all toolbars provided therefore, and (iii) a reduced-size non-toolbar mode—i.e., the display of the window is smaller than the full screen as desired without showing the toolbars (alternatively, a reduced-size tool
  • a window may be transparent such that, for example, a web page associated/synchronized with a current TV program may be overlaid or displayed on top of such TV program displayed (i.e., there are two layers of display contents), so as to provide the function of allowing a user to click on a display item that is provided by the web page but appears to be provided by the TV program.
  • the cursor 920 provides two functions: ( 1 ) if the respective local application content is not fully displayed within the current window, operating the rolling wheels 74 V or 74 L/ 74 R will scroll the application contents within the window, i.e., moving the view of the local application content such that a hidden portion of the content is displayed within the window; and ( 2 ) after scrolling to an end of the display content of the application within the window, the cursor 920 itself will then start to move within said the window if the user repeats the same rolling wheel operation.
  • a new icon for the cursor 920 (as compared with the cursor 920 of FIG.
  • the cursor 920 itself starts to move upwardly (as compared with FIG. 4) when the user repeats the same operation of rolling the wheel 74 V upwardly.
  • the tool bar or menu bar area of an application or window can be regarded as a window or a sub-window. It is preferred that, clicking on an “Application Tools” button 731 provided on the remote control device 710 will cause the application tool buttons of an current application program to be displayed within a predefined area (see FIG.
  • buttons or vertical stick may be provided on the remote control 710 such that the operating thereof by a user will cause said entire menu or toolbar to slide horizontally or to roll vertically first before causing the cursor 920 to browse through each individual application button.
  • the display 912 of FIG. 4 is an exemplary desktop window display according to the present invention, which includes an interactive section 94 D for display of live or updated information provided by a web site, such as sports/news update, email update, live stock market data or quote, etc.
  • An icon within the window 912 may also be made interactive.
  • an Email icon 95 C and the number 95 C′ therein indicate that there is currently one new email received.
  • some of the application or web link or file icons displayed within the window 912 are arranged within a four by four matrix 980 . Each matrix cell includes one display item, and is identified by a matrix ID number.
  • the ID numbers 11 , 14 , 41 and 44 are assigned to the matrix cells 98 A, 98 B, 98 C, and 98 D respectively, so as to facilitate easy identification of each matrix cell and to allow a user to use the number keys 720 in combination with a function/program key 75 F provided on the remote control 710 to have easy access to the items associated with or displayed within these matrix cells (see below).
  • the desktop window 912 of FIG. 4 also includes a hard drive icon 90 A and a trashcan icon 90 B, which may be partially visible through an application content within the widow for graphically indicating user's actions of, respectively, saving and deleting of files and/or data.
  • a file shortcut 93 P a web link 94 C, a web application icon 94 B, a file folder shortcut 93 Q, a web-based TV schedule link 94 A, a TV channel-1 selection icon 95 D (i.e., clicking on the icon 95 D will cause the current window to switch to TV channel No. 1), a shortcut 95 A for an application, and an icon 95 B for a computer game.
  • the window 912 of FIG. 4 also include a “Go” icon 94 G such that clicking on the icon 94 G will have essentially the same effect as depressing the “Go” button 74 G of the remote control 710 .
  • the icon 94 G may also provide a visual effect that the “Go” button 74 G of the remote control 710 have been pressed.
  • the window 912 may also includes an alert component 981 , which may be situated, for example, at the bottom of the window 912 , as shown in FIG. 4.
  • the alert component 981 shown includes an email-alert icon 98 Z for indicating whether there is any urgent email; a deadline alert icon 98 X for indicating whether a bill-pay or other type of deadline is getting close; and an appointment alert icon 98 Y, which may be associated with a web-based calendar application, etc. When there is no alert, the area 981 may automatically hide.
  • alert component may be provided for any type of web browser or window applications.
  • FIG. 4 example also includes a “command input” text field 91 B for user to input a file name, an application, or a web page URL, etc., with the status thereof being indicated by an indicator 91 A.
  • the indicator 91 A is “on”, it indicates that the field 91 B is ready for receiving a command. For example, if a user want to view a web page linked thereto by the “Web Link 1 ” 94 C, which is located within the matrix 980 at cell ID No. 21 of the window 912 of FIG. 4, he can first click the “Appl.
  • Prgrms” button 75 F and then the number buttons “2” and “1” on the remote control 710 , which will cause the web page name or URL associated with the “Web Link 1 ” be displayed within the command input field 91 B. Thereafter, the user can press the “Go” button 74 G of the remote control 710 to view such web page. If the user decides that he made a mistake and wants to input another application, such as an “Appl” 95 A, into the command input field 91 B, the user can then click the button 75 F twice such that the command input field 91 B be ready for receiving new commands.
  • another application such as an “Appl” 95 A
  • the input of text into any type of text field can be done by a speech recognition system provided, which may be controlled by a voice input button 79 M on the remote control 710 .
  • a microphone 78 F is provided on the remote control 710 for receiving voice input.
  • the cursor is usually in said text-cursor mode, and the cursor icon may be set to look like a small microphone or the like.
  • the remote control 710 also includes an “App tool” button 731 for displaying/hiding the user's favorite toolbar provided for the current window and/or window application program.
  • the current application 490 within a window 912 ′ is a word processor; a plurality of application-tool buttons are to be displayed within a toolbar sub-window 470 when desired; and a user's frequently used application tools or commands for such application include: “open” 47 A, “close” 47 B, “save” 47 C, “spell” 47 D, “undo” 47 E, and “redo” 47 F.
  • Pressing the “App Tools” button 73 I will cause the following effects, (i) if the toolbar sub-window 470 was displayed with a plurality of application-tool buttons 47 A- 47 F therein, hiding the toolbar sub-window 470 and any contents therein; (ii) if there is no application tool button displayed, and thus the toolbar sub-window 470 was not shown, instructing the window 912 ′ to display a plurality of application tool buttons 47 A- 47 F within the toolbar sub-window 470 , and instructing the cursor 920 to “jump” into or be displayed at the toolbar area 470 in, for example, the leaping local mode such that, the user could easily navigate or browse through these tools 47 A- 47 F using the rolling wheels 74 V and/or 74 L/ 74 R of the remote control 710 , and execute or “click on” any of these tools 47 A- 47 F using the “Go” button 74 G; Pressing the “App Tools” button 731 again will hide the toolbar 470 .
  • the toolbar window/sub-window 470 includes one row of application tool buttons.
  • the toolbar window may include more than one row of application tool buttons.
  • the application 490 of FIG. 6 may be provided with other application tools that may not be all displayed within the toolbar window 470 . In the FIG. 7 example, all of the application tool buttons provided for the application 490 of FIG.
  • 3 ⁇ 6 virtual matrix or rectangle 495 which includes 3 rows, i.e., row 471 , the middle row 47 A-F, and row 472 , and 6 colunms; Some of these tools, such as the tool 47 X, may be associated with or controlled by a web site; Some of them, such as the tool 47 Y may be a menu that includes a listing of other tools. It is understood that, the purpose of providing such a virtual matrix arrangement is for providing instruction to the interface system regarding the sequence of displaying the application tools within the toolbar window/sub-window 470 (i.e.
  • Tool” button 73 I by a user, if the user wants to view other tools available for the application 490 , operating the rolling wheel 74 V downward will cause the first row 471 of the virtual matrix/rectangle 495 to be displayed within the window 470 ; operating the rolling wheel 74 V upward will cause the third row 472 of the virtual matrix/rectangle 495 to be displayed within the window 470 ; moving the cursor 920 to an application tool button displayed within the window 470 may be done by operating the rolling wheels 74 R/ 74 L.
  • the horizontal scrolling of the display within window 470 will start after the cursor 920 reaches a horizontal end of the window 470 in response to the user's operating of the rolling wheels 74 R/ 74 L.
  • the display button 71 Q of the remote control 710 may also service as a “shortcut” for viewing and navigating menus and other information provided by the Window 912 .
  • pressing the display button 71 Q and then the bookmark button 73 X of the remote control 710 will: (i) cause a bookmark menu 93 FX of the window 912 to be displayed in its expanded mode, as shown in FIG. 8, such that a plurality of items included therein (i.e., items 3 X 1 , 3 X 2 , . . .
  • the item 3 X 2 included in the menu 93 FX is not an expandable lower-level submenu; So when a user moves the cursor in horizontal direction using the rolling wheel 74 L/ 74 R of the remote control 710 while the cursor 920 is located at the item 3 X 2 , the cursor will be restricted within the boundary of the expanded menu 93 FX.
  • the item 3 X 4 included in the menu 93 FX is an expandable lower-level submenu and includes a plurality of submenu items (i.e., 34 X 1 , 34 X 2 , 34 X 3 , 34 X 4 );
  • a user moves the cursor in horizontal direction using the rolling wheel 74 L/ 74 R of the remote control 710 while the cursor 920 is located at the item 3 X 4 , it will expand the submenu 3 X 4 into an expanded menu 934 X, which is displayed next to the menu 93 FX, as shown.
  • Prgrms” button 75 F of the remote control 710 will cause an application/program menu 93 B of the window 912 to be displayed in its expanded mode such that a user can have access to all application programs provided by the computer system; and (ii) depressing the “Disp” key 71 Q and the window-control button 72 W of the remote control 710 will cause an window management menu 95 W of the window 912 to be displayed in its expanded mode such that a user may have a brief view of all windows currently being opened, and may switch to another opened window by clicking on one of the listed items included in the expanded menu 95 W displayed.
  • Some of the frequently used application programs included in the menu 93 B may be assigned with a single-digit application ID number such that a user may have quick access to such application using the “Appl.
  • Prgrms” key 75 F and the number keys 720 of the remote control 710 may be assigned with an application ID No. 1 , such that when a user depress the “Appl. Prgrms” key 75 F and the number “1” key of the remote control 710 , the name of such email application will be displayed within the “command input” field 91 B; then the user can depress the “Go” button 74 G of the remote control 710 after confirming that the application name shown in the “command input” field 91 B is the desired application.
  • the most recently book-marked web pages included in the bookmark menu 93 F may be assigned with a bookmark ID No.
  • bookmark ID e.g., the web pages “yahoo.com”, “msn.com”, “amazon.com”, etc. may be assigned with bookmark ID Nos. 1 , 2 , 3 , . . . respectively
  • the menus 93 A, 93 B, and 93 F of the window 912 are provided with graphic icons 93 W, 95 F, and 95 X, which are essentially the same as the graphic symbols on the keys 72 W, 75 F, and 73 X respectively of the remote control 710 , which are directly related thereto.
  • buttons on the remote control 710 may provide easy access to any application tools desired.
  • the combination of pressing the “disp button” 71 Q and the “App tools” button 73 I of the remote control 710 will, (i) if the application menu bar was not displayed within the window, instruct the window 912 ′ to display the menus or the menu bar, (ii) cause the cursor 920 to “jump” onto such menu bar in its local mode, and (iii) expand one of the menus located by the cursor 920 ; When forcing the cursor 920 to the right or left, it will expand the respective neighbor menu(s);
  • “Indirect Control” method is applied when using the remote control 710 for a general-purpose remote control of other electronic devices.
  • the computer 30 is provided with means for transmitting/receiving remote-control signals and with the associated software system, so as to simulate the functioning of a general-purpose handheld remote control device; if the remote control 710 is to be “adjusted” to control, for examples, new devices 702 , rather than adjusting the remote control 710 itself, such an “adjustment” is made to the respective software applications provided therefore and installed in the computer 30 such that, the desired (or adjusted) remote control signals be transmitted from the computer 30 to the device 702 in response to the user operation of the remote control 710 , while the control signals transmitted from the remote control 710 to the computer 30 are not “adjusted” (thus “Indirect Control”).
  • computer system 30 of FIG. 1 is to be provided with a signal transmitter/receiver subsystem or peripheral for interacting with the remote control 710 and with the electronic appliance 702 via wireless signals.
  • the wireless signal employed for such remote control interactions may be, preferably, RF signal.
  • such wireless signal may be infrared (IR) or intermediate frequency (IF) or modulated light signal or other type of commonly used wireless signal for remote control of an electronic appliance.
  • said signal transmitter/receiver subsystem is provided with means for transmitting and receiving wide range(s) of commonly used signal spectrum so as to facilitate the functioning of general-purpose remote control.
  • each one of the electronic devices feasible for remote control such, for examples, as the device 702 of FIG. 1, may be provided with an application icon or link in the computer system 30 that may be shown on the window desktop; When a user click on such application icon to activate the associated remote-control software application program, the electronic appliance associated therewith may then be control by the remote control device 710 .
  • said signal transmitter/receiver subsystem is to be provided with a digital interface system so as to interact with other components and/or processing unit of the computer 30 .
  • the computer 30 can be programmed to interact with the remote control device 710 or to control the electronic appliance 702 without providing the remote control device 710 and the electronic appliance 702 with complex digital interface.
  • the computer system 30 may be a mouse-window type computer system or a remote-control based computer system or other type of commonly used computer system.
  • the computer 30 may be connected to a network, such as the Internet, such that a user can control the electronic appliance 702 from a remote location by accessing the computer 30 from another computer provided at said remote location through said network.
  • the remote control system of the present invention may be used to control or to interact with, for examples, a clock, an exercise device such as a treadmill, an air condition system, a microwave, a TV set, a VCR or DVD player, a sound system, a radio, a washer/dryer, an electronic stove, an electronic cooking device, or an electronic toy, etc.
  • the computer 30 may be provided with “button identification/assignment” software application program for identifying a button on a remote control and assign such button to a selected button on a general purpose remote control device.
  • the electronic appliance 702 is provided with an original handheld remote control device 710 x from the manufacture that has a button named 710 x - a , and a user wants to designate a button 710 -A on the general-purpose remote control device 710 to replace the functioning of the button 710 x - a of the remote control device 710 x ; the processes of identifying the buttons 710 x - a and 710 -A are by simply clicking on these buttons on the remote control devices 710 x and 710 respectively, and the resultant wireless signals will then be received by the computer 30 and by the button identification/assignment application program, which may, for example, assign a reference code and/or a image icon to each said buttons so identified; the button identification/assignment application program may then be used to link or associate the button 710 -A to the button 710 x - a such that, when the user depress or click on the button 710 -A of the remote control 710 , the wireless signals transmitted from
  • the quality of the video images to be displayed at the client side may be improved significantly by amplifying the client-side pixel resolution and by adjusting the color characters of those newly created pixels at the client side according to the color characters of those original neighboring pixels.
  • the conventional digital video/image compression technologies utilizes the so-called symmetric pixel resolution method, i.e., the pixel resolution of the video images to be displayed at the client side (hereinafter the “client-side pixel resolution”) is equal to (or less than) the pixel resolution of the original video images before compression (hereinafter the “server-side pixel resolution”).
  • DCT Discrete Cosine Transform
  • the image is divided into small blocks of pixels, with each block of the pixels then undergoing a two-dimensional cosine transform to produce a two-dimensional array of transform coefficients; thereafter, the resultant transform coefficients are subject to compression by threshold and quantization operations: (i) through threshold operation, all those coefficients with magnitude smaller than a threshold value are set to zero, whereas (ii) the quantization operation involves scaling each coefficient by finite step size (i.e. quantized value) and rounding off to the nearest quantized value.
  • the DCT compression method may be understood as transforming the original image data in the two-dimensional special domain into a two-dimensional frequency domain, or it may be understood as using vibration-type waveforms (i.e., cosine function) to represent the image data.
  • the color character F at any pixel point (xy) of a two-dimensional video image frame is not a naturally vibrating signal.
  • cosine function is not necessarily the best math function for representing each and every pixel block of the image frame with respect to image-compression efficiency.
  • CMFT Continuous Multi-Function Transform
  • DCT Discrete Cosine Transform
  • Each one of these math functions/formulas may have its boundary condition unless such boundary is the same as or is outside the respective pixel blocks.
  • the data F′ 1 , F′ 2 , F′ 3 , F′ b1 , F′ b2 , F′ 7 , F′ 8 and F′ N represents the original values of color characters F at the pixel positions XY 1 , XY 2 , XY 3 , XY 4 , XY 6 , XY 7 , XY 8 , and XYN, respectively, of an exemplary and simplified pixel block XY 1 —XY N . As shown in FIG.
  • LSF Lest Square Fitting
  • These statistical data analysis method usually only provide estimation of the parameters/coefficients of the math function(s)/formula(s) used for the data fitting;
  • the form(s) of the math function(s)/formula(s) needs to be predetermined based on prior experimentations or experience;
  • an error bar for representing statistical error is usually provided for each and every data.
  • the error bar may be artificially added to the data at each pixel point, in which case, the value of the error bars may be estimated based on the desired accuracy of the data fitting at a particular area of the video image frame; and (ii) the “statistical weight” of the data may also be artificially manipulated (e.g., in order to make sure that the data fitting is more accurate near an image-element boundary, “statistical weight” of the data near such boundary may be artificially increased).
  • the original video-image data Fs are transformed into the parameters/coefficients of a group of predetermined math functions/formulas.
  • the data transmitted from the server to the clients will include (but not limited to): (i) Math formula/function IDs; (ii) values of the parameters/coefficients of each Math formula/function used for the data fitting; and (iii) boundary condition for each Math formula/function if such boundary is within the pixel block.
  • the data of each such block may be fitted to predetermined math function(s) without concerning other boundary conditions other than the values of the data at the edges of the pixel block. If the predetermined math function(s) is to be used to fit the data of a relatively large pixel block or parent pixel block, it might be necessary to apply a boundary condition.
  • boundary condition sometimes it may be necessary or convenient to use a math function to represent a portion of the boundary of an image element;
  • the process of pixel-resolution amplification at the client side described in the 429 Application can be done conveniently, efficiently and naturally without requesting high computing power from the client computing system if the CMFT method is employed.
  • FIG. 11 the process of pixel-resolution amplification at the client side described in the 429 Application can be done conveniently, efficiently and naturally without requesting high computing power from the client computing system if the CMFT method is employed.

Abstract

Disclose herein are apparatus, methods and systems for computer remote control. According to the present invention, the user-interface of a conventional window-desktop system can be modified such that a user may use any type of input device, such as a handheld remote-control device or a mouse, to fully and conveniently interact with the desktop-window computer system. This is accomplished by taking full advantage of the flexibilities of software programming of a computer system according to the present invention. For example, after receiving a user input for displaying a display item, the interface system of the present invention will cause such a display item to be displayed on a display, and in the meantime, also cause the cursor to be located at said display item; thus the user is not always required to manually use the input device to quickly and precisely place the cursor at the desired position.

Description

  • This Application claims the benefits of U.S. Provisional Application No. 60/421,493 filed Oct. 28, 2002 and U.S. Provisional Application No. 60/401,795 filed Aug. 7, 2002, of which the complete disclosures are incorporated fully herein by reference.[0001]
  • FIELD OF THE INVENTION
  • The present invention pertains generally to user-friendly computer interface system and, in particular, to remote-control computer interface system that allows a user to conveniently interact with a computer-window operating system and any application program supported or executed thereby using a handheld remote-control device. [0002]
  • BACKGROUND OF THE INVENTION
  • With the increasing popularity of interactive electronic networks, such as the Internet and the World Wide Web, and the advent of digital video technologies, the services of providing integrated multimedia interactive entertainment systems are drawing more attention in the market place. It is known in the art that, a fully interactive TV-entertainment system requires the functionalities of a mouse-window type computer operation system such that, for example, a streaming video received from a TV-broadcasting system can be displayed within a computer window. However, the prior art does not provide any convenient remote-control system that allows a user to use a handheld remote-control device as a user input means for fully interacting with the display of a window-base multimedia computer. As a result thereof, a user is required to sit very close to the display or monitor of the computer so as to use a mouse as input device to interact with the contents provided thereby. [0003]
  • It is well known that, the conventional mouse-window type desktop computer system has the very unique and important user-interface feature of allowing a user to use a mouse to conveniently, quickly, easily, and very precisely place a cursor (i.e., an input-device indicator) at or move it to any position on a display of the computer system. The failures of the prior art computer remote control systems result, in part, from the facts that, (i) Almost all of the existing desktop computer application programs are designed based on such a user-interface feature; (ii) It is very difficult to match such user-interface feature of mouse-window type desktop computer system using other type of input device (e.g. remote-control device) for cursor control, regardless of how complex the input device is made; and (iii) The prior art fails to take full advantage of the flexibilities of software programming of a computer system. [0004]
  • SUMMARY OF THE PRESENT INVENTION
  • To remedy the foregoing and other drawbacks of the prior art and to achieve other objects of the present invention, there are provided and disclosed herein novel computer remote control methods an apparatus. As described above, it would be difficult to employ a handheld remote-control device to replace the mouse as an input device of a desktop computer system while still providing the user-interface feature of allowing a user to conveniently, quickly, easily, and very precisely place the cursor at or move it to any position on the display of the computer system. The solution thereto, according to the present invention, is to modify the user-interface of the desktop computer system such that, a user can use an input device to fully and conveniently interact with the conventional desktop-window computer system without being required to always use the input device to quickly and very precisely place the cursor at or move it to any position on the display of the computer system. This is accomplished by taking full advantage of the flexibilities of software programming of a computer system according to the present invention. For examples, after receiving an user input for displaying a display item, such, for examples, as a menu or an application tool bar, within a predefined area on a display, the computer interface system of the present invention will cause such a display item to be displayed within said predefined area on said display, and in the meantime, also cause the cursor to be displayed within said predefined area; Thus, it is not necessary for the user to use the input device to move the cursor from another position to said predefined area on the display. Those skilled in the art would appreciate that, the user-interface system of the present invention allows a use to fully interact with a widow-desktop computer system using both mouse and handheld remote-control device as input device, since the mouse-based and remote-control-based window-desktop user-interface modes, according to the present invention, may only have minor differences, and a user can easily switch the two modes with click of a button. [0005]
  • The foregoing is intended to be merely a summary, and not for limiting the scope of the present specification. The features of the invention that are believed to be novel are set forth with particularity in the claims. The invention, together with further objects and advantages thereof, may best be appreciated by reference to the following detailed description taken in conjunction with the drawings.[0006]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a schematic representation of an exemplary multimedia home entertainment computer system for implementing the methods of the present, wherein an exemplary simplified TV broadcasting and client-server network system for providing synchronized interactive contents to the multimedia home entertainment system is also illustrated. [0007]
  • FIG. 2 is a diagrammatic representation of an exemplary handheld remote-control device for interacting with the multimedia home entertainment system of FIG. 1 using the computer remote-control methods of the present invention. [0008]
  • FIG. 3 illustrates an exemplary window desktop display according to the present invention. [0009]
  • FIGS. [0010] 4-6 and 8-9 are displays of exemplary computer windows for illustrating methods of using the remote-control device of FIG. 2 to interact with the multimedia system of FIG. 1 according to the present invention.
  • FIG. 7 is a schematic illustration of an exemplary virtual rectangle for arranging application-tool buttons of an application program so as to provide instruction for displaying the application-tool buttons within an application-tool window of FIG. 6 according to the present invention. [0011]
  • FIGS. [0012] 10-12 are simplified exemplary diagrams for illustrating the CMFT video image compression method according to another aspect of the present inventions.
  • DETAILED DESCRIPTION OF THE INVENTION
  • Referring to FIGS. [0013] 1-9, there are shown new and novel computer remote-control methods, apparatus, and systems embodying the concepts of the present invention. While the present invention is susceptible to embodiments in various forms, there is provided detailed description of the presently preferred embodiments, with the understanding that the present disclosure is to be regarded as exemplifications, and does not limit the invention to the specific embodiments illustrated. In some instances, for purposes of explanation and not for limitation, specific reference or other numbers, diagrams, or dimensions, etc., may be set forth in order to provide a thorough understanding of the invention. In other instances, detailed descriptions of well-known elements or electronic circuitry or computer or network components are omitted so as to not obscure the depiction of the invention with unnecessary details. In case when alternate arrangements of an element or component are described or displayed, like parts or components may be assigned with the same numerical reference numbers.
  • Referring first to FIG. 1, a home entertainment system may include an Internet enabled [0014] multimedia client computer 30, and a hand-held remote control device 710 for control of all other elements of the entertainment system. In addition, the entertainment system may also include other type of electronic devices, such as a toy figure, a CD or DVD player, a sound system, etc., that are controlled by the computer 30 and by the remote control 710; In FIG. 1, these electronic devices controlled by the computer 30 and by the remote control 710 are represented generally by the device 702. The computer system 30 is provided with a display 900, such as a computer monitor or a large screen TV, and may include a TV turner component such that both the computer/Internet contents received from a web site 300 and TV programs or streaming videos 270 received from a TV broadcasting center 208 can be displayed on the display 900. As shown, the computer 30 is connected to the web site 300 via the Internet 800. The streaming video 270 may also be transmitted to the computer 30 from the web site 300 through the Internet. It is preferred that the Web site 300 and the TV broadcasting system 208 are provided with synchronization systems 202 and 210 respectively such that the TV contents provided by the broadcasting system 208 can be made interactive. As it is well know in the art, the Web site 300 usually includes a Web server processing system for serving or providing Web content such as a video or video clip or a HTML document requested by the client computer 30; in a standard request-response process for viewing a graphical content by the client, the client system 30 specifies the URL or IP address of said content in a request, which is forwarded to the corresponding Web site 300 supporting such content; in response thereto, the Web server 300 will send the requested content to the client 30. Typically, the Web site 300 also includes application or programming system and database system for implementing a business entity's various business applications.
  • Reference is now made to FIGS. [0015] 2-3 in conjunction with FIG. 1. As shown therein, the user control of the multimedia entertainment system of FIG. 1 is provided by a handheld remote control device 710. The remote control 710 includes computer and Internet/web-browser operation buttons and display-control/scrolling means (as described below), a conventional number/letter button assembly 720 for TV-channel selection, TV- channel changing buttons 72U and 72D for increasing and decreasing the current TV channel number respectively, a TV channel return button 72R, and conventional volume control buttons 71U and 71D and a mute button 71M. Alternatively, a conventional VCR-, CD-, or DVD-type media-player operation assembly that includes “play”, “fast forward”, “fast reverse”, “pause”, and “stop” buttons, etc. may also be included on the remote control device 710.
  • It is understood that, the foregoing conventional TV control buttons may also be employed for interacting with other components of the multimedia system of FIG. 1, and that, some of said “conventional” TV control buttons may also be used for computer operations. For examples, (i) In addition to the function of conventional TV channel selection, the number/[0016] letter buttons 720 may also be used to provide access to a computer application program, as described in details herein below; and (ii) The channel return button 72R may be used for controlling the currently active computer-TV window by switching the display content therein back to the previously viewed TV channel, etc. The remote control 710 may (optionally) includes a device-selection button 71A for selecting which device (i.e., e.g., whether it is the TV, VCR, AC, DVD, or e-Toy, or the currently active window of the Computer system 30, etc.) is to be currently controlled by the remote control 710 and/or by the computer 30.
  • It is appreciated that, the basic concepts of computer remote control of the present invention include, (i) a simple remote control operation will instruct an active window to display a display item, such as a listing of application buttons or links (e.g., a toolbar, a bookmark listing, or a menu, etc.), and in the meantime, causing the cursor to be displayed on such display item so as to facilitate the user's desired action of easily browsing through and clicking on one of the application buttons or links so listed; (ii) a limited number of press-button combinations on the [0017] remote control 710 will provide unlimited shortcut means for easy access to the user's desired applications or commands; and (iii) the press-buttons of the remote control 710 are arranged in such a way that they provide a user with intuitive means to interact with window-based computer multimedia system.
  • It is preferred that, (i) the [0018] remote control 710, as shown in FIG. 2, includes a display buttons 71Q for display control, such, for examples, as opening/closing a window on the display 900, or displaying or expanding a menu (see below), etc., by interacting with the Computer operation system 30 via wireless signals, and that (ii) the function of TV channel selection and other conventional TV operations are the default functions provided by the number buttons assembly 720, since almost all users already have extensive experience of using a remote-control device to interact with TV. For examples, (i) in order to display TV channel 7 within a new TV-window 913 (i.e., window No. 6 or VI) on the display 900 (see FIG. 3), a user will depress the display button 71Q and then the number button “6” of the remote control 710 for opening a new window 913 on the display 900, then the user can press the number button “7” for displaying the TV channel 7 within the TV-window 913; and (ii) if the user presses the number button “7” without depressing the button 71Q or any other functional button there-before, the current active window will be switched to TV channel No. 7.
  • It is preferred, according to the present invention, that each window or TV-window displayed on the [0019] display 900 of the multimedia system 30 is provided with a simple window ID so as to facilitate remote control by a user. For example, as shown in FIG. 3, the windows 913, 912, and 914 are provided with, respectively, an ID 92C (i.e., a bar and a dot on right for indicating ID No. 6, which is similar to “VI”), an ID 92A (i.e., three dot, or III), and an ID 92D (i.e., a bar for indicating ID No. 5, similar to “V”), for indicating that they are window No. 6, 3, and 5 respectively. These window IDs 92A, 92C, and 92D may also service the purpose of indicating the currently “active” window, i.e., the window currently controlled by the remote control 710, by, for example, highlighting or brightening the ID of the active window (e.g., In FIG. 3, the currently active window is widow 912, as indicated by the window ID 92A). Apparently, (i) other methods, such for example as highlighting the frame of a Window, may also be used for indicating the currently active window, and (ii) other commonly used ID methods can be employed for the purpose of window identification. The window IDs can also allow a user to easily switch from one window to another window displayed on the display 900, or to close a window, using the remote control device 710.
  • Alternatively, two or more remote control devices may be provided for control of different windows displayed on the [0020] same display 900 and supported or controlled by the same computer system 30, in which case the computer and the remote control devices may be provided with device-identification systems/components such that a window opened by one remote control device will not response to control signals transmitted from other remote control device(s). Alternatively, if a multimedia system is provided with more than one remote-control devices, one or more of these remote-control device may be provided with higher control priority (the master remote control), i.e., a window opened by a non-master remote control can be controlled by a master remote control device, while a window opened by a master remote control will not response to a non-master remote control device.
  • As shown in FIG. 2, a cancel or [0021] close button 74C may be provided on the remote control 710 such that, for examples, (i) the combination of depressing the cancel/close button 74C and then the display button 71Q will close the current active window; (ii) if the currently active window is the TV-window 913 and the user wants to close the TV-window 912 (window ID No. 3), the user may then have two options, including: (a) using the combination of depressing the cancel/close button 74C and then the number button “3” on the remote control 710, or (b) switching from the TV-window 913 to the TV-window 912 by pressing the “Disp” button 71Q and the number button “3”, then closing the now active window 912 by the combination of depressing cancel/close button 74C and then the display button 71Q.
  • The [0022] TV signals 270 transmitted from the broadcast center 208 may include display instructions as to how many TV-windows are desired for a current TV program 901 displayed on the display 900, and/or the default size, position, and content of each such TV-window. A web page or web content associated and/or in synchronization with the current TV program may (i) provide sub-content information relating to the TV program (e.g., stats information or different camera angle for a live sport event), and/or (ii) include web links or application links that are related to the TV program. Such a web page/content associated with the current TV program may be displayed within a separate window on the display 900; clicking through any web/application link therein using the remote control 710 will cause the associated contents be displayed within a designated or newly opened Window.
  • It is preferred that the TV-[0023] computer operation system 30 is a web-browser based operation system, i.e., the full functionality of a conventional web browser is integrated or incorporated into the basic functionality of the operation system 30. Accordingly, the remote control 710 is provided with short-cut press buttons for interacting with the web-browser functions of the TV-computer system 30.
  • It is preferred that the [0024] remote control 710 includes a “bookmark” button 73X, as shown in FIG. 2, for adding a web page into the bookmark list (or the like) of the computer system 30's web browser. The bookmark function of the remote control 710 can be used to provide users with interactive TV experience if a TV program on the display 900 is provided with a synchronized web page/content by the web site 300. When the computer 30 receives the bookmark signal from the remote control 710, it will contact the web site 300 for obtaining the web page associated or synchronized with the current TV program and/or the URL or IP address thereof, and add such URL or IP address to the bookmark listing of the web browser, such that a user may later have access to interactive information provided thereby. It is preferred that, (i) if the currently active Window displays a TV program 901, depressing the “bookmark” button 73X will cause the web browser of the computer 30 to bookmark a Web page associated and/or synchronized with the current TV program 901, regardless of whether such web page is displayed within a window; and that (ii) if the currently active window on the display 900 displays a web page or web content, regardless of whether such web page/content is related to any TV content shown within any other windows on the display 900, depressing the “bookmark” button 73X will cause the web browser to bookmark such web page or web content so displayed. In some situations, a user's computer may not be connected to the Internet while, for example, watching a TV program on the display 900, and thus it would be impossible to immediately obtain the URL or IP address of the web page associated or synchronized with the current TV program; In which case, the information stored in the bookmark file of the computer 30 in response to receiving a bookmark signal from the remote control device 710 may only includes the name or channel number of the current TV program and the current timestamp; Then when the user later wants to have access to the associated web page to learn more information about such particular section of the TV program, the web site server 300 used for providing interactive contents for the TV program will be able to obtain such web page and sent it to back to the client 30 base on the TV-channel and the timestamp information received from the client computer 30.
  • It is also preferred that, the [0025] remote control 710 further includes a “buy” button 73B for facilitating online purchasing by activating an online identity-authentication/purchasing application installed in the computer 30. For examples, if a web page shown within a window on the display 900 includes a “purchase” item available for online purchasing, when a user press the “buy” button 73B to activate said online identity-authentication/purchasing application, it will cause the client computer 30 to contact the web site that supports such e-commerce transactions. As a result thereof, the related confirmation information, such as the price, name, shipping address, credit card account information, etc., and/or simple instructions, will be displayed on the display 900 within a designated window; the user can then press the “buy” button 73B again or a “go” button 74G (see below) on the remote control 710 to complete the transaction; Apparently, the system 30 may require that the user provide password information using, for example, the number buttons 720 on the remote control 710 before completing the purchasing process. If the current web page does not include any “purchase” item available for online purchasing, a brief message such as “no item available for online purchasing” may be displayed in response to user pressing the “buy” button 73B.
  • It is understood that, the web page or content associated or synchronized with a TV program and provided by a web site may also include TV-display instruction for instructing the TV-[0026] computer system 30 as to the desired size, position, and background color, etc. of the TV windows designated for the TV program and/or for any of its sub-contents. In one example, if the web content associated/synchronized with a TV program is a HTML- or XML-type web page, said TV-display instruction may be included in a HTML- or XML-type <tag> at the header or body section of such web page.
  • As shown in FIG. 2, the [0027] remote control 710 also includes a “Go” button 74G for interacting with or for activating a computer application program, a “cursor float” control button 74F for controlling the “floating status” of an input-device indicator or cursor 920 on the display 900 (See FIG. 4), and a cursor control assembly 740. As shown, the assembly 740 includes a vertical rolling wheel 74V and a pair of horizontal rolling wheels 74R and 74L. The vertical rolling wheel 74V is provided for controlling vertical-only content scrolling or cursor movement or the like on the display 900; the two horizontal rolling wheels 74R and 74L are provided for controlling horizontal-only content scrolling or cursor movement or the like. It is understood that, the main reason for having two horizontal rolling wheels 74R and 74L instead of one in the FIG. 2 example is for the purpose of providing geometric symmetry only. Alternatively, the remote device 710 may be provided with only one horizontal rolling wheel. It is also understood that, (i) the rolling wheels 74V, 74R and 74L of the FIG. 2 example shall be understood as one full rolling mechanism for providing the full function of content scrolling and/or for placing the input device indicator, or the cursor 920 of FIG. 3, to any position on the display 900, and that (ii) the horizontal rolling mechanism provided by 74R/74L may be replaced by a “sliding mechanism” or the like, such, for example, as having the wheel 74V mounted on a sliding bar such that moving the wheel 74V along such sliding bar will provide the same effect as the rolling wheels 74R/74L.
  • It is well known that, the conventional mouse has at least one full rolling mechanism, such as the trackball underneath the convention mouse. Some of the mouse-type input device, such as the so-called “intelli-mouse” marketed by Microsoft Corp., has two rolling mechanism, including a conventional trackball located at the underneath and a small rolling wheel on top of the mouse. The basic functions of the computer mouse as an input device includes: (i) cursor movement, i.e., moving the cursor to any position on a computer display, (ii) scrolling, i.e., scrolling contents displayed within a window if the window does not provide enough space for displaying the entire content of an application program; (iii) execution, i.e., executing or “clicking on/through” an display item, such as a command button, a link, an icon, a shortcut, a menu, etc., currently located by the cursor, which is accomplished by the “left click” button of the conventional computer mouse; (iv) command listing, i.e., providing a listing of commands or other items or properties associated with the display item currently located by the cursor, which is accomplished by the “right click” button of the conventional computer mouse; and (v) text-cursor control, i.e., placing the text-typing cursor at an desired position—the conventional window system employs a two-cursor system in a text-related application, such as a word-processor, wherein the text cursor is the position where text input is to be entered into the text field of the application; in many cases, the text cursor is separate from the mouse-movement cursor. [0028]
  • As described above, the “Go” [0029] button 74G of the remote-control device 710 provide the foregoing function of executing or “clicking on/through” of the conventional mouse; The rolling wheels 74V and 74R/74L provide the foregoing function of cursor movement and/or text-cursor control. Another button 74K is provided on the device 7 1 0 for providing the foregoing function of command listing or “right clicking” of the conventional mouse. Since a full rolling mechanism usually requires substantial space, it is preferred that a single full rolling mechanism, i.e., the rolling wheels 74V and 74R/74L of the FIG. 2 example, is used for providing both content scrolling and cursor movement functions (Alternatively, a vertical scrolling bar/rod or stick that can be operated by a user's thumb may be provided on the remote control 710 for providing content scrolling). This is accomplished by providing the cursor 920 and the rolling mechanism of the remote control device 710 with various “cursor-control/scrolling modes”. According to the present invention, the controlling and/or arrangement of such cursor-control/scrolling mode shall be based on (i) the type of user inputs received from the remote control 710, and/or on (ii) the type of application or contents displayed within the current window; The assignment of such cursor-control mode to each window content may be done either manually by a user or automatically by the computer interface system based on the type of contents or application within the window. For example, if the current window is a very long web page, the computer interface system may automatically assign the default cursor-control/scrolling mode of such application to a “fast-scrolling local” mode (see below). It is appreciated that such a cursor-mode-control system of the present invention provides an important advantage of allowing user to have easy access to display items/contents on the display 900, as described in detailed herein below. Since the cursor icon 920 is for indicating the functioning and user's manipulation of a user-input device, the status of the cursor may be reflected or indicated by the shape and/or color of the cursor icon 920.
  • It is preferred that the [0030] cursor 920 on the display 900 is provided with three basic floating status or modes, including a “floating mode”, a “local mode” and a “text-cursor mode”, which are related to the “depth” (or “floating depth”) of the cursor movement and are controlled by the button 74F of the remote control device 710. If the current application area located by the cursor 920 is not a text field for text input, pressing the button 74F will cause the cursor 920 to switch between said floating and local modes—i.e., the interface system will ignore the text-cursor mode; If the current application area located by the cursor 920 is a text field for text input, pressing the button 74F will cause the cursor 920 to switch among said floating, local, and text-cursor modes. The floating statuses of the cursor are defined as follows: (i) If the cursor 920 is in said floating mode, a user may cause the cursor 920 to move freely throughout the entire display area of the display 900 by operating the rolling wheels 74V or 74L/74R of the remote control, in which case, the cursor 920 is not restricted within a specific Window or application area on the display; (ii) If the cursor 920 is in said local mode, the cursor will provide scrolling and/or cursor movement functions for the respective local window application area (see below for details), and the cursor will usually be restricted within a local application window; (iii) The “text-cursor mode” is the conventional text cursor of a text field for text input; operating the rolling wheels 74V or 74R/74L will move such text cursor within a text field; the conventional text-selection function may be provided by operating the rolling wheels 74V or 74R/4L after double-clicking or while holding the Go button 74G (similar to holding the left button of a mouse) of the remote control 710; clicking the button 74C of the remote control 710 after text selection will delete the selected texts; etc.
  • It is also preferred, according to the present invention, that in parallel to said local, floating, and text-cursor modes, the [0031] cursor 920 is also provided with three modes relating to cursor/scrolling movement, including a “continuous mode”, a “leaping mode”, and a “fast-scrolling mode”—the status of the cursor 920 may be switched among these three modes by clicking a control button 74U on the remote control device 710. The definitions of these three modes are as follows: (i) the “continuous mode” is the conventional mode for continuous cursor movement; (ii) the “leaping mode” is for causing the cursor 920 to leap among the executable items displayed, i.e., the cursor will skip those non-executable item, so as to allow user to quickly locate the executable items displayed; as used herein, the term “executable item” means an item displayed that can allow a user to execute a desired command or a program or an action, by click on the item, or to input text, such as a web link, an application icon or shortcut on the desktop, a file/folder icon or shortcut, an application-tool button, a text field for text input, etc.; and (iii) the “fast-scrolling mode” is for providing the function of fast scrolling of any display contents within a window or sub-window. It is understood that the cursor status controlled by the button 74F are parallel to the cursor status controlled by the button 74U of the remote control 710; Thus, there are total of nine (9) cursor-control/scrolling mode available, including: continuous floating, continuous local, continuous text-cursor, leaping floating, leaping local, leaping text-cursor, fast-scrolling local, fast-scrolling floating, and fast-scrolling text-cursor modes. Apparently, other type of cursor-control/scrolling mode may also be provided, depending the nature or character of each individual application program. Some of these modes, such as the fast-scrolling floating and the leaping text-cursor modes, may never be use or be ignored by the computer interface system—i.e., when in the floating mode, the interface system may ignore the fast-scrolling mode; when in the text-cursor mode, the leaping mode may be ignored by the interface system, etc. In one example, it is preferred that when the cursor is located at a text field, it is automatically switched to the continuous text-cursor mode by the interface system. It is preferred that, the computer interface system of the present invention will determined the optimal cursor-control/scrolling mode for each application or content within a window; or Alternatively, a user may set the cursor-control/scrolling mode for each application manually. For examples, (i) if the application is a word processor, the interface system may set its default cursor-control/scrolling mode to the “continuous text-cursor” mode, and ignore all the leaping modes, and regards the “local mode” and the “continuous mode” as the same; (ii) if the contents within a window are application-tool buttons of an application program, the interface system may set its default cursor-control/scrolling mode to the “continuous local” or “leaping local” mode (see below), and ignore the text-cursor mode; (iii) If the application is a relatively short web page that is displayed fully within a window, the interface system may set its default cursor-control mode to the “leaping floating” mode; etc.
  • The control of any new or application-specific cursor-control/scrolling modes added for a specific application program may be provided by “Double clicking” the [0032] button 74F; Alternatively, the remote-control device 710 may be provided with another button for control of any new cursor-control/scrolling modes added for a specific application program. Also alternatively, the rolling wheel 74V and the button 74F may be combined such that clicking on the wheel 74V will provide the same effect as depressing the button 74F, so as to reduce number of button on the remote-control device 710. In the FIG. 2 example, a window-control button 72W is provided on the remote control 710 such that, (I) double-clicking the button 72W will cause the cursor 920 to be in a window-size adjusting mode such that operating the rolling wheels 74V and/or 74R/4L of the remote control 710 thereafter will change the size of the current window; doubling clicking the button 72W again will cause the cursor 920 to be in its previous mode; and (II) It is preferred that each window on the display 900 is provided with at least three “display modes”, including: (i) a full-screen mode—i.e., full-screen display of the window without showing any toolbar, (ii) a full-screen toolbar mode—i.e., full-screen display of the window with the showing of some or all toolbars provided therefore, and (iii) a reduced-size non-toolbar mode—i.e., the display of the window is smaller than the full screen as desired without showing the toolbars (alternatively, a reduced-size toolbar mode may also be added thereto, which may be done at user's option); depressing the button 72W of the remote control 710 will cause the window to switch amount these display modes; Other window-display modes, such as transparent/non-transparent modes, or window-position-control mode for permitting/facilitating using the rolling wheels 74V and/or 74R/4L of the remote control 710 to change the position of an entire window on the display 900, may also be included therein, or be included in a “right-clicking” listing of an window that is to be listed and be available for use when a user “right-click” a mouse or press the button 74K of the remote control device 710 when pointing the cursor 920 to the frame of the window. It is understood that a window, according to the present invention, may be transparent such that, for example, a web page associated/synchronized with a current TV program may be overlaid or displayed on top of such TV program displayed (i.e., there are two layers of display contents), so as to provide the function of allowing a user to click on a display item that is provided by the web page but appears to be provided by the TV program.
  • It is preferred that while in said fast-scrolling local mode, the [0033] cursor 920 provides two functions: (1) if the respective local application content is not fully displayed within the current window, operating the rolling wheels 74V or 74L/74R will scroll the application contents within the window, i.e., moving the view of the local application content such that a hidden portion of the content is displayed within the window; and (2) after scrolling to an end of the display content of the application within the window, the cursor 920 itself will then start to move within said the window if the user repeats the same rolling wheel operation. In the FIG. 5 example, a new icon for the cursor 920 (as compared with the cursor 920 of FIG. 4) indicates that the cursor is now in the fast-scrolling local mode; After the content of the window 912 reach its top end (as shown in FIG. 5, a file folder 93Q′ is located at the top portion of the widow 912, as compared with FIG. 4), the cursor 920 itself starts to move upwardly (as compared with FIG. 4) when the user repeats the same operation of rolling the wheel 74V upwardly. For the purposes of window control, the tool bar or menu bar area of an application or window can be regarded as a window or a sub-window. It is preferred that, clicking on an “Application Tools” button 731 provided on the remote control device 710 will cause the application tool buttons of an current application program to be displayed within a predefined area (see FIG. 4) (Note that, it may include one or more than one row(s) of application-tool buttons) and in the meantime, caused the cursor 920 to be displayed at such application-tool area, and cause the cursor 920 to be in said “leaping local mode”, so as to allow a user to navigate or browse through the menu/tool bar area window/sub-window—If the menu or toolbar sub-window does not show all the available buttons, rolling the wheels 74V or 74L/74R will first cause the cursor 920 to browse through each individual application-tool buttons displayed; After the cursor 920 reaches the boundary of such application-tool sub-window, if the user repeats the same rolling wheel operation, it will cause the entire menu or toolbar to slide horizontally and/or to roll vertically (i.e., scrolling) such that more application-tool button can be displayed within the sub-window. Alternatively, another set of navigation/scrolling buttons or vertical stick may be provided on the remote control 710 such that the operating thereof by a user will cause said entire menu or toolbar to slide horizontally or to roll vertically first before causing the cursor 920 to browse through each individual application button.
  • The [0034] display 912 of FIG. 4 is an exemplary desktop window display according to the present invention, which includes an interactive section 94D for display of live or updated information provided by a web site, such as sports/news update, email update, live stock market data or quote, etc. An icon within the window 912 may also be made interactive. For examples, an Email icon 95C and the number 95C′ therein indicate that there is currently one new email received. As shown, some of the application or web link or file icons displayed within the window 912 are arranged within a four by four matrix 980. Each matrix cell includes one display item, and is identified by a matrix ID number. As shown, the ID numbers 11, 14, 41 and 44 are assigned to the matrix cells 98A, 98B, 98C, and 98D respectively, so as to facilitate easy identification of each matrix cell and to allow a user to use the number keys 720 in combination with a function/program key 75F provided on the remote control 710 to have easy access to the items associated with or displayed within these matrix cells (see below). In addition, the desktop window 912 of FIG. 4 also includes a hard drive icon 90A and a trashcan icon 90B, which may be partially visible through an application content within the widow for graphically indicating user's actions of, respectively, saving and deleting of files and/or data. In addition, the following items are included within matrix 980: a file shortcut 93P, a web link 94C, a web application icon 94B, a file folder shortcut 93Q, a web-based TV schedule link 94A, a TV channel-1 selection icon 95D (i.e., clicking on the icon 95D will cause the current window to switch to TV channel No. 1), a shortcut 95A for an application, and an icon 95B for a computer game. The window 912 of FIG. 4 also include a “Go” icon 94G such that clicking on the icon 94G will have essentially the same effect as depressing the “Go” button 74G of the remote control 710. The icon 94G may also provide a visual effect that the “Go” button 74G of the remote control 710 have been pressed.
  • The [0035] window 912 may also includes an alert component 981, which may be situated, for example, at the bottom of the window 912, as shown in FIG. 4. The alert component 981 shown includes an email-alert icon 98Z for indicating whether there is any urgent email; a deadline alert icon 98X for indicating whether a bill-pay or other type of deadline is getting close; and an appointment alert icon 98Y, which may be associated with a web-based calendar application, etc. When there is no alert, the area 981 may automatically hide. One skilled in the art would appreciate that such type of alert component may be provided for any type of web browser or window applications. In addition, the window 912 of the FIG. 4 example also includes a “command input” text field 91B for user to input a file name, an application, or a web page URL, etc., with the status thereof being indicated by an indicator 91A. When the indicator 91A is “on”, it indicates that the field 91B is ready for receiving a command. For example, if a user want to view a web page linked thereto by the “Web Link 194C, which is located within the matrix 980 at cell ID No. 21 of the window 912 of FIG. 4, he can first click the “Appl. Prgrms” button 75F, and then the number buttons “2” and “1” on the remote control 710, which will cause the web page name or URL associated with the “Web Link 1” be displayed within the command input field 91B. Thereafter, the user can press the “Go” button 74G of the remote control 710 to view such web page. If the user decides that he made a mistake and wants to input another application, such as an “Appl” 95A, into the command input field 91B, the user can then click the button 75F twice such that the command input field 91B be ready for receiving new commands. It is understood that, the input of text into any type of text field can be done by a speech recognition system provided, which may be controlled by a voice input button 79M on the remote control 710. A microphone 78F is provided on the remote control 710 for receiving voice input. For example, if a user want to run an application, the user can just read the name of such application after the “command input” field 91B being ready for receiving input and after the user pressing voice input button 79M. When using speech recognition system for text input, the cursor is usually in said text-cursor mode, and the cursor icon may be set to look like a small microphone or the like.
  • The [0036] remote control 710 also includes an “App tool” button 731 for displaying/hiding the user's favorite toolbar provided for the current window and/or window application program. In the FIG. 6 example, the current application 490 within a window 912′ is a word processor; a plurality of application-tool buttons are to be displayed within a toolbar sub-window 470 when desired; and a user's frequently used application tools or commands for such application include: “open” 47A, “close” 47B, “save” 47C, “spell” 47D, “undo” 47E, and “redo” 47F. Pressing the “App Tools” button 73I will cause the following effects, (i) if the toolbar sub-window 470 was displayed with a plurality of application-tool buttons 47A-47F therein, hiding the toolbar sub-window 470 and any contents therein; (ii) if there is no application tool button displayed, and thus the toolbar sub-window 470 was not shown, instructing the window 912′ to display a plurality of application tool buttons 47A-47F within the toolbar sub-window 470, and instructing the cursor 920 to “jump” into or be displayed at the toolbar area 470 in, for example, the leaping local mode such that, the user could easily navigate or browse through these tools 47A-47F using the rolling wheels 74V and/or 74L/74R of the remote control 710, and execute or “click on” any of these tools 47A-47F using the “Go” button 74G; Pressing the “App Tools” button 731 again will hide the toolbar 470. It is preferred that some of the number keys 720 on the remote control 710 are predefined for access to some commonly used tools through combination with the “App tool” button 731. For example, the combination of pressing the “App tool” key 731 and the number key “3” on the remote control 710 would be equivalent to clicking on the “save” icon 47C, etc. In FIGS. 6-7, the toolbar window/sub-window 470 includes one row of application tool buttons. Alternatively, the toolbar window may include more than one row of application tool buttons. The application 490 of FIG. 6 may be provided with other application tools that may not be all displayed within the toolbar window 470. In the FIG. 7 example, all of the application tool buttons provided for the application 490 of FIG. 6 are arranged in form of a 3×6 virtual matrix or rectangle 495, which includes 3 rows, i.e., row 471, the middle row 47A-F, and row 472, and 6 colunms; Some of these tools, such as the tool 47X, may be associated with or controlled by a web site; Some of them, such as the tool 47Y may be a menu that includes a listing of other tools. It is understood that, the purpose of providing such a virtual matrix arrangement is for providing instruction to the interface system regarding the sequence of displaying the application tools within the toolbar window/sub-window 470 (i.e. scrolling instruction), while the entire matrix 495, other than those elements to be displayed within the window 470, shall not be displayed in any form at all (i.e., “virtual arrangement”). With respect to vertical scrolling, after causing the display of FIG. 6 in response to pressing the “Appl. Tool” button 73I by a user, if the user wants to view other tools available for the application 490, operating the rolling wheel 74V downward will cause the first row 471 of the virtual matrix/rectangle 495 to be displayed within the window 470; operating the rolling wheel 74V upward will cause the third row 472 of the virtual matrix/rectangle 495 to be displayed within the window 470; moving the cursor 920 to an application tool button displayed within the window 470 may be done by operating the rolling wheels 74R/74L. If the matrix 495 is longer than the window 470 in the horizontal direction, the horizontal scrolling of the display within window 470 will start after the cursor 920 reaches a horizontal end of the window 470 in response to the user's operating of the rolling wheels 74R/74L.
  • The [0037] display button 71Q of the remote control 710 may also service as a “shortcut” for viewing and navigating menus and other information provided by the Window 912. For example, pressing the display button 71Q and then the bookmark button 73X of the remote control 710 will: (i) cause a bookmark menu 93FX of the window 912 to be displayed in its expanded mode, as shown in FIG. 8, such that a plurality of items included therein (i.e., items 3X1, 3X2, . . . and 3X6, as shown) are listed along the vertical menu-expansion direction, regardless of whether the unexpanded bookmark icon 93F was displayed thereon therebefore, and in the meantime, (ii) cause the cursor 920 to be located within the expanded bookmark menu 93FX in the “leaping local” or “continuous local” mode, so as to let user easily browse through the listed items. In FIGS. 8-9, the item 3X2 included in the menu 93FX is not an expandable lower-level submenu; So when a user moves the cursor in horizontal direction using the rolling wheel 74L/74R of the remote control 710 while the cursor 920 is located at the item 3X2, the cursor will be restricted within the boundary of the expanded menu 93FX. The item 3X4 included in the menu 93FX is an expandable lower-level submenu and includes a plurality of submenu items (i.e., 34X1, 34X2, 34X3, 34X4); Thus, when a user moves the cursor in horizontal direction using the rolling wheel 74L/74R of the remote control 710 while the cursor 920 is located at the item 3X4, it will expand the submenu 3X4 into an expanded menu 934X, which is displayed next to the menu 93FX, as shown. Similarly, (i) depressing the “Disp” key 71Q and the “Appl. Prgrms” button 75F of the remote control 710 will cause an application/program menu 93B of the window 912 to be displayed in its expanded mode such that a user can have access to all application programs provided by the computer system; and (ii) depressing the “Disp” key 71Q and the window-control button 72W of the remote control 710 will cause an window management menu 95W of the window 912 to be displayed in its expanded mode such that a user may have a brief view of all windows currently being opened, and may switch to another opened window by clicking on one of the listed items included in the expanded menu 95W displayed. Some of the frequently used application programs included in the menu 93B may be assigned with a single-digit application ID number such that a user may have quick access to such application using the “Appl. Prgrms” key 75F and the number keys 720 of the remote control 710. For example, an email client application may be assigned with an application ID No. 1, such that when a user depress the “Appl. Prgrms” key 75F and the number “1” key of the remote control 710, the name of such email application will be displayed within the “command input” field 91B; then the user can depress the “Go” button 74G of the remote control 710 after confirming that the application name shown in the “command input” field 91B is the desired application. Similarly, (i) The most recently book-marked web pages included in the bookmark menu 93F may be assigned with a bookmark ID No. 0 such that a user may have quick and sequential access to each one of these web pages by the repeated actions of pressing the Bookmark key 73X and the number key “0” of the remote control 710; (ii) A user's favorite web pages or contents may be assigned with a bookmark ID (e.g., the web pages “yahoo.com”, “msn.com”, “amazon.com”, etc. may be assigned with bookmark ID Nos. 1, 2, 3, . . . respectively) such that the user may have quick access to these web pages/contents by pressing the Bookmark key 73X and the bookmark ID No. keys, respectively, on the remote control 710. The desktop window 912 of FIG. 4 may also include a file management menu 93C that is similar to the bookmark menu 93F, or the two menus 93C and 93F may be combined. As shown, for the purpose of providing user with convenience, the menus 93A, 93B, and 93F of the window 912 are provided with graphic icons 93W, 95F, and 95X, which are essentially the same as the graphic symbols on the keys 72W, 75F, and 73X respectively of the remote control 710, which are directly related thereto.
  • It is appreciated that, using the combinations of pressing the “Disp” key [0038] 71Q and other buttons on the remote control 710 may provide easy access to any application tools desired. For examples: (I) Since most of the window applications include expandable menus (or menu bar) at the top that contain listings of all commands available for such application (e.g., for a word processor, the menu bar may include “File”, “Edit”, “View”, “Format”, “Tools” menus, etc.), the combination of pressing the “disp button” 71Q and the “App tools” button 73I of the remote control 710 will, (i) if the application menu bar was not displayed within the window, instruct the window 912′ to display the menus or the menu bar, (ii) cause the cursor 920 to “jump” onto such menu bar in its local mode, and (iii) expand one of the menus located by the cursor 920; When forcing the cursor 920 to the right or left, it will expand the respective neighbor menu(s); The application command located by the cursor 920 in the expanded menu may then be executed or “clicked on” by pressing the “Go” button 74G of the remote control 710; (II) The combination of pressing the “disp button” 71Q and the “App tools” button 73I and then the number “0” button of the remote control 710 will, (i) if the alert area 981 was not displayed within the window 912, instruct the window 912′ to display the alert area 981, and (ii) cause the cursor 920 to “jump” into the alert area 981 in its local mode; The user could then click on any of the icon therein using the “Go” button 74G of the remote control 710.
  • The following disclosure regarding method of using the [0039] remote control device 710 as a general-purpose remote-control device for control any type of household electronic device is disclosed in paragraphs [0033]-[0036] and is illustrated in FIGS. 7-8 of the U.S. patent application Ser. No. 10/340,429 filed Jan. 10, 2003 by the common Applicant, which is incorporated herein by reference.
  • According to another aspect of the present invention, “Indirect Control” method is applied when using the [0040] remote control 710 for a general-purpose remote control of other electronic devices. For example, in FIG. 1, the computer 30 is provided with means for transmitting/receiving remote-control signals and with the associated software system, so as to simulate the functioning of a general-purpose handheld remote control device; if the remote control 710 is to be “adjusted” to control, for examples, new devices 702, rather than adjusting the remote control 710 itself, such an “adjustment” is made to the respective software applications provided therefore and installed in the computer 30 such that, the desired (or adjusted) remote control signals be transmitted from the computer 30 to the device 702 in response to the user operation of the remote control 710, while the control signals transmitted from the remote control 710 to the computer 30 are not “adjusted” (thus “Indirect Control”).
  • Thus, [0041] computer system 30 of FIG. 1 is to be provided with a signal transmitter/receiver subsystem or peripheral for interacting with the remote control 710 and with the electronic appliance 702 via wireless signals. The wireless signal employed for such remote control interactions may be, preferably, RF signal. Alternatively, such wireless signal may be infrared (IR) or intermediate frequency (IF) or modulated light signal or other type of commonly used wireless signal for remote control of an electronic appliance. It is preferred that said signal transmitter/receiver subsystem is provided with means for transmitting and receiving wide range(s) of commonly used signal spectrum so as to facilitate the functioning of general-purpose remote control. In addition, each one of the electronic devices feasible for remote control, such, for examples, as the device 702 of FIG. 1, may be provided with an application icon or link in the computer system 30 that may be shown on the window desktop; When a user click on such application icon to activate the associated remote-control software application program, the electronic appliance associated therewith may then be control by the remote control device 710.
  • Apparently, said signal transmitter/receiver subsystem is to be provided with a digital interface system so as to interact with other components and/or processing unit of the [0042] computer 30. As a result, the computer 30 can be programmed to interact with the remote control device 710 or to control the electronic appliance 702 without providing the remote control device 710 and the electronic appliance 702 with complex digital interface. One skilled in the art would appreciate that such a method may also be applied generally to using the computer 30 to control an electronic appliance 702 without providing the appliance 702 with digital interface, and the interaction between the computer and the appliance 702 may be either one-way or two-way interaction without providing the electronic appliance with digital interface; The computer system 30 may be a mouse-window type computer system or a remote-control based computer system or other type of commonly used computer system. The computer 30 may be connected to a network, such as the Internet, such that a user can control the electronic appliance 702 from a remote location by accessing the computer 30 from another computer provided at said remote location through said network. The remote control system of the present invention may be used to control or to interact with, for examples, a clock, an exercise device such as a treadmill, an air condition system, a microwave, a TV set, a VCR or DVD player, a sound system, a radio, a washer/dryer, an electronic stove, an electronic cooking device, or an electronic toy, etc.
  • Since the transmitter/receiver of the [0043] computer 30 is provided with wide-range signal spectrum capability, the computer 30 may be provided with “button identification/assignment” software application program for identifying a button on a remote control and assign such button to a selected button on a general purpose remote control device. For example, if the electronic appliance 702 is provided with an original handheld remote control device 710 x from the manufacture that has a button named 710 x-a, and a user wants to designate a button 710-A on the general-purpose remote control device 710 to replace the functioning of the button 710 x-a of the remote control device 710 x; the processes of identifying the buttons 710 x-a and 710-A are by simply clicking on these buttons on the remote control devices 710 x and 710 respectively, and the resultant wireless signals will then be received by the computer 30 and by the button identification/assignment application program, which may, for example, assign a reference code and/or a image icon to each said buttons so identified; the button identification/assignment application program may then be used to link or associate the button 710-A to the button 710 x-a such that, when the user depress or click on the button 710-A of the remote control 710, the wireless signals transmitted from computer 30 to the appliance 702 will be the same as the wireless signals transmitted thereto when the user depress the button 710 x-a of the remote control device 710 x; Similarly, the button 710 x-a of the remote control device 710 x may also be assigned to a display button of a toolbar or image shown on the computer monitor such that when a user click on said toolbar or said display button using a computer mouse, the wireless signals transmitted from the computer 30 to the appliance 702 will be the same as the wireless signals transmitted thereto when the user depress the button 710 x-a of the remote control device 710 x.
  • The following disclosures relate to the U.S. patent application Ser. No. 10/340,429 filed Jan. 10, 2003 by the common Applicant (hereinafter the “429” Application), of which the complete disclosures are incorporated fully herein by reference. [0044]
  • According to the 429 Application, the quality of the video images to be displayed at the client side may be improved significantly by amplifying the client-side pixel resolution and by adjusting the color characters of those newly created pixels at the client side according to the color characters of those original neighboring pixels. The conventional digital video/image compression technologies utilizes the so-called symmetric pixel resolution method, i.e., the pixel resolution of the video images to be displayed at the client side (hereinafter the “client-side pixel resolution”) is equal to (or less than) the pixel resolution of the original video images before compression (hereinafter the “server-side pixel resolution”). In addition, Discrete Cosine Transform (DCT) is the standard image compression technique. In the DCT process, the image is divided into small blocks of pixels, with each block of the pixels then undergoing a two-dimensional cosine transform to produce a two-dimensional array of transform coefficients; thereafter, the resultant transform coefficients are subject to compression by threshold and quantization operations: (i) through threshold operation, all those coefficients with magnitude smaller than a threshold value are set to zero, whereas (ii) the quantization operation involves scaling each coefficient by finite step size (i.e. quantized value) and rounding off to the nearest quantized value. Thus, the DCT compression method may be understood as transforming the original image data in the two-dimensional special domain into a two-dimensional frequency domain, or it may be understood as using vibration-type waveforms (i.e., cosine function) to represent the image data. However, unlike the sound signal, the color character F at any pixel point (xy) of a two-dimensional video image frame is not a naturally vibrating signal. Thus, in many cases, cosine function is not necessarily the best math function for representing each and every pixel block of the image frame with respect to image-compression efficiency. [Note that, it would be feasible for using the cosine function to transform the sound signal from the time domain into the frequency domain—i.e., dividing a sound signal into a plurality of sequential time block, and then using the cosine function to transform each time block into frequency domain.][0045]
  • According to another aspect of the present invention, Continuous Multi-Function Transform (i.e., “CMFT”) (as compared with Discrete Cosine Transform or DCT) method is to be used for (video) image compression. In the CMFT process, a video image frame is divided into a plurality of pixel blocks (which is similar to the DCT method); thereafter, the values of the color characters F at pixel positions (xy) of each pixel block is transformed into the parameters/coefficients of a group of predefined continuous math functions/formulas. The CMFT method can be understood as using a group of continuous (instead of discrete) math functions/formula F(xy) to represent the data F of each pixel block. Said group of predefined math function/formula may include cosine function as well as any other type of math function, such as a polynomial, a straight line or plane, a constant, an exponential, etc., or any combination thereof. For example, if a pixel block is just part of a flat background, it would be more efficient to use the simple function of {F(xy)=const} than using the DCT transform. Each one of these math functions/formulas may have its boundary condition unless such boundary is the same as or is outside the respective pixel blocks. [0046]
  • In FIG. 10, the data F′[0047] 1, F′2, F′3, F′b1, F′b2, F′7, F′8 and F′N represents the original values of color characters F at the pixel positions XY1, XY2, XY3, XY4, XY6, XY7, XY8, and XYN, respectively, of an exemplary and simplified pixel block XY1—XYN. As shown in FIG. 10, the CMFT method of the present invention can be understood as finding the math function(s) {F=F(xy)} that can “draw” best line/plane 450 across through each and every one of these data, i.e., transforming these data into the parameters/coefficients of said math function(s). It is understood that, in almost all cases, it's impossible to obtain “rigorous” math method for such transform. However, there are non-rigorous or computing methods, such as statistical data fitting and the like and other computing method, available for such transform. (Other data fitting method may also be used) [Note that, The DCT transform may be understood as “rigorous” math transform. However, such DCT transform does not provide any data compression at all—as described above, the compression is actually realized by the threshold and quantization operations after DCT.] In one example, the statistical data analysis method, such as the Lest Square Fitting (LSF) used in physics and other scientific research, may be used to calculate the parameters/coefficients of the math function(s) {F=F(xy)}; These statistical data analysis method usually only provide estimation of the parameters/coefficients of the math function(s)/formula(s) used for the data fitting; The form(s) of the math function(s)/formula(s) needs to be predetermined based on prior experimentations or experience; In addition, an error bar for representing statistical error is usually provided for each and every data. If, for example, the LSF method or the like is to be used for CMFT, (i) the error bar may be artificially added to the data at each pixel point, in which case, the value of the error bars may be estimated based on the desired accuracy of the data fitting at a particular area of the video image frame; and (ii) the “statistical weight” of the data may also be artificially manipulated (e.g., in order to make sure that the data fitting is more accurate near an image-element boundary, “statistical weight” of the data near such boundary may be artificially increased). In general, a better data fitting result would require more computing power and/or more complex math function(s)/formula(s) {F=F(xy)} that has more parameters/coefficients.
  • Thus, through the CMFT process, the original video-image data Fs are transformed into the parameters/coefficients of a group of predetermined math functions/formulas. The data transmitted from the server to the clients will include (but not limited to): (i) Math formula/function IDs; (ii) values of the parameters/coefficients of each Math formula/function used for the data fitting; and (iii) boundary condition for each Math formula/function if such boundary is within the pixel block. Usually, if the size of the pixel block or sub-block is relatively small (e.g., 8×8 or 4×4), the data of each such block may be fitted to predetermined math function(s) without concerning other boundary conditions other than the values of the data at the edges of the pixel block. If the predetermined math function(s) is to be used to fit the data of a relatively large pixel block or parent pixel block, it might be necessary to apply a boundary condition. In regarding boundary condition, sometimes it may be necessary or convenient to use a math function to represent a portion of the boundary of an image element; Such image-boundary math function(s) may be provided with another set of math-function ID(s) such that it can be easily employed to identify the pixel range of the data that are to be fitted to a math function {F=F(xy)}. Sometimes, it may be better to apply spherical or elliptic or other coordinate system for describing said image-boundary math function than utilizing the conventional Cartesian/rectangular coordinate systems. [0048]
  • Therefore, as shown in FIG. 11, the data transferred from the server to the client for the pixel block of XY[0049] 1—XYN may be understood as continuous math function(s) or continuous data, i.e., the client computing system can create the image data for the pixel block of XY1—XYN with ANY pixel resolution as desired based the math function(s) {F=F(xy)} and the parameters/coefficients thereof received from the server system. Thus, the process of pixel-resolution amplification at the client side described in the 429 Application can be done conveniently, efficiently and naturally without requesting high computing power from the client computing system if the CMFT method is employed. As shown in FIG. 12, the new data of f1, f2, . . . fN for representing the increased pixel resolution are obtained by simply putting the respective pixel positions thereof into the formula(s)/function(s) of {F=F(xy)}. It is also appreciated that, by using the CMFT method, the pixel resolution of the video image frame to be displayed at the client side may not be evenly distributed throughout the image frame.
  • Naturally, the embodiments of the present invention are not limited to the above-described examples or to those examples shown in the drawings. It will be understood that various substitutions, rearrangements and other changes to the forms and details of the examples can be made by those skilled in the art without departing from the scope of the invention as set forth in the annexed claims. [0050]

Claims (23)

What is claimed is:
1. In a computing system having an application program executed by the computing system and displayed within an application window on a display of said computing system, said application program including application tools that are represented by application-tool buttons respectively that are to be displayed within a predefined application-tool area when desired, said computing system including a cursor to be displayed on said display when desired for indicating functioning and user's manipulation of a user-input device, a method comprising the steps of:
In response to receiving a user input from said user-input device,
Determining whether any of said application-tool buttons are displayed within said application-tool area,
When it is determined that there is no application-tool button displayed within said application-tool area: displaying a plurality of said application program's application-tool buttons within said application-tool area, causing said cursor to be displayed within said application-tool area, and browsing through said application-tool buttons when a cursor-movement input is received.
2. The method as set forth in claim 1, wherein said application-tool area is a window, which is to be visible on said display when any of said application-tool buttons are displayed therein, said method further comprising the step of: when it is determined that there is at least one of said application-tool buttons displayed within said application-tool area and thus that the application-tool area window is visible on said display, hiding said application-tool area window.
3. The method of claim 1, further comprising the step of: causing said cursor to be in a local mode such that movement of the cursor is restricted within said application-tool area.
4. The method as set forth in claim 1, wherein said application-tool buttons are arranged in form of a virtual geometric shape so as to provide instructions for sequentially displaying said application-tool buttons within said application-tool area, whereby said virtual geometric shape is to be partially displayed within said application-tool area when desired, and wherein said step of browsing through comprises the step of:
In response to receiving a cursor-movement input for directing the cursor to move in a desired direction,
Determining whether there is substantial space for moving the cursor in said desired direction before the cursor encountering an external boundary of said application-tool area;
When it is determined that there is substantial space for moving the cursor in said desired direction before the cursor encountering the external boundary of said application-tool area, moving said cursor in said desired direction;
When it is determined that there is no substantial space for moving the cursor in said desired direction before the cursor encountering the external boundary of said application-tool area, scrolling said application-tool area's content displayed.
5. The method as set forth in claim 4, wherein said application-tool buttons are arranged in such a way that said virtual geometric shape is a virtual rectangle such that said applications-tool buttons form a plurality of virtual rows and columns, and wherein said step of scrolling comprises the steps of:
Determining whether in said desired direction there is any virtually hidden application-tool buttons outside said application-tool area's boundary;
When it is determined that in said desired direction there is virtually hidden application-tool buttons outside said application-tool area's boundary, moving said hidden application-tool buttons into said application-tool area for display.
6. The method as set forth in claim 5, wherein two opposite sides of said virtual rectangle are virtually attached to one another such that said virtual rectangular forms a virtual cylinder so as to provide continuous scrolling experience in a desired scrolling direction.
7. The method as set forth in claim 1, 2, 3, 4, 5, or 6, wherein said application program is a spreadsheet or the like, a web browser or the like, a media player or the like, a word processor or the like, a CAD application or the like, an image editor or the like, an image viewer or the like, a motion-picture editor or the like, motion-picture viewer or the like, a web publishing application or the like, a document reader or the like, an Instant Messaging client or the like, an Instant-Messaging-related application or the like, an E-mail client or the like, or an E-mail-related application or the like.
8. The method as set forth in claim 1, wherein said user-input device is a handheld remote-control device.
9. In a computing system having an expandable menu for display on a display of said computing system when desired and a cursor to be displayed on said display when desired for indicating functioning and user's manipulation of a user-input device, a method comprising the steps of:
In response to receiving a user input from said user-input device,
Displaying said menu in its expanded mode on said display such that a plurality of items included in said menu are displayed on said display; and
Causing said cursor to be visibly located on said expanded menu.
10. The method as set forth in claim 9, wherein said step of displaying is to be performed before said step of causing.
11. The method as set forth in claim 9, wherein said step of displaying is to be performed after said step of causing.
12. The method of claim 9, further comprising the step of: causing said cursor to be in a local mode such that movement of the cursor is restricted within the expanded menu displayed.
13. The method as set forth in claim 9, 10, 11, or 12, wherein said user-input device is a handheld remote-control device.
14. In a computing system having a cursor for indicating functioning and user's manipulation of a user-input device and an expandable menu, said menu being displayed in its expanded mode on a display of said computing system such that a plurality of items included therein are displayed and are listed along a menu-expansion direction on said display, said cursor being visible on said display and being located within said expanded menu, a method comprising the steps of:
In response to a cursor-movement input from said user-input device for moving the cursor in a desired direction,
Determining whether there is substantial space for moving the cursor in said desired direction before the cursor encountering an external boundary of said expanded menu,
When it is determined that, there is substantial space for moving the cursor in said desired direction before the cursor encountering the external boundary of said expanded menu, moving said cursor in said desired direction;
When it is determined that, there is no substantial space for moving the cursor in said desired direction before the cursor encountering the external boundary of said expanded menu, navigating the item currently located by the cursor.
15. The method as set forth in claim 14, wherein said item currently located by the cursor is an expandable submenu including a plurality of submenu items, and wherein said step of navigating comprises the step of:
Determining whether said desired direction is substantially perpendicular or parallel to said menu-expansion direction,
When it is determined that said desired direction is substantially perpendicular to said menu-expansion direction, expanding said submenu such that a plurality of submenu items included therein are displayed on said displayed, and moving said cursor to said expanded submenu.
16. The method of claim 15, further comprising the step of: When it is determined that said desired direction is substantially parallel to said menu-expansion direction, maintaining said cursor's position near said external boundary of said expanded menu such that said cursor-movement input does not cause the cursor to move beyond said external boundary.
17. The method as set forth in claim 14, wherein said item currently located by the cursor is not an expandable submenu and does not include any submenu item, and wherein said step of navigating comprises the step of: maintaining said cursor's position near said external boundary of said expanded menu such that said cursor-movement input does not cause the cursor to move beyond said external boundary.
18. The method as set forth in claim 14, 15, 16, or 17, wherein said user-input device is a handheld remote-control device.
19. A method comprising the steps of:
In response to receiving a user input,
Displaying an display item within a predefined area on a display of a computer system, and
Causing a cursor of said computer system to be displayed within said predefined area on said display.
20. The method as set forth in claim 19, wherein said step of displaying is to be performed before said step of causing.
21. The method as set forth in claim 19, wherein said step of displaying is to be performed after said step of causing.
22. The method as set forth in claim 19, wherein said display item includes a plurality of application-tool buttons of an application program executed by said computer system.
23. The method as set forth in claim 19, wherein said display item is a pulled-down menu.
US10/688,269 2002-10-28 2003-10-20 Computer remote control Abandoned US20040135819A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/688,269 US20040135819A1 (en) 2002-10-28 2003-10-20 Computer remote control

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US42149302P 2002-10-28 2002-10-28
US10/688,269 US20040135819A1 (en) 2002-10-28 2003-10-20 Computer remote control

Publications (1)

Publication Number Publication Date
US20040135819A1 true US20040135819A1 (en) 2004-07-15

Family

ID=32717421

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/688,269 Abandoned US20040135819A1 (en) 2002-10-28 2003-10-20 Computer remote control

Country Status (1)

Country Link
US (1) US20040135819A1 (en)

Cited By (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040104929A1 (en) * 2002-12-02 2004-06-03 Tatung Co., Ltd. Method of establishing a customized webpage desktop
WO2004061594A2 (en) * 2002-12-16 2004-07-22 Microsoft Corporation Systems and metzhods for interfacing with computer devices
US20040187139A1 (en) * 2003-03-21 2004-09-23 D'aurelio Ryan James Interface for determining the source of user input
US20040189592A1 (en) * 2003-03-28 2004-09-30 Ge Medical Systems Global Technology Company, Llc Method for associating multiple functionalitis with mouse buttons
US20040220723A1 (en) * 2002-12-16 2004-11-04 Gould Bear Eric Justin Systems and methods for interfacing with computer devices
US20040217988A1 (en) * 2002-12-16 2004-11-04 Bear Eric Justin Gould Systems and methods for interfacing with computer devices
US20040223599A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Computer system with do not disturb system and method
US20040223061A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Computer camera system and method for reducing parallax
US20040222978A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Control and communications panel for a computer system
US20040225892A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Method and system for activating a computer system
US20040257341A1 (en) * 2002-12-16 2004-12-23 Bear Eric Justin Gould Systems and methods for interfacing with computer devices
US20050033536A1 (en) * 2003-08-07 2005-02-10 Fender Michael R. Systems and methods for operating a measurement and testing instrument
US20050069101A1 (en) * 2003-09-30 2005-03-31 Microsoft Corporation System and method for using telephony controls on a personal computer
US20050068423A1 (en) * 2003-09-30 2005-03-31 Microsoft Corporation Method and system for capturing video on a personal computer
US20060026279A1 (en) * 2004-07-28 2006-02-02 Microsoft Corporation Strategies for monitoring the consumption of resources
US20060164324A1 (en) * 2004-11-23 2006-07-27 Microsoft Corporation Sending notifications to auxiliary displays
US20060176834A1 (en) * 2005-02-07 2006-08-10 Agilemesh, Inc. Video node for wireless mesh network
US20060230055A1 (en) * 2005-03-31 2006-10-12 Microsoft Corporation Live graphical preview with text summaries
US20060242590A1 (en) * 2005-04-21 2006-10-26 Microsoft Corporation Simple content format for auxiliary display devices
US20060294454A1 (en) * 2005-06-22 2006-12-28 Sony Corporation Program, information processing method, and information processing apparatus
US20070004463A1 (en) * 2005-07-01 2007-01-04 Plantronics, Inc. Wireless headset systems and methods for activating application programs on processor-based host
EP1744240A1 (en) * 2005-07-12 2007-01-17 Kabushiki Kaisha Toshiba Mobile phone and mobile phone control method
US20070021129A1 (en) * 2005-07-21 2007-01-25 Sony Corporation Information processing apparatus, processing method therefor, program allowing computer to execute the method
US20070022447A1 (en) * 2005-07-22 2007-01-25 Marc Arseneau System and Methods for Enhancing the Experience of Spectators Attending a Live Sporting Event, with Automated Video Stream Switching Functions
US20070150719A1 (en) * 2003-09-30 2007-06-28 Microsoft Corporation Method and system for unified audio control on a personal computer
US20070176896A1 (en) * 2006-01-31 2007-08-02 Hillcrest Laboratories, Inc. 3D Pointing devices with keysboards
WO2007088410A1 (en) 2006-02-02 2007-08-09 Nokia Corporation System, method and computer program for controlling a cursor
US20070195007A1 (en) * 2003-05-05 2007-08-23 Microsoft Corporation Method and system for auxiliary display of information for a computing device
US20070226644A1 (en) * 2006-03-23 2007-09-27 Bradfield Terry R Method and apparatus to control the display of windows in a processing system
US20070288640A1 (en) * 2006-06-07 2007-12-13 Microsoft Corporation Remote rendering of multiple mouse cursors
US20080037741A1 (en) * 2003-05-05 2008-02-14 Microsoft Corporation Real-Time Communications Architecture And Methods For Use With A Personal Computer System
US20080122675A1 (en) * 2006-06-27 2008-05-29 John Bilodeau Universal remote control programming and operations platform
US20080175179A1 (en) * 2007-01-23 2008-07-24 Fujitsu Limited Content processing apparatus and content processing program
US20090319954A1 (en) * 2008-06-23 2009-12-24 Microsoft Corporation Command driven web site browsing
US20100064334A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US20100060477A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US20100064328A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US20100060715A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US20100064329A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US20100060788A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US20100064333A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US20100060716A1 (en) * 2008-09-05 2010-03-11 Kaido Kert Peripheral device for communication over a communications system
US7701471B1 (en) * 2005-03-02 2010-04-20 Adobe Systems Incorporated Methods and apparatus to display a viewing region
US20100100850A1 (en) * 2001-10-02 2010-04-22 Verizon Corporate Services Group, Inc. Methods and apparatus for controlling a plurality of applications
US7711868B2 (en) 2004-11-23 2010-05-04 Microsoft Corporation Waking a main computer system to pre-fetch data for an auxiliary computing device
US20100122162A1 (en) * 2007-02-16 2010-05-13 Satoshi Terada Content display device, television receiver, content display method, content display control program, and recording medium
US20100138873A1 (en) * 2005-10-07 2010-06-03 Sharp Kabushiki Kaisha Receiving device, server, television receiver, mobile terminal, system, receiving method, information processing program, and storage medium
US7784065B2 (en) 2005-02-07 2010-08-24 Microsoft Corporation Interface for consistent program interaction with auxiliary computing devices
US20100235740A1 (en) * 2009-03-11 2010-09-16 Sony Corporation Interactive Access to Media or Other Content Related to a Currently Viewed Program
US7827232B2 (en) 2003-05-05 2010-11-02 Microsoft Corporation Record button on a computer system
US20120026400A1 (en) * 2010-08-02 2012-02-02 Haengjoon Kang Method for providing a shortcut and image display device thereof
US20120154382A1 (en) * 2010-12-21 2012-06-21 Kabushiki Kaisha Toshiba Image processing apparatus and image processing method
US20120162538A1 (en) * 2010-12-28 2012-06-28 Comcast Interactive Media, Llc Communication, Monitoring and Control Architecture and Method
CN102547428A (en) * 2011-12-06 2012-07-04 中兴通讯股份有限公司 Switching method of television channels and client for realizing switch of television channels
US20120331389A1 (en) * 2011-06-22 2012-12-27 Google Inc. Download area management
US20130125195A1 (en) * 2004-02-10 2013-05-16 Uei Cayman Inc. Interactive web-based codeset selection and development tool
US20130131836A1 (en) * 2011-11-21 2013-05-23 Microsoft Corporation System for controlling light enabled devices
US8635554B2 (en) 2003-05-20 2014-01-21 Microsoft Corporation Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer
US8689139B2 (en) * 2007-12-21 2014-04-01 Adobe Systems Incorporated Expandable user interface menu
US20140289254A1 (en) * 2004-01-22 2014-09-25 Sony Electronics Inc. Methods and apparatuses for presenting content
CN104462012A (en) * 2014-12-05 2015-03-25 唐茂杰 Remote operating terminal for computer
CN104536591A (en) * 2014-12-10 2015-04-22 康佳集团股份有限公司 Mouse quick positioning method and system
US20150128088A1 (en) * 2013-11-05 2015-05-07 Humax Co., Ltd. Method, apparatus and system for controlling size or position of display window
USD749085S1 (en) * 2011-08-23 2016-02-09 Sony Corporation Display panel or screen with graphical user interface
US20160044359A1 (en) * 2014-08-08 2016-02-11 Arris Enterprises, Inc. Channel tuning with synthesized key codes
US20160078640A1 (en) * 2010-03-10 2016-03-17 Tangentix Limited Multimedia content delivery system
US20160179363A1 (en) * 2014-12-23 2016-06-23 Lenovo (Singapore) Pte. Ltd. Cursor indicator for overlay input applications
US20170242562A1 (en) * 2016-02-19 2017-08-24 Analogix Semiconductor, Inc. Remote Controller
US20180234720A1 (en) * 2010-04-06 2018-08-16 Comcast Cable Communications, Llc Streaming and Rendering Of 3-Dimensional Video by Internet Protocol Streams
US10534754B2 (en) * 2011-10-17 2020-01-14 Samsung Electronics Co., Ltd Method and apparatus for providing search function in touch-sensitive device
CN110856036A (en) * 2019-11-11 2020-02-28 深圳市赛菲姆科技有限公司 Remote desktop implementation method, interaction method, device, equipment and storage medium
US11523169B2 (en) * 2011-07-31 2022-12-06 Google Llc Systems and methods for presenting home screen shortcuts
US11711592B2 (en) 2010-04-06 2023-07-25 Comcast Cable Communications, Llc Distribution of multiple signals of video content independently over a network

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5588107A (en) * 1993-03-22 1996-12-24 Island Graphics Corporation Method and apparatus for selectably expandable menus
US5831615A (en) * 1994-09-30 1998-11-03 Intel Corporation Method and apparatus for redrawing transparent windows
US5896123A (en) * 1995-06-16 1999-04-20 Sony Corporation Information processing method and apparatus
US5959621A (en) * 1996-12-06 1999-09-28 Microsoft Corporation System and method for displaying data items in a ticker display pane on a client computer
US5990862A (en) * 1995-09-18 1999-11-23 Lewis; Stephen H Method for efficient input device selection of onscreen objects
US6353450B1 (en) * 1999-02-16 2002-03-05 Intel Corporation Placing and monitoring transparent user interface elements in a live video stream as a method for user input
US20020085045A1 (en) * 2000-12-28 2002-07-04 Vong William H. Context sensitive labels for an electronic device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5588107A (en) * 1993-03-22 1996-12-24 Island Graphics Corporation Method and apparatus for selectably expandable menus
US5831615A (en) * 1994-09-30 1998-11-03 Intel Corporation Method and apparatus for redrawing transparent windows
US5896123A (en) * 1995-06-16 1999-04-20 Sony Corporation Information processing method and apparatus
US5990862A (en) * 1995-09-18 1999-11-23 Lewis; Stephen H Method for efficient input device selection of onscreen objects
US5959621A (en) * 1996-12-06 1999-09-28 Microsoft Corporation System and method for displaying data items in a ticker display pane on a client computer
US6353450B1 (en) * 1999-02-16 2002-03-05 Intel Corporation Placing and monitoring transparent user interface elements in a live video stream as a method for user input
US20020085045A1 (en) * 2000-12-28 2002-07-04 Vong William H. Context sensitive labels for an electronic device

Cited By (146)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100100850A1 (en) * 2001-10-02 2010-04-22 Verizon Corporate Services Group, Inc. Methods and apparatus for controlling a plurality of applications
US8239779B2 (en) * 2001-10-02 2012-08-07 Verizon Corporate Services Group Inc. Methods and apparatus for controlling a plurality of applications
US7188315B2 (en) * 2002-12-02 2007-03-06 Tatung Co., Ltd. Method of establishing a customized webpage desktop
US20040104929A1 (en) * 2002-12-02 2004-06-03 Tatung Co., Ltd. Method of establishing a customized webpage desktop
US20040217988A1 (en) * 2002-12-16 2004-11-04 Bear Eric Justin Gould Systems and methods for interfacing with computer devices
WO2004061594A3 (en) * 2002-12-16 2005-03-31 Microsoft Corp Systems and metzhods for interfacing with computer devices
WO2004061594A2 (en) * 2002-12-16 2004-07-22 Microsoft Corporation Systems and metzhods for interfacing with computer devices
US20040179042A1 (en) * 2002-12-16 2004-09-16 Bear Eric Justin Gould Systems and methods for interfacing with computer devices
US20040220723A1 (en) * 2002-12-16 2004-11-04 Gould Bear Eric Justin Systems and methods for interfacing with computer devices
US20040257341A1 (en) * 2002-12-16 2004-12-23 Bear Eric Justin Gould Systems and methods for interfacing with computer devices
US7325238B2 (en) * 2003-03-21 2008-01-29 Microsoft Corporation Interface for determining the source of user input
US20040187139A1 (en) * 2003-03-21 2004-09-23 D'aurelio Ryan James Interface for determining the source of user input
US20040189592A1 (en) * 2003-03-28 2004-09-30 Ge Medical Systems Global Technology Company, Llc Method for associating multiple functionalitis with mouse buttons
US20040225892A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Method and system for activating a computer system
US7827232B2 (en) 2003-05-05 2010-11-02 Microsoft Corporation Record button on a computer system
US20040222978A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Control and communications panel for a computer system
US20040223061A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Computer camera system and method for reducing parallax
US7913182B2 (en) 2003-05-05 2011-03-22 Microsoft Corporation Method and system for auxiliary display of information for a computing device
US7443971B2 (en) 2003-05-05 2008-10-28 Microsoft Corporation Computer system with do not disturb system and method
US7424740B2 (en) 2003-05-05 2008-09-09 Microsoft Corporation Method and system for activating a computer system
US20080037741A1 (en) * 2003-05-05 2008-02-14 Microsoft Corporation Real-Time Communications Architecture And Methods For Use With A Personal Computer System
US20040223599A1 (en) * 2003-05-05 2004-11-11 Bear Eric Gould Computer system with do not disturb system and method
US20070195007A1 (en) * 2003-05-05 2007-08-23 Microsoft Corporation Method and system for auxiliary display of information for a computing device
US8635554B2 (en) 2003-05-20 2014-01-21 Microsoft Corporation Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer
US8694915B2 (en) 2003-05-20 2014-04-08 Microsoft Corporation Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer
US9392043B2 (en) 2003-05-20 2016-07-12 Microsoft Technology Licensing, Llc Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer
US20060136156A1 (en) * 2003-08-07 2006-06-22 Fender Michael R Systems and methods for operating a measurement and testing instrument
US20050033536A1 (en) * 2003-08-07 2005-02-10 Fender Michael R. Systems and methods for operating a measurement and testing instrument
US7010442B2 (en) * 2003-08-07 2006-03-07 Agilent Technologies, Inc. Systems and methods for operating a measurement and testing instrument
US8443179B2 (en) 2003-09-30 2013-05-14 Microsoft Corporation Method and system for unified audio control on a personal computer
US8127125B2 (en) 2003-09-30 2012-02-28 Microsoft Corporation Method and system for unified audio control on a personal computer
US20070150719A1 (en) * 2003-09-30 2007-06-28 Microsoft Corporation Method and system for unified audio control on a personal computer
US8644481B2 (en) 2003-09-30 2014-02-04 Microsoft Corporation Method and system for unified audio control on a personal computer
US7440556B2 (en) 2003-09-30 2008-10-21 Microsoft Corporation System and method for using telephony controls on a personal computer
US20050069101A1 (en) * 2003-09-30 2005-03-31 Microsoft Corporation System and method for using telephony controls on a personal computer
US8166287B2 (en) 2003-09-30 2012-04-24 Microsoft Corporation Method and system for unified audio control on a personal computer
US20050068423A1 (en) * 2003-09-30 2005-03-31 Microsoft Corporation Method and system for capturing video on a personal computer
US8245027B2 (en) 2003-09-30 2012-08-14 Microsoft Corporation Method and system for unified audio control on a personal computer
US10372748B2 (en) * 2004-01-22 2019-08-06 Sony Corporation Methods and apparatuses for presenting content
US20140289254A1 (en) * 2004-01-22 2014-09-25 Sony Electronics Inc. Methods and apparatuses for presenting content
US20130125195A1 (en) * 2004-02-10 2013-05-16 Uei Cayman Inc. Interactive web-based codeset selection and development tool
US9792133B2 (en) * 2004-02-10 2017-10-17 Universal Electronics Inc. Interactive web-based codeset selection and development tool
US10261816B2 (en) * 2004-02-10 2019-04-16 Universal Electronics Inc. Interactive web-based codeset selection and development tool
US20060026279A1 (en) * 2004-07-28 2006-02-02 Microsoft Corporation Strategies for monitoring the consumption of resources
US20060164324A1 (en) * 2004-11-23 2006-07-27 Microsoft Corporation Sending notifications to auxiliary displays
US7711868B2 (en) 2004-11-23 2010-05-04 Microsoft Corporation Waking a main computer system to pre-fetch data for an auxiliary computing device
US7835331B2 (en) * 2005-02-07 2010-11-16 Agilemesh, Inc. Video node for wireless mesh network
US20060176834A1 (en) * 2005-02-07 2006-08-10 Agilemesh, Inc. Video node for wireless mesh network
US7784065B2 (en) 2005-02-07 2010-08-24 Microsoft Corporation Interface for consistent program interaction with auxiliary computing devices
US7701471B1 (en) * 2005-03-02 2010-04-20 Adobe Systems Incorporated Methods and apparatus to display a viewing region
US7680810B2 (en) * 2005-03-31 2010-03-16 Microsoft Corporation Live graphical preview with text summaries
US20060230055A1 (en) * 2005-03-31 2006-10-12 Microsoft Corporation Live graphical preview with text summaries
US20060242590A1 (en) * 2005-04-21 2006-10-26 Microsoft Corporation Simple content format for auxiliary display devices
US7810022B2 (en) * 2005-06-22 2010-10-05 Sony Corporation Program, information processing method, and information processing apparatus
US20060294454A1 (en) * 2005-06-22 2006-12-28 Sony Corporation Program, information processing method, and information processing apparatus
US20070004463A1 (en) * 2005-07-01 2007-01-04 Plantronics, Inc. Wireless headset systems and methods for activating application programs on processor-based host
US8755845B2 (en) * 2005-07-01 2014-06-17 Plantronics, Inc. Wireless headset systems and methods for activating application programs on processor-based host
US7526316B2 (en) 2005-07-12 2009-04-28 Kabushiki Kaisha Toshiba Mobile phone and mobile phone control method
EP1744240A1 (en) * 2005-07-12 2007-01-17 Kabushiki Kaisha Toshiba Mobile phone and mobile phone control method
US20070015534A1 (en) * 2005-07-12 2007-01-18 Kabushiki Kaisha Toshiba Mobile phone and mobile phone control method
US20070021129A1 (en) * 2005-07-21 2007-01-25 Sony Corporation Information processing apparatus, processing method therefor, program allowing computer to execute the method
US7614017B2 (en) * 2005-07-21 2009-11-03 Sony Corporation Information processing apparatus, processing method therefor, program allowing computer to execute the method
US8391774B2 (en) * 2005-07-22 2013-03-05 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with automated video stream switching functions
US8391825B2 (en) 2005-07-22 2013-03-05 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with user authentication capability
US8391773B2 (en) 2005-07-22 2013-03-05 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with content filtering function
US8432489B2 (en) 2005-07-22 2013-04-30 Kangaroo Media, Inc. System and methods for enhancing the experience of spectators attending a live sporting event, with bookmark setting capability
US9065984B2 (en) 2005-07-22 2015-06-23 Fanvision Entertainment Llc System and methods for enhancing the experience of spectators attending a live sporting event
US20070022447A1 (en) * 2005-07-22 2007-01-25 Marc Arseneau System and Methods for Enhancing the Experience of Spectators Attending a Live Sporting Event, with Automated Video Stream Switching Functions
US8156531B2 (en) 2005-10-07 2012-04-10 Sharp Kabushiki Kaisha Receiving device, server, television receiver, mobile terminal, system, receiving method, information processing program, and storage medium
US20100138873A1 (en) * 2005-10-07 2010-06-03 Sharp Kabushiki Kaisha Receiving device, server, television receiver, mobile terminal, system, receiving method, information processing program, and storage medium
US20070176896A1 (en) * 2006-01-31 2007-08-02 Hillcrest Laboratories, Inc. 3D Pointing devices with keysboards
US9411428B2 (en) * 2006-01-31 2016-08-09 Hillcrest Laboratories, Inc. 3D pointing devices with keyboards
WO2007088410A1 (en) 2006-02-02 2007-08-09 Nokia Corporation System, method and computer program for controlling a cursor
EP1979803A1 (en) * 2006-02-02 2008-10-15 Nokia Corporation System, method and computer program for controlling a cursor
EP1979803A4 (en) * 2006-02-02 2015-01-21 Nokia Corp System, method and computer program for controlling a cursor
US20110041093A1 (en) * 2006-03-23 2011-02-17 Terry Ryun Bradfield Method And Apparatus To Control The Display Of Windows In A Processing System
US7831924B2 (en) * 2006-03-23 2010-11-09 Intel Corporation Method and apparatus to control the display of windows in a processing system
US8694914B2 (en) * 2006-03-23 2014-04-08 Intel Corporation Method and apparatus to control the display of windows in a processing system
US20070226644A1 (en) * 2006-03-23 2007-09-27 Bradfield Terry R Method and apparatus to control the display of windows in a processing system
US20070288640A1 (en) * 2006-06-07 2007-12-13 Microsoft Corporation Remote rendering of multiple mouse cursors
US20080122675A1 (en) * 2006-06-27 2008-05-29 John Bilodeau Universal remote control programming and operations platform
US20080175179A1 (en) * 2007-01-23 2008-07-24 Fujitsu Limited Content processing apparatus and content processing program
US8479096B2 (en) * 2007-02-16 2013-07-02 Sharp Kabushiki Kaisha Content display device, television receiver, content display method, content display control program, and recording medium
US20100122162A1 (en) * 2007-02-16 2010-05-13 Satoshi Terada Content display device, television receiver, content display method, content display control program, and recording medium
US9965145B2 (en) 2007-12-21 2018-05-08 Adobe Systems Incorporated Expandable user interface menu
US8689139B2 (en) * 2007-12-21 2014-04-01 Adobe Systems Incorporated Expandable user interface menu
US9396280B2 (en) * 2008-06-23 2016-07-19 Microsoft Technology Licensing, Llc Command driven web site browsing
US20090319954A1 (en) * 2008-06-23 2009-12-24 Microsoft Corporation Command driven web site browsing
US20100064329A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US20130305175A1 (en) * 2008-09-05 2013-11-14 Microsoft Corporation Displaying Graphical Representations of Contacts
US20100064328A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US9128592B2 (en) * 2008-09-05 2015-09-08 Skype Displaying graphical representations of contacts
US8473994B2 (en) 2008-09-05 2013-06-25 Skype Communication system and method
US20100060716A1 (en) * 2008-09-05 2010-03-11 Kaido Kert Peripheral device for communication over a communications system
US8489691B2 (en) * 2008-09-05 2013-07-16 Microsoft Corporation Communication system and method
US8520050B2 (en) 2008-09-05 2013-08-27 Skype Communication system and method
US9654726B2 (en) 2008-09-05 2017-05-16 Skype Peripheral device for communication over a communications system
US8866628B2 (en) 2008-09-05 2014-10-21 Skype Communication system and method
US20100060477A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US20100064334A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US8421839B2 (en) 2008-09-05 2013-04-16 Skype Peripheral device for communication over a communications system
US20100060715A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US8413199B2 (en) 2008-09-05 2013-04-02 Skype Communication system and method
US20100064333A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US8407749B2 (en) 2008-09-05 2013-03-26 Skype Communication system and method
US20100060788A1 (en) * 2008-09-05 2010-03-11 Skype Limited Communication system and method
US8555167B2 (en) * 2009-03-11 2013-10-08 Sony Corporation Interactive access to media or other content related to a currently viewed program
EP2725784A1 (en) * 2009-03-11 2014-04-30 Sony Corporation Interactive access to media or other content related to a currently viewed program
CN102349308A (en) * 2009-03-11 2012-02-08 索尼公司 Interactive access to media or other content related to a currently viewed program
US20100235740A1 (en) * 2009-03-11 2010-09-16 Sony Corporation Interactive Access to Media or Other Content Related to a Currently Viewed Program
US20160078640A1 (en) * 2010-03-10 2016-03-17 Tangentix Limited Multimedia content delivery system
US9776086B2 (en) * 2010-03-10 2017-10-03 Tangentix Limited Method of transforming an image file
US20200137445A1 (en) * 2010-04-06 2020-04-30 Comcast Cable Communications, Llc Handling of Multidimensional Content
US10448083B2 (en) 2010-04-06 2019-10-15 Comcast Cable Communications, Llc Streaming and rendering of 3-dimensional video
US11368741B2 (en) * 2010-04-06 2022-06-21 Comcast Cable Communications, Llc Streaming and rendering of multidimensional video using a plurality of data streams
US20220279237A1 (en) * 2010-04-06 2022-09-01 Comcast Cable Communications, Llc Streaming and Rendering of Multidimensional Video Using a Plurality of Data Streams
US11711592B2 (en) 2010-04-06 2023-07-25 Comcast Cable Communications, Llc Distribution of multiple signals of video content independently over a network
US20180234720A1 (en) * 2010-04-06 2018-08-16 Comcast Cable Communications, Llc Streaming and Rendering Of 3-Dimensional Video by Internet Protocol Streams
CN102346630A (en) * 2010-08-02 2012-02-08 Lg电子株式会社 Method for providing a shortcut and image display device thereof
US20120026400A1 (en) * 2010-08-02 2012-02-02 Haengjoon Kang Method for providing a shortcut and image display device thereof
US8411201B2 (en) * 2010-08-02 2013-04-02 Lg Electronics Inc. Method for providing a shortcut and image display device thereof
US20120154382A1 (en) * 2010-12-21 2012-06-21 Kabushiki Kaisha Toshiba Image processing apparatus and image processing method
US10797904B2 (en) * 2010-12-28 2020-10-06 Comcast Interactive Media, Llc Communication, monitoring and control architecture and method
US11799683B2 (en) * 2010-12-28 2023-10-24 Comcast Interactive Media, Llc Communication, monitoring and control architecture and method
US20210160092A1 (en) * 2010-12-28 2021-05-27 Comcast Interactive Media, Llc Communication, Monitoring and Control Architecture and Method
US20120162538A1 (en) * 2010-12-28 2012-06-28 Comcast Interactive Media, Llc Communication, Monitoring and Control Architecture and Method
US20120331389A1 (en) * 2011-06-22 2012-12-27 Google Inc. Download area management
US11818302B2 (en) 2011-07-31 2023-11-14 Google Llc Systems and methods for presenting home screen shortcuts
US11523169B2 (en) * 2011-07-31 2022-12-06 Google Llc Systems and methods for presenting home screen shortcuts
USD802605S1 (en) 2011-08-23 2017-11-14 Sony Corporation Display panel or screen with graphical user interface
USD749085S1 (en) * 2011-08-23 2016-02-09 Sony Corporation Display panel or screen with graphical user interface
US10956367B2 (en) * 2011-10-17 2021-03-23 Samsung Electronics Co., Ltd Method and apparatus for providing search function in touch-sensitive device
US10534754B2 (en) * 2011-10-17 2020-01-14 Samsung Electronics Co., Ltd Method and apparatus for providing search function in touch-sensitive device
US11461271B2 (en) 2011-10-17 2022-10-04 Samsung Electronics Co., Ltd Method and apparatus for providing search function in touch-sensitive device
US9628843B2 (en) * 2011-11-21 2017-04-18 Microsoft Technology Licensing, Llc Methods for controlling electronic devices using gestures
US20130131836A1 (en) * 2011-11-21 2013-05-23 Microsoft Corporation System for controlling light enabled devices
CN102547428A (en) * 2011-12-06 2012-07-04 中兴通讯股份有限公司 Switching method of television channels and client for realizing switch of television channels
US20150128088A1 (en) * 2013-11-05 2015-05-07 Humax Co., Ltd. Method, apparatus and system for controlling size or position of display window
US20160044359A1 (en) * 2014-08-08 2016-02-11 Arris Enterprises, Inc. Channel tuning with synthesized key codes
US9729929B2 (en) * 2014-08-08 2017-08-08 Arris Enterprises Llc Channel tuning with synthesized key codes
CN104462012A (en) * 2014-12-05 2015-03-25 唐茂杰 Remote operating terminal for computer
CN104536591A (en) * 2014-12-10 2015-04-22 康佳集团股份有限公司 Mouse quick positioning method and system
US20160179363A1 (en) * 2014-12-23 2016-06-23 Lenovo (Singapore) Pte. Ltd. Cursor indicator for overlay input applications
US10592096B2 (en) * 2014-12-23 2020-03-17 Lenovo (Singapore) Pte. Ltd. Cursor indicator for overlay input applications
US20170242562A1 (en) * 2016-02-19 2017-08-24 Analogix Semiconductor, Inc. Remote Controller
CN110856036A (en) * 2019-11-11 2020-02-28 深圳市赛菲姆科技有限公司 Remote desktop implementation method, interaction method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
US20040135819A1 (en) Computer remote control
US11126333B2 (en) Application reporting in an application-selectable user interface
US20200221183A1 (en) Information Processing Apparatus, Information Processing Method, Program, And Information Processing System
AU2012100055A4 (en) Interface for watching a stream of videos
JP4388982B2 (en) Web browser capable of navigation between hypertext objects by remote control device
EP2499577B1 (en) Implementing customized control interfaces
JP5172169B2 (en) Content display device, television receiver, content display method, content display control program, and recording medium
US20140380229A1 (en) System, method and user interface for designing customizable products from a mobile device
JP4309937B2 (en) Content server
CN100334847C (en) Device and method for controlling equipment in household network and household network system
US20100077431A1 (en) User Interface having Zoom Functionality
WO2001037165A2 (en) An apparatus and method for simple wide-area network navigation
JP2009266238A (en) Control framework with zoomable graphical user interface for organizing, selecting and launching media item
KR20140028029A (en) Presentation format for an application tile
KR20080040035A (en) A method and a device for browsing information feeds
CN103649908A (en) Asynchronous handling of a user interface manipulation
EP2715482A1 (en) Visual search and recommendation user interface and apparatus
WO2022083554A1 (en) User interface layout and interaction method, and three-dimensional display device
US20230082668A1 (en) Methods for storing, accessing and rendering multimedia file and its metadata
JPH1021036A (en) Interactive video input and output system
US7773857B2 (en) Process and device for audio-visual program editing
EP2645733A1 (en) Method and device for identifying objects in movies or pictures
KR20030094584A (en) System and method for video based interactive interface

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION