WO2006003506A1 - Dynamic shortcuts - Google Patents

Dynamic shortcuts Download PDF

Info

Publication number
WO2006003506A1
WO2006003506A1 PCT/IB2005/002070 IB2005002070W WO2006003506A1 WO 2006003506 A1 WO2006003506 A1 WO 2006003506A1 IB 2005002070 W IB2005002070 W IB 2005002070W WO 2006003506 A1 WO2006003506 A1 WO 2006003506A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
remote control
control device
user interface
media files
Prior art date
Application number
PCT/IB2005/002070
Other languages
French (fr)
Inventor
Seppo PYHÄLAMMI
Kaj HÄGGMAN
Jouni Soitinaho
Tuomo Sihvola
Original Assignee
Nokia Corporation
Nokia, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Corporation, Nokia, Inc. filed Critical Nokia Corporation
Priority to EP05759635A priority Critical patent/EP1766603A1/en
Priority to JP2007517524A priority patent/JP2008507165A/en
Publication of WO2006003506A1 publication Critical patent/WO2006003506A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/162Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
    • H04N7/163Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing by receiver means only
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4888Data services, e.g. news ticker for displaying teletext characters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42208Display device provided on the remote control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4433Implementing client middleware, e.g. Multimedia Home Platform [MHP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications

Abstract

The invention provides searching, accessing, maintaining, or editing of media files using a remote control device having a display. The invention enables a user to manipulate displayed media files and other types of information stored on a server. The server may be coupled to a display device such as a television receiver and to a remote control device also having a display. A user, through the remote control device, may manipulate media files through the use of buttons displayed on the remote control device. The buttons of the remote control device may be associated with executable commands to be performed on the media files. The modified media files may be displayed on both the television receiver and the remote control device to improve a user's ability to modify the media files.

Description

DYNAMIC SHORTCUTS
FIELD OF THE INVENTION
[01] Aspects of the present invention relate generally to searching, accessing, maintaining, or editing digital information using a remote control device having a display. More specifically, aspects of the present invention concern sharing a user interface between two or more devices such as a receiver and a remote control device in order to provide a convenient way for a user to browse, select, or edit displayed media files.
BACKGROUND OF THE INVENTION
[02] A variety of mobile computing devices exist, such as personal digital assistants (PDAs), mobile phones, digital cameras, digital players, mobile terminals, etc. (hereinafter referred to as "mobile devices"). These devices perform various functions specific to the device, and are often able to communicate (via wired or wireless connection) with other devices. A single mobile device may, for example, provide Internet access, maintain a personal calendar, provide mobile telephony, and take digital photographs. However, memory capacity is typically limited on mobile devices. Wireless telephones and other mobile devices that create digital photographs, video segments and audio segments must store those segments. Storage of these items usually requires a relatively large amount of memory. Moreover, mobile devices are often not optimized for later viewing and enjoyment of image collections. The display screens on mobile devices are often small and have limited resolution. The small display screens also present difficulties when more than one person wishes to simultaneously view images.
[03] One solution to these challenges is to transfer files to other devices, such as a remotely-located personal computer or dedicated storage equipment. A user may, for example, use a mobile device to create images such as photographs, and periodically transfer those images to a server or other storage device located in the user's home or elsewhere. The images may be displayed on a receiver such as a television set for viewing. In this manner, the number of images a user may create (and retain) is not limited by the memory constraints of his or her mobile device. In addition, the images or photographs may be displayed on a larger and higher resolution display.
[04] However, the above solution creates additional challenges as users can now easily create and store numerous images. Users must manipulate a much larger number of images which increases the number of input commands such as key strokes that a user must enter to search, access, or edit the created images. In addition, a user must constantly share their attention between the television screen to view the images and the mobile device used to enter commands which is distracting and inefficient.
[05] For example, a user is often required to manipulate images such as rotating or enlarging images for proper viewing on a display. Manipulating these images requires a user to perform a number of separate keystrokes for each image including the issuing of a save command to save each manipulated image. In addition, in order to manipulate each of these images a user must constantly share their attention between the display device and the remote control device in order to properly enter each of the input commands.
[06] For these and other reasons, there remains a need for a system and method by which a user can more conveniently manipulate images and other displayed media files.
SUMMARY OF THE INVENTION
[07] Aspects of the present invention are directed to allowing a user to manipulate displayed media files and other types of information stored on a server. The server may be coupled to a display device such as a television receiver and to a remote control device also having a display. A user, through the remote control device, may manipulate media files through the use of buttons displayed on the remote control device. The buttons of the remote control device may be associated with executable commands to be performed on the media files. The executable commands may be substantially simultaneously displayed on both the television receiver and the remote control device to improve a user's ability to modify the media files. [08] These and other features of the invention will be apparent upon consideration of the following detailed description of preferred embodiments.
BRIEF DESCRIPTION OF THE DRAWINGS
[09] The foregoing summary of the invention, as well as the following detailed description of preferred embodiments, is better understood when read in conjunction with the accompanying drawings, which are included by way of example, and not by way of limitation with regard to the claimed invention.
[10] Figure 1 is a block diagram of an example of a wireless communication system in which various aspects of the present invention may be implemented.
[11] Figure 2 is a block diagram of an illustrative remote control device in accordance with an aspect of the present invention.
[12] Figure 3 is a block diagram of a server in accordance with an aspect of the present invention.
[13] Figure 4 shows a configuration for manipulating media files in accordance with an aspect of the present invention.
[14] Figure 5 show various screens of media application in accordance with an aspect of the present invention.
[15] Figure 6 shows a remote control device and an enlargement of an image displayed on the remote control device in accordance with an aspect of the present invention.
[16] Figure 7 shows a system for interacting with and manipulating media files with an enlargement of a second image displayed on both a remote control device and on a display device in accordance with an aspect of the present invention.
[17] Figure 8 shows a system for interacting with media files in accordance with an aspect of the present invention. [18] Figure 9 show a system for interacting with media files in accordance with another aspect of the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Example Operating Environment
[19] Figure 1 shows an example of a wireless communication system 110 in which the systems and methods of the present invention may be advantageously employed. One or more network-enabled remote control or input devices 112, such as a personal digital assistant (PDA), digital camera, cellular phone, mobile terminal, television, PC monitor, LCD projector, head display, or combinations thereof, is in communication with a server 114. Although not shown in Figure 1, server 114 may act as a file server, such as a personal server or personal storage device, for a network such as home network, some other Local Area Network (LAN), or a Wide Area Network (WAN).
[20] Server 114 may be a computer, laptop, set-top box, DVD, television, PVR, DVR, TiVo device, personal portable server, personal portable media player, network server or other device capable of storing and accessing data. Mobile device 112 may communicate with server 114 in a variety of manners. For example, remote control device 112 may communicate with server 114 via wireless network 118. Wireless network 118 may be a third-generation (3G) cellular data communications network, a Global System for Mobile communications network (GSM), or other wireless communication network. Remote control device 112 may also have one or more ports allowing a wired connection to server 114 via, e.g., universal serial bus (USB) cable 115. Remote control device 112 may also be capable of short-range wireless connection 120 (e.g., a BLUETOOTH, WLAN5 WiFi or IrDA link) to server 114. A single remote control device 112 may be able to communicate with server 114 in multiple manners.
[21] Server 114 may act as a repository for storing files received from remote control device 112 and from other sources. Server 114 may have, or be coupled to, a wireless interface 122 configured to transmit and/or receive communications (such as messages, files, or other data) with mobile network 118 or WLAN network. Server 114 may alternatively (or also) have one or more other communication network connections. For example, server 114 may be linked (directly or via one or more intermediate networks) to the Internet, to a conventional wired telephone system, or to some other communication or broadcasting network, such as a TV, a radio or IP datacasting networks.
[22] In one embodiment, remote control device 112 has a wireless interface configured to send and/or receive digital wireless communications within wireless network 118. As part of wireless network 118, one or more base stations (not shown) may support digital communications with remote control device 112 while the remote control device is located within the administrative domain of wireless network 118. The base station of wireless network 118 that is in communication with remote control device 112 may be the same or a different base station that is in communication with server 114. Indeed, remote control device 112 and server 114 may each be in communication with different wireless networks (e.g., remote control device 112 could be roaming), which could in turn be interlinked via one or more intermediate wired or wireless networks. For simplicity, server 114 and remote control device 112 are shown within the same wireless network 118.
[23] Remote control device 112 communicates with server 114 via wireless network 118 and is configured to transmit user data (e.g., electronic images, audio clips, video clips) for remote storage on server 114. Remote control device 112 may also be configured to access data previously stored on server 114. In one embodiment, file transfers between remote control device 112 and server 114 may occur via Short Message Service (SMS) messages and/or Multimedia Messaging Service (MMS) messages transmitted via short message service center (SMSC) 124 and/or a multimedia messaging service center (MMSC) 126. Although shown as part of network 118, SMSC 124 and MMSC 126 may be part of another network or otherwise outside of network 118. Although shown as separate logical entities, SMSC 124 and MMSC 126 could be a single entity. Further, SMSC 124 and MMSC 126 may coordinate via signaling between themselves for improving the file transfer process. For example, because SMSC 124 and MMSC 126 may be store-and-forward systems, rather than real-time systems, a file requested via an SMS message from remote control device 112 may still reside on MMSC 126 based upon a previous request. As such, SMSC 124 may copy MMSC 126 on an SMS file request and, if applicable, MMSC 126 may notify the user of the previously stored file. Further, MMSC 126 may simply transfer the requested file based on its stored copy of the file. In other embodiments, MMSC 126 may act as a repository for files, and remote control device 112 may simply request transfer of files from MMSC 126.
[24] As shown in Figure 2, remote control device 112 may include processor 128 connected to user interface 130, wireless communications interface 132, memory 134 and/or other storage, display 136, and digital camera 138. User interface 130 may further include a keypad, four arrow keys, joy-stick, data glove, mouse, roller ball, touch screen, voice interface, or the like. Software 140 may be stored within memory 134 and/or other storage to provide instructions to processor 128 for enabling remote control device 112 to perform various functions. For example, software 140 may configure processor 128 to enable remote control device 112 to take digital photographs via digital camera 138, to automatically name a photograph, to save photographs as image files, to transfer image files to server 114, to retrieve and display image files from server 114, and to browse the Internet using communications interface 132. Although not shown, communications interface 132 could include additional wired (e.g., USB) and/or wireless (e.g., BLUETOOTH, WLAN, WiFi or IrDA) interfaces configured to communicate over different communication links.
[25] As shown in Figure 3, server 114 may include processor 142 coupled via bus 144 to one or more communications interfaces 146, 148, 150, and 152. Interface 146 may be a cellular telephone or other wireless network communications interface. There may be multiple different wireless network communication interfaces. Interface 148 may be a conventional wired telephone system interface. Interface 150 may be a cable modem. Interface 152 may be a BLUETOOTH interface or any other short range wireless connection interface. Additionally, there may be multiple different interfaces. Figure 3 also illustrates receiver devices such as receiver devices 160, 162, and 164. Receiver device 162 may comprise a television receiver configured to receive and decode transmissions based on Digital Video Broadcast (DVB) standard. Receiver 162 may include a radio receiver such as a FM radio receiver to receive and decode FM radio transmissions. Receiver 164 may comprise an IP datacasting receiver.
[26] Server 114 may also include volatile memory 154 (e.g., RAM) and/or non-volatile memory 156 (such as a hard disk drive, tape system, or the like). Software and applications may be stored within memory 154 and/or memory 156 that provides instructions to processor 142 for enabling server 114 to perform various functions, such as processing file transfer requests (such as for image files), storing files in memory 154 or memory 156, displaying images and other data, and organizing images and other data. The other data may include but is not limited to video files, audio files, emails, SMS/MMS messages, other message files, text files, or presentations. Although shown as part of server 114, memory 156 could be remote storage coupled to server 114, such as an external drive or another storage device in communication with server 114. Preferably, server 114 also includes or is coupled to a display device 158 (FIG. 1) that may have a speaker, via a video interface (not shown). Display 158 may be a computer monitor, a television set, a LCD projector, or other type of display device. In at least some embodiments, server 114 also includes a speaker 155 over which audio clips (or audio portions of video clips) stored in memory 154 or 156 may be played. In some other embodiments, the input device 112 and the display 158, or alternatively the input device 112, the display device 158 and the server 114 may be combined in a same device unit.
[27] A user accesses server 114 directly through a local input device, such as input device 112. Server 114 also displays various user interfaces (e.g., such as are described below) on display device 158 in addition to thumbnails, enlarged images, and other information. Possible input devices 112 include wired and wireless keyboards, mice and remote control units. Remote control device 112 could also communicate with server 114 by BLUETOOTH or other wireless link, or via a cable connection to a port on mobile device 112. In some embodiments, server 114 is accessible remotely via remote control device 112 or (other devices) over wireless network 118, the Internet, or another communication network.
Description of Illustrative Aspects of the Invention
[28] According to an aspect of the invention, a system is provided for manipulating media files stored on a device such as a server 114. The media files may comprise images, video files, audio files, text files, or messages. One example of a media file used throughout the various aspects of the present invention comprises an image such as a digital picture represented as a thumbnail image. Those skilled in the art will realize that the use of thumbnail images throughout the various examples of the present invention is illustrative of one form of media files which may be used with the present invention. The use of thumbnail images in the various illustrations of the present invention is not meant to be limiting to such thumbnail images but is utilized to provide the details of the invention. In addition, although the following description refers to media files received from one or more remote control devices 112, the invention is not limited by data type or source.
[29] As shown in Figure 4, a remote control device 112 may transmit media files to be stored in a server such as personal server 402. The media files may have been created by remote control device 112 or remote control device 112 may have received them through a network. For example, remote control device 112 may comprise a digital camera (not shown) which may enable a user to take digital images or photographs of interest to the user. Images created with remote control device 112 may be transmitted to personal server 402 and stored in memory 154 or 156 of personal server 402.
[30] At some later point, a user may access the media files stored within memory 154 or 156 of personal server 402. In one aspect of the invention, a user is able to view executable commands on the remote control device 112 and the display device 404 substantially simultaneously. In another aspect of the invention, a user is able to view the media files on the remote control device 112 and the display device 404 substantially simultaneously. In yet another aspect of the invention, a user is able to view both the media files and the executable command on the remote control device 112 and the display device 404 substantially simultaneously.
[31] In Figure 4, the media files are represented as thumbnail images 406. Thumbnail images 406 may or may not have been created on a single occasion. For example, a user may transfer collections or multiple thumbnail images 406 from remote control device 112 to personal server 402 on several occasions. The thumbnail images 406 may be in JPEG format or other formats. Furthermore, as those skilled in the art will realize, media files may be represented in formats other than thumbnails 406. The thumbnails 406 transferred from remote control device 112 to personal server 402 may be displayed chronologically based on the order transferred from remote control device 112. In addition, the first thumbnail image transferred may be named consecutively, as for example "Image(l)" whereas the second thumbnail or media file to be transferred may be named "Image(2)."
[32] A user utilizing remote control device 112 may highlight a particular thumbnail of interest as shown in Figure 5. In Figure 5, a thumbnail 502 entitled "Image(l)" has been selected by a user utilizing remote control device 112. The selection of various thumbnails may be accomplished by moving a selection box using arrow or similar type keys, or joy-stick, on remote control device 112. Although Figure 5 shows seven thumbnails or media files, it will be appreciated by those skilled in the art that many more images or media files may be displayed on display device 404 (Figure 4). Accordingly, a page down "arrow" 504 and a page "back" button 506 may be displayed on thumbnail display 508 so that a user can move to additional screens in order to view all of the stored thumbnails or media files.
[33] After a user highlights a particular thumbnail of interest, in one aspect of the invention, a user may enlarge the highlighted thumbnail to be viewed on display device 404. The user may, for example, be reviewing various images that he or she has allowed to accumulate in memory 154 or 156 and deciding which images should be saved and which images discarded. As the user peruses the relatively low- resolution thumbnails, he or she identifies an image of interest and causes the image to be enlarged by highlighting the thumbnail and pressing an "enter" or other appropriate key on the remote control device 112.
[34] In addition to selecting a particular thumbnail image such as thumbnail image 502 in Figure 5, a user may select an "Options" button 510 on thumbnail display screen 508. The selection of an "Options" or "Menu" button 510 on thumbnail display screen 508 may pull up a command menu 512 that can be selected to be performed on the selected thumbnail image or full image. For example, an "Open" command 514 may be displayed on the command menu 512. The activation of the "Open" command 514 by a user may enlarge the selected thumbnail 502 to view the contents of thumbnail image 502. As another example, a user utilizing remote control 112 may activate a "Go to" command 516 on the command menu 512. The selection of the "Go to" command 516 may present a sub-command menu 517 further associated with the "Go to" command 515. For example, the sub-command menu 517 may present a user with a choice as to whether the user wants to view a "Date view" 518 or a "Main view" 520. For example, the "Date view" 518 command may present to a user a thumbnail display screen which shows the thumbnail images in chronological order whereas as the "Main view" 520 command may display a thumbnail display screen which shows the thumbnails alphabetized by thumbnail image name.
[35] Returning to Figure 4, in accordance with one aspect of the invention, personal server 402 may transmit to remote control device 112 a command menu 410 that is same, similar or at least partially related to command menu 512. The transmitted command menu 410 may enable a user to issue commands pertaining to a selected media file without having to closely view or concentrate on both the display device 404 and the display 136 (or user interface 130) of remote control device 112. The transmitted command menu 410 may not contain every command that may be executed on a particular media file.
[36] In one aspect of the invention, the command menu 410 may contain only the most frequently used commands for the selected media files. Figure 6 illustrates one possible command menu 610 that may be used in accordance with one aspect of the present invention. In Figure 6, a command menu 610 may provide the most frequently used commands associated with a highlighted object on display device 404. For example, command menu 610 may be associated with a highlighted thumbnail image such as thumbnail image 502 (Figure 5) named "Image(l)." For a highlighted thumbnail image such as thumbnail image 502, the command menu 610 may display commands such as an "OPEN" command 612 and a "ROTATE" command 614. Each of the commands displayed on display 136 of remote control device 112 may be interlinked or associated with a button found on remote control device 112. For example, the "ROTATE" command 614 may be interlinked with a number "2" button found on remote control device 112. In other words, the command menu 610 may display a mapping of commands to buttons found on remote control device 112. The activation of the corresponding button on remote control device 112 may perform the command on objects highlighted on display screen 404 such as thumbnail image 502. In another embodiment, the commands may be displayed on a touch screen display, so that the commands are interlinked or associated with that area of the touch screen.
[37] In one aspect of the invention the command menu 512 may only give an indication or notification to a user that the command menu 410 has been transmitted to the remote control device 512. The indication may include an icon, text or both.
[38] As indicated above, only the most frequently used commands may be displayed on display 136 of remote control device 112. Personal server 114 or an application running on personal server 114 may alter the user interface, such as content, features or appearance of the user interface, displayed on remote control device 112 based on the object highlighted in display screen 404. In addition, the application running on personal server 114 may also recognize when sharing of a menu or user interface is convenient for a user. This may be automatic and preinstructed by the application program, e.g. by content or file type, or a user may ask the application to share the menu or the user interface [39] In one embodiment of the invention, the server 114 may recognize the remote control device and technical capabilities of the remote control device. The technical capabilities may include, but are not limited to, size and resolution of the display, type of the display, style of a keyboard, key buttons that are used in the user interfaces, and style of the user interface. Alternatively, the remote control device may itself transmit instructions regarding how to modify the menu.
[40] Figure 7 shows a system for interacting with media files in accordance with another aspect of the present invention. In Figure 7, a user has transmitted a group of media files such as thumbnail images 701 to personal server 706 from remote control device 712. The thumbnail images 701 may be displayed on display device 704. In Figure 7, a user may want to rename a folder which may contain a thumbnail image or numerous related thumbnail images. A folder may be used to store media files which a user may wish to view simultaneously. Folders may allow a user to create categories of media files to help a user organize and search his or her collection of media files.
[41] In Figure 7, a folder 708 has been given the name "Albumm." A user wishing to change the name of folder 708 may first move a cursor over folder 708 by using key buttons or a joystick found on remote control device 712 in order to highlight folder 708. A user may select folder 708 by pressing a menu button on remote control device 712 or by pressing an enter key on remote control device 712. Those skilled in the art will realize that numerous ways exist for a user to activate a menu for a selected object.
[42] Upon pressing a menu button, a menu with commands associated with folder 708 may be substantially simultaneous displayed on display device 704 and on remote control device 712. The menu with commands for remote control device 712 may be adjusted to be properly displayed on smaller display screen 736 of remote control device 712. The menu commands displayed on display screen 736 may be interlinked to keyboard buttons found on remote control device 712. In another aspect of the invention, the remote control device 712 may include a touch sensitive screen in which the activation of a particular command may be accomplished by touching the screen with a pointing device in a particular area of the screen.
[43] For example, a command menu may include a "Name" command that is interlinked to a keyboard button 5 similar to the command menu 610 found in Figure 6. Upon activation of a "Name" command by a user, a dialog box 722 may open substantially simultaneously on the display device 704 and on the display 736 of remote control device 712. A user wanting to change the name of a folder 708 may begin to enter a new name for folder 708 using the buttons on remote control device 712. Typing of the new name for folder 708 may be further enhanced by using a predictive text input system, such as T9. The user entering the new name of folder 708 may not need to view display screen 704 while entering the new name of folder 708 as the display 736 contains all the information needed to accomplish the name change. For example, the dialog box 722 on remote control device 712 may include a field entitled "New box name:" 723 for entry of the new folder name. As shown in Figure 7, a user may change the name of folder 708 from "Albumm" to "Boxw" upon entry of the new name into text box field 724. Similar to the name change command, a user may perform various other commands such as delete, move, send, hide, search, properties, print, copy, and/or mark/unmark. Those skilled in the art will realize that numerous other commands may be listed in a command menu. In addition, the commands displayed in the command menu may change based on the object highlighted in display screen 704.
[44] Figure 8 illustrates another aspect of the present invention. In Figure 8, a personal server 814 may transmit a signal such as a television signal to a television receiver 804. The television receiver 804 may be an Internet Protocol Datacasting (IPDC) receiver. In another embodiment, the personal server 814 may first transmit the television signal to a set-top box 805. The television broadcast may include interactive services complying with the Multimedia Home Platform (DVB-MHP) standard or any other DVB or digital television broadcasting standard. In addition, vertical blanking interval transmission, such as Teletext, Text-TV or Super Teletext services, may be utilized. [45] In MHP (Multimedia Home Platform) applications, Text-TV or Super Teletext transmission, a four colored button system may be utilized to receive additional information on various subjects. Figure 8 illustrates the aspects of the invention in a Text-TV context. In Figure 8, colored buttons such as MENU button 840, NEWS button 841, SPORT button 842, and WEATHER button 843 are shown in display device 804 in a command menu 810.
[46] A similar command menu 859 may also be located on a display 836 of remote control device 812. The command menu 859 may enable a user to issue commands pertaining to a selected media file or Text-TV content without having to closely view both the display device 804 and the display 836 of remote control device 812. The transmitted command menu 810 may not contain every command that may be executed on a particular Text-TV application.
[47] In one aspect of the invention, the command menu 859 may contain only the most frequently used commands such as MENU button 860, NEWS button 861, SPORT button 862, and WEATHER button 864. In addition, remote control device 812 may also comprise shortcut commands on the command menu 860 for various programs. The shortcuts may provide additional information about the program being presented. For example, television receiver 804 may comprise various links to program information such as links 106, 107, 165, 138 and 212.
[48] Each of the commands displayed on display 836 of remote control device 812 may be interlinked with a button found on remote control device 812. For example, the "MENU" command 860 may be interlinked with a number "1" button 866 found on remote control device 812. In other words, the command menu 860 may display a mapping of commands to buttons found on remote control device 812. The activation of the corresponding button on remote control device 812 may perform the command such as to provide additional information regarding world news or sports. In another aspect of the invention, the remote control device 812 may include a touch sensitive screen in which the activation of a particular command may be activated by touching the screen with a pointing device in a particular area of the screen. [49] In another aspect of the invention, the broadcasting content may only be displayed on a display of a remote control device. For instance in Figure 9, a personal server 814 may transmit a signal such as a television signal to remote control device 812. The remote control device 812 may be an Internet Protocol Datacasting (PDC) receiver. As stated above, in MHP (Multimedia Home Platform) applications, Text-TV or Super Teletext transmissions, a four colored button system may be utilized to receive additional information on various subjects. Figure 9 illustrates the aspects of the invention in a Text-TV context. In Figure 9, colored buttons such as MENU button 840, NEWS button 841, SPORT button 842, and WEATHER button 843 are shown in display 901 of remote control device 812. A similar command menu 900 may also be located on a display 901 of remote control device 812. The command menu 900 may be interlinked with the buttons as shown in Figure 9. For example, a first button "1" (902) may correspond to MENU button 840. Similarly, a second button "2" (904) may correspond to a NEWS button 841. Furthermore, a third button "3" (906) and fourth button "4" (908) may also correspond to a SPORTS button 842 and a WEATHER button 843, respectively.
[50] As can be appreciated from the preceding description, embodiments of the invention allow a user to browse, select, or edit displayed media files in a convenient manner. Moreover, the invention is not limited to organization of data for still images. Although the above description used still images as examples, the invention is equally applicable to video clips. Alternatively (and in the case of audio clips), the user can be presented with a display of icons or list of file names as the "thumbnail" interface. Additionally, folders, albums or collections of files may be manipulated by same way as media files described in this invention.
[51] Figure 1 described above illustrates an embodiment in which the data or media files are stored in a portable personal server 114. In another embodiment, the data files may be stored in a network server that is preferably a service by a service provider. A user may now access the server and present, edit, or manipulate the data files by using their mobile communication device (or wireline communication device like a PC computer) by the same manner as described throughout the specification. The network server may receive the data files from the user's mobile communication device (or from PC computer) or from any other source, such as photo service provider, or music or video service provider. The user may access the server and service with their mobile communication device through a wireless network, such as wireless telecom network, WLAN, Bluetooth, or similar wireless protocol. Commands for presenting, manipulating and editing the data files are transmitted through the network. The selected data files are also retrieved for presentation through the network if a user display is attached in the user's mobile communication device. Alternatively, when the user display is separate from the user's mobile communication device, such as a TV device, set-top box, personal computer, the selected data files may directed to the display device through a second communication network (wireless or wireline).
[52] While illustrative systems and methods as described herein embodying various aspects of the present invention are shown by way of example, it will be understood, of course, that the invention is not limited to these embodiments. Modifications may be made by those skilled in the art, particularly in light of the foregoing teachings. For example, each of the elements of the aforementioned embodiments may be utilized alone or in combination with elements of the other embodiments. Also, the invention has been defined using the appended claims; however these claims are exemplary in that the invention is intended to include the elements and steps described herein in any combination or sub-combination. It will also be appreciated and understood that modifications may be made without departing from the true spirit and scope of the invention.

Claims

We claim:
1. A system for manipulating and interacting with media files, the system comprising: at least one display device having a first display; at least one remote control device, the remote control device comprising a second display; and a computer readable medium having computer executable instructions for performing the steps of: displaying a first user interface on the first display and a second user interface on the second display, the second user interface displayed on the remote control device, the second user interface at least partly related to the first user interface displayed on the at least one display device, the second interface capable of receiving executable commands; and receiving an executable command from the second user interface of the remote control device to manipulate the media files.
2. The system of claim 1, further comprising displaying the manipulated media files on the first display.
3. The system of claim 1, wherein the second user interface includes at least part of the executable commands of the first user interface displayed on the at least one display device.
4. The system of claim 1, wherein the first user interface and the second user interface are similar.
5. The system of the claim 1, wherein the first user interface displays an indication that the second user interface is transmitted to the remote control device.
6. The system of claim 1, wherein the second user interface displayed on the second display of the remote control device includes a dialog box.
7. The system of claim 6, wherein a user enters at least one character as an executable command into the dialog box displayed on the second user interface of the remote control device.
8. The system of claim 7, wherein the at least one character entered by the user is substantially simultaneously displayed on both the first display and the second display of the remote control device.
9. The system of claim 1, wherein the second user interface displayed on the second display of the remote control device comprises a menu with executable commands.
10. The system of claim 9, wherein the executable commands on the second user interface are associated with key buttons of the remote control device.
11. The system of claim 1, wherein the second user interface displayed on the remote control device includes buttons associated with executable commands.
12. The system of claim 1, wherein the remote control device comprises a mobile communication device.
13. The system of claim 12, wherein the mobile communication device comprises a cellular telephone.
14. The system of claim 1, wherein the media files comprise images.
15. The system of claim 1, wherein the media files comprise text files or messages.
16. The system of claim 1, wherein the media files comprise video files.
17. The system of claim 1, wherein the manipulated media files are substantially simultaneously displayed on both the first display and the second display.
8. A system for interacting with media files, the system comprising:
(a) at least one display device having a first display;
(b) a remote control device, the remote control device, including:
(1) a digital camera;
(2) a memory for storing the media files, the media files created with the digital camera,
(3) a second display; and
(4) a first communication interface with a wireless communication network for transmission of the media files stored in the memory; and
(c) a server, .the server including:
(1) a second communication interface through which the media files are received from the remote control device via the wireless communication network;
(2) a server memory for storing the media files received through the communication interface; and
(3) a processor configured to perform the steps of: transmitting a user interface to both the at least one display device and the remote control device, the user interface displayed on the first display and the second display, the user interface displayed on the remote control device capable of receiving executable commands, the executable commands for manipulating the media files; receiving through the second communication interface an executable command from the remote control device to manipulate the media files; and transmitting the manipulated media files to both the first display and the second display.
19. The system of claim 18, wherein the manipulated media files are substantially simultaneously displayed on both the first display and the second display.
20. The system of claim 18, wherein the processor transmits the user interface and the manipulated media files through a short-range wireless communication network.
21. The system of claim 20, wherein the short-range communication network comprises Bluetooth.
22. The system of claim 18, wherein the user interface displayed on the second display of the remote control device includes a dialog box.
23. The system of claim 22, wherein a user enters at least one character into the dialog box displayed on the user interface of the remote control device.
24. The system of claim 23, wherein the at least one character entered by the user is substantially simultaneously displayed on both the first display and the second display of the remote control device.
25. The system of claim 18, wherein the remote control device comprises a mobile communication device.
26. The system of claim 25, wherein the mobile communication device comprises a cellular telephone.
27. The system of claim 18, wherein the server comprises a set top box.
28. The system of claim 18, wherein the at least one display device comprises a television receiver.
29. The system of claim 18, wherein the remote control device comprises a mobile communication device.
30. The system of claim 29, wherein the mobile communication device comprises a cellular telephone.
31. A server for interacting with media files, the server comprising: a memory; a communications interface through which media files stored on a remote control device may be transferred to the memory; and a processor configured to perform steps comprising: transmitting a first user interface to a first display of a first display device; transmitting a second user interface to a second display of a remote control device, the second user interface displayed on second display of the remote control device, the second user interface capable of receiving executable commands; receiving through the communication interface an executable command from the second user interface of the remote control device to manipulate the media files; and transmitting the manipulated media files to the first user interface of the first display of the display device and to the second user interface of the second display of the remote control device.
32. The server of claim 31, wherein the user interface displayed on the second display of the remote control device includes a dialog box.
33. The server of claim 32, wherein a user enters at least one character into the dialog box displayed on user interface of the remote control device.
34. The server of claim 33, wherein the at least one character entered by the user is substantially simultaneously displayed on the first display of the display device and on the second display of the remote control device.
35. The server of claim 31, wherein the manipulated media files are substantially simultaneously displayed on the first display of the display device and on the second display of the remote control device.
36. The server of claim 31, wherein the second user interface displayed on the second display of the remote control device comprises a menu with executable commands.
37. The server of claim 36, wherein the executable commands on the second user interface are associated with key buttons of the remote control device.
38. The server of claim 31, wherein the second user interface displayed on the remote control device includes buttons associated with executable commands.
39. In a media system having a first and second user interface, a method of manipulating a media file, comprising the steps of: displaying the first user interface on a first display and the second user interface on a second display, the second user interface displayed on a remote control device, the second user interface at least partly related to the first user interface displayed on the display device, the second interface capable to receive executable commands; receiving an executable command from a user selection to manipulate the media file; and displaying the manipulated media file on the second display of the remote control device.
40. A network server for interacting with media files, the network server comprising: a memory; a Communications interface through which media files stored on a remote control device may be transferred to the memory; and a processor configured to perform steps comprising: transmitting a first user interface to a first display of a first display device; transmitting a second user interface to a second display of a remote control device, the second user interface displayed on second display of the remote control device, the second user interface capable of receiving executable commands; receiving through the communication interface an executable command from the second user interface of the remote control device to manipulate the media files; storing the manipulated media files in the memory; and transmitting the manipulated media files to the first user interface of the first display of the display device and to the second user interface of the second display of the remote control device.
41. The network server of claim 40, wherein the user interface displayed on the second display of the remote control device includes a dialog box.
42. The network server of claim 41, wherein a user enters at least one character into the dialog box displayed on user interface of the remote control device.
43. The network server of claim 42, wherein the at least one character entered by the user is substantially simultaneously displayed on the first display of the display device and on the second display of the remote control device.
44. The network server of claim 40, wherein the manipulated media files are substantially simultaneously displayed on the first display of the display device and on the second display of the remote control device. W
45. The network server of claim 40, wherein the second user interface displayed on the second display of the remote control device comprises a menu with executable commands.
46. The network server of claim 45, wherein the executable commands on the second user interface are associated with key buttons of the remote control device.
PCT/IB2005/002070 2004-06-30 2005-06-17 Dynamic shortcuts WO2006003506A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP05759635A EP1766603A1 (en) 2004-06-30 2005-06-17 Dynamic shortcuts
JP2007517524A JP2008507165A (en) 2004-06-30 2005-06-17 Dynamic shortcut

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/881,393 2004-06-30
US10/881,393 US20060004834A1 (en) 2004-06-30 2004-06-30 Dynamic shortcuts

Publications (1)

Publication Number Publication Date
WO2006003506A1 true WO2006003506A1 (en) 2006-01-12

Family

ID=35515297

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2005/002070 WO2006003506A1 (en) 2004-06-30 2005-06-17 Dynamic shortcuts

Country Status (6)

Country Link
US (1) US20060004834A1 (en)
EP (1) EP1766603A1 (en)
JP (1) JP2008507165A (en)
KR (1) KR100909619B1 (en)
CN (1) CN1993729A (en)
WO (1) WO2006003506A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1965317A1 (en) * 2007-02-01 2008-09-03 Sony Corporation Content providing method, content playback method, portable wireless terminal, and content playback apparatus

Families Citing this family (96)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7581182B1 (en) * 2003-07-18 2009-08-25 Nvidia Corporation Apparatus, method, and 3D graphical user interface for media centers
EP1536391A1 (en) * 2003-11-28 2005-06-01 Connexion2 Limited Lone worker monitor
US7353034B2 (en) 2005-04-04 2008-04-01 X One, Inc. Location sharing and tracking using mobile phones or other wireless devices
US7636794B2 (en) * 2005-10-31 2009-12-22 Microsoft Corporation Distributed sensing techniques for mobile devices
US7817991B2 (en) * 2006-02-14 2010-10-19 Microsoft Corporation Dynamic interconnection of mobile devices
GB2436193A (en) * 2006-03-14 2007-09-19 Jurij Beklemisev Controlling equipment via remote control
JP2007304666A (en) * 2006-05-08 2007-11-22 Sony Computer Entertainment Inc Information output system and information output method
KR100764649B1 (en) * 2006-08-18 2007-10-08 삼성전자주식회사 Apparatus and method for controlling media player in portable terminal
US20080294652A1 (en) * 2007-05-21 2008-11-27 Microsoft Corporation Personalized Identification Of System Resources
CN101163347B (en) * 2007-11-21 2011-05-18 华为终端有限公司 Method and equipment for remote control mobile terminal
US7996571B2 (en) * 2008-03-25 2011-08-09 Nokia Corporation Wireless coordination of apparatus interaction
CN101431566B (en) * 2008-12-16 2011-04-20 中兴通讯股份有限公司 Mobile terminal and method for providing user with shortcut operation
KR101854141B1 (en) 2009-01-19 2018-06-14 삼성전자주식회사 Apparatus and method for controlling display information
CN101674110A (en) * 2009-10-21 2010-03-17 中兴通讯股份有限公司 Method for implementing desktop sharing and control of mobile terminals and mobile terminal
US8885552B2 (en) 2009-12-11 2014-11-11 At&T Intellectual Property I, L.P. Remote control via local area network
US8990702B2 (en) * 2010-09-30 2015-03-24 Yahoo! Inc. System and method for controlling a networked display
US9021354B2 (en) * 2010-04-09 2015-04-28 Apple Inc. Context sensitive remote device
CN101835020A (en) * 2010-04-20 2010-09-15 惠州Tcl移动通信有限公司 Method and device for communications between mobile phone and television set
US8266551B2 (en) * 2010-06-10 2012-09-11 Nokia Corporation Method and apparatus for binding user interface elements and granular reflective processing
US9021402B1 (en) 2010-09-24 2015-04-28 Google Inc. Operation of mobile device interface using gestures
KR20120039197A (en) * 2010-10-15 2012-04-25 삼성전자주식회사 Remote controller, display apparatus, 3d glasses, and control method thereof
CN102572226A (en) * 2010-12-09 2012-07-11 三星电子(中国)研发中心 Self-adaptive distributed camera shooting method and system
US20120216152A1 (en) * 2011-02-23 2012-08-23 Google Inc. Touch gestures for remote control operations
US20130109374A1 (en) * 2011-10-31 2013-05-02 Young Hoon Kwon System and Method for a Display Unit Coupled to a Smartphone
KR101679343B1 (en) 2011-12-28 2016-11-24 노키아 테크놀로지스 오와이 Application switcher
US8996729B2 (en) 2012-04-12 2015-03-31 Nokia Corporation Method and apparatus for synchronizing tasks performed by multiple devices
CN103491364A (en) * 2012-06-12 2014-01-01 上海熙讯电子科技有限公司 3G control system of full-color LED display screens
TW201417573A (en) * 2012-10-19 2014-05-01 Hon Hai Prec Ind Co Ltd Remotely controllable electronic device and system using the same
US9398342B1 (en) * 2012-11-29 2016-07-19 Amazon Technologies, Inc. Interactive applications
EP3017606A1 (en) * 2013-07-05 2016-05-11 Koninklijke Philips N.V. Patient user interface for controlling a patient display
CN103974111B (en) * 2014-05-22 2017-12-29 华为技术有限公司 By the method, apparatus of the data transfer on intelligent terminal to television terminal
US10735512B2 (en) 2015-02-23 2020-08-04 MyGnar, Inc. Managing data
US9965247B2 (en) 2016-02-22 2018-05-08 Sonos, Inc. Voice controlled media playback system based on user profile
US10509626B2 (en) 2016-02-22 2019-12-17 Sonos, Inc Handling of loss of pairing between networked devices
US9947316B2 (en) 2016-02-22 2018-04-17 Sonos, Inc. Voice control of a media playback system
US10264030B2 (en) 2016-02-22 2019-04-16 Sonos, Inc. Networked microphone device control
US10743101B2 (en) 2016-02-22 2020-08-11 Sonos, Inc. Content mixing
US10095470B2 (en) 2016-02-22 2018-10-09 Sonos, Inc. Audio response playback
US9978390B2 (en) 2016-06-09 2018-05-22 Sonos, Inc. Dynamic player selection for audio signal processing
US10134399B2 (en) * 2016-07-15 2018-11-20 Sonos, Inc. Contextualization of voice inputs
US10152969B2 (en) 2016-07-15 2018-12-11 Sonos, Inc. Voice detection by multiple devices
US10115400B2 (en) 2016-08-05 2018-10-30 Sonos, Inc. Multiple voice services
US9942678B1 (en) 2016-09-27 2018-04-10 Sonos, Inc. Audio playback settings for voice interaction
US9743204B1 (en) 2016-09-30 2017-08-22 Sonos, Inc. Multi-orientation playback device microphones
US10181323B2 (en) 2016-10-19 2019-01-15 Sonos, Inc. Arbitration-based voice recognition
WO2018128728A1 (en) 2017-01-03 2018-07-12 Rovi Guides, Inc. Systems and methods for predicting viewing behavior
US11183181B2 (en) 2017-03-27 2021-11-23 Sonos, Inc. Systems and methods of multiple voice services
US10628570B2 (en) * 2017-05-15 2020-04-21 Fmr Llc Protection of data in a zero user interface environment
US10475449B2 (en) 2017-08-07 2019-11-12 Sonos, Inc. Wake-word detection suppression
US10048930B1 (en) 2017-09-08 2018-08-14 Sonos, Inc. Dynamic computation of system response volume
US10446165B2 (en) 2017-09-27 2019-10-15 Sonos, Inc. Robust short-time fourier transform acoustic echo cancellation during audio playback
US10051366B1 (en) 2017-09-28 2018-08-14 Sonos, Inc. Three-dimensional beam forming with a microphone array
US10621981B2 (en) 2017-09-28 2020-04-14 Sonos, Inc. Tone interference cancellation
US10482868B2 (en) 2017-09-28 2019-11-19 Sonos, Inc. Multi-channel acoustic echo cancellation
US10466962B2 (en) 2017-09-29 2019-11-05 Sonos, Inc. Media playback system with voice assistance
US20190121610A1 (en) * 2017-10-25 2019-04-25 Comcast Cable Communications, Llc User Interface For Hands Free Interaction
US10880650B2 (en) 2017-12-10 2020-12-29 Sonos, Inc. Network microphone devices with automatic do not disturb actuation capabilities
US10818290B2 (en) 2017-12-11 2020-10-27 Sonos, Inc. Home graph
WO2019152722A1 (en) 2018-01-31 2019-08-08 Sonos, Inc. Device designation of playback and network microphone device arrangements
US11175880B2 (en) 2018-05-10 2021-11-16 Sonos, Inc. Systems and methods for voice-assisted media content selection
US10847178B2 (en) 2018-05-18 2020-11-24 Sonos, Inc. Linear filtering for noise-suppressed speech detection
US10959029B2 (en) 2018-05-25 2021-03-23 Sonos, Inc. Determining and adapting to changes in microphone performance of playback devices
US10681460B2 (en) 2018-06-28 2020-06-09 Sonos, Inc. Systems and methods for associating playback devices with voice assistant services
US10461710B1 (en) 2018-08-28 2019-10-29 Sonos, Inc. Media playback system with maximum volume setting
US11076035B2 (en) 2018-08-28 2021-07-27 Sonos, Inc. Do not disturb feature for audio notifications
US10878811B2 (en) 2018-09-14 2020-12-29 Sonos, Inc. Networked devices, systems, and methods for intelligently deactivating wake-word engines
US10587430B1 (en) 2018-09-14 2020-03-10 Sonos, Inc. Networked devices, systems, and methods for associating playback devices based on sound codes
US11024331B2 (en) 2018-09-21 2021-06-01 Sonos, Inc. Voice detection optimization using sound metadata
US10811015B2 (en) 2018-09-25 2020-10-20 Sonos, Inc. Voice detection optimization based on selected voice assistant service
US11100923B2 (en) 2018-09-28 2021-08-24 Sonos, Inc. Systems and methods for selective wake word detection using neural network models
US10692518B2 (en) 2018-09-29 2020-06-23 Sonos, Inc. Linear filtering for noise-suppressed speech detection via multiple network microphone devices
US11899519B2 (en) 2018-10-23 2024-02-13 Sonos, Inc. Multiple stage network microphone device with reduced power consumption and processing load
US10971160B2 (en) 2018-11-13 2021-04-06 Comcast Cable Communications, Llc Methods and systems for determining a wake word
EP3654249A1 (en) 2018-11-15 2020-05-20 Snips Dilated convolutions and gating for efficient keyword spotting
US11183183B2 (en) 2018-12-07 2021-11-23 Sonos, Inc. Systems and methods of operating media playback systems having multiple voice assistant services
US11132989B2 (en) 2018-12-13 2021-09-28 Sonos, Inc. Networked microphone devices, systems, and methods of localized arbitration
US10602268B1 (en) 2018-12-20 2020-03-24 Sonos, Inc. Optimization of network microphone devices using noise classification
US10867604B2 (en) 2019-02-08 2020-12-15 Sonos, Inc. Devices, systems, and methods for distributed voice processing
US11315556B2 (en) 2019-02-08 2022-04-26 Sonos, Inc. Devices, systems, and methods for distributed voice processing by transmitting sound data associated with a wake word to an appropriate device for identification
US11120794B2 (en) 2019-05-03 2021-09-14 Sonos, Inc. Voice assistant persistence across multiple network microphone devices
US11361756B2 (en) 2019-06-12 2022-06-14 Sonos, Inc. Conditional wake word eventing based on environment
US11200894B2 (en) 2019-06-12 2021-12-14 Sonos, Inc. Network microphone device with command keyword eventing
US10586540B1 (en) 2019-06-12 2020-03-10 Sonos, Inc. Network microphone device with command keyword conditioning
US11138969B2 (en) 2019-07-31 2021-10-05 Sonos, Inc. Locally distributed keyword detection
US11138975B2 (en) 2019-07-31 2021-10-05 Sonos, Inc. Locally distributed keyword detection
US10871943B1 (en) 2019-07-31 2020-12-22 Sonos, Inc. Noise classification for event detection
US11189286B2 (en) 2019-10-22 2021-11-30 Sonos, Inc. VAS toggle based on device orientation
US11200900B2 (en) 2019-12-20 2021-12-14 Sonos, Inc. Offline voice control
US11562740B2 (en) 2020-01-07 2023-01-24 Sonos, Inc. Voice verification for media playback
US11556307B2 (en) 2020-01-31 2023-01-17 Sonos, Inc. Local voice data processing
US11308958B2 (en) 2020-02-07 2022-04-19 Sonos, Inc. Localized wakeword verification
US11482224B2 (en) 2020-05-20 2022-10-25 Sonos, Inc. Command keywords with input detection windowing
US11308962B2 (en) 2020-05-20 2022-04-19 Sonos, Inc. Input detection windowing
US11727919B2 (en) 2020-05-20 2023-08-15 Sonos, Inc. Memory allocation for keyword spotting engines
US11698771B2 (en) 2020-08-25 2023-07-11 Sonos, Inc. Vocal guidance engines for playback devices
US11551700B2 (en) 2021-01-25 2023-01-10 Sonos, Inc. Systems and methods for power-efficient keyword detection

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030117532A1 (en) * 2001-12-25 2003-06-26 Seiko Epson Corporation Projector wireless control system and wireless control method
WO2003088027A1 (en) * 2002-04-05 2003-10-23 Matsushita Electric Industrial Co., Ltd. User configurable electronic program guide drawing upon disparate content sources
WO2004025952A1 (en) * 2002-09-10 2004-03-25 Philips Intellectual Property & Standards Gmbh Wireless projection system
WO2004044737A2 (en) * 2002-11-05 2004-05-27 Speakeasy, Llc Integrated information presentation system with environmental controls

Family Cites Families (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1469239A (en) * 1921-10-07 1923-10-02 Orra A Ostrander Tail holder for cattle
JPH0649030Y2 (en) * 1989-04-05 1994-12-12 パイオニア株式会社 Data input device
US5526034A (en) * 1990-09-28 1996-06-11 Ictv, Inc. Interactive home information system with signal assignment
US5236199A (en) * 1991-06-13 1993-08-17 Thompson Jr John W Interactive media system and telecomputing method using telephone keypad signalling
US5410326A (en) * 1992-12-04 1995-04-25 Goldstein; Steven W. Programmable remote control device for interacting with a plurality of remotely controlled devices
DE69432199T2 (en) * 1993-05-24 2004-01-08 Sun Microsystems, Inc., Mountain View Graphical user interface with methods for interfacing with remote control devices
US5819103A (en) * 1993-09-21 1998-10-06 Kabushiki Kaisha Toshiba Information recording/reproducing apparatus and method
US5648813A (en) * 1993-10-20 1997-07-15 Matsushita Electric Industrial Co. Ltd. Graphical-interactive-screen display apparatus and peripheral units
US5598523A (en) * 1994-03-31 1997-01-28 Panasonic Technologies, Inc. Method and system for displayed menu activation using a matching distinctive arrangement of keypad actuators
US5500794A (en) * 1994-03-31 1996-03-19 Panasonic Technologies, Inc. Distribution system and method for menu-driven user interface
US5625608A (en) * 1995-05-22 1997-04-29 Lucent Technologies Inc. Remote control device capable of downloading content information from an audio system
US5874960A (en) * 1995-07-05 1999-02-23 Microsoft Corporation Method and system for sharing applications between computer systems
US6411725B1 (en) * 1995-07-27 2002-06-25 Digimarc Corporation Watermark enabled video objects
JPH0962631A (en) * 1995-08-24 1997-03-07 Hitachi Ltd Collaborative operation support system
US5761280A (en) * 1996-09-04 1998-06-02 8×8, Inc. Telephone web browser arrangement and method
CN1118746C (en) * 1997-03-24 2003-08-20 发展产品有限公司 Two-way remote control with advertising display
US6130726A (en) * 1997-03-24 2000-10-10 Evolve Products, Inc. Program guide on a remote control display
JPH10301874A (en) * 1997-04-22 1998-11-13 Internatl Business Mach Corp <Ibm> Remote operation method, server remotely operated from terminal through network and storage medium storing html file
JP2000513916A (en) * 1997-06-25 2000-10-17 サムソン エレクトロニクス カンパニー リミテッド Method and apparatus for home network automatic tree generator
US6802076B1 (en) * 1997-07-18 2004-10-05 Sony Corporation Control device, control method, electric apparatus, control method of an electric apparatus, electric apparatus system, control method of an electric apparatus system, and transmission medium
US6606385B1 (en) * 1997-08-07 2003-08-12 Hitachi, Ltd. Data encrypting/decrypting conversion methods and apparatuses and data communication system adopting the same
SE511516C2 (en) * 1997-12-23 1999-10-11 Ericsson Telefon Ab L M Handheld display unit and method for displaying screens
AR014332A1 (en) * 1998-01-30 2001-02-07 Koninkl Philips Electronics Nv A METHOD FOR OPERATING AN AUDIO / VIDEO EQUIPMENT AS BASED ON A HIERARCHICAL MENU OF ITEMS SELECTED AS LARGE POINTS AND PLACED IN CHAIN AND AN AUDIO / VIDEO EQUIPMENT WILLING TO PRACTICE THE METHOD
US6144991A (en) * 1998-02-19 2000-11-07 Telcordia Technologies, Inc. System and method for managing interactions between users in a browser-based telecommunications network
US6784925B1 (en) * 1998-03-24 2004-08-31 Canon Kabushiki Kaisha System to manage digital camera images
US6040829A (en) * 1998-05-13 2000-03-21 Croy; Clemens Personal navigator system
US6476825B1 (en) * 1998-05-13 2002-11-05 Clemens Croy Hand-held video viewer and remote control device
US7586398B2 (en) * 1998-07-23 2009-09-08 Universal Electronics, Inc. System and method for setting up a universal remote control
JP3792405B2 (en) * 1998-08-10 2006-07-05 富士通株式会社 File operation device and recording medium recording file operation program
JP3852892B2 (en) * 1998-10-20 2006-12-06 松下電器産業株式会社 Network control system
US6532592B1 (en) * 1998-11-09 2003-03-11 Sony Corporation Bi-directional remote control unit and method of using the same
US6408128B1 (en) * 1998-11-12 2002-06-18 Max Abecassis Replaying with supplementary information a segment of a video
US6407779B1 (en) * 1999-03-29 2002-06-18 Zilog, Inc. Method and apparatus for an intuitive universal remote control system
US6684087B1 (en) * 1999-05-07 2004-01-27 Openwave Systems Inc. Method and apparatus for displaying images on mobile devices
US6636888B1 (en) * 1999-06-15 2003-10-21 Microsoft Corporation Scheduling presentation broadcasts in an integrated network environment
GB0003306D0 (en) * 2000-02-15 2000-04-05 Koninkl Philips Electronics Nv Control of interconnected audio/video devices
JP4411730B2 (en) * 2000-02-29 2010-02-10 ソニー株式会社 User interface system, server device, and remote terminal device
GB0005337D0 (en) * 2000-03-07 2000-04-26 Hewlett Packard Co Image transfer over mobile radio network
US6587125B1 (en) * 2000-04-03 2003-07-01 Appswing Ltd Remote control system
US7269843B2 (en) * 2000-04-26 2007-09-11 Minolta Co., Ltd. Broadcasting system and media player
JP3712591B2 (en) * 2000-04-26 2005-11-02 富士通フロンテック株式会社 Telephone cooperation display system, data processing apparatus, and recording medium
US20020002707A1 (en) * 2000-06-29 2002-01-03 Ekel Sylvain G. System and method to display remote content
US7079113B1 (en) * 2000-07-06 2006-07-18 Universal Electronics Inc. Consumer electronic navigation system and methods related thereto
ATE502477T1 (en) * 2000-07-25 2011-04-15 America Online Inc VIDEO MESSAGING
US20020178279A1 (en) * 2000-09-05 2002-11-28 Janik Craig M. Webpad and method for using the same
WO2002023857A2 (en) * 2000-09-11 2002-03-21 Viafone, Inc. Method and system for integrating applications and mobile networks
JP4562264B2 (en) * 2000-09-25 2010-10-13 シャープ株式会社 Information communication system, mobile communication terminal, and communication method
JP2002123488A (en) * 2000-10-16 2002-04-26 Sony Corp Method and device for controlling equipment
US20020151327A1 (en) * 2000-12-22 2002-10-17 David Levitt Program selector and guide system and method
US6981223B2 (en) * 2001-03-19 2005-12-27 Ecrio, Inc. Method, apparatus and computer readable medium for multiple messaging session management with a graphical user interface
US7063619B2 (en) * 2001-03-29 2006-06-20 Interactive Telegames, Llc Method and apparatus for identifying game players and game moves
AU2002302942A1 (en) * 2001-05-10 2002-11-18 Decima Ventures Ltd. Modular personal device system
US7206806B2 (en) * 2001-05-30 2007-04-17 Pineau Richard A Method and system for remote utilizing a mobile device to share data objects
US20030117427A1 (en) * 2001-07-13 2003-06-26 Universal Electronics Inc. System and method for interacting with a program guide displayed on a portable electronic device
US20030037341A1 (en) * 2001-08-17 2003-02-20 Van Der Meulen Pieter Sierd System for remotely controlling consumer electronics using a web-cam image
US6978424B2 (en) * 2001-10-15 2005-12-20 General Instrument Corporation Versatile user interface device and associated system
US7929808B2 (en) * 2001-10-30 2011-04-19 Hewlett-Packard Development Company, L.P. Systems and methods for generating digital images having image meta-data combined with the image data
US8095879B2 (en) * 2002-12-10 2012-01-10 Neonode Inc. User interface for mobile handheld computer unit
US7050097B2 (en) * 2001-11-13 2006-05-23 Microsoft Corporation Method and apparatus for the display of still images from image files
GB0129669D0 (en) * 2001-12-12 2002-01-30 Slaughter Paul Apparatus and method
US20030140343A1 (en) * 2002-01-18 2003-07-24 General Instrument Corporation Remote wireless device with EPG display, intercom and emulated control buttons
US20030145089A1 (en) * 2002-01-29 2003-07-31 Xerox Corporation System and method for enabling arbitrary components to transfer data between each other
US7109974B2 (en) * 2002-03-05 2006-09-19 Matsushita Electric Industrial Co., Ltd. Remote control system including an on-screen display (OSD)
JP3817491B2 (en) * 2002-03-28 2006-09-06 株式会社第一興商 Method for enlarging and displaying Web page image displayed on portable browser phone on general-purpose display device via relay device, program for portable browser phone, relay device
US7987491B2 (en) * 2002-05-10 2011-07-26 Richard Reisman Method and apparatus for browsing using alternative linkbases
JP3775346B2 (en) * 2002-05-29 2006-05-17 株式会社日立製作所 Videophone system and terminal device thereof
US20030234809A1 (en) * 2002-06-19 2003-12-25 Parker Kathryn L. Method and system for remotely operating a computer
AU2003254036A1 (en) * 2002-07-19 2004-02-09 Intellisign, Ltd Methods and apparatus for an interactive media display
US20040054757A1 (en) * 2002-09-14 2004-03-18 Akinobu Ueda System for remote control of computer resources from embedded handheld devices
US7165224B2 (en) * 2002-10-03 2007-01-16 Nokia Corporation Image browsing and downloading in mobile networks
KR20040031159A (en) * 2002-10-04 2004-04-13 삼성전자주식회사 Function control apparatus using remote controller and method thereof
US7154510B2 (en) * 2002-11-14 2006-12-26 Eastman Kodak Company System and method for modifying a portrait image in response to a stimulus
JP4093088B2 (en) * 2003-03-18 2008-05-28 松下電器産業株式会社 Remote control transmitter
US8014768B2 (en) * 2003-04-30 2011-09-06 Disney Enterprises, Inc. Mobile phone multimedia controller
US20050039133A1 (en) * 2003-08-11 2005-02-17 Trevor Wells Controlling a presentation of digital content
KR100982511B1 (en) * 2003-10-08 2010-09-16 삼성전자주식회사 Apparatus and method for remote controlling
US7155305B2 (en) * 2003-11-04 2006-12-26 Universal Electronics Inc. System and methods for home appliance identification and control in a networked environment
US20050132055A1 (en) * 2003-12-12 2005-06-16 Raja Neogi System and method to control appliances using adaptive interfaces
JP2005301908A (en) * 2004-04-15 2005-10-27 Toshiba Corp Information apparatus remote control system
US9591345B2 (en) * 2004-10-21 2017-03-07 Core Wireless Licensing S.A.R.L. Group editing of media content stored on wireless portable devices

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030117532A1 (en) * 2001-12-25 2003-06-26 Seiko Epson Corporation Projector wireless control system and wireless control method
WO2003088027A1 (en) * 2002-04-05 2003-10-23 Matsushita Electric Industrial Co., Ltd. User configurable electronic program guide drawing upon disparate content sources
WO2004025952A1 (en) * 2002-09-10 2004-03-25 Philips Intellectual Property & Standards Gmbh Wireless projection system
WO2004044737A2 (en) * 2002-11-05 2004-05-27 Speakeasy, Llc Integrated information presentation system with environmental controls

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1965317A1 (en) * 2007-02-01 2008-09-03 Sony Corporation Content providing method, content playback method, portable wireless terminal, and content playback apparatus
EP2075719A1 (en) * 2007-02-01 2009-07-01 Sony Corporation Content providing method, content playback method, portable wireless terminal, and content playback apparatus

Also Published As

Publication number Publication date
JP2008507165A (en) 2008-03-06
KR100909619B1 (en) 2009-07-30
CN1993729A (en) 2007-07-04
EP1766603A1 (en) 2007-03-28
US20060004834A1 (en) 2006-01-05
KR20070038501A (en) 2007-04-10

Similar Documents

Publication Publication Date Title
US20060004834A1 (en) Dynamic shortcuts
US11671479B2 (en) Contextual remote control user interface
US20220342519A1 (en) Content Presentation and Interaction Across Multiple Displays
US7464110B2 (en) Automated grouping of image and other user data
US8386458B2 (en) Mobile terminal device and computer program
US8966546B2 (en) Method and apparatus for reproducing content through integrated channel management
US7681149B2 (en) User interface display for set-top box device
US7661075B2 (en) User interface display for set-top box device
JP5650143B2 (en) User interface configuration
CN101594279B (en) Information processing apparatus, information processing method and information processing system
KR101810403B1 (en) Apparatus and method for storing data of peripheral device in portable terminal
US20110161818A1 (en) Method and apparatus for video chapter utilization in video player ui
US20060004698A1 (en) Automated prioritization of user data files
US20100083338A1 (en) Remote control device and remote control system
EP2934017A1 (en) Display apparatus and control method thereof
US20090295998A1 (en) Information processing device, display method and program
US20090049386A1 (en) Inter-Device Operation Interface, Device Control Terminal, and Program
WO2023036277A1 (en) Control display method and apparatus, device and medium
US7917162B2 (en) Mobile terminal and method for managing message thereof
US20090094548A1 (en) Information Processing Unit and Scroll Method
CN113542899A (en) Information display method, display device and server
US9277285B2 (en) Broadcasting method and system with variable audio/video program menu
WO2011074149A1 (en) Content play device, content play method, program, and recording medium
KR20150117212A (en) Display apparatus and control method thereof
KR100981237B1 (en) Apparatus for Home Media Service

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2005759635

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2007517524

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

WWE Wipo information: entry into national phase

Ref document number: 1020077000236

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 200580026014.X

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 2005759635

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020077000236

Country of ref document: KR