CN104170397A - User interface for entertainment systems - Google Patents

User interface for entertainment systems Download PDF

Info

Publication number
CN104170397A
CN104170397A CN201380014806.XA CN201380014806A CN104170397A CN 104170397 A CN104170397 A CN 104170397A CN 201380014806 A CN201380014806 A CN 201380014806A CN 104170397 A CN104170397 A CN 104170397A
Authority
CN
China
Prior art keywords
content
search
electronic equipment
data source
input
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201380014806.XA
Other languages
Chinese (zh)
Other versions
CN104170397B (en
Inventor
H·杨
S·哈奇
Y-K·琼
T·I·可文那米
T·A·托诺那
J·可维可
T·J·金那恩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nuance Communications Inc
Original Assignee
Nuance Communications Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/587,300 external-priority patent/US9026448B2/en
Priority claimed from US13/587,280 external-priority patent/US9031848B2/en
Priority claimed from US13/587,222 external-priority patent/US8799959B2/en
Priority claimed from US13/587,234 external-priority patent/US9497515B2/en
Priority claimed from US13/587,353 external-priority patent/US9106957B2/en
Priority claimed from US13/587,260 external-priority patent/US20140052450A1/en
Priority to CN201710977995.0A priority Critical patent/CN107613353B/en
Application filed by Nuance Communications Inc filed Critical Nuance Communications Inc
Publication of CN104170397A publication Critical patent/CN104170397A/en
Application granted granted Critical
Publication of CN104170397B publication Critical patent/CN104170397B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H04N21/4828—End-user interface for program selection for searching program descriptors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43—Querying
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/48—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/489—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using time information
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/732—Query formulation
    • G06F16/7343—Query language or query format
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7844—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using original textual content or text extracted from visual content or transcript of audio data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/68—Systems specially adapted for using specific information, e.g. geographical or meteorological information
    • H04H60/72—Systems specially adapted for using specific information, e.g. geographical or meteorological information using electronic programme guides [EPG]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Abstract

Methods and apparatus (100) for providing a search interface for an electronic device including a tuner (112) configured to tune the electronic device to receive scheduled programming content (124). Voice input (104)comprising a search query is received and one or more data sources (124) including information about media content are searched based, at least in part, on the search query. The results of the search are presented on a user interface (122) of the electronic device.

Description

For the user interface of entertainment systems
Background technology
Some electronic equipments that can be used to access entertainment content (for example audio frequency and/or video content) comprise or are connected to tuner, tuner makes electronic equipment can receive and show the programme content of arrangement, such as TV, radio station or other media programs.In order to select specific program for checking on electronic equipment, user generally uses remote control equipment to input the numeral of the channel for example, being associated with specific program (broadcast).Some are tunable, and electronic equipment also allows user to use remote control equipment so that search for and chosen content with electronic program guides (EPG), and EPG is the user interface that shows the arrangement information of the current and following programme content for arranging with time-based grid format.User navigates by the programme content entry of the arrangement that shows in EPG by pressing button on remote control equipment conventionally, and remote control equipment uses five navigation command systems (left and right, upper and lower and select).Once user has highlighted specific program on EPG, can, by pressing the selection button on remote control equipment, on electronic equipment, show corresponding content, after this, electronic equipment is tuned to selected channel.
Summary of the invention
An embodiment is for a kind of method that presents Search Results on electronic equipment, and wherein said electronic equipment comprises and is configured to tuning described electronic equipment to receive the tuner of the program arranging.Described method comprises: receive the phonetic entry that comprises search inquiry; At least in part based on described search inquiry, search at least one data source with at least one processor; With present the result of search with time-based axle with the axle of time-independent.
In one aspect, with the axle of time-independent based on described search inquiry in the degree of correlation of one or more described result is sorted.
On the other hand, search at least one data source and comprise program content data source and at least one bundled services content-data source of searching at least one arrangement.
On the other hand, described result is included in the programme content of the arrangement identifying in the program content data source of described at least one arrangement and the bundled services content identifying in described at least one bundled services content-data source.
On the other hand, described result comprises bundled services content, in the time that described bundled services content is selected, shows the multiple results from least one the bundled services content-data source being associated with selected bundled services content.
On the other hand, time-based axle is distinguished current first content and the current second content that can not be used for playback that can be used for playback.
On the other hand, the described result presenting along time-based axle only includes the programme content of arrangement.
Another embodiment, for a kind of electronic equipment, comprising: be configured to tuning described electronic equipment to receive the tuner of the program arranging; With at least one processor, described at least one processor is programmed to: receive the phonetic entry that comprises search inquiry; Based on described search inquiry, search at least one data source at least in part; With present the result of search with time-based axle with the axle of time-independent.
In one aspect, with the axle of time-independent based on described search inquiry in the degree of correlation of one or more described result is sorted.
On the other hand, described electronic equipment also comprises: speech input interface, is configured to receive described search inquiry as phonetic entry.
On the other hand, search at least one data source and comprise program content data source and at least one bundled services content-data source of searching at least one arrangement.
On the other hand, described result comprises bundled services content, in the time that described bundled services content is selected, shows the multiple results from least one the bundled services content-data source being associated with selected bundled services content.
On the other hand, time-based axle is distinguished current first content and the current second content that can not be used for by described electronic equipment playback that can be used for by described electronic equipment playback.
Another embodiment, for a kind of computer-readable recording medium with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carries out a kind of method, and described method comprises: receive the phonetic entry that comprises search inquiry; Based on described search inquiry, search at least one data source at least in part; With present the result of search with time-based axle with the axle of time-independent.
In one aspect, with the axle of time-independent based on described search inquiry in the degree of correlation of one or more described result is sorted.
Another embodiment is for a kind of method that presents Search Results on visual user interface being configured to the digital tunable electronic equipment that shows the programme content arranging, and described method comprises: receive search inquiry; Natural language understanding analysis based on to described search inquiry at least in part, searches for program content data source and at least one bundled services content-data source of at least one arrangement; With the result that presents search in this user interface, wherein the combination of the described result of search is corresponding at least one first result of the programme content arranging with corresponding at least one second result of bundled services content.
In one aspect, described at least one second result comprises at least one bundled services result, in the time that described at least one bundled services result is selected, shows to come multiple results of self-corresponding bundled services data source.
On the other hand, described at least one bundled services data source comprises the data source for the service based on web.
On the other hand, described at least one bundled services data source comprises the local data source being associated with described electronic equipment.
On the other hand, described at least one bundled services data source comprises the multiple data sources that connect via network.
On the other hand, described at least one bundled services data source comprises the data source of on-demand content.
On the other hand, the described result that presents search comprises at least one the corresponding image presenting with the described result of search.
Another embodiment is for a kind of computer-readable recording medium with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind of method that presents Search Results on visual user interface being configured to the digital tunable electronic equipment that shows the programme content arranging, described method comprises: receive search inquiry; Natural language understanding analysis based on to described search inquiry at least in part, searches for program content data source and at least one bundled services content-data source of at least one arrangement; With the result that presents search in this user interface, wherein the combination of the described result of search is corresponding at least one first result of the programme content arranging with corresponding at least one second result of bundled services content.
In one aspect, the described result that presents search comprises at least one the corresponding image presenting with the described result of search.
Another embodiment is for a kind of digital tunable electronic equipment that is configured to show the programme content arranging, and described electronic equipment comprises: at least one processor, and described at least one processor is programmed to: receive search inquiry; Natural language understanding analysis based on to described search inquiry at least in part, searches for program content data source and at least one bundled services content-data source of at least one arrangement; With the result that presents search in user interface, wherein the combination of the described result of search is corresponding at least one first result of the programme content arranging with corresponding at least one second result of bundled services content.
In one aspect, described at least one second result comprises at least one bundled services result, in the time that described at least one bundled services result is selected, shows to come multiple results of self-corresponding bundled services data source.
On the other hand, described at least one bundled services data source comprises the data source for the service based on web.
On the other hand, described at least one bundled services data source comprises the local data source being associated with described electronic equipment.
On the other hand, described at least one bundled services data source comprises the multiple data sources that connect via network.
On the other hand, described at least one bundled services data source comprises the data source of on-demand content.
Another embodiment is for a kind of method of the user interface that is provided for digital tunable electronic equipment, described electronic equipment is configured to show the programme content arranging, described method comprises: in described user interface, show the label that multiple and content is irrelevant, described label multiple and that content is irrelevant comprises first label irrelevant with content, the first content unit that the first tag identifier that should be irrelevant with content returns from search; With in response to receive corresponding to the first input of irrelevant the first label of content, carry out at least one action relevant with first content unit, wherein the first input comprises the first phonetic entry, and is wherein configured to the first phonetic entry to respond with irrelevant the first label of content.
In one aspect, described method also comprises: receive the second input, in the irrelevant label of wherein said multiple and content, be configured to the second input to respond with irrelevant the second label of content; Wherein carry out described at least one action relevant with first content unit comprise at least in part carry out based on the second input described at least one action.
On the other hand, the second input is the second phonetic entry, and is wherein configured to the second phonetic entry to respond with irrelevant the second label of content.
On the other hand, receive the first input and receive the second input and be included in before receiving the first input and receive the second input.
On the other hand, described method also comprises: based on the first input selection first content unit.
On the other hand, carry out at least one action relevant with first content unit comprise by described electronic equipment be tuned to channel with demonstration the program for the arrangement of first content unit.
On the other hand, first content unit, corresponding to the bundled services content element that comprises multiple Search Results, is wherein carried out at least one action relevant with first content unit and is comprised the described multiple Search Results of demonstration.
On the other hand, described method also comprises: multiple voice commands are associated with described user interface, wherein said multiple voice command comprises the first voice command and the second voice command, wherein the first voice command calls the first action and the second voice command calls the second action, and wherein the first voice command and the second voice command are identified by described electronic equipment, and do not consider the specific screens showing in described user interface.
Another embodiment is for a kind of computer-readable recording medium with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind of method of the user interface that is provided for digital tunable electronic equipment, described electronic equipment is configured to show the programme content arranging, described method comprises: in described user interface, show the label that multiple and content is irrelevant, described label multiple and that content is irrelevant comprises first label irrelevant with content, the first content unit that the first tag identifier that should be irrelevant with content returns from search; With in response to receive corresponding to the first input of irrelevant the first label of content, carry out at least one action relevant with first content unit, wherein the first input is the first phonetic entry, and is wherein configured to the first phonetic entry to respond with irrelevant the first label of content.
Another embodiment is for a kind of digital tunable electronic equipment that is configured to show the programme content arranging, described electronic equipment comprises: at least one processor, described at least one processor is programmed to: in user interface, show the label that multiple and content is irrelevant, described label multiple and that content is irrelevant comprises first label irrelevant with content, the first content unit that the first tag identifier that should be irrelevant with content returns from search; With in response to receive corresponding to the first input of irrelevant the first label of content, carry out at least one action relevant with first content unit, wherein the first input is the first phonetic entry, and is wherein configured to the first phonetic entry to respond with irrelevant the first label of content.
In one aspect, described at least one processor is also programmed to: receive the second input, in the irrelevant label of wherein said multiple and content, be configured to the second input to respond with irrelevant the second label of content; Wherein carry out described at least one action relevant with first content unit comprise at least in part carry out based on the second input described at least one action.
On the other hand, described execution at least one action relevant with first content unit comprise by described electronic equipment be tuned to channel to show the program for the arrangement of first content unit.
On the other hand, first content unit, corresponding to the bundled services content element that comprises multiple Search Results, is wherein carried out at least one action relevant with first content unit and is comprised the described multiple Search Results of demonstration.
Another embodiment is for the digital tunable electronic equipment of one, comprise at least one processor, described at least one processor is programmed to: user interface is provided, described user interface makes described electronic equipment can receive search inquiry and no matter which in multiple screens is displayed in described user interface in the time that described search inquiry is received, and wherein said search inquiry comprises showing on described digital tunable electronic equipment and/or the search of the content of playback; Reception comprises the phonetic entry of described search inquiry; With in response to receiving described search inquiry, start corresponding to the search to content of described search inquiry.
In one aspect, start the search of content is comprised and will the inquiry of content be sent to at least one data source that is connected to described electronic equipment by one or more networks.
On the other hand, described at least one processor is also programmed to: in described user interface, show one or more icons, described one or more icon indicating users can be used for starting the input of the search to content.
On the other hand, described at least one processor is also programmed to: multiple voice commands are associated with described user interface, wherein said multiple voice command comprises the first voice command and the second voice command, and wherein the first voice command calls the first action and the second voice command calls the second action.
On the other hand, the first action and/or the second action are corresponding to the search starting content.
Another embodiment is for the computer implemented method of one, comprise: user interface is provided, described user interface makes electronic equipment can receive search inquiry and no matter which in multiple screens is displayed in described user interface in the time that described search inquiry is received, and wherein said search inquiry comprises showing on described electronic equipment and/or the search of the content of playback; Reception comprises the phonetic entry of described search inquiry; With in response to receiving described search inquiry, start corresponding to the search to content of described search inquiry.
In one aspect, start the search of content is comprised and will the inquiry of content be sent to at least one data source that is connected to described electronic equipment by one or more networks.
On the other hand, described computer implemented method also comprises: in described user interface, show one or more icons, described one or more icon indicating users can be used for starting the input of the search to content.
On the other hand, described computer implemented method also comprises: multiple voice commands are associated with described user interface, wherein said multiple voice command comprises the first voice command and the second voice command, and wherein the first voice command calls the first action and the second voice command calls the second action.
On the other hand, the first action and/or the second action are corresponding to the search starting content.
Another embodiment is for a kind of computer-readable recording medium with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind of method, described method comprises: user interface is provided, described user interface makes electronic equipment can receive search inquiry and no matter which in multiple screens is displayed in described user interface in the time that described search inquiry is received, and wherein said search inquiry comprises showing on digital tunable electronic equipment and/or the search of the content of playback; Reception comprises the phonetic entry of described search inquiry; With in response to receiving described search inquiry, start corresponding to the search to content of described search inquiry.
In one aspect, start the search of content is comprised and will the inquiry of content be sent to at least one data source that is connected to described electronic equipment by one or more networks.
On the other hand, described method also comprises: in described user interface, show one or more icons, described one or more icon indicating users can be used for starting the input of the search to content.
On the other hand, described method also comprises: multiple voice commands are associated with described user interface, wherein said multiple voice command comprises the first voice command and the second voice command, and wherein the first voice command calls the first action and the second voice command calls the second action.
On the other hand, the first action and/or the second action are corresponding to the search starting content.
Another embodiment, for the digital tunable electronic equipment of one, comprises at least one processor, and described at least one processor is programmed to: receive the first input; Enter listen mode in response to recognizing the first input; Determine during the special time amount in the time that described electronic equipment is in described listen mode whether receive the second input, wherein the first input and/or the second input are phonetic entries; With during described special time amount, do not receive the second input and exit described listen mode in response to determining.
In one aspect, the second input is the implicit commands that exits described listen mode; And described at least one processor is also programmed to exit described listen mode in response to receiving the second input.
On the other hand, described at least one processor is also programmed in response to exiting described listen mode, the first input be monitored.
On the other hand, described electronic equipment also comprises at least one display, and described at least one processor is also programmed on described at least one display to show to the current whether instruction in listen mode of described electronic equipment.
On the other hand, described instruction comprises one or more selection labels and/or icon.
On the other hand, described at least one processor is also programmed to: determine that described electronic equipment is whether in listen mode; With show the multiple voice labels irrelevant with content in response to determining described electronic equipment in listen mode.
On the other hand, described at least one processor is also programmed to: not in described listen mode, hide the described multiple voice labels that have nothing to do with content in response to definite described electronic equipment.
Another embodiment, for the computer implemented method of one, comprising: receive the first input; In response to recognizing the first input, make electronic equipment enter listen mode; Determine during the special time amount in the time that described electronic equipment is in described listen mode whether receive the second input, wherein the first input and/or the second input are phonetic entries; With during described special time amount, do not receive the second input and exit described listen mode in response to determining.
On the other hand, the second input is the implicit commands that exits described listen mode; And described method also comprises in response to receiving the second input and exits described listen mode.
On the other hand, described electronic equipment comprises at least one display, and described method is also included in and on described at least one display, shows the current whether instruction in listen mode of described electronic equipment.
On the other hand, described instruction comprises one or more selection labels and/or icon.
On the other hand, described method also comprises: determine that described electronic equipment is whether in listen mode; Show the multiple voice labels irrelevant with content in response to determining described electronic equipment in listen mode; With in response to determining that described electronic equipment hides the irrelevant multiple voice labels of described and content not in described listen mode.
Another embodiment, for a kind of computer-readable recording medium with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carries out a kind of method, and described method comprises: receive the first input; In response to recognizing the first input, make electronic equipment enter listen mode; Determine during the special time amount in the time that described electronic equipment is in described listen mode whether receive the second input, wherein the first input and/or the second input are phonetic entries; With during described special time amount, do not receive the second input and exit described listen mode in response to determining.
In one aspect, described electronic equipment comprises at least one display, and described method also comprises: on described at least one display, show the current whether instruction in listen mode of described electronic equipment.
On the other hand, described instruction comprises one or more selection labels and/or icon.
On the other hand, described method also comprises: determine that described electronic equipment is whether in listen mode; Show the multiple voice labels irrelevant with content in response to determining described electronic equipment in listen mode; With in response to determining that described electronic equipment hides the irrelevant multiple voice labels of described and content not in described listen mode.
Another embodiment is for a kind of to the method that will show on digital tunable electronic equipment and/or the content of playback is searched for, and described electronic equipment is configured to show the programme content arranging.Described method comprises: receive and comprise that the phonetic entry of search inquiry, wherein said search inquiry comprise showing and/or the search of the described content of playback on described electronic equipment from user; Determine that based on described search inquiry user wants the action of carrying out; Want based on user the described action of carrying out at least in part, determine and will search for one or more data sources; At least in part based on described search inquiry, in described one or more data sources, search will show and/or the described content of playback on described electronic equipment.
In one aspect, determine that user wants the described action of carrying out to comprise: determine that user wants to listen to media content, and determine that the one or more data sources that will search for comprise: determine that described one or more data source is music data source.
On the other hand, determine that user wants the described action of carrying out to comprise: determine that user wants to watch media content, and determine that the one or more data sources that will search for comprise: determine the program content source that described one or more data source is at least one arrangement.
On the other hand, described method also comprises: store one or more rules, described one or more rules by the input of particular type be associated for the particular order of searching for described one or more data sources; Wherein searching for described one or more data source comprises: search for described one or more data source according to described one or more rules.
On the other hand, search for described one or more data source and comprise all available data sources of search.
On the other hand, described method also comprises: receive Search Results from described one or more data sources; With in user interface, present described Search Results.
Another embodiment is for a kind of computer-readable recording medium with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind ofly to the method that will show on digital tunable electronic equipment and/or the content of playback is searched for, described electronic equipment is configured to show the programme content arranging.Described method comprises: receive and comprise that the phonetic entry of search inquiry, wherein said search inquiry comprise showing and/or the search of the described content of playback on described electronic equipment from user; Determine that based on described search inquiry user wants the action of carrying out; Want based on user the described action of carrying out at least in part, determine and will search for one or more data sources; At least in part based on described search inquiry, in described one or more data sources, search will show and/or the described content of playback on described electronic equipment.
In one aspect, determine that user wants the described action of carrying out to comprise: determine that user wants to listen to media content, and determine that the one or more data sources that will search for comprise: determine that described one or more data source is music data source.
On the other hand, determine that user wants the described action of carrying out to comprise: determine that user wants to watch media content, and determine that the one or more data sources that will search for comprise: determine the program content source that described one or more data source is at least one arrangement.
On the other hand, described method also comprises: store one or more rules, described one or more rules by the input of particular type be associated for the particular order of searching for described one or more data sources; Comprise with the described one or more data sources of search: search for described one or more data source according to described one or more rules.
Another embodiment is for a kind of digital tunable electronic equipment that is configured to show the programme content arranging, described electronic equipment comprises: at least one processor, described at least one processor is programmed to: receive and comprise that the phonetic entry of search inquiry, wherein said search inquiry comprise showing and/or the search of the described content of playback on described electronic equipment from user; Determine that based on described search inquiry user wants the action of carrying out; Want based on user the described action of carrying out at least in part, determine and will search for one or more data sources; At least in part based on described search inquiry, in described one or more data sources, search will show and/or the described content of playback on described electronic equipment.
In one aspect, determine that user wants the described action of carrying out to comprise: determine that user wants to listen to media content, and determine that the one or more data sources that will search for comprise: determine that described one or more data source is music data source.
On the other hand, determine that user wants the described action of carrying out to comprise: determine that user wants to watch media content, and determine that the one or more data sources that will search for comprise: determine the program content source that described one or more data source is at least one arrangement.
On the other hand, described at least one processor is also programmed to store one or more rules, described one or more rules by the input of particular type be associated for the particular order of searching for described one or more data sources; Comprise with the described one or more data sources of search: search for described one or more data source according to described one or more rules.
On the other hand, search for described one or more data source and comprise all available data sources of search.
Should be appreciated that in more detail below all combinations (if such concept is not mutual inconsistent words) of the aforementioned concepts discussed and other concept are considered to a part for theme of the present invention disclosed herein.
Brief description of the drawings
Accompanying drawing is not intended to draw in proportion.In the accompanying drawings, represent with identical number designation at the each identical or intimate identical assembly shown in each figure.For clarity sake, may not that each assembly is all labeled in every accompanying drawing.In the accompanying drawings:
Fig. 1 is the example system that comprises the relevant assembly of the search interface with for entertainment systems of some embodiments of the present invention;
Fig. 2 be according to some embodiments of the present invention for present the processing of the result to content search in user interface;
Fig. 3 be according to some embodiments of the present invention for showing the schematic diagram of part of user interface of the result to content search;
Fig. 4 be according to some embodiments of the present invention for showing the schematic diagram of part of user interface of the mixing resultant to content search;
Fig. 5 can use input and the schematic diagram of the part of the user interface of mutual voice label with it according to the demonstration user of some embodiments of the present invention;
Fig. 6 be according to some embodiments of the present invention for using the exemplary process of listen mode to Input Monitor Connector; With
Fig. 7 is the exemplary computer system of some embodiment that can be used in the present invention.
Embodiment
The inventor has realized that and understands, and can improve the search of the content to checking on electronic equipment, and this electronic equipment comprises the tuner of the programme content for showing arrangement.The electronic program guides (EPG) of the above-mentioned type is usually used in searching for and selects the programme content arranging to check on tunable electronic equipment, and uses the display format of corresponding mesh-like of time of can be used for checking with the programme content of arrangement to be configured.The grid format that EPG shows is designed to receive from the input of remote control equipment that uses five navigation command systems with mobile cursor to the different entries in grid.The inventor has realized that the navigation that uses conventional EPG to show is trouble.For the entry of navigating by five navigation command systems in showing by the EPG of conventional mesh-like, may require user (for example to provide a series of navigation command, " under-under-under-right-select "), this does not produce efficiently or intuitively experiencing for the user of selection specific program.
The inventor has realized that the demonstration of conventional EPG search system is the user interface of " vision first ", and wherein the principal focal point at this interface is to show with visually consistent box the programme content arranging.The inventor understands, and is feasible for the other technologies of search content, and these technology do not need the strict vision that is arranged programme content to present, because user is not limited to by the five navigation command systems shown entry of navigating.For this reason, some embodiments of the present invention for for improvement of the method and apparatus at visual search interface.Especially, in some embodiments of the invention, visual user interface is designed to encourage the input of " natural language first ", makes interface be configured to encourage user to say or otherwise provide and be input to search system according to natural mode.
Some embodiment encourage to use phonetic entry as main input form, using the visual aspects of user interface as supplementing phonetic entry.But, should be appreciated that any input that can say can alternatively for example, be provided via the input form (, inputting with the text of keyboard) of another type.Therefore, although embodiment described below is described as inputting form by the use of voice, can use other forms with allow user to provide and following embodiment by the same type that voice were provided in the input described.
Fig. 1 shows the example system 100 for using according to some embodiments of the present invention.System 100 comprises electronic equipment 102, and it can be TV, computer, portable electric appts (such as smart phone or be configured to receive and show any other tunable electronic equipment of the programme content arranging).Electronic equipment 102 can be configured to receive search and the input of chosen content to check at electronic equipment from user, wherein uses one or more input forms to receive this input.In certain embodiments, electronic equipment 102 comprises speech input interface 104, such as microphone and one or more other input interfaces 106 that are configured to receive input.Other input interfaces 106 can include but not limited to keyboard interface (for example qwerty keyboard), mouse interface, Remote Control Interface or make the user can search content any other suitable interface to check on electronic equipment 102.
The phonetic entry receiving via speech input interface 104 can be sent to automatic speech recognition (ASR) engine 108, the content for automatic speech recognition with the identification phonetic entry that received.Although ASR engine 108 is shown in Figure 1 for a part that is included as electronic equipment 102, but ASR engine 108 can alternatively remotely be located from electronic equipment 102, and can use any suitable communication media (for example one or more networks) and communicate by letter with electronic equipment 102.In certain embodiments, electronic equipment 102 can be associated with the ASR engine of one or more local ASR engines 108 and one or more long range positionings, at least some phonetic entries that receive are by the processing of described one or more local ASR engine thus, and at least some phonetic entries that receive are by the ASR engine processing of described one or more long range positionings.The example of this distributed ASR system is well known by persons skilled in the art.Using the communication media (for example one or more networks) of one or more connecting electronic equipment 102 and ASR engine to be sent to described one or more long-range ASR engine can use identical or different communication media and turn back to electronic equipment 102 from the ASR engine of long range positioning for the phonetic entry of identifying.
In certain embodiments, ASR engine 108 can be communicated by letter with one or more voice command data sources 110 of the one or more voice commands of storage.ASR engine 108 can match received phonetic entry the described one or more voice commands that are stored in described one or more voice command data source 110, and the voice command that returns to one or more couplings is to one or more processors 114, processor 114 is programmed to carry out at least one action corresponding to the voice command of described one or more couplings.In certain embodiments, the output of ASR engine 108 can be used natural language understanding (NLU) engine analyzed, and NLU engine uses any suitable for NLU technology, and its example is known in the art.NLU output can be at least in part for being associated voice command with received phonetic entry.In certain embodiments, electronic equipment 102 can be configured in response to below phonetic entry being interpreted as to voice command: the activation of input signal (for example, user presses the button on remote controller or keyboard), or receive the phonetic entry corresponding to " waking up " language, in the time that the phonetic entry corresponding to " waking up " language is received, indicate the phonetic entry of following this input signal should be interpreted as voice command.Alternatively, phonetic entry can be interpreted as order and need to for example, not start via the order of input signal (language is pressed or waken up to button), because embodiments of the invention are unrestricted in this regard.
The set of the voice command that one or more voice command data sources 110 are stored can comprise for searching for and any suitable order of chosen content to check on electronic equipment 102.In certain embodiments, the set of voice command can comprise the order of controlling the function of electronic equipment 102 own, and its example is included in the order of often finding on conventional remote control equipment, such as " quiet ", " opening power " and " volume ".The set of the illustrative electronic equipment order for controlling electronic equipment 102 has been shown in table 1 below, but has should be understood that, provide these to order only as example, embodiment as described herein is not limited to use these specifically to order.
Table 1: illustrative electronic equipment order
The set of voice command can also comprise for searching for and/or selecting the programme content of arrangement with the tuner command of demonstration on electronic equipment 102, such as " < channel designation >, " succeeding channel " and " < programm name > is shown " being shown.The set of illustrative tuner command has been shown in table 2 below, but has should be understood that, provide these to order only as example, embodiment as described herein is not limited to use these specifically to order.
Table 2: illustrative tuner command
The set of voice command can also comprise for electronic equipment 102 on the mutual utility command of one or more client application, described client application is carried out any function in many functions, and the access providing many services is provided.For example, user can use utility command to call out (for example Skype to use to carry out tM) client application start voice call session, search Weather information or carry out many other action in any action.The set of illustrative application order has been shown in table 3 below.
Table 3: illustrative utility command
Illustrative application order described in table 3 comprises the order of controlling exemplary client application, and these client application comprise Twitter tM, YouTube tM, and Skype tM.But, should be appreciated that embodiments of the invention can comprise the voice command for any other client application, and do not limited in this respect.For example, also can comprise for including but not limited to gmail tM, hulu tMand MySpace tMthe voice command of client application.Some client application (comprise many listed above those) can be can be via the proprietary application on electronic equipment or via the web browser on the equipment accessed service based on web or application, and embodiments of the invention do not limit the accessed mode of client application.
The set of voice command can also comprise action command, and each action command is for carrying out the action relevant with one or more projects of search result list.Table 4 has below been described the list of illustrative actions order.
Table 4: illustrative action command
In certain embodiments, the set of voice command can also comprise for showing mutual EPG order with EPG.The navigation of limited subscriber by EPG entry be contrary with coming by the routine five navigation command systems of use with remote control equipment together with, and the set of EPG order can provide the additional phonetic function viewing experience with enhancing user.Table 5 has below been described the set of illustrative EPG order.
Table 5: illustrative EPG order
In certain embodiments, electronic equipment 102 also comprises tuner 112, tuner 112 be configured so that electronic equipment 102 can be tuned to specific channel to show the programme content arranging on electronic equipment 102.For example, tuner 112 can make electronic equipment to receive the programme content arranging from the program content source 124 of one or more arrangements of being connected to electronic equipment 102 via network 120.The program content source 124 arranging can be found the source for the media content of these arrangements of time, and described media content includes but not limited to content (for example TV programme and film) and the live media content of storage.The programme content that storage and/or transmission arrange is known to the program content source 124 of the arrangement of electronic equipment (for example, by the communication media such as wired or satellite network).Some embodiment can comprise the tuner that is configured to receive from multiple content source the programme content arranging, and/or can comprise multiple tuners, its each be configured to receive from different content source the programme content arranging.
Electronic equipment 102 can also comprise network interface 118, and it is configured to communicate by letter with one or more storages and/or treatment facility via one or more networks 120.As described above, network interface 118 can receive voice identification result to one or more long-range ASR engines with from described one or more ASR engines for transmitting phonetic entry.Electronic equipment 102 can adopt single network interface 118 or more than one network interface 118, to make electronic equipment 102 can be connected to the network (for example, to carry out different functions) more than a type.
A kind of example electronic device 102 is television systems.Television system generally includes tuner, and it makes television system can show the programme content of the arrangement being received by the Set Top Box that is connected to TV.Set Top Box is the example of tuner 112, and it receives the programme content content that also decoding receives arranging to make electronic equipment show this content on display 122 via network interface 118.The programme content of the arrangement receiving via network 120 or any other content can show on the display 122 that is connected to electronic equipment 102.In certain embodiments, display 122 can the integrated part as electronic equipment 102, and in other embodiments, display 122 can be connected to electronic equipment 102 via one or more wired or wireless connections.Display 122 can be also individual monitor or multiple display, and embodiments of the invention are unrestricted in this regard.
In certain embodiments, electronic equipment 102 can also be associated with local content data source 116, and local content data source 116 can be configured to store one or more TV programme, one or more film or any other and be suitable for the content of playback on electronic equipment.For example, in certain embodiments, local content data source 116 can be digital video recordings device (DVR), and it is configured to store the programme content of the arrangement of recording.One or more local clients that local content data source 116 can be configured to storage and be associated with electronic equipment 102 are applied relevant content, and described local client application includes but not limited to one or more application of storage and/or management picture file, music file and/or video file.
According to some embodiment, when search content is to check on electronic equipment 102 and/or when playback, can be from local content data source 116 and/or for example, from electronic equipment 102 long range positionings and be connected to one or more data sources (the content-data source 124, the bundled services content-data source 124 that arrange) retrieval of content of electronic equipment 102 by network 120.Searched particular source can depend on search inquiry at least in part.In the time returning results from multiple sources, Search Results at least in part the content based on corresponding with Search Results source and be sorted.In certain embodiments, user can be included in the source of the content in Search Results and/or the type of content limits the search to content based on expecting, as described in more detail below.
Some embodiment are for the controlled visual search of the voice interface showing on display 122, and are configured to allow user search content so that check and/or playback with electronic equipment 102.User can search for alternately with search interface the programme content of arrangement, as described above.The programme content arranging includes but not limited to the broadcasted content such as TV and program of radio station.
In addition, some embodiment can make user can search for bundled services content, and bundled services content is for example stored by bundled services data source 124 and/or the local content data source 116 of one or more interconnection networks.The programme content that is different from only the arrangement for for example, checking at special time (in the time that this content is arranged for broadcasting), bundled services content can be for check at any time/playback.Bundled services content from the content of the service based on web (for example can include but not limited to ), from the content of the Local or Remote data source of storing media content (such as DVR content, from on-demand content of service provider etc.) and with the one or more client application that are associated with electronic equipment 102 (for example ) content that is associated.As described in more detail below, can allow user in single search, to search for the programme content, bundled services content that arrange or programme content and the bundled services content of arrangement according to some embodiment to the search of content.
Fig. 2 shows the illustrative methods for the treatment of search inquiry according to some embodiments of the present invention.In step 210, electronic equipment 102 receives content search to check on electronic equipment 102 and/or the search inquiry of playback.For example, search inquiry can comprise one or more voice commands, as described above.For received phonetic entry is interpreted as to one or more voice commands, phonetic entry can be processed for identification by one or more this locality and/or long-range ASR engine.In certain embodiments, can be at least in part type based on phonetic entry determine and be via local ASR engine or long-range ASR engine or carry out processed voice input via the two.For example, in one implementation, for example, corresponding to the phonetic entry of fixed form device command (" quiet ", " powered-down ", " volume increase ") can be by the processing of local ASR engine, and comprise that the order of free form input (for example " search ", " searching " etc.) can for example, by (" cloud ") ASR engine processing of one or more long range positionings.For example, because fixed form order can be associated with limited grammer, can more easily identify them, local ASR engine can be enough for speech recognition and with input is sent to long-range ASR engine and compares faster.But the input of free form may more be difficult to identification, therefore for acceptable recognition performance, may need input to send to the more ASR engine of robust.And the language model being associated with long-range ASR engine can upgrade termly to reflect the variation of pop culture, the title of film, performer, books etc., these may be impalpable for local ASR engine on the contrary.In certain embodiments, the at least Part I of phonetic entry can be by the processing of local ASR engine, and at least Part II of phonetic entry can be by the ASR engine processing of long range positioning, and any combination of local and remote ASR engine can be used for the phonetic entry that identification receives.
Process and then enter in step 220, wherein one or more data sources are searched in the phonetic entry corresponding to search inquiry based on identified at least in part.Described one or more data source can be searched with any order, and any specific data source (comprise and be less than whole available data sources) can be searched.The result of being returned by search can be come to determine in any suitable manner.In certain embodiments, can want the specific action of carrying out to determine which data source of search based on user at least in part.For example, if user says " listening Bob Seger ", system can determine that user wants to listen to the music, and therefore only has local music data source instead of the data source that is associated with EPG can be searched.Alternatively, if user says " watching Modern Family ", can determine that user wants to watch TV show.Correspondingly, the data source being associated with EPG and the one or more data sources that are associated with the television content of recording can be searched, but local music data source may be not searched.By optionally searching for and be less than whole available data sources, some embodiments of the present invention can be returned to the time quantum of Search Results and be returned to relevant Search Results in more efficient mode by minimizing.But, be not that all embodiment are restricted to the subset of only searching for useful source, because can search for all useful sources for some search.
In certain embodiments, can be at least in part based on by particular command (or determined user view) with carry out for searching for and/or present one or more rules that the particular order of Search Results is associated the order that the searched order in specified data source and/or Search Results are presented.For example, if user says " watching Modern Family ", identification (or the expection action of voice command " being watched ", if do not adopt particular command, as discussed below) can cause electronic equipment first to search for and return results from the data source being associated with EPG, secondly search for and return results from the data source being associated with local content, again from client application (for example YouTube tM) data source that is associated searches for and return results.Should be appreciated that description is this for searching for and returning with " watching " and order the particular order of the Search Results being associated to be only used for illustrative object, alternatively can use any other desired order.
In addition, some embodiment can not comprise fix command grammer, but can determine in some other modes user's intention from the input being received, such as determine user's intention by the particular utterance in the input of monitoring free form, and perform an action in response to the intention of determining user.For example, if user uses the Play command or use " a broadcastings " word in free form input, the use that system can identify this play command or " broadcastings " word can imply that user accesses the intention of addressable content always (this locality store or program request can be used).Can determine and play what media content with one or more priority rules.For example, can first determine whether EPG has any media content that is currently available for broadcasting (such as broadcasted content, on-demand content etc.) matching with phonetic entry.For example, if determine there is no current available content from EPG, next can determine whether that any media content of recording (DVR content) mates with phonetic entry.If more than one recording medium inclusive segment and phonetic entry match, it is shown that described one or more priority rule can be specified the content of all couplings, and user can be selected therein.Alternatively, in certain embodiments, electronic equipment can automatically playback matching content selected one (content of recording of for example the oldest not watching (or part is watched) selected and playback on electronic equipment), instead of show multiple Search Results to user.Although relating to, above-mentioned example plays media content with the set of certain priority rule, but be to be understood that, these rules are just illustrative, can use the set of any suitable priority rule for any phonetic entry, because embodiments of the invention are not limited in this respect.
Get back to the processing of Fig. 2, searched for described one or more data source in step 220 after, processing enters step 222, wherein, in response to searching from described one or more data sources the content matching with search inquiry, in the user interface being associated with electronic equipment 102, show one or more results.Search Results can show in any suitable manner, comprises the search result interfaces that uses voice-enabled (voice-enabled), as will be described in more detail.As described above, demonstration result can comprise directly presenting with user inputs the inclusive segment matching.
Fig. 3 shows according to the part at the visual search interface of some embodiments of the present invention.Particularly, Fig. 3 shows illustrative result screen 300, for showing the Search Results returning from the search to the content of checking at electronic equipment and/or play of user's startup.In certain embodiments, result screen 300 is configured to along at least two axle display of search results.In an illustrative embodiment, an axle is in the prospect of search interface, and one or more other axles are in the background of search interface, still can for example, be brought to the prospect of search interface in response to order (voice command).In other embodiment more again, the content focusing effect (in focus) only showing on the axle in prospect, and other shaft portions ground decokings (out of focus) are to attract prospect axle by user's attentiveness.But not all embodiment of prospect of the application and background axle are restricted in this respect, because some embodiment can present two or more axle focusing effects.
In certain embodiments, for the first axle of display of search results can be and the axle 310 of time-independent.When can be used for checking corresponding to the content of Search Results and/or when playback, can with any suitable with the tolerance of time-independent along carrying out rank search result with the axle 310 of time-independent.For example, in a nonrestrictive example, can be at least in part based on the degree of correlation of the search inquiry bearing results along carrying out rank search result with the axle of time-independent.In certain embodiments, can be restricted to along the content showing with the axle of time-independent the content that can use in current time, and in other embodiments, it can comprise current disabled content.For based on the sort embodiment of returned Search Results of the degree of correlation of search inquiry, (for example can use in any suitable manner any suitable algorithm, comprise and provide the higher degree of correlation to being currently available for the content of checking) determine the degree of correlation, because embodiments of the invention are unrestricted in this regard.Should be understood that, with the degree of correlation of search inquiry be only along a kind of mode result being sorted with the axle of time-independent, and any other suitable tolerance can be used to replace or in addition in using with the degree of correlation of search inquiry.The combination of type that for example, can be content-based at least in part, the source of content or any other factor or factor is sorted to Search Results.
In certain embodiments, Search Results also can be organized along the second axle, and the second axle is time-based and is configured to show and is used in the Search Results that different time is checked.For example, the prospect of result screen 300 can show the Search Results for current available content, and only future time can with content may be displayed in background 320, as shown in Figure 3.
Although result screen 300 comprises the Search Results being presented on two axles only, should be appreciated that Search Results may be displayed on the axle of any number, because embodiments of the invention are unrestricted in this regard.For example, in certain embodiments, for current time can with but before viewing content, may need the Search Results of the bundled services content that pays subscription charge or some other fees to show along independent axle (not shown), to indicate this content only just can be checked after paying payment applicatory.
Result screen 300 can also comprise describes part 330, and it comprises the information about the Search Results of current selection.Describe part 330 and can also comprise other information, other information make user from the Search Results showing in result screen 300, to make wise selection.For example, describe part 330 and can comprise the description of the content being associated with current selected Search Results, and the selection that this description can be based on to the different Search Results that show in result screen 300 and changing.
In certain embodiments, may be displayed on result screen 300 so that crowded the minimizing showing than process the few Search Results of whole Search Results returning from search.In certain embodiments, user can with one or more voice labels mutual (as described in more detail below), to check other Search Results.Result screen 300 can also comprise finds field 340, and it makes one or more in can the Search Results based on showing in result screen 300 of user and the search that adds.For example, find that field 340, in the time being selected by user, can start the search to the content similar with the content that is associated with current selected Search Results.Similarity can be determined by the method for any suitable algorithm of any suitable use, because embodiments of the invention are unrestricted in this regard.For example, at least in part content-based retrieve from the type of content source, the one or more content tabs (parental ratings of for example film) that are associated with inclusive segment, content or any combination of these or other factor determine similarity.
In certain embodiments, result screen 300 can comprise tool bar 350, and it comprises the information of the user interactions of convenient and scouting screen 300.For example, tool bar 350 can comprise one or more icons, text or other indicating devices, described other indicating device interpreting users can be used for result screen 300 mutual specific to screen or the overall situation input (for example voice command).
According to some embodiments of the present invention, Search Results can comprise the Search Results of mixing, and it comprises dissimilar content.For example, as discussed above, Search Results can comprise the result corresponding with the programme content arranging and bundled services content.Fig. 4 shows illustrative result screen 400, and the Search Results wherein showing in result screen 400 comprises the Search Results of mixing, that is, at least two in Search Results are associated with dissimilar content.The Search Results mixing can comprise the first result of returning from the program content data source of one or more arrangements and the second result of returning from one or more bundled services content-datas source.The Search Results showing in result screen 400 comprises Search Results 410,412 and 414, they can be the results of returning from the program content data source of one or more arrangements, also comprise Search Results 420 and 422, they can be the results of returning from one or more bundled services content-datas source.
As shown in Figure 4, the Search Results returning from the program content data source arranging and the Search Results returning from bundled services content-data source may be mixed together and use the combination of any suitable tolerance or tolerance along sorting with the axle of time-independent, and these tolerance include but not limited to the degree of correlation, the type of content and the source of content with search inquiry.The same with result screen 300, result screen 400 can comprise describes part 430, the one or more relevant information in it Search Results that comprises and show in result screen 400.
In certain embodiments, the Search Results showing in result screen 400 can be sorted along comprising with the axle of time-independent and at least two axles of time-based axle.In certain embodiments, the Search Results showing in the background parts of search interface can only comprise the programme content of arrangement and not comprise bundled services content.For example, because some bundled services contents can be always addressable, in certain embodiments, can always be presented in the prospect part of search interface corresponding to the Search Results of such bundled services content, to indicate it to can be used for checking and/or playing immediately.But, should be appreciated that this is only an illustrative mode carrying out organising content with two axles, its hetero-organization of content is also possible.
As discussed above, some bundled services contents only just can be accessed immediately once defrayment.For example, from Online Music shop (such as ) song only once buy this song just can be accessed immediately.In certain embodiments, although not shown in Fig. 4, with become be used on electronic equipment, check and/or playback before need the corresponding Search Results of the content that pays not mix with other Search Results, but can appear in the different piece of search result interfaces.
In certain embodiments, can comprise one or more selection labels according to the search interface of some embodiments of the present invention, mutual between the convenient user of these labels and one or more assemblies of search interface.Fig. 5 shows the exemplary result screen 500 that comprises multiple selection labels.As shown in Figure 5, one or more can being associated with selecting label 510 in Search Results, its indicating user can provide (for example, via spoken language input, keyboard or keypad etc.) to select the input of specific Search Results.In exemplary result screen 500, for the embodiment that adopts speech interface, if user wants to select the first Search Results in the lower left corner, user can say " selecting 1 ".Alternatively, if user wants to select to be presented at the Search Results on the lower right corner, user can say " selecting 4 ".
Result screen 500 can also comprise the selection label of other types, and such as one or more icons 520, it makes user to carry out the one or more actions relevant with the content that is associated with this icon by select command.For example, icon 520 can include but not limited to indicate them can check certain content, record certain content or carry out the icon of some other actions of being associated with the certain content that is associated with icon to user.User can be by action and the combined action of carrying out selected content of mark of selecting label.For example, user can be by saying that " checking 1 " check the content being associated with the Search Results in the lower left corner of Fig. 5.
Adopt in the embodiment of speech interface at some, depend on when voice command activates, can be classified as dissimilar voice command with the interactive voice at visual search interface.For example, some voice commands can be classified as the order irrelevant with screen, and these orders are independent of the content showing in any specific screens, always and activate and no matter current what specific screens what just presenting on display be.Include but not limited to the order such as volume control, channel control, screen intensity and menu access order with some limiting examples of the irrelevant order of screen.In certain embodiments, with the set of the irrelevant order of screen and functional substantially overlapping by remote control equipment control conventionally.The order irrelevant with screen can be associated with one or more marks, described mark is for showing on search interface, with the selection label existing to these orders of user reminding, or in certain embodiments, suppose the order that user knows that these always can be used and can be called, making not show selection label or icon.In certain embodiments, in the tool bar showing, can comprise the list that can access global command for one or more icon of global command and/or in response to trigger event (such as seeking help, press hot key on input equipment or other modes with some) on search interface screen.
Some interactive voices can be associated with the action with screen-dependent, with the action of screen-dependent, user can only be performed an action in the specific screens of user interface.For example, in the result screen 500 shown in Fig. 5, select label 510 can allow user to select specific Search Results (as described above), and in response to having selected specific Search Results, the description of the content being associated with selected Search Results can be updated to provide information to user on search interface, and whether this information can help user for example to determine, to the content being associated with selected Search Results perform an action (watch, buy, record).
Other can be associated with one or more navigation features of search interface with the action of screen-dependent, and navigation feature makes user can in specific result screen, navigate and/or upgrade the content of result screen.For example, search interface can show the mark of voice-enabled (voice-enabled), it allows user to check the current additional Search Results not showing on search interface, for example, upgrade result screen to comprise additional result by the input of saying " next result " or some other order phrases or free form.
Search interface can further dispose the integration of user interaction functionality being associated with the action of screen-dependent, to switch between the Search Results that allows user to present at the varying level showing with multiaxis.For example, at Search Results, in the embodiment showing with the axle of time-independent and time-based axle, user can use voice (or other forms of) input, and to switch, which result along time-based axle is current is focused and can be selected.For example, user can say the content of " after a while " (or some other language or phrases) to select to be associated with the Search Results that the time-based axle along shown Search Results shows in the background of user interface.This can be useful, for example, allow user take with time after a while can with the relevant action (for example recording) of the content that programs.In order to carry out this action, user can say " after a while " (or some other language or phrases), this can switch in Search Results shown in prospect and in background shown Search Results so that user can chosen content only in the future available project.
Graphic icons 520 can represent the user interactions of another kind, and these user interactions make user can carry out specific action, such as the content of recording, checking or playback being associated with Search Results.In certain embodiments, graphic icons also can be corresponding to additional increment action, and these increment actions make user can carry out the function of other " less important ", for example, post carry out Twitter tMon action or carry out alternately with the service of another client application or website.
Although above-mentioned illustrative example discussed three kinds of dissimilar user interactions (with the irrelevant order of screen, with action and the graphic icons action of screen-dependent), but should be clear, can use the user interactions of any number type, because embodiments of the invention are unrestricted in this regard.
In the embodiment of some support voice interfaces, whether the selection label showing on search interface and/or the existence of other icons or do not exist can be at least in part voice activatedly based on be determined for search interface alternately.Determine whether interactive voice activates for search interface and can carry out in any suitable manner, comprise and for example determine whether microphone activates, determines whether speech recognition software is carried out, determined whether user has sent voice command to show voice label or other suitable modes on search interface on electronic equipment.
In certain embodiments, electronic equipment can receive the input that makes electronic equipment enter " listen mode ", and during " listen mode ", electronic equipment is expected from user's further input to perform an action.On the contrary, when electronic equipment is not during in listen mode, electronic equipment can not be interpreted as received input the intention of the execution specific action that represents user acquiescently, triggers but can monitor the input that enters into listen mode.Fig. 6 show according to some embodiments of the present invention for comprising the illustrative process of electronic equipment of listen mode.In operation 610, determine whether to receive and will make electronic equipment enter the first input of listen mode.For example, in the embodiment that comprises speech interface, the first input can be corresponding, as described above with voice command or some other phonetic entries of proof user's the intention performing an action.Alternatively, the first input can be to make electronic equipment enter any other suitable input of listen mode, includes but not limited to by the specific keys on lower keyboard or keypad.
If determine and do not receive the first input in step 610, process and continue the first input that monitoring receives.Otherwise, if received the first input, process and enter step 612, wherein make electronic equipment enter listen mode in response to identification the first input.When in listen mode, process and enter step 614, wherein determine whether to have received the second input.If determine and received the second input in listen mode, process and enter step 620, wherein carry out the one or more actions corresponding to the first and/or second input.Having carried out from step 620 after one or more actions, if expect additional input, process and can turn back to alternatively step 612 to enter listen mode.For example, second input can be " on the HBO comedy inventory of tonight, what having? ", and the action of carrying out in step 620 can be the HBO comedy inventory of opening the same day.Because expect additional input, all processing can enter step 612 to enter listen mode, wait for additional input (for example next, previous, exit etc.).But, if not additional input is expected carry out one or more actions from step 620 after, processes and can finish.
If determine and do not receive the second input in step 614, process and enter step 616, wherein determine whether passed through specific time quantum (for example 5 seconds) since entering listen mode.If determine and also do not pass through specific time quantum in step 616, process and continue monitoring the second input.Otherwise, if determine and pass by specific time quantum, process and enter step 618, wherein make electronic equipment exit listen mode, and process and turn back to step 610 to monitor the first input.In the embodiment describing in the above, entering after listen mode, electronic equipment is having pass by exit listen mode after specific time quantum.But, should be clear, in certain embodiments, can otherwise alternatively exit listen mode.For example, some embodiment can make user to exit listen mode by providing the input of guiding electronic equipment to exit listen mode to carry out explicitly.This explicit input can be taked any applicable form, includes but not limited to voice command (or definite user view) or by the button on lower keyboard or keypad.
In certain embodiments, in the time making electronic equipment enter listen mode, this can be noted in some way in the shown user interface of electronic equipment.For example, once entering listen mode, one or more selection labels and/or icon can appear in user interface to notify user to enter listen mode.The user interface that should be appreciated that the mode state that can carry out by any way reflection electronic equipment changes, and it is a kind of mode of indicating status that show or hide is selected the example of label and/or icon, and other modes are also feasible.
In certain embodiments, can represent bundled services content search result in hierarchical ground.For example, if specific bundled services comprises one or more inclusive segments that match with search inquiry, can represent them by the identifier instead of the corresponding inclusive segment that comprise bundled services at Search Results at first, and then from Search Results, select bundled services can make corresponding inclusive segment be illustrated in user interface.For example, the application being associated with bundled services content search result can be depicted as image or the icon for applying, and this image or icon are recognized by the user for representing this application.For example, bundled services Search Results can be served corresponding to movie streams processing (streaming), such as (for example by figure indicates), and for example, in response to (selecting the second Search Results by for example saying search Results) " select 2 " and select movie streams to process service, can show search Results in application.
In illustrative example, user can search for the content corresponding to " Yankees ", and the Search Results returning in response to this search can comprise for the programme content of the arrangement of New York Yankees baseball match, process the bundled services content of service, the music content relevant with band " Damn Yankees " and the electronic book contents for the e-book " A Connecticut Yankee in King Arthur ' s Court " of Mark Twain from the movie streams of the film for relevant with New York Yankees.With show bundled services included, all films relevant with Yankees are contrary, Search Results can illustrate the image of processing service for movie streams at first, this movie streams processing service comprises the multiple films relevant with search terms " Yankees ".Once by using the image of for example selecting to process for this movie streams service with the selection voice label of this image correlation connection, process service from this stream available and may be displayed on Search Results corresponding to one of search terms " Yankees " or multi-section film.The Search Results that hierarchical presents can have the hierarchical level of any number, because embodiments of the invention are unrestricted in this regard.
The illustrative example of another content can hierarchical representing is the song in music libraries.For example, user may want to play the song of Metallica, but may forget the title of this song.In order to search for this song, user can start the search to " Metallica ", the Search Results returning can comprise that this locality is stored in the special edition of the multiple Metallica in the local data source being associated with electronic equipment, and/or comprises the music data source (for example database) connecting from one or more networks of the music of Metallica.In certain embodiments, Search Results can be rendered as a series of images for the album cover of the different special editions of Metallica, and can point out user from Search Results, to select (for example, by using the selection voice label joining with each special edition image correlation) in special edition.Once one that selects in special edition, selected special edition can launch to show the Search Results for one or many in the song being associated with special edition, and user can select one of song on special edition to carry out playback.Therefore, in this respect, Search Results can present in hierarchical mode, makes can to allow user to navigate to the selective sequential of Search Results and wants the content of playback on electronic equipment by Search Results with discriminating user.
In certain embodiments, can adopt guide user how from the voice label of the different component interactions of user interface.The voice label of content neutral is the irrelevant mark of content identifying with voice label.The example of the voice label of content neutral is the selection voice label shown in Fig. 5 (1,2,3,4), and they allow user to select one of Search Results and needless to say go out to identify the title of the content of Search Results.Therefore, the voice label of content neutral does not identify the content itself being associated with them, but neutral gear (slot) or the position of the Search Results that only sign content is assigned to.By using the voice label of content neutral, the set of voice label is provided to user, the consistent user that they are conducive to when with visual search interface alternation experiences.In addition, allowing user with the voice label of content neutral is the content identifying based on this label at least in part and creating, the voice still less of needs are carried out to call instruction with comparing at voice label.Use the voice label of content neutral also to allow to use fixing grammer (for example numeral, letter), this can produce more accurate ASR for the content may with unique title etc.
In certain embodiments, user can provide the input (for example, via voice) causing more than the order of a type or mutual activation.For example, user can say " watching 1 ".As response, occur two alternately: the first project in (1) Search Results can be selected and (2) selected project can be played.Like this, single input can cause multiple orders or is performed alternately and must sends independent order without user.This system makes user can use nature input (for example voice) to control electronic equipment.
Describe the search that can carry out for the content of any type above, comprised YouTube tM, Hulu tMor any other video is shared the search of the video clipping on website or web services.In addition, as mentioned above, user can search for this locality and be stored in a music libraries or the music content that can for example, access via network (internet).User can have the ability that search is limited to the content (such as the programme content of music, video or arrangement) of particular type, makes Search Results only include user to expect the content of particular type of search.For this reason, search interface can be associated with Advanced Search ability, and Advanced Search ability can be used phonetic entry and/or other input forms to be configured.
In certain embodiments, the inclusive segment showing in Search Results can comprise multiple labels (for example voice label), one of them tag identifier content, the action (for example watching, record or buy content) that another label instruction is carried out by content.For search interface, the quantity of the label being associated with Search Results is not the restriction of the embodiment of the present invention.
Fig. 7 shows the illustrative realization of the computer system 700 that can be combined with any embodiment of invention described herein.Computer system 700 can comprise one or more processors 710 and one or more computer-readable non-volatile memory medium (for example memory 720 and one or more non-volatile memory medium 730).Processor 710 in any suitable manner subtend memory 720 and non-volatile memory device 730 is write data and controls from their reading out datas, because each aspect of the present invention described herein is also unrestricted in this.Described herein any functional in order to carry out, processor 710 can be carried out the one or more instructions that are for example stored in, in one or more computer-readable recording mediums (memory 720), and described one or more computer-readable recording mediums can serve as the non-volatile computer readable storage medium storing program for executing for storing the instruction of being carried out by processor 710.
The above embodiment of the present invention can be with any realization the in various ways.For example, embodiment can combine to realize with hardware, software or its.In the time realizing with software, software code can be carried out on any suitable processor or processor collection, no matter is arranged in single computer and is still distributed between multiple computers.Should be appreciated that any assembly or the assembly collection of carrying out above-mentioned functions can usually be considered to be one or more controllers of controlling above-mentioned functions.Described one or more controller can be realized in many ways, for example, such as the common hardware (one or more processors) or the specialized hardware that are programmed to carry out above-mentioned functions with use microcode or software.
In this respect, should be clear, a realization of embodiments of the invention comprises at least one non-volatile computer readable storage medium storing program for executing (such as computer storage, floppy disk, CD, tape etc.), it is encoded with computer program (being multiple instructions), in the time that described computer program is carried out on processor, carry out the above-mentioned functions of embodiments of the invention.Computer-readable recording medium can be transmissible, and the program of storing on it can be loaded on any computer resource to realize each aspect of the present invention discussed in this article.In addition the above-mentioned functions computer program of carrying out in the time being performed that, should be appreciated that institute's reference is not limited to the application program of moving on host computer.On the contrary, use term computer program for example to refer to be in general sense used to programmed processor, to realize the computer code (software or microcode) of any type of above-mentioned each side of the present invention at this.
Various aspect of the present invention can use separately, be used in combination or with not in the aforementioned embodiment the concrete diversified layout of discussing use, therefore various aspect of the present invention not by their application restric-tion in set forth in the above description or layout and the details of described assembly in the accompanying drawings.For example, the each side described in an embodiment can be combined with the each side described in other embodiment by any way.
And embodiments of the invention can be implemented as one or more methods, provide its example.Can sort in any suitable manner as the action that the part of method is performed.Therefore, can be configured in wherein with from shown in the embodiment that performs an action of the different order of order, it can comprise carries out some actions simultaneously, even if be shown as sequentially-operating in illustrative embodiment.
Use in the claims and carry out modification right such as the ordinal number of " first ", " second " " the 3rd " etc. and require element itself and do not mean that a claim key element with respect to any order of another claim key element, precedence or preferentially, also do not mean that the time sequencing that the action of method is performed.These terms are only with marking to distinguish another key element that has a claim key element of a certain title and have same names (except using ordinal number).
Wording and the term object for describing, should not be considered to be restriction as used herein." comprise " as used herein, " comprising ", " having " " comprise " " relating to " and modification thereof and be intended to comprise the project listed thereafter and other project.
Described several embodiments of the present invention in detail, those skilled in the art can easily expect various amendments and improvement.These amendments and improvement are intended to belong to the spirit and scope of the present invention.Therefore, above-mentioned specification is only exemplary, but not is intended to restriction.The present invention is only restricted to as limited in claim and equivalent thereof.

Claims (89)

1. on electronic equipment, present a method for Search Results, wherein said electronic equipment comprises and is configured to tuning described electronic equipment to receive the tuner of program arranging, and described method comprises:
Reception comprises the phonetic entry of search inquiry;
At least in part based on described search inquiry, search at least one data source with at least one processor; With
Present the result of search with time-based axle with the axle of time-independent.
2. method according to claim 1, wherein with the axle of time-independent based on described search inquiry in the degree of correlation of one or more described result is sorted.
3. method according to claim 1, wherein searches at least one data source and comprises program content data source and at least one bundled services content-data source of searching at least one arrangement.
4. method according to claim 3, wherein said result is included in the programme content of the arrangement identifying in the program content data source of described at least one arrangement and the bundled services content identifying in described at least one bundled services content-data source.
5. method according to claim 1, wherein said result comprises bundled services content, in the time that described bundled services content is selected, shows the multiple results from least one the bundled services content-data source being associated with selected bundled services content.
6. method according to claim 1, wherein time-based axle is distinguished current first content and the current second content that can not be used for playback that can be used for playback.
7. method according to claim 1, the described result wherein presenting along time-based axle only includes the programme content of arrangement.
8. an electronic equipment, comprising:
Be configured to tuning described electronic equipment to receive the tuner of the program arranging; With
At least one processor, is programmed to:
Reception comprises the phonetic entry of search inquiry;
Based on described search inquiry, search at least one data source at least in part; With
Present the result of search with time-based axle with the axle of time-independent.
9. electronic equipment according to claim 8, wherein with the axle of time-independent based on described search inquiry in the degree of correlation of one or more described result is sorted.
10. electronic equipment according to claim 8, also comprises:
Speech input interface, is configured to receive described search inquiry as phonetic entry.
11. electronic equipments according to claim 8, wherein search at least one data source and comprise program content data source and at least one bundled services content-data source of searching at least one arrangement.
12. electronic equipments according to claim 8, wherein said result comprises bundled services content, in the time that described bundled services content is selected, show the multiple results from least one the bundled services content-data source being associated with selected bundled services content.
13. electronic equipments according to claim 8, wherein time-based axle is distinguished current first content and the current second content that can not be used for by described electronic equipment playback that can be used for by described electronic equipment playback.
14. 1 kinds of computer-readable recording mediums with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind of method, and described method comprises:
Reception comprises the phonetic entry of search inquiry;
Based on described search inquiry, search at least one data source at least in part; With
Present the result of search with time-based axle with the axle of time-independent.
15. computer-readable recording mediums according to claim 14, wherein with the axle of time-independent based on described search inquiry in the degree of correlation of one or more described result is sorted.
16. 1 kinds present the method for Search Results on the visual user interface that is configured to the digital tunable electronic equipment that shows the programme content arranging, and described method comprises:
Receive search inquiry;
Natural language understanding analysis based on to described search inquiry at least in part, searches for program content data source and at least one bundled services content-data source of at least one arrangement; With
In this user interface, present the result of search, wherein the combination of the described result of search is corresponding at least one first result of the programme content arranging with corresponding at least one second result of bundled services content.
17. methods according to claim 16, wherein said at least one second result comprises at least one bundled services result, in the time that described at least one bundled services result is selected, shows to come multiple results of self-corresponding bundled services data source.
18. methods according to claim 16, wherein said at least one bundled services data source comprises the data source for the service based on web.
19. methods according to claim 16, wherein said at least one bundled services data source comprises the local data source being associated with described electronic equipment.
20. methods according to claim 16, wherein said at least one bundled services data source comprises the multiple data sources that connect via network.
21. methods according to claim 16, wherein said at least one bundled services data source comprises the data source of on-demand content.
22. methods according to claim 16, the described result that wherein presents search comprises at least one the corresponding image presenting with the described result of searching for.
23. 1 kinds of computer-readable recording mediums with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind of method that presents Search Results on visual user interface being configured to the digital tunable electronic equipment that shows the programme content arranging, described method comprises:
Receive search inquiry;
Natural language understanding analysis based on to described search inquiry at least in part, searches for program content data source and at least one bundled services content-data source of at least one arrangement; With
In this user interface, present the result of search, wherein the combination of the described result of search is corresponding at least one first result of the programme content arranging with corresponding at least one second result of bundled services content.
24. computer-readable recording mediums according to claim 23, the described result that wherein presents search comprises at least one the corresponding image presenting with the described result of searching for.
25. 1 kinds are configured to show the digital tunable electronic equipment of the programme content arranging, and described electronic equipment comprises:
At least one processor, is programmed to:
Receive search inquiry;
Natural language understanding analysis based on to described search inquiry at least in part, searches for program content data source and at least one bundled services content-data source of at least one arrangement; With
In user interface, present the result of search, wherein the combination of the described result of search is corresponding at least one first result of the programme content arranging with corresponding at least one second result of bundled services content.
26. digital tunable electronic equipments according to claim 25, wherein said at least one second result comprises at least one bundled services result, in the time that described at least one bundled services result is selected, show to come multiple results of self-corresponding bundled services data source.
27. digital tunable electronic equipments according to claim 25, wherein said at least one bundled services data source comprises the data source for the service based on web.
28. digital tunable electronic equipments according to claim 25, wherein said at least one bundled services data source comprises the local data source being associated with described electronic equipment.
29. digital tunable electronic equipments according to claim 25, wherein said at least one bundled services data source comprises the multiple data sources that connect via network.
30. digital tunable electronic equipments according to claim 25, wherein said at least one bundled services data source comprises the data source of on-demand content.
31. 1 kinds are provided for the method for the user interface of digital tunable electronic equipment, and described electronic equipment is configured to show the programme content of arrangement, and described method comprises:
In described user interface, show the label that multiple and content is irrelevant, described labels multiple and that content is irrelevant comprise first label irrelevant with content, and the first tag identifier that should be irrelevant with content is from searching for the first content unit returning; With
In response to receive corresponding to the first input of irrelevant the first label of content, carry out at least one action relevant with first content unit, wherein the first input comprises the first phonetic entry, and is wherein configured to the first phonetic entry to respond with irrelevant the first label of content.
32. methods according to claim 31, also comprise:
Receive the second input, in the irrelevant label of wherein said multiple and content, be configured to the second input to respond with irrelevant the second label of content; With
Wherein carry out described at least one action relevant with first content unit comprise at least in part carry out based on the second input described at least one action.
33. methods according to claim 32, wherein the second input is the second phonetic entry, and is wherein configured to the second phonetic entry to respond with irrelevant the second label of content.
34. methods according to claim 32, wherein receive the first input and receive the second input and be included in before receiving the first input and receive the second input.
35. methods according to claim 31, also comprise:
Based on the first input selection first content unit.
36. methods according to claim 31, wherein carry out at least one action relevant with first content unit comprise by described electronic equipment be tuned to channel with demonstration the program for the arrangement of first content unit.
37. methods according to claim 31, wherein first content unit, corresponding to the bundled services content element that comprises multiple Search Results, is wherein carried out at least one action relevant with first content unit and is comprised the described multiple Search Results of demonstration.
38. methods according to claim 31, also comprise:
Multiple voice commands are associated with described user interface, wherein said multiple voice command comprises the first voice command and the second voice command, wherein the first voice command calls the first action and the second voice command calls the second action, and wherein the first voice command and the second voice command are identified by described electronic equipment, and do not consider the specific screens showing in described user interface.
39. 1 kinds of computer-readable recording mediums with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind of method of the user interface that is provided for digital tunable electronic equipment, described electronic equipment is configured to show the programme content of arrangement, and described method comprises:
In described user interface, show the label that multiple and content is irrelevant, described labels multiple and that content is irrelevant comprise first label irrelevant with content, and the first tag identifier that should be irrelevant with content is from searching for the first content unit returning; With
In response to receive corresponding to the first input of irrelevant the first label of content, carry out at least one action relevant with first content unit, wherein the first input is the first phonetic entry, and is wherein configured to the first phonetic entry to respond with irrelevant the first label of content.
40. 1 kinds are configured to show the digital tunable electronic equipment of the programme content arranging, and described electronic equipment comprises:
At least one processor, is programmed to:
In user interface, show the label that multiple and content is irrelevant, described labels multiple and that content is irrelevant comprise first label irrelevant with content, and the first tag identifier that should be irrelevant with content is from searching for the first content unit returning; With
In response to receive corresponding to the first input of irrelevant the first label of content, carry out at least one action relevant with first content unit, wherein the first input is the first phonetic entry, and is wherein configured to the first phonetic entry to respond with irrelevant the first label of content.
41. according to the digital tunable electronic equipment described in claim 40, and wherein said at least one processor is also programmed to:
Receive the second input, in the irrelevant label of wherein said multiple and content, be configured to the second input to respond with irrelevant the second label of content; With
Wherein carry out described at least one action relevant with first content unit comprise at least in part carry out based on the second input described at least one action.
42. according to the digital tunable electronic equipment described in claim 40, wherein said execution at least one action relevant with first content unit comprise by described electronic equipment be tuned to channel to show the program for the arrangement of first content unit.
43. according to the digital tunable electronic equipment described in claim 40, wherein first content unit, corresponding to the bundled services content element that comprises multiple Search Results, is wherein carried out at least one action relevant with first content unit and is comprised the described multiple Search Results of demonstration.
44. 1 kinds of digital tunable electronic equipments, comprising:
At least one processor, is programmed to:
User interface is provided, described user interface makes described electronic equipment can receive search inquiry and no matter which in multiple screens is displayed in described user interface in the time that described search inquiry is received, and wherein said search inquiry comprises showing on described digital tunable electronic equipment and/or the search of the content of playback;
Reception comprises the phonetic entry of described search inquiry; With
In response to receiving described search inquiry, start the search to content corresponding to described search inquiry.
45. according to the digital tunable electronic equipment described in claim 44, wherein starts the search of content is comprised and will the inquiry of content be sent to at least one data source that is connected to described electronic equipment by one or more networks.
46. according to the digital tunable electronic equipment described in claim 44, and wherein said at least one processor is also programmed to:
In described user interface, show one or more icons, described one or more icon indicating users can be used for starting the input of the search to content.
47. according to the digital tunable electronic equipment described in claim 44, and wherein said at least one processor is also programmed to:
Multiple voice commands are associated with described user interface, and wherein said multiple voice commands comprise the first voice command and the second voice command, and wherein the first voice command calls the first action and the second voice command calls the second action.
48. according to the digital tunable electronic equipment described in claim 47, and wherein the first action and/or the second action are corresponding to the search starting content.
49. 1 kinds of computer implemented methods, comprising:
User interface is provided, described user interface makes electronic equipment can receive search inquiry and no matter which in multiple screens is displayed in described user interface in the time that described search inquiry is received, and wherein said search inquiry comprises showing on described electronic equipment and/or the search of the content of playback;
Reception comprises the phonetic entry of described search inquiry; With
In response to receiving described search inquiry, start the search to content corresponding to described search inquiry.
50. according to the computer implemented method described in claim 49, wherein starts the search of content is comprised and will the inquiry of content be sent to at least one data source that is connected to described electronic equipment by one or more networks.
51. according to the computer implemented method described in claim 49, also comprises:
In described user interface, show one or more icons, described one or more icon indicating users can be used for starting the input of the search to content.
52. according to the computer implemented method described in claim 49, also comprises:
Multiple voice commands are associated with described user interface, and wherein said multiple voice commands comprise the first voice command and the second voice command, and wherein the first voice command calls the first action and the second voice command calls the second action.
53. according to the computer implemented method described in claim 52, and wherein the first action and/or the second action are corresponding to the search starting content.
54. 1 kinds of computer-readable recording mediums with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind of method, and described method comprises:
User interface is provided, described user interface makes electronic equipment can receive search inquiry and no matter which in multiple screens is displayed in described user interface in the time that described search inquiry is received, and wherein said search inquiry comprises showing on digital tunable electronic equipment and/or the search of the content of playback;
Reception comprises the phonetic entry of described search inquiry; With
In response to receiving described search inquiry, start the search to content corresponding to described search inquiry.
55. according to the computer-readable recording medium described in claim 54, wherein starts the search of content is comprised and will the inquiry of content be sent to at least one data source that is connected to described electronic equipment by one or more networks.
56. according to the computer-readable recording medium described in claim 54, and wherein said method also comprises:
In described user interface, show one or more icons, described one or more icon indicating users can be used for starting the input of the search to content.
57. according to the computer-readable recording medium described in claim 54, and wherein said method also comprises:
Multiple voice commands are associated with described user interface, and wherein said multiple voice commands comprise the first voice command and the second voice command, and wherein the first voice command calls the first action and the second voice command calls the second action.
58. according to the computer-readable recording medium described in claim 57, and wherein the first action and/or the second action are corresponding to the search starting content.
59. 1 kinds of digital tunable electronic equipments, comprising:
At least one processor, is programmed to:
Receive the first input;
Enter listen mode in response to recognizing the first input;
Determine during the special time amount in the time that described electronic equipment is in described listen mode whether receive the second input, wherein the first input and/or the second input are phonetic entries; With
During described special time amount, do not receive the second input and exit described listen mode in response to determining.
60. according to the digital tunable electronic equipment described in claim 59, and wherein the second input is the implicit commands that exits described listen mode; And wherein said at least one processor is also programmed to:
Exit described listen mode in response to receiving the second input.
61. according to the digital tunable electronic equipment described in claim 59, and wherein said at least one processor is also programmed to:
In response to exiting described listen mode, the first input is monitored.
62. according to the digital tunable electronic equipment described in claim 59, and wherein said electronic equipment also comprises at least one display, and wherein said at least one processor is also programmed to:
On described at least one display, show the current whether instruction in listen mode of described electronic equipment.
63. according to the digital tunable electronic equipment described in claim 62, and wherein said instruction comprises one or more selection labels and/or icon.
64. according to the digital tunable electronic equipment described in claim 59, and wherein said at least one processor is also programmed to:
Determine that described electronic equipment is whether in listen mode; With
Show the multiple voice labels irrelevant with content in response to determining described electronic equipment in listen mode.
65. according to the digital tunable electronic equipment described in claim 64, and wherein said at least one processor is also programmed to:
Not in described listen mode, hide the described multiple voice labels that have nothing to do with content in response to determining described electronic equipment.
66. 1 kinds of computer implemented methods, comprising:
Receive the first input;
In response to recognizing the first input, make electronic equipment enter listen mode;
Determine during the special time amount in the time that described electronic equipment is in described listen mode whether receive the second input, wherein the first input and/or the second input are phonetic entries; With
During described special time amount, do not receive the second input and exit described listen mode in response to determining.
67. according to the computer implemented method described in claim 66, and wherein the second input is the implicit commands that exits described listen mode; And wherein said method also comprises:
Exit described listen mode in response to receiving the second input.
68. according to the computer implemented method described in claim 66, and wherein said electronic equipment comprises at least one display, and wherein said method also comprises:
On described at least one display, show the current whether instruction in listen mode of described electronic equipment.
69. according to the computer implemented method described in claim 68, and wherein said instruction comprises one or more selection labels and/or icon.
70. according to the computer implemented method described in claim 66, also comprises:
Determine that described electronic equipment is whether in listen mode;
Show the multiple voice labels irrelevant with content in response to determining described electronic equipment in listen mode; With
Not in described listen mode, hide the described multiple voice labels that have nothing to do with content in response to determining described electronic equipment.
71. 1 kinds of computer-readable recording mediums with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind of method, and described method comprises:
Receive the first input;
In response to recognizing the first input, make electronic equipment enter listen mode;
Determine during the special time amount in the time that described electronic equipment is in described listen mode whether receive the second input, wherein the first input and/or the second input are phonetic entries; With
During described special time amount, do not receive the second input and exit described listen mode in response to determining.
72. according to the computer-readable recording medium described in claim 71, and wherein said electronic equipment comprises at least one display, and wherein said method also comprises:
On described at least one display, show the current whether instruction in listen mode of described electronic equipment.
73. according to the computer-readable recording medium described in claim 72, and wherein said instruction comprises one or more selection labels and/or icon.
74. according to the computer-readable recording medium described in claim 71, also comprises:
Determine that described electronic equipment is whether in listen mode;
Show the multiple voice labels irrelevant with content in response to determining described electronic equipment in listen mode; With
Not in described listen mode, hide the described multiple voice labels that have nothing to do with content in response to determining described electronic equipment.
75. 1 kinds to the method that will show on digital tunable electronic equipment and/or the content of playback is searched for, and described electronic equipment is configured to show the programme content arranging, and described method comprises:
Receive and comprise that the phonetic entry of search inquiry, wherein said search inquiry comprise showing and/or the search of the described content of playback on described electronic equipment from user;
Determine that based on described search inquiry user wants the action of carrying out;
Want based on user the described action of carrying out at least in part, determine and will search for one or more data sources; With
At least in part based on described search inquiry, in described one or more data sources, search will show and/or the described content of playback on described electronic equipment.
76. according to the method described in claim 75, wherein determine that user wants the described action of carrying out to comprise: determine that user wants to listen to media content, and wherein determine that the one or more data sources that will search for comprise: determine that described one or more data source is music data source.
77. according to the method described in claim 75, wherein determine that user wants the described action of carrying out to comprise: determine that user wants to watch media content, and wherein determine that the one or more data sources that will search for comprise: determine the program content source that described one or more data source is at least one arrangement.
78. according to the method for claim 75, also comprises:
Store one or more rules, described one or more rules by the input of particular type be associated for the particular order of searching for described one or more data sources; With
Wherein searching for described one or more data source comprises: search for described one or more data source according to described one or more rules.
79. according to the method described in claim 75, wherein searches for described one or more data source and comprises all available data sources of search.
80. according to the method described in claim 75, also comprises:
Receive Search Results from described one or more data sources; With
In user interface, present described Search Results.
81. 1 kinds of computer-readable recording mediums with multiple instruction encodings, in the time that described instruction is carried out by least one computer, carry out a kind of to the method that will show on digital tunable electronic equipment and/or the content of playback is searched for, described electronic equipment is configured to show the programme content of arrangement, and described method comprises:
Receive and comprise that the phonetic entry of search inquiry, wherein said search inquiry comprise showing and/or the search of the described content of playback on described electronic equipment from user;
Determine that based on described search inquiry user wants the action of carrying out;
Want based on user the described action of carrying out at least in part, determine and will search for one or more data sources; With
At least in part based on described search inquiry, in described one or more data sources, search will show and/or the described content of playback on described electronic equipment.
82. computer-readable recording mediums described in 1 according to Claim 8, wherein determine that user wants the described action of carrying out to comprise: determine that user wants to listen to media content, and wherein determine that the one or more data sources that will search for comprise: determine that described one or more data source is music data source.
83. computer-readable recording mediums described in 1 according to Claim 8, wherein determine that user wants the described action of carrying out to comprise: determine that user wants to watch media content, and wherein determine that the one or more data sources that will search for comprise: determine the program content source that described one or more data source is at least one arrangement.
84. computer-readable recording mediums described in 1 according to Claim 8, wherein said method also comprises:
Store one or more rules, described one or more rules by the input of particular type be associated for the particular order of searching for described one or more data sources; With
Wherein searching for described one or more data source comprises: search for described one or more data source according to described one or more rules.
85. 1 kinds are configured to show the digital tunable electronic equipment of the programme content arranging, and described electronic equipment comprises:
At least one processor, is programmed to:
Receive and comprise that the phonetic entry of search inquiry, wherein said search inquiry comprise showing and/or the search of the described content of playback on described electronic equipment from user;
Determine that based on described search inquiry user wants the action of carrying out;
Want based on user the described action of carrying out at least in part, determine and will search for one or more data sources; With
At least in part based on described search inquiry, in described one or more data sources, search will show and/or the described content of playback on described electronic equipment.
86. digital tunable electronic equipments described in 5 according to Claim 8, wherein determine that user wants the described action of carrying out to comprise: determine that user wants to listen to media content, and wherein determine that the one or more data sources that will search for comprise: determine that described one or more data source is music data source.
87. digital tunable electronic equipments described in 5 according to Claim 8, wherein determine that user wants the described action of carrying out to comprise: determine that user wants to watch media content, and wherein determine that the one or more data sources that will search for comprise: determine the program content source that described one or more data source is at least one arrangement.
88. digital tunable electronic equipments described in 5 according to Claim 8, wherein said at least one processor is also programmed to:
Store one or more rules, described one or more rules by the input of particular type be associated for the particular order of searching for described one or more data sources; With
Wherein searching for described one or more data source comprises: search for described one or more data source according to described one or more rules.
89. digital tunable electronic equipments described in 5 according to Claim 8, wherein search for described one or more data source and comprise all available data sources of search.
CN201380014806.XA 2012-08-16 2013-08-16 A kind of method and computer-readable storage medium that search result is presented on an electronic device Expired - Fee Related CN104170397B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710977995.0A CN107613353B (en) 2012-08-16 2013-08-16 Method for presenting search results on electronic device, electronic device and computer storage medium

Applications Claiming Priority (13)

Application Number Priority Date Filing Date Title
US13/587,300 2012-08-16
US13/587,234 2012-08-16
US13/587,280 US9031848B2 (en) 2012-08-16 2012-08-16 User interface for searching a bundled service content data source
US13/587,222 US8799959B2 (en) 2012-08-16 2012-08-16 User interface for entertainment systems
US13/587,353 2012-08-16
US13/587,234 US9497515B2 (en) 2012-08-16 2012-08-16 User interface for entertainment systems
US13/587,260 2012-08-16
US13/587,353 US9106957B2 (en) 2012-08-16 2012-08-16 Method and apparatus for searching data sources for entertainment systems
US13/587,300 US9026448B2 (en) 2012-08-16 2012-08-16 User interface for entertainment systems
US13/587,260 US20140052450A1 (en) 2012-08-16 2012-08-16 User interface for entertainment systems
US13/587,280 2012-08-16
US13/587,222 2012-08-16
PCT/US2013/055259 WO2014028797A1 (en) 2012-08-16 2013-08-16 User interface for entertainment systems

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201710977995.0A Division CN107613353B (en) 2012-08-16 2013-08-16 Method for presenting search results on electronic device, electronic device and computer storage medium

Publications (2)

Publication Number Publication Date
CN104170397A true CN104170397A (en) 2014-11-26
CN104170397B CN104170397B (en) 2017-10-24

Family

ID=49083777

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201710977995.0A Expired - Fee Related CN107613353B (en) 2012-08-16 2013-08-16 Method for presenting search results on electronic device, electronic device and computer storage medium
CN201380014806.XA Expired - Fee Related CN104170397B (en) 2012-08-16 2013-08-16 A kind of method and computer-readable storage medium that search result is presented on an electronic device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201710977995.0A Expired - Fee Related CN107613353B (en) 2012-08-16 2013-08-16 Method for presenting search results on electronic device, electronic device and computer storage medium

Country Status (4)

Country Link
EP (1) EP2803004A1 (en)
KR (1) KR20150045404A (en)
CN (2) CN107613353B (en)
WO (1) WO2014028797A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107093426A (en) * 2017-04-26 2017-08-25 医惠科技有限公司 The input method of voice, apparatus and system
CN107210035A (en) * 2015-01-03 2017-09-26 微软技术许可有限责任公司 The generation of language understanding system and method
CN113301395A (en) * 2021-04-30 2021-08-24 当趣网络科技(杭州)有限公司 Voice searching method combining user grades in video playing state

Families Citing this family (165)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US10002189B2 (en) 2007-12-20 2018-06-19 Apple Inc. Method and apparatus for searching using an active ontology
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US20120311585A1 (en) 2011-06-03 2012-12-06 Apple Inc. Organizing task items that represent tasks to perform
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US10199051B2 (en) 2013-02-07 2019-02-05 Apple Inc. Voice trigger for a digital assistant
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US10748529B1 (en) 2013-03-15 2020-08-18 Apple Inc. Voice activated device for use with a voice-based digital assistant
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
CN110442699A (en) 2013-06-09 2019-11-12 苹果公司 Operate method, computer-readable medium, electronic equipment and the system of digital assistants
US10296160B2 (en) 2013-12-06 2019-05-21 Apple Inc. Method for extracting salient dialog usage from live data
EP3480811A1 (en) 2014-05-30 2019-05-08 Apple Inc. Multi-command single utterance input method
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US9830321B2 (en) 2014-09-30 2017-11-28 Rovi Guides, Inc. Systems and methods for searching for a media asset
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US10152299B2 (en) 2015-03-06 2018-12-11 Apple Inc. Reducing response latency of intelligent automated assistants
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10200824B2 (en) 2015-05-27 2019-02-05 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US20160378747A1 (en) 2015-06-29 2016-12-29 Apple Inc. Virtual assistant for media playback
KR102376657B1 (en) 2015-08-18 2022-03-21 엘지전자 주식회사 Mobile terminal
DK179690B1 (en) * 2015-09-08 2019-03-26 Apple Inc. Intelligent automated media search and playback assistant
US10331312B2 (en) * 2015-09-08 2019-06-25 Apple Inc. Intelligent automated assistant in a media environment
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10740384B2 (en) 2015-09-08 2020-08-11 Apple Inc. Intelligent automated assistant for media search and playback
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10956666B2 (en) 2015-11-09 2021-03-23 Apple Inc. Unconventional virtual assistant interactions
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
JP6834256B2 (en) * 2016-08-30 2021-02-24 株式会社リコー Information processing equipment, information processing systems, and programs
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. User interface for correcting recognition errors
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
DK180048B1 (en) 2017-05-11 2020-02-04 Apple Inc. MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK201770428A1 (en) 2017-05-12 2019-02-18 Apple Inc. Low-latency intelligent automated assistant
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US20180336275A1 (en) 2017-05-16 2018-11-22 Apple Inc. Intelligent automated assistant for media exploration
DK179549B1 (en) 2017-05-16 2019-02-12 Apple Inc. Far-field extension for digital assistant services
US20180336892A1 (en) 2017-05-16 2018-11-22 Apple Inc. Detecting a trigger of a digital assistant
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
DK179822B1 (en) 2018-06-01 2019-07-12 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
DK201870355A1 (en) 2018-06-01 2019-12-16 Apple Inc. Virtual assistant operation in multi-device environments
US11076039B2 (en) 2018-06-03 2021-07-27 Apple Inc. Accelerated task performance
CN109104631B (en) * 2018-09-06 2021-09-28 网易传媒科技（北京）有限公司 Video display method and device
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
CN109147801B (en) * 2018-09-30 2021-08-10 深圳市元征科技股份有限公司 Voice interaction method, system, terminal and storage medium
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
DK201970509A1 (en) 2019-05-06 2021-01-15 Apple Inc Spoken notifications
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
DK201970510A1 (en) 2019-05-31 2021-02-11 Apple Inc Voice identification in digital assistant systems
DK180129B1 (en) 2019-05-31 2020-06-02 Apple Inc. User activity shortcut suggestions
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
US11468890B2 (en) 2019-06-01 2022-10-11 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
WO2021056255A1 (en) 2019-09-25 2021-04-01 Apple Inc. Text detection using global geometry estimators
US11061543B1 (en) 2020-05-11 2021-07-13 Apple Inc. Providing relevant data items based on context
US11043220B1 (en) 2020-05-11 2021-06-22 Apple Inc. Digital assistant hardware abstraction
US11755276B2 (en) 2020-05-12 2023-09-12 Apple Inc. Reducing description length based on confidence
US11490204B2 (en) 2020-07-20 2022-11-01 Apple Inc. Multi-device audio adjustment coordination
US11438683B2 (en) 2020-07-21 2022-09-06 Apple Inc. User identification using headphones

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001309256A (en) * 2000-04-26 2001-11-02 Sanyo Electric Co Ltd Receiver of digital tv broadcasting
US20070192310A1 (en) * 2006-02-13 2007-08-16 Sony Corporation Information processing apparatus and method, and program
CN102054014A (en) * 2009-10-30 2011-05-11 索尼计算机娱乐公司 Information processing apparatus, tuner, and information processing method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8200688B2 (en) * 2006-03-07 2012-06-12 Samsung Electronics Co., Ltd. Method and system for facilitating information searching on electronic devices

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001309256A (en) * 2000-04-26 2001-11-02 Sanyo Electric Co Ltd Receiver of digital tv broadcasting
US20070192310A1 (en) * 2006-02-13 2007-08-16 Sony Corporation Information processing apparatus and method, and program
CN102054014A (en) * 2009-10-30 2011-05-11 索尼计算机娱乐公司 Information processing apparatus, tuner, and information processing method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107210035A (en) * 2015-01-03 2017-09-26 微软技术许可有限责任公司 The generation of language understanding system and method
CN107210035B (en) * 2015-01-03 2020-10-23 微软技术许可有限责任公司 Generation of language understanding systems and methods
US10909969B2 (en) 2015-01-03 2021-02-02 Microsoft Technology Licensing, Llc Generation of language understanding systems and methods
CN107093426A (en) * 2017-04-26 2017-08-25 医惠科技有限公司 The input method of voice, apparatus and system
CN113301395A (en) * 2021-04-30 2021-08-24 当趣网络科技(杭州)有限公司 Voice searching method combining user grades in video playing state

Also Published As

Publication number Publication date
CN104170397B (en) 2017-10-24
CN107613353A (en) 2018-01-19
EP2803004A1 (en) 2014-11-19
CN107613353B (en) 2020-10-16
WO2014028797A1 (en) 2014-02-20
KR20150045404A (en) 2015-04-28

Similar Documents

Publication Publication Date Title
CN104170397A (en) User interface for entertainment systems
US9066150B2 (en) User interface for entertainment systems
US9497515B2 (en) User interface for entertainment systems
US9031848B2 (en) User interface for searching a bundled service content data source
US9026448B2 (en) User interface for entertainment systems
US9106957B2 (en) Method and apparatus for searching data sources for entertainment systems
US20140052450A1 (en) User interface for entertainment systems
US20140006022A1 (en) Display apparatus, method for controlling display apparatus, and interactive system
US20140195244A1 (en) Display apparatus and method of controlling display apparatus
US20140244263A1 (en) Method and system for controlling a user receiving device using voice commands
US20110119715A1 (en) Mobile device and method for generating a control signal
US20050278336A1 (en) Program information processing system, program information management server, program information operation terminal, and computer program
US9230559B2 (en) Server and method of controlling the same
CN106489150A (en) For recognize and preserve media asset a part system and method
US20230142720A1 (en) Smart interactive media content guide
US20150382077A1 (en) Method and terminal device for acquiring information
KR20160039830A (en) multimedia apparatus and method for providing voice guide thereof
JP2013085232A (en) Method and device for providing integrated epg information of plurality of input sources
CN112135170A (en) Display device, server and video recommendation method
EP3076678A1 (en) Display apparatus for searching and control method thereof
CN109792502A (en) Information processing equipment, information processing method, program and information processing system
KR101511311B1 (en) System and method of providing user personalized advertisement using settop-box control log and contents search log
WO2014043987A1 (en) Information transmission method, device, and system
US20150066887A1 (en) Information processing apparatus, information processing method, and program
US10667008B1 (en) Method and system for setting and receiving user notifications for content available far in the future

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20171024