CN104170397B

CN104170397B - A kind of method and computer-readable storage medium that search result is presented on an electronic device

Info

Publication number: CN104170397B
Application number: CN201380014806.XA
Authority: CN
Inventors: H·杨; S·哈奇; Y-K·琼; T·I·可文那米; T·A·托诺那; J·可维可; T·J·金那恩
Original assignee: Nuance Communications Inc
Current assignee: Nuance Communications Inc
Priority date: 2012-08-16
Filing date: 2013-08-16
Publication date: 2017-10-24
Anticipated expiration: 2033-08-16
Also published as: WO2014028797A1; EP2803004A1; KR20150045404A; CN107613353A; CN107613353B; CN104170397A

Abstract

Method and apparatus (100) for providing the search interface for electronic equipment, the electronic equipment includes the tuner (112) for being configured as tuning programme content (124) of the electronic equipment to receive arrangement.Reception includes the phonetic entry (104) of search inquiry, and being based at least partially on the search inquiry search includes one or more data sources (124) of the information on media content.The result of search is presented in the user interface of electronic equipment (122).

Description

A kind of method and computer-readable storage medium that search result is presented on an electronic device

Background technology

Some electronic equipments that can be used to access entertainment content (such as audio and/or video content) include or are connected to Tuner, tuner enables electronic equipment to receive and show the programme content of arrangement, such as TV, radio station or other media Program.In order to select specific program be used for check on an electronic device, user typically using remote control equipment with input with it is specific The numeral of the associated channel of program (for example broadcasting).Some are tunable electronic equipment also allows the user to use remote control equipment so that Content is searched for and selected with electronic program guides (EPG), and EPG is to be shown with time-based grid format for the current of arrangement With the user interface of the arrangement information of future program content.User generally navigates and passed through by pressing the button on remote control equipment The program content entity of the arrangement shown in the epg, remote control equipment uses five to (left and right, the upper and lower and choosing of navigation command system Select).Once user highlights specific program on EPG, then can by pressing the select button on remote control equipment, Corresponding content is shown on an electronic device, and after this, electronic equipment is tuned to selected channel.

The content of the invention

One embodiment is for a kind of method that search result is presented on an electronic device, wherein the electronic equipment includes It is configured as tuning the tuner of program of the electronic equipment to receive arrangement.Methods described includes：Reception includes search and looked into The phonetic entry of inquiry；The search inquiry is based at least partially on, at least one data source is searched for at least one processor；With The result of search is presented using time-based axle and the axle unrelated with the time.

In one aspect, the axle unrelated with the time based on the degree of correlation with one or more of search inquiry item come The result is ranked up.

On the other hand, searching at least one data source includes searching at least one program content data source and extremely arranged A few bundled services content-data source.

On the other hand, the result is included in what is identified in the program content data source of at least one arrangement The programme content of arrangement and the bundled services content identified at least one described bundled services content-data source.

On the other hand, the result includes bundled services content, and when the bundled services content is chosen, display comes Multiple results from least one the bundled services content-data source associated with selected bundled services content.

On the other hand, time-based axle distinguishes the first content that can be currently used for playback with currently cannot be used for playback The second content.

On the other hand, the result presented along time-based axle only includes the programme content of arrangement.

Another embodiment is directed to a kind of electronic equipment, including：It is configured as tuning the electronic equipment receiving arrangement The tuner of program；With at least one processor, at least one described processor is programmed to：Reception includes the language of search inquiry Sound is inputted；The search inquiry is based at least partially on, at least one data source is searched for；With using time-based axle and and when Between unrelated axle the result of search is presented.

On the other hand, the electronic equipment also includes：Speech input interface, is configured as receiving the search inquiry work For phonetic entry.

On the other hand, time-based axle distinguishes the first content that can be currently used for being played back by the electronic equipment with working as Before cannot be used for the second content for being played back by the electronic equipment.

Another embodiment is directed to a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer is performed, a kind of method is performed, methods described includes：Reception includes the phonetic entry of search inquiry；At least portion Divide ground to be based on the search inquiry, search at least one data source；Come with using time-based axle and the axle unrelated with the time The result of search is presented.

Another embodiment is set for a kind of in the digital tunable electronics for being configured as the programme content that display is arranged The method that search result is presented on standby visual user interface, methods described includes：Receive search inquiry；It is based at least partially on Natural language understanding analysis to the search inquiry, searches for program content data source and at least one bundle of at least one arrangement Tie up service content data source；The result of search is presented on the user interface, wherein the result combination searched for corresponds to At least one first result of the programme content of arrangement and at least one second result corresponding to bundled services content.

In one aspect, at least one described second result includes at least one bundled services result, when described at least one When individual bundled services result is chosen, display carrys out multiple results of self-corresponding bundled services data source.

On the other hand, at least one described bundled services data source includes the data source for the service based on web.

On the other hand, at least one described bundled services data source includes the local number associated with the electronic equipment According to source.

On the other hand, at least one described bundled services data source includes multiple data sources via network connection.

On the other hand, at least one described bundled services data source includes the data source of on-demand content.

On the other hand, the result of search, which is presented, to be included being presented corresponding with least one in the result searched for Image.

Another embodiment is directed to a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer is performed, a kind of digital tunable electronic equipment in the programme content for being configured as display arrangement is performed Visual user interface on the method for search result is presented, methods described includes：Receive search inquiry；It is based at least partially on pair The natural language understanding analysis of the search inquiry, searches for program content data source and at least one binding of at least one arrangement Service content data source；The result of search is presented on the user interface, wherein the result combination searched for corresponds to peace At least one first result of the programme content of row and at least one second result corresponding to bundled services content.

In one aspect, the result of search, which is presented, to be included being presented corresponding with least one in the result searched for Image.

Another embodiment is directed to a kind of digital tunable electronic equipment for being configured as the programme content that display is arranged, The electronic equipment includes：At least one processor, at least one described processor is programmed to：Receive search inquiry；At least Be based in part on the natural language understanding to the search inquiry analysis, search at least one arrangement program content data source and At least one bundled services content-data source；The result of search is presented on a user interface, wherein the result group searched for Close at least one first result and at least one second knot corresponding to bundled services content for corresponding to the programme content arranged Really.

Another embodiment is directed to a kind of method for providing the user interface for digital tunable electronic equipment, described Electronic equipment is configured as the programme content that display is arranged, and methods described includes：Shown in the user interface it is multiple with it is interior Hold unrelated label, the multiple label unrelated with content includes first label unrelated with content, should be unrelated with content The first content unit that first tag identifier is returned from search；Correspond to first label unrelated with content with response to receiving The first input, perform at least one relevant with first content unit action, wherein first inputs and includes the first phonetic entry, And the first wherein unrelated with content label is configured as responding the first phonetic entry.

In one aspect, methods described also includes：Receive second to input, wherein in the multiple label unrelated with content Second label unrelated with content be configured as to second input respond；Wherein perform relevant with first content unit At least one described action include being based at least partially on the second input performing at least one described action.

On the other hand, the second input is the second phonetic entry, and the second wherein unrelated with content label is configured To be responded to the second phonetic entry.

On the other hand, receive the first input and receive before the second input is included in the input of reception first and receive second defeated Enter.

On the other hand, methods described also includes：Based on the first input selection first content unit.

On the other hand, performing at least one action relevant with first content unit is included the tune electronic devices To channel to show the program of the arrangement for first content unit.

On the other hand, first content unit, which corresponds to, includes the bundled services content element of multiple search results, wherein Performing at least one action relevant with first content unit includes the multiple search result of display.

On the other hand, methods described also includes：Multiple voice commands are associated with the user interface, wherein described Multiple voice commands include the first voice command and the second voice command, wherein the first voice command calls the first action and the Two voice commands call the second action, and wherein the first voice command and the second voice command are recognized by the electronic equipment, Without the specific screens for considering to show in the user interface.

Another embodiment is directed to a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer is performed, a kind of method that the user interface for digital tunable electronic equipment is provided is performed, it is described Electronic equipment is configured as the programme content that display is arranged, and methods described includes：Shown in the user interface it is multiple with it is interior Hold unrelated label, the multiple label unrelated with content includes first label unrelated with content, should be unrelated with content The first content unit that first tag identifier is returned from search；Correspond to first label unrelated with content with response to receiving The first input, perform at least one relevant with first content unit action, wherein first to input be the first phonetic entry, and And wherein first label unrelated with content is configured as responding the first phonetic entry.

Another embodiment is directed to a kind of digital tunable electronic equipment for being configured as the programme content that display is arranged, The electronic equipment includes：At least one processor, at least one described processor is programmed to：Show on a user interface many The individual label unrelated with content, the multiple label unrelated with content includes first label unrelated with content, is somebody's turn to do and content The first content unit that the first unrelated tag identifier is returned from search；Correspond to unrelated with content the with response to receiving First input of one label, performs at least one action relevant with first content unit, wherein the first input is the first voice Input, and the first wherein unrelated with content label is configured as responding the first phonetic entry.

In one aspect, at least one described processor is also programmed to：Receive second input, wherein it is the multiple with it is interior Hold second label unrelated with content in unrelated label to be configured as responding the second input；Wherein perform and the At least one relevant described action of one content element include being based at least partially on the second input perform it is described at least one Action.

On the other hand, the execution at least one action relevant with first content unit is included the electronic equipment Be tuned to channel to show the program of the arrangement for first content unit.

Another embodiment is directed to a kind of digital tunable electronic equipment, including at least one processor, it is described at least One processor is programmed to：User interface is provided, the user interface enables the electronic equipment to receive search inquiry But regardless of when the search inquiry is received which of multiple screens be displayed in the user interface, wherein described Search inquiry is included to the search for the content to show and/or play back on the digital tunable electronic equipment；Receive Include the phonetic entry of the search inquiry；With in response to receiving the search inquiry, start and correspond to the search inquiry The search to content.

In one aspect, starting the search to content includes the inquiry to content being sent to by one or more networks It is connected at least one data source of the electronic equipment.

On the other hand, at least one described processor is also programmed to：One or many is shown in the user interface Individual icon, one or more of icon instruction users can be used for starting the input of the search to content.

On the other hand, at least one described processor is also programmed to：By multiple voice commands and the user interface It is associated, wherein the multiple voice command includes the first voice command and the second voice command, wherein the first voice command is adjusted Acted with first and the second voice command calls the second action.

On the other hand, the first action and/or the second action correspond to the search started to content.

Another embodiment is directed to a kind of computer implemented method, including：User interface is provided, the user interface causes Electronic equipment can receive search inquiry but regardless of when the search inquiry is received which of multiple screens be shown In the user interface, wherein the search inquiry includes the content to show and/or play back on the electronic equipment Search；Reception includes the phonetic entry of the search inquiry；With in response to receiving the search inquiry, start and correspond to institute State the search to content of search inquiry.

On the other hand, the computer implemented method also includes：Show one or more in the user interface Icon, one or more of icon instruction users can be used for starting the input of the search to content.

On the other hand, the computer implemented method also includes：By multiple voice commands and the user interface phase Association, wherein the multiple voice command includes the first voice command and the second voice command, wherein the first voice command is called First action and the second voice command calls the second action.

Another embodiment is directed to a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer is performed, a kind of method is performed, methods described includes：User interface is provided, the user interface causes electronics Equipment can receive search inquiry but regardless of when the search inquiry is received which of multiple screens be displayed on institute State in user interface, wherein the search inquiry is included to show and/or play back on digital tunable electronic equipment Content search；Reception includes the phonetic entry of the search inquiry；With in response to receiving the search inquiry, start pair The search to content of search inquiry described in Ying Yu.

In one aspect, starting the search to content includes the inquiry to content being sent to by one or more nets Network is connected at least one data source of the electronic equipment.

On the other hand, methods described also includes：One or more icons are shown in the user interface, it is one Or multiple icon instruction users can be used for starting the input of the search to content.

On the other hand, methods described also includes：Multiple voice commands are associated with the user interface, wherein described Multiple voice commands include the first voice command and the second voice command, wherein the first voice command calls the first action and the Two voice commands call the second action.

Another embodiment is directed to a kind of digital tunable electronic equipment, including at least one processor, it is described at least One processor is programmed to：First is received to input；Enter listening mode in response to recognizing the first input；It is determined that working as State during electronic equipment is in special time amount when in the listening mode and whether receive the second input, wherein the first input And/or second input be phonetic entry；With the second input is not received by during the special time amount in response to determining and Exit the listening mode.

In one aspect, the second input is the implicit commands for exiting the listening mode；And at least one described processing Device is also programmed to exit the listening mode in response to receiving the second input.

On the other hand, at least one described processor is also programmed in response to exiting the listening mode to first Input is monitored.

On the other hand, the electronic equipment also includes at least one display, and at least one described processor is also It is programmed to show the instruction currently whether being in the electronic equipment in listening mode at least one described display.

On the other hand, the instruction includes one or more selection labels and/or icon.

On the other hand, at least one described processor is also programmed to：Determine the electronic equipment whether in monitoring In pattern；The multiple voice labels unrelated with content are shown with response to determining the electronic equipment to be in listening mode.

On the other hand, at least one described processor is also programmed to：In response to determining that the electronic equipment is not at The multiple voice labels unrelated with content are hidden in the listening mode.

Another embodiment is directed to a kind of computer implemented method, including：First is received to input；In response to recognizing first Input so that electronic equipment enters listening mode；It is determined that specific when the electronic equipment is in the listening mode Whether second input is received during time quantum, wherein the first input and/or the second input are phonetic entries；With in response to determine The second input is not received by during the special time amount and the listening mode is exited.

On the other hand, the second input is the implicit commands for exiting the listening mode；And methods described also includes ringing Ying Yu receives the second input and exits the listening mode.

On the other hand, the electronic equipment includes at least one display, and methods described be additionally included in it is described extremely The instruction currently whether being in the electronic equipment in listening mode is shown on a few display.

On the other hand, methods described also includes：Determine whether the electronic equipment is in listening mode；In response to true The fixed electronic equipment is in listening mode and shows the multiple voice labels unrelated with content；With in response to determining the electricity Sub- equipment is not in the listening mode and hides the multiple voice labels unrelated with content.

Another embodiment is directed to a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer is performed, a kind of method is performed, methods described includes：First is received to input；In response to recognizing the first input, So that electronic equipment enters listening mode；It is determined that in the special time amount when the electronic equipment is in the listening mode Whether period receives the second input, wherein the first input and/or the second input are phonetic entries；With in response to determining described The second input is not received by during special time amount and the listening mode is exited.

In one aspect, the electronic equipment includes at least one display, and methods described also includes：It is described extremely The instruction currently whether being in the electronic equipment in listening mode is shown on a few display.

Another embodiment is entered for a kind of content to show and/or play back on digital tunable electronic equipment The method of row search, the electronic equipment is configured as the programme content that display is arranged.Methods described includes：Receive and wrap from user The phonetic entry of search inquiry is included, wherein the search inquiry is included to show and/or play back on the electronic equipment The search of the content；The action that user wishes to carry out is determined based on the search inquiry；User is based at least partially on to want The action performed, it is determined that to search for one or more data sources；Be based at least partially on the search inquiry, described The content to show and/or play back on the electronic equipment is searched in one or more data sources.

In one aspect, determine that the action that user wishes to carry out includes：Determine that user wants to listen to media content, and And determine that the one or more data sources to be searched for include：It is music data source to determine one or more of data sources.

On the other hand, determine that the action that user wishes to carry out includes：Determine that user wants viewing media content, and And determine that the one or more data sources to be searched for include：Determine the section that one or more of data sources are at least one arrangement Mesh content source.

On the other hand, methods described also includes：One or more rules are stored, one or more of rules will be specific The input of type is associated with the particular order for searching for one or more of data sources；Wherein search for it is one or Multiple data sources include：One or more of data sources are searched for according to one or more of rules.

On the other hand, searching for one or more of data sources includes searching for all available data sources.

On the other hand, methods described also includes：From one or more of data sources search results；With in user The search result is presented on interface.

Another embodiment is directed to a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer is performed, perform a kind of content to show and/or play back on digital tunable electronic equipment and enter The method of row search, the electronic equipment is configured as the programme content that display is arranged.Methods described includes：Receive and wrap from user The phonetic entry of search inquiry is included, wherein the search inquiry is included to show and/or play back on the electronic equipment The search of the content；The action that user wishes to carry out is determined based on the search inquiry；User is based at least partially on to want The action performed, it is determined that to search for one or more data sources；Be based at least partially on the search inquiry, described The content to show and/or play back on the electronic equipment is searched in one or more data sources.

On the other hand, methods described also includes：One or more rules are stored, one or more of rules will be specific The input of type is associated with the particular order for searching for one or more of data sources；It is one or more of with searching for Data source includes：One or more of data sources are searched for according to one or more of rules.

Another embodiment is directed to a kind of digital tunable electronic equipment for being configured as the programme content that display is arranged, The electronic equipment includes：At least one processor, at least one described processor is programmed to：Being received from user includes search The phonetic entry of inquiry, wherein the search inquiry is including described interior to what is shown and/or play back on the electronic equipment The search of appearance；The action that user wishes to carry out is determined based on the search inquiry；It is based at least partially on what user wished to carry out The action, it is determined that to search for one or more data sources；Be based at least partially on the search inquiry, one or The content to show and/or play back on the electronic equipment is searched in multiple data sources.

On the other hand, at least one described processor is also programmed to store one or more rules, it is one or Multiple rules are associated with the particular order for searching for one or more of data sources by certain types of input；With search The one or more of data sources of rope include：One or more of data sources are searched for according to one or more of rules.

It should be appreciated that all combinations of the aforementioned concepts that are more thoroughly discussed below and other concept are (if such If concept is not mutually internally inconsistent) be considered as present subject matter disclosed herein a part.

Brief description of the drawings

Accompanying drawing is not intended to drawn to scale.In the accompanying drawings, each identical or intimate identical component shown in the various figures Represented with identical number designation.For clarity, may not be that each component is labeled in every accompanying drawing.In accompanying drawing In：

Fig. 1 is the example for the component relevant with the search interface for entertainment systems for including some embodiments of the present invention Sexual system；

Fig. 2 is for the place to the result of content search to be presented on a user interface according to some embodiments of the present invention Reason；

Fig. 3 is the part for being used to show the user interface to the result of content search according to some embodiments of the present invention Schematic diagram；

Fig. 4 is to be used for user interface of the display to the mixing resultant of content search according to some embodiments of the present invention Partial schematic diagram；

Fig. 5 is the voice label that input can be used according to the display user of some embodiments of the present invention and interacts The schematic diagram of the part of user interface；

Fig. 6 is to be used for the exemplary process using listening mode to Input Monitor Connector according to some embodiments of the present invention； With

Fig. 7 is the exemplary computer system that can be used for realizing some embodiments of the present invention.

Embodiment

The present inventors have realized that and understand, the search of the content to checking on an electronic device, the electricity can be improved Sub- equipment includes the tuner for being used to show the programme content arranged.The electronic program guides (EPG) of the above-mentioned type is usually used in searching Rope simultaneously selects the programme content arranged to be checked on tunable electronic equipment, and can be used for using the programme content with arrangement The display format of time for checking corresponding mesh-like is configured.The grid format that EPG is shown is designed to make to receive to come from With five to the input of the remote control equipment of navigation command system to move a cursor to the different entries in grid.The present inventor has recognized Know, the use of the conventional EPG navigation shown is troublesome.In order that being navigated with five to navigation command system by regular grid The EPG of sample show in entry, it may be required that user provide a series of navigation command (for example, " under-under-under-right side-choosing Select "), this is not produced for selecting the efficient of the user of specific program or intuitively experiencing.

It has been recognised by the inventors that, the display of routine EPG search systems is that " user interface of vision the first " wherein should The principal focal point at interface is the programme content arranged with visually consistent box display.The present inventor has understood that, is used for The other technologies of search content are feasible, and the strict vision that these technologies need not be arranged programme content is presented, because with Family is not limited to navigate to navigation command system shown entry using five.Therefore, some embodiments of the present invention pin To the method and apparatus for improved visual search interface.Especially, in some embodiments of the invention, visual user circle Face be designed to encourage " input of natural language the first " so that interface be configured as encourage user say or otherwise by Search system is provided input directly to according to natural mode.

Some embodiments encourage use phonetic entry as form is mainly inputted, using the visual aspects of user interface as right The supplement of phonetic entry.It is understood, however, that any input that can be said can be alternatively via another type of input shape State (for example, with the text input of keyboard) is provided.Therefore, although embodiment described below the use of voice is described as it is defeated Enter form, but other forms can be used with the following implementations for the same type for allowing user's offer and being provided by voice Input described in example.

Fig. 1 shows the example system 100 for being used according to some embodiments of the present invention.System 100 includes Electronic equipment 102, its can be TV, computer, portable electric appts (such as smart phone or be configured as receive and Show any other tunable electronic equipment of the programme content arranged).Electronic equipment 102 can be configured as receiving from user and search The input of rope and selection content to check on an electronic device, wherein receiving the input using one or more input form. In some embodiments, electronic equipment 102 include speech input interface 104, such as microphone and be configured as receive input one Other individual or multiple input interfaces 106.Other input interfaces 106 can include but is not limited to keyboard interface (such as QWERTY keys Disk), mouse interface, Remote Control Interface or allow users to search for content with checked on electronic equipment 102 any other conjunction Suitable interface.

The phonetic entry received via speech input interface 104 can be sent to automatic speech recognition (ASR) engine 108, for automatic speech recognition with recognize received speech input content.Although ASR 108 be shown in Figure 1 for by Including the part as electronic equipment 102, but ASR 108 alternatively can be positioned remotely from electronic equipment 102, And any suitable communication media (such as one or more networks) can be used and communicated with electronic equipment 102.At some In embodiment, electronic equipment 102 can draw with the ASR of one or more local ASRs 108 and one or more long range positionings Hold up associated, thus at least some phonetic entries received are handled by one or more of local ASRs, at least some The phonetic entry received is handled by the ASR of one or more of long range positionings.The example of this distributed ASR system It is well known by persons skilled in the art.Using it is one or more connection electronic equipments 102 and ASR communication media (for example One or more networks) be sent to one or more of long-range ASRs be used for recognize phonetic entry can use phase With or different communication medias and return to electronic equipment 102 from the ASR of long range positioning.

In certain embodiments, one or more voices that ASR 108 can be with the one or more voice commands of storage Order data source 110 communicates.ASR 108 phonetic entry received can be matched be stored in it is one or more of One or more of voice commands in voice command data source 110, and return to the voice command of one or more matchings and arrive One or more processors 114, processor 114 is programmed to execute the voice command corresponding to one or more of matchings At least one action.In certain embodiments, the output of ASR 108 can use natural language understanding (NLU) engine to be divided Analysis, NLU engines are suitably based on NLU technologies using any, and its example is known in the art.NLU outputs can be at least partly Ground is used for voice command is associated with the phonetic entry received.In certain embodiments, electronic equipment 102 can be configured For phonetic entry is interpreted as into voice command in response to following：The activation of input signal is (for example, user presses remote control or key Button on disk), or the phonetic entry corresponding to " wake-up " language is received, when the voice corresponding to " wake-up " language is defeated Enter and indicate to follow the phonetic entry of the input signal to be interpreted as voice command when being received.Alternatively, phonetic entry can Order is interpreted as without the order startup via input signal (such as language is pressed or waken up to button), because of the invention Embodiment it is unrestricted in this regard.

The set for the voice command that one or more voice command data sources 110 are stored can include being used to search for and select Any suitable order for selecting content to check on electronic equipment 102.In certain embodiments, the set of voice command can be with Include the order of the function of of control electronics 102 itself, its example is included in the order often found in conventional remote equipment, Such as " Jing Yin ", " turning on the power " and " volume ".Shown in following table 1 for the illustrative of control electronics 102 Electronic equipment order set, but it is to be understood that there is provided these order only as an example, embodiment as described herein It is not limited to use these specific orders.

Table 1：Illustrative electronic equipment order

The set of voice command can also include being used to search for and/or select the programme content arranged with electronic equipment The tuner command shown on 102, such as " shows<Channel designation>, " succeeding channel " and " show<Programm name>”.Below Table 2 in show the set of illustrative tuner command, but it is to be understood that there is provided these orders only as an example, Embodiment as described herein is not limited to use these specific orders.

Table 2：Illustrative tuner command

The set of voice command can also include being used to interact with one or more client applications on electronic equipment 102 Utility command, the client application performs any function in many functions, including provides the access to many services.Example Such as, utility command can be used to perform calling (such as Skype to use for user^TM) client application start audio call meeting Any action in words, search Weather information or many other actions of execution.Show that illustrative application is ordered in following table 3 The set of order.

Table 3：Illustrative utility command

Illustrative application order described in table 3 includes the order of control exemplary client application, these clients End application includes Twitter^TM、YouTube^TMAnd Skype^TM.It will be appreciated, however, that embodiments of the invention can include using It is without limitations in the voice command of any other client application, and in this respect.For example, it is also possible to including for including but It is not limited toGmail^TM、Hulu^TMAnd MySpace^TMClient application voice command. Some client applications (including many those listed above) otherwise can be can be with via the proprietary application on electronic equipment Via the accessed service or application based on web of the web browser in equipment, and embodiments of the invention are not limited The accessed mode of client application.

The set of voice command can also include action command, and each action command is used in execution and search result list The relevant action of one or more projects.Following table 4 describes the list of illustrative actions order.

Table 4：Illustrative action command

In certain embodiments, the set of voice command can also include being used to show the EPG orders interacted with EPG.With Using limiting user to navigation command system by the navigation of EPG entries with conventional five that remote control equipment is used together on the contrary, The set of EPG orders can provide additional phonetic function to strengthen the viewing experience of user.Following table 5 describes explanation The set of the EPG orders of property.

Table 5：Illustrative EPG orders

In certain embodiments, electronic equipment 102 also includes tuner 112, and tuner 112 is configured so that electronic equipment 102 can be tuned to specific channel to show the programme content of arrangement on electronic equipment 102.For example, tuner 112 can be with Electronic equipment enable from the program content source 124 for one or more arrangements that electronic equipment 102 is connected to via network 120 Receive the programme content arranged.The program content source 124 of arrangement can find for these arrangements of time media content come Source, the media content includes but is not limited to the content (such as TV programme and film) and live media content of storage.Storage And/or the programme content of arrangement is transmitted to the arrangement of electronic equipment (such as by such as wired or satellite network communication media) Program content source 124 be known.Some embodiments can include being configured as receiving the program arranged from multiple content sources The tuner of content, and/or multiple tuners can be included, each of which is configured as receiving from different content sources and arranged Programme content.

Electronic equipment 102 can also include network interface 118, and it is configured as via one or more networks 120 and one Individual or multiple storages and/or processing equipment communication.As described above, network interface 118 can be used for transmitting phonetic entry Voice identification result is received to one or more long-range ASRs and from one or more of ASRs.Electronic equipment 102 Single network interface 118 or more than one network interface 118 can be used, to cause electronic equipment 102 to be connectable to The network (such as to perform different functions) of more than one type.

A kind of example electronic device 102 is television system.Television system generally includes tuner, and it causes television system The programme content of the arrangement received by the set top box for being connected to TV can be shown.Set top box is the example of tuner 112, its The programme content arranged is received via network interface 118 and decodes received content to cause electronic equipment in display 122 Upper display content.The programme content of the arrangement received via network 120 or any other content can be connected to electronics Shown on the display 122 of equipment 102.In certain embodiments, display 122 can be using the integrated portion as electronic equipment 102 Point, and in other embodiments, display 122 can be connected to electronics via one or more wired or wireless connections Equipment 102.Display 122 can also be individual monitor or multiple displays, and embodiments of the invention are not limited in this respect System.

In certain embodiments, electronic equipment 102 can also be associated with local content data source 116, local content number According to source 116 can be configured as storing one or more TV programme, one or more films or any other be suitable in electronics The content played back in equipment.For example, in certain embodiments, local content data source 116 can be digital video recordings device (DVR), its programme content for being configured as the arrangement that storage is recorded.Local content data source 116 can be configured as storage and Be associated with electronic equipment 102 one or more local clients apply relevant content, the local client apply including But be not limited to store and/or manage picture file, one or more applications of music file and/or video file.

, can be from local when searching for content to check and/or play back on electronic equipment 102 according to some embodiments Content-data source 116 and/or it is remotely located from electronic equipment 102 and is connected to one of electronic equipment 102 by network 120 Or multiple data source (content-data source 124, the bundled services content-data source 124 of such as arrangement) retrieval contents.Searched Particular source can depend, at least partially, on search inquiry.When from multiple source returning results, search result can be at least partly Source of the ground based on the content corresponding with search result and be sorted.In certain embodiments, user can be included based on expectation The source of content in search result and/or the type of content limit the search to content, as described in more detail below.

Some embodiments are directed to the controllable visual search interface of voice shown on display 122, and are configured as permitting Family allowable searches for content to be checked and/or played back using electronic equipment 102.User can interact to search interface The programme content arranged is searched for, as described above.The programme content of arrangement includes but is not limited to such as TV and radio station section Purpose broadcasted content.

In addition, some embodiments can enable a user to search for bundled services content, bundled services content is for example by one The bundled services data source 124 of individual or multiple connection networks and/or local content data source 116 are stored.Different from that may only use In the programme content for the arrangement checked in special time (such as when the content is arranged for broadcast), bundled services content can For checking/playing back at any time.Bundled services content can include but is not limited in the service based on web Hold (for example), the content of Local or Remote data source from storage media content (such as DVR contents, comes from On-demand content of service provider etc.) and with being associated with one or more client applications of electronic equipment 102 (for example) associated content.As described in more detail below, can be with according to the search to content of some embodiments User is allowed to search for the programme content of arrangement, the programme content of bundled services content or arrangement and binding in single search Both service content.

Fig. 2 shows the illustrative methods for being used to handle search inquiry according to some embodiments of the present invention.In step In 210, electronic equipment 102 receives the search inquiry to check and/or play back on electronic equipment 102 to content search.For example, Search inquiry can include one or more voice commands, as described above.In order to which the phonetic entry received is interpreted For one or more voice commands, phonetic entry can be handled by one or more locally and/or remotely ASRs for knowing Not.In certain embodiments, the type that can be based at least partially on phonetic entry determines it is via local ASR or remote Journey ASR handles phonetic entry via both.For example, in one implementation, being ordered corresponding to fixed form equipment Making the phonetic entry of (such as " Jing Yin ", " closing power supply ", " volume increase ") can be handled by local ASR, and including freely Form input (such as " search ", " lookups ") order can by one or more long range positionings (such as " cloud ") ASR Processing.For example, because fixed form order can be associated with limited grammer, can be easier to recognize them, local ASR draws Speech recognition can be sufficiently used for and be compared faster with input is sent into long-range ASR by holding up.However, free form is defeated Enter to be more difficult to identification, therefore for acceptable recognition performance, it may be necessary to input is sent to more robust ASR and drawn Hold up.Moreover, the language model associated with long-range ASR can be updated periodically to reflect the change of pop culture, electricity Shadow, performer, title of books etc., conversely these are probably what is be difficult to for local ASR.In certain embodiments, At least Part I of phonetic entry can be handled by local ASR, and at least Part II of phonetic entry can be by The ASR processing of long range positioning, and any combinations of local and remote ASR can be for the received voice of identification Input.

Processing is subsequently entered in step 220, and wherein at least is based in part on the voice corresponding to search inquiry recognized Input to search for one or more data sources.One or more of data sources can be searched in any order, and any Specific data source (including all or less than available data sources) can be searched.The result returned by search can be closed with any Suitable mode is determined.In certain embodiments, specific action that user wishes to carry out can be based at least partially on to determine Which data source searched for.If for example, user, which says, " listens Bob Seger ", system can determine that user wants to listen music, therefore Only local music data source rather than the data source associated with EPG can be searched.Alternatively, if user says " viewing Modern Family ", then can determine that user wants viewing TV show.Correspondingly, the data source associated with EPG and with The associated one or more data sources of the television content of recording can be searched, but local music data source may not be searched Rope.By be selectively searched for all or less than available data sources, some embodiments of the present invention can search by reducing return The time quantum of hitch fruit and return in a more efficient manner correlation search result.However, simultaneously the embodiment of not all is limited Only to search for the subset of useful source, because may search for all useful sources for some search.

In certain embodiments, it can be based at least partially on particular command (or identified user view) with being used for Search and/or the associated one or more rules of particular order of search result are presented to determine order that data source is searched And/or the order that search result is presented.If for example, user says that " viewing Modern Family ", " see to voice command See " identification (or expected action, if not using particular command, as discussed below) electronic equipment can be caused First from the data source search associated with EPG and returning result, secondly from the data source search associated with local content simultaneously Returning result, again from client application (such as YouTube^TM) associated data source search and returning result.It should manage Solution, describes this particular order for being used to search for and return the search result associated with " viewing " order and is only used for explanation Property purpose, can alternatively use any other desired order.

In addition, some embodiments can not include fix command grammer, but can be in some other manner from being received Input determine the intention of user, such as determine the intention of user by monitoring the particular utterance in free form input, And perform action in response to determining the intention of user.If for example, user uses " broadcasting " to order in free form input Order uses " broadcasting " one word, then system can identify that the use of the play command or " broadcasting " one word can imply that user visits Ask the intention of always addressable content (or the program request being locally stored is available).It can use one or more excellent First level rule come determine play what media content.For example, can determine whether EPG has what is matched with phonetic entry first It is currently available for any media content played (such as broadcasted content, on-demand content).If currently may be used from EPG determinations are no Content, then next it may be determined whether that the media content (such as DVR contents) of any recording is matched with phonetic entry. If more than one recording medium inclusive segment matches with phonetic entry, one or more of priority rules can refer to The content of fixed all matchings is shown so that user can select wherein.Alternatively, in certain embodiments, electronic equipment Selected one of matching content can be played back automatically, and (such as the content of the oldest recording for not watching (or partially viewed) is chosen Select and play back on an electronic device), rather than show multiple search results to user.Although above-mentioned example is directed to use with specific excellent Media content is played in the set of first level rule, but it is to be understood that these rules are merely exemplary, and can use any conjunction The set of suitable priority rule is for any phonetic entry, because embodiments of the invention are not limited in this respect.

Fig. 2 processing is returned to, has been searched in a step 220 after one or more of data sources, processing enters Step 222, wherein in response to searching the content matched with search inquiry from one or more of data sources, with electronics One or more results are shown in the associated user interface of equipment 102.Search result can show in any suitable manner, Including the use of the search result interfaces of voice-enabled (voice-enabled), as will be described in more detail.Such as institute above Description, display result can include directly presenting inputting the inclusive segment matched with user.

Fig. 3 shows the part at the visual search interface according to some embodiments of the present invention.Specifically, Fig. 3 is shown Illustrative result screen 300, for showing the searching to the content checking and/or play on an electronic device started from user The search result that rope is returned.In certain embodiments, result screen 300 is configured as along at least two axles display search knot Really.In an illustrative embodiment, an axle is in the prospect of search interface, and other one or more axles are on search circle In the background in face, but the prospect of search interface can be brought in response to order (such as voice command).It is still other its In his embodiment, the content shown on axle only in the foreground is fully focused (in focus), and the decoking of other shaft portions ground (out of focus) by the notice of user to be attracted to prospect axle.However, not all realities of prospect of the application and background axle Apply example and be limited in this context system, because some embodiments can be presented two or more axles and be fully focused.

In certain embodiments, for showing that the first axle of search result can be the axle 310 unrelated with the time.When correspondence When the content of search result can be used for checking and/or playing back, any suitably measurement unrelated with the time can be used to come edge The axle 310 unrelated with the time and carry out sorted search result.For example, in a nonrestrictive example, can be at least in part Based on produce result search inquiry the degree of correlation come along the axle unrelated with the time come sorted search result.In some implementations In example, the content shown along the axle unrelated with the time can be restricted in the available content of current time, and in other realities Apply in example, it can include the content being currently unavailable.What is returned for being sorted based on the degree of correlation with search inquiry is searched The embodiment of hitch fruit, can be in any suitable manner using any suitable algorithm (e.g., including to being currently available for looking into The content seen provides the higher degree of correlation) degree of correlation is determined, because embodiments of the invention are unrestricted in this regard.Should Understand, a kind of mode being ranked up with the degree of correlation of search inquiry only along the axle unrelated with the time to result, and And any other suitable measurement can be used to replace or in addition in using with the degree of correlation of search inquiry.For example, can be with The combination for being based at least partially on the type of content, the source of content or any other factor or factor to carry out search result Sequence.

In certain embodiments, search result can also be organized along the second axle, the second axle be it is time-based and It is configured as the search result that display can be used for checking in different time.It is used for for example, the prospect of result screen 300 can be shown The search result of currently available content, and only be may be displayed in the available content of future time in background 320, as shown in Figure 3.

Although result screen 300 includes the search result being shown on only two axles, but it is to be understood that search result can To be shown on any number of axle, because embodiments of the invention are unrestricted in this regard.For example, in some embodiments In, for can use in current time but may need to pay the binding of subscription charge or some other expenses before content is checked The search result of service content can be shown along single axle (not shown), to indicate that the content is only paying applicable Payment after can just be checked.

Result screen 300 can also include description section 330, and it includes the information of the search result on currently selecting. Description section 330 can also include other information, and other information is allowed users to from searching for being shown in result screen 300 The selection of wisdom is made in hitch fruit.For example, description section 330 can include it is associated with currently selected search result The description of content, and the description can the selection based on the different search results to being shown in result screen 300 and change.

In certain embodiments, the search result fewer than the whole search results returned from search process may be displayed on knot So that the crowded minimum of display on fruit screen 300.In certain embodiments, user can hand over one or more voice labels Mutually (as described in more detail below), to check other search result.Result screen 300 can also include findings that field 340, What it allowed users to be added based on one or more of search result shown in result screen 300 searches Rope.For example, it was discovered that field 340 by user when being selected, it can start pair and be associated with the interior of currently selected search result Hold the search of similar content.Similarity can suitably be determined with any using the method for any suitable algorithm, because Embodiments of the invention are unrestricted in this regard.For example, being based at least partially on content source and content that content is retrieved from The associated one or more content tabs (parental ratings of such as film) of section, the type of content or these or other because Any combinations of element determine similarity.

In certain embodiments, result screen 300 can include tool bar 350, and it includes convenient and scouting screen 300 User mutual information.For example, tool bar 350 can include one or more icons, text or other indicators, it is described its His indicator explains user, and available for being interacted with result screen 300 specific to screen or global input, (for example voice is ordered Make).

According to some embodiments of the present invention, search result can include the search result of mixing, and it includes different type Content.For example, as discussed above, search result can include relative with the programme content and bundled services content of arrangement The result answered.Fig. 4 shows illustrative result screen 400, wherein the search result shown in result screen 400 includes mixing The search result of conjunction, i.e. at least two in search result are associated with different types of content.The search result of mixing can be with Including the first result for being returned from the program content data source of one or more arrangements and from one or more bundled services contents The second result that data source is returned.The search result shown in result screen 400 includes search result 410,412 and 414, it Can be result from the return of the program content data sources of one or more arrangements, in addition to search result 420 and 422, it Can be from one or more bundled services content-data sources return result.

As shown in figure 4, the search result that is returned from the program content data source of arrangement and from bundled services content-data source The search result of return may be mixed together and using any suitable measurement or measurement combination along unrelated with the time Axle sequence, these measurements include but is not limited to sources with the degree of correlation of search inquiry, the type of content and content.With result screen As curtain 300, result screen 400 can include description section 430, its search knot for including and being shown in result screen 400 One or more of fruit relevant information.

In certain embodiments, the search result shown in result screen 400 can be along including unrelated with the time At least two axles of axle and time-based axle are sorted.In certain embodiments, shown in the background parts of search interface Search result can only include arrange programme content without including bundled services content.For example, because some bundled services Content can be always addressable, in certain embodiments, can be total corresponding to the search result of such bundled services content It is shown in the foreground part of search interface, to indicate that it can be used for checking and/or playing immediately.It will be appreciated, however, that This is only an illustrative mode for carrying out organising content using two axles, and its hetero-organization of content is also possible.

As discussed above, some bundled services contents only can be just accessed immediately once payment expense.For example, From Online Music shop (such as) song only once buy the song can just be accessed immediately.One In a little embodiments, although not shown in Fig. 4, with being needed before becoming available for checking and/or playing back on an electronic device The search result that the content of payment is corresponding may not be mixed with other search results, but can appear in search result interfaces Different piece in.

In certain embodiments, one or more selections can be included according to the search interface of some embodiments of the present invention Label, interacting between the convenient user of these labels and the one or more assemblies of search interface.Fig. 5 is shown including multiple Select the exemplary result screen 500 of label.As shown in figure 5, one or more of search result can be with selection label 510 are associated, and its instruction user can provide (such as via spoken language input, keyboard or keypad) to select specific search to tie The input of fruit.In exemplary result screen 500, for the embodiment using speech interface, if user wants a selection left side The first search result in inferior horn, then user is it may be said that " selection 1 ".Alternatively, if user wants selection and is shown in the lower right corner On search result, then user it may be said that " selection 4 ".

Result screen 500 can also be including other kinds of selection label, such as one or more icons 520, and it causes The relevant one or more actions of content that user can use select command to perform be associated with the icon.For example, icon 520 can include but is not limited to indicate to the user that they can check certain content, record certain content or perform with being associated with The icon of the associated some other actions of the certain content of icon.User will can be acted with selecting the mark of label combined To perform the action to selected content.For example, user can by saying " check 1 " come check with Fig. 5 lower left corner The associated content of search result.

When it is activation depending on voice command, with visual search circle in some embodiments using speech interface The interactive voice in face can be classified as different types of voice command.For example, some voice commands can be classified as and shield The unrelated order of curtain, these orders independently of the content shown in any specific screens, and always activate but regardless of working as It is preceding that just presenting over the display is any specific screens.Some non-limiting examples of the order unrelated with screen are included but not It is limited to the order of such as volume control, channel control, screen intensity and menu access order.In certain embodiments, with screen The set of unrelated order and the feature conventionally controlled by remote control equipment are substantially overlapping.The order unrelated with screen can be with Associated with one or more marks, the mark is for being shown on search interface, so as to user reminding, these are ordered The selection label of presence, or in certain embodiments, it is assumed that user knows these always available orders and can be by Call so that do not show selection label or icon.In certain embodiments, can in the tool bar shown on search interface screen With including the icon for one or more of global command and/or in response to trigger event (such as seek help, press it is defeated Enter the hot key in equipment or in some other modes) list of global command can be accessed.

Some interactive voices can be associated with the action related to screen, and the action related to screen is allowed users to only Action is performed in the specific screens of user interface.For example, in the result screen 500 shown in Fig. 5, selection label 510 can be with User is allowed to select specific search result (as described above), and in response to have selected specific search result, with The description of the associated content of selected search result can be updated to provide a user information on search interface, the letter Breath can help a user decide whether that a pair content associated with selected search result performs action and (for example watch, purchase Buy, record).

Other actions related to screen can be associated with one or more navigation features of search interface, navigation feature Allow users to navigate and/or update in specific result screen the content of result screen.For example, search interface can To show the mark of voice-enabled (voice-enabled), it allows user to check to be not currently in show on search interface attached Plus search result, for example update knot by saying the input of " next result " or some other order phrases or free form Fruit screen is with including additional result.

Search interface can be further configured with being associated with the integration of user interaction functionality of the action related to screen, to allow User switches between the search result that the varying level shown with multiaxis is presented.For example, search result along with the time without In the embodiment that the axle of pass and time-based axle are shown, user can use voice (or other forms) input to switch edge Which result for time-based axle is currently focused and can be chosen.For example, user it may be said that " later " (or some Other language or phrase) shown with selection and in the background of user interface along the time-based axle of shown search result The associated content of search result.This can be it is useful, for example, it is allowed to which user takes and in the available peace of later time Arrange the relevant action of programme content (for example recording).In order to perform the action, user it may be said that " later " (or some other language Or phrase), this can switch search result shown in the foreground and search result shown in the background, so that handy Family can select content only in available project in the future.

Graphic icons 520 can represent the user mutual of another species, and these user mutuals allow users to perform spy Fixed action, such as records, checks or plays back the content associated with search result.In certain embodiments, graphic icons Additional increment action is can correspond to, these increments action allows users to perform the function of other " secondary ", for example, sent out Model is arrivedPerform Twitter^TMOn action or handed over another client application service or website Mutually.

Although illustrative above example discuss three kinds of different types of user mutuals (i.e. unrelated with screen order, The action related to screen and graphic icons action), but it should be clear that the user mutual of any destination type can be used, Because embodiments of the invention are unrestricted in this regard.

In the embodiment of some support speech interfaces, the selection label and/or other icons shown on search interface Existence or non-existence can be based at least partially on and whether activated interactive voice for search interface to determine.Determine language Whether sound interaction activates can be carried out in any suitable manner for search interface, including for example determine whether microphone swashs It is living, determine whether speech recognition software performs on an electronic device, determine user and whether have been sent from voice command with search Voice label or other suitable modes are shown on interface.

In certain embodiments, electronic equipment can receive the input for causing electronic equipment to enter " listening mode ", in " prison Listen pattern " during electronic equipment expect the further input from user to perform action.On the contrary, when electronic equipment is not at prison When listening pattern, the input received can not acquiescently be interpreted as representing the meaning of the execution specific action of user by electronic equipment Figure, but can monitor the input that triggering enters listening mode.Fig. 6 is shown according to some embodiments of the present invention Illustrative process for the electronic equipment including listening mode.In operation 610, it is determined whether electricity will be caused by having been received by Sub- equipment enters the first input of listening mode.For example, in the embodiment including speech interface, the first input can be with proof The voice command of the intention of the execution action of user or some other phonetic entries are corresponding, as described above.Alternatively, First input may be such that electronic equipment enters any other suitable input of listening mode, including but not limited to by lower key Specific keys on disk or keypad.

If determining to be not received by the first input in step 610, processing continues to monitor the first input received. Otherwise, if having been received by the first input, processing enters step 612, causes electronics wherein being inputted in response to identification first Equipment enters listening mode.When in listening mode, processing enters step 614, where it is determined whether it is defeated to have been received by second Enter.If it is determined that have been received by the second input in listening mode, then processing enters step 620, corresponds to the wherein performing One and/or second input one or more actions.After one or more actions are performed from step 620, if expected Additional input, then processing can alternatively return to step 612 to enter listening mode.For example, the second input can be " modern What has on the HBO comedy inventories in evening", and the action performed in step 620 can be open on the day of HBO comedies it is clear It is single.Because expecting additional input, all processing can enter step 612 to enter listening mode, wait input (example to be appended It is such as next, previous, exit).If however, do not added after one or more actions are performed from step 620 Input be expected, then processing can terminate.

If determining to be not received by the second input in step 614, processing enters step 616, wherein determine since Specific time quantum (such as 5 seconds) whether is had already been through into listening mode.If determining to have not gone through in step 616 Specific time quantum, then processing continues to monitor the second input.Otherwise, if it is determined that pass by specific time quantum, then located Reason enters step 618, wherein cause electronic equipment to exit listening mode, and handles that to return to step 610 defeated to monitor first Enter.In embodiment described above, after listening mode is entered, electronic equipment is after specific time quantum has been pass by Exit listening mode.It will be apparent, however, that in certain embodiments, otherwise can alternatively exit listening mode.Example Such as, some embodiments can enable a user to guide electronic equipment to exit the input of listening mode explicitly to move back by offer Go out listening mode.The explicit input can take any suitable form, including but not limited to voice command (or the use of determination Family is intended to) or by the button on lower keyboard or keypad.

In certain embodiments, when causing electronic equipment to enter listening mode, this can be shown by electronic equipment It is noted in some way in user interface.For example, once entering listening mode, one or more selection labels and/or figure Mark can occur on a user interface notifying user to come into listening to pattern.It should be appreciated that can perform in any way Reflect the user interface change of the mode state of electronic equipment, show or hide selects the example of label and/or icon to be only referred to Show a kind of mode of state, and other modes are also feasible.

In certain embodiments, bundled services content search results can be represented with hierarchical.If for example, specific bundle The service of tying up includes one or more inclusive segments matched with search inquiry, then can be initially by including bundle in search result Tie up the identifier rather than corresponding inclusive segment of service to represent them, and then select bundled services can from search result To cause corresponding inclusive segment to show on a user interface.For example, the application associated with bundled services content search results can To be shown as image or icon for application, the image or icon are recognized by the user to represent the application.For example, bundled services Search result can correspond to film stream process (streaming) service, such as(for example byFigure Indicate), and in response to for example, by saying the second search result of selection (for exampleSearch result) " selection 2 " and select film stream process service, can showSearch result in.

In the illustrated example, user may search for the content corresponding to " Yankees ", be returned in response to the search Search result can include the programme content of arrangement for New York Yankees baseball matches, from being used for and New Film relevant York Yankees film stream process service bundled services content, " Damn Yankees " are relevant with band Music content and e-book " A Connecticut Yankee in King Arthur ' s for Mark Twain Court " electronic book contents.With all films included by display bundled services, relevant with Yankees on the contrary, search As a result the image serviced for film stream process can be initially shown, the film stream process services package is included and search terms " Yankees " relevant multiple films.Once selected by using selection voice label for example associated with the image use The image serviced in the film stream process, services available and corresponding to search terms " Yankees " one or many from the stream process Portion's film may be displayed in search result.The search result that hierarchical is presented can have any number of hierarchical water It is flat, because embodiments of the invention are unrestricted in this regard.

The illustrative example of another content that can be represented with hierarchical is the song in music libraries.For example, user may Want broadcasting Metallica song, but the title of the song may be forgotten.In order to search for the song, user can start Search to " Metallica ", the search result returned can include being locally stored in associated with electronic equipment local The special edition of multiple Metallica in data source, and/or one or more nets including the music from Metallica The music data source (such as database) of network connection.In certain embodiments, search result can be rendered as being used for Metallica The a series of images of the album cover of different special editions, and user can be pointed out to select one in special edition from search result (such as by using the selection voice label associated with each album image).It is one in one chosen special edition, selected Special edition can deploy to show for one in the song associated with special edition or how first search result, and user can To select one of song on special edition to be played back.Therefore, in this respect, search result can be presented in hierarchical mode, Alloing allows the sequential selection of search result user's navigation to want by search result with discriminating user in electronic equipment The content of upper playback.

In certain embodiments, can be using the voice mark for guiding user's component interactions how different from user interface Label.The voice label of content neutral is the mark unrelated with the content that voice label is identified.The voice label of content neutral Example is the selection voice label (1,2,3,4) shown in Fig. 5, and they allow user to select one of search result without saying The title of the content of identification search result.Therefore, the voice label of content neutral does not identify the content being associated in itself, But only identify neutral gear (slot) or the position of the search result that content is assigned to.By using the voice mark of content neutral Label, have provided a user the set of voice label, they are conducive to consistent user's body when with visual search interface alternation Test.In addition, using to compare using the voice label permission user of content neutral the mark is at least partially based in voice label The identified content of label and less voice of needs is carried out into call instruction in the case of creating.Use the voice mark of content neutral Label also allow using fixed grammer (such as numeral, letter), and this can be for that may have the content production of unique title etc. Raw more accurate ASR.

In certain embodiments, user can provide the input of the activation of the order or the interaction that cause more than one type (such as via voice).For example, user is it may be said that " viewing 1 ".As response, occur two interactions：(1) in search result One project can be chosen and (2) selected project can be played.So, single input can cause multiple orders or interaction It is performed without user and must send out single order.This system is allowed users to using nature input (such as voice) With control electronics.

The search that can be performed for any kind of content is described above is, including to YouTube^TM、Hulu^TMOr appoint The what search of his video sharing web sites or the video clipping on web services.In addition, as described above, user may search for locally It is stored in the music content that can be accessed in a music libraries or via network (such as internet).User, which can have, limits search It is formed on the ability of certain types of content (such as music, video or the programme content of arrangement) so that search result only includes use Expect the certain types of content of search in family.Therefore, search interface can be associated with advanced searching capabilities, advanced searching capabilities Phonetic entry and/or other input forms can be used to be configured.

In certain embodiments, the inclusive segment shown in search result can include multiple labels (such as voice mark Label), one of tag identifier content, the action that another label instruction is performed with content is (such as in watching, record or buying Hold).For search interface, the quantity of the label associated with search result is not the limitation of the embodiment of the present invention.

Fig. 7 shows the explanation for the computer system 700 that can be used in combination with any embodiment of invention described herein The realization of property.Computer system 700 can include one or more processors 710 and one or more computer-readable non-volatile Property storage medium (such as memory 720 and one or more non-volatile memory mediums 730).Processor 710 can be with any Appropriate mode is controlled to writing data to memory 720 and non-volatile memory device 730 and reading data from them, Because each side of invention as described herein is not restricted by this.In order to perform any work(described herein Energy property, processor 710 can perform one be stored in one or more computer-readable recording mediums (such as memory 720) Individual or multiple instruction, one or more of computer-readable recording mediums may act as storing what is performed by processor 710 The non-volatile computer readable storage medium storing program for executing of instruction.

The above embodiment of the present invention can be realized with any one of various ways.For example, embodiment can make Realized with hardware, software or its combination.When implemented in software, software code can be in any suitable processor or processing Performed on device collection, no matter be provided in single computer and be also distributed across between multiple computers.It should be appreciated that performing above-mentioned Any component or component set of function can usually be considered to be one or more controllers of control above-mentioned functions.Described one Individual or multiple controllers can be realized in many ways, such as be programmed to perform above-mentioned functions with using microcode or software Common hardware (such as one or more processors) or specialized hardware.

In this respect, it should be clear that a realization of embodiments of the invention includes at least one non-volatile computer Readable storage medium storing program for executing (such as computer storage, floppy disk, CD, tape), it is compiled with computer program (i.e. multiple instruction) Code, when the computer program is performed on a processor, performs the above-mentioned functions of embodiments of the invention.It is computer-readable to deposit Storage media can be transmittable so that the program stored thereon can be loaded on any computer resource to realize herein The each aspect of the present invention discussed.Moreover, it will be appreciated that the referenced above-mentioned functions computer program of execution upon being performed It is not limited to the application program run on a host computer.On the contrary, herein using term computer program with general significance Upper finger can be used for programmed process device with any kind of computer code (such as software for the above-mentioned each side for realizing the present invention Or microcode).

The various aspects of the present invention can be used alone, are applied in combination or be discussed with not specific in the aforementioned embodiment Diversified arrangement use, therefore their application is not limited in the above description by the various aspects of the present invention The arrangement and details of component illustrated or described in the accompanying drawings.For example, each side described in one embodiment can With combined with each side described in other embodiment in any way.

Moreover, embodiments of the invention can be implemented as one or more methods, there has been provided its example.It is used as method Part performed by action can sort in any suitable manner.Therefore, it can construct wherein with it is shown suitable Sequence different order performs the embodiment of action, and it may include while some actions are performed, even if in an illustrative embodiment It is shown as sequentially-operating.

Carry out modification right using the ordinal number of " first ", " second " " the 3rd " etc. in the claims and require element sheet Body is not meant to a claim elements relative to any order of another claim elements, precedence or preferential, The time sequencing that the action of method is performed is not meant that yet.These terms are used only as marking distinguishing one with a certain title Individual claim elements and another key element with same names (in addition to using ordinal number).

Wording as used herein and term for descriptive purposes, are not considered as limitation." comprising " as used herein, "comprising", " having " "comprising" " being related to " and its modification are intended to include items listed thereafter and other project.

Several embodiments of the present invention are described in detail, various modifications are readily appreciated in those skilled in the art And improvement.These modification and improvement are intended to belong to the spirit and scope of the present invention.Therefore, description above is merely exemplary , and be not intended to be limiting.As the present invention is limited only as claim and its equivalent limits.

Claims

1. a kind of method that search result is presented on an electronic device, wherein the electronic equipment includes being configured as described in tuning Electronic equipment is to receive the tuner of the programme content of arrangement, and methods described includes：

Receive the search inquiry as phonetic entry；

The search inquiry is based at least partially on, includes the first data source and the second data source with the search of at least one processor Multiple data sources；

It is determined that at least one search result returned from the first data source and at least one the search knot returned from the second data source Fruit and the degree of correlation of the search inquiry；With

The result of search is presented using time-based axle and the axle unrelated with the time, wherein the axle unrelated with the time includes root According to the identified degree of correlation with the search inquiry along being returned from the first data source of sorting of the axle unrelated with the time At least one search result and from the second data source return at least one search result, wherein the result along with the time without The sequence of the axle of pass is independent of the data source for returning to the result, wherein time-based axle includes the foreground portion of user interface Point and user interface background parts, and the result of search be wherein presented using time-based axle include：Along based on Current result usable in the foreground part of user interface is presented in the axle of time, and is presented current along time-based axle In the obsolete result of the background parts of user interface.

2. according to the method described in claim 1, wherein searching at least one data source includes searching at least one section arranged Mesh content-data source and at least one bundled services content-data source.

3. method according to claim 2, wherein the result is included in the programme content number of at least one arrangement The binding identified according to the programme content of the arrangement identified in source and at least one described bundled services content-data source Service content.

4. according to the method described in claim 1, wherein the result includes bundled services content, when the bundled services content When being chosen, show from many of at least one the bundled services content-data source associated with selected bundled services content Individual result.

5. according to the method described in claim 1, wherein time-based axle distinguish can currently be used for playback first content with Current the second content that cannot be used for playback.

6. according to the method described in claim 1, wherein the result presented along time-based axle only includes arrangement Programme content.

7. a kind of electronic equipment, including：

It is configured as tuning the tuner of programme content of the electronic equipment to receive arrangement；With

At least one processor, is programmed to：

Receive the search inquiry as phonetic entry；

The search inquiry is based at least partially on, search includes multiple data sources of the first data source and the second data source；

8. electronic equipment according to claim 7, wherein searching at least one data source includes searching at least one arrangement Program content data source and at least one bundled services content-data source.

9. electronic equipment according to claim 7, wherein the result includes bundled services content, when the bundled services When content is chosen, show from least one bundled services content-data source associated with selected bundled services content Multiple results.

10. electronic equipment according to claim 7, can currently be used to be set by the electronics wherein time-based axle is distinguished The first content of standby playback is with currently cannot be used for the second content played back by the electronic equipment.

11. a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is performed by least one computer When, perform following steps：

Receive the search inquiry as phonetic entry；

12. computer-readable recording medium according to claim 11, wherein searching at least one data source includes search At least one program content data source and at least one bundled services content-data source for arranging.

13. computer-readable recording medium according to claim 11, can currently be used for wherein time-based axle is distinguished The first content of playback and the second content that currently cannot be used for playback.

14. computer-readable recording medium according to claim 11, wherein along described in the presentation of time-based axle As a result the programme content of arrangement is only included.