WO2023179454A1 - 服务调用方法及电子设备 - Google Patents

服务调用方法及电子设备 Download PDF

Info

Publication number
WO2023179454A1
WO2023179454A1 PCT/CN2023/081952 CN2023081952W WO2023179454A1 WO 2023179454 A1 WO2023179454 A1 WO 2023179454A1 CN 2023081952 W CN2023081952 W CN 2023081952W WO 2023179454 A1 WO2023179454 A1 WO 2023179454A1
Authority
WO
WIPO (PCT)
Prior art keywords
service
user
service type
semantics
user input
Prior art date
Application number
PCT/CN2023/081952
Other languages
English (en)
French (fr)
Inventor
王依伦
胡凯
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023179454A1 publication Critical patent/WO2023179454A1/zh

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/30Semantic analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Definitions

  • the embodiments of the present application relate to the technical field of terminal equipment, and in particular, to a service invoking method and electronic equipment.
  • electronic devices provide more and more services to users (such as video playback services, e-commerce shopping services, music playback services, radio playback services, etc.).
  • the electronic device can provide an interactive interface for users to select or input required services in the interactive interface.
  • this application provides a service calling method and electronic device.
  • users can use services provided by local applications without operating local applications, and the way electronic devices provide services is more flexible and intelligent.
  • embodiments of the present application provide a service invoking method.
  • the method includes: in response to a first user input received in the session interface, detecting that the first user input satisfies a preset condition for triggering a target service, and calling the target of the target application based on the first user input. Service; display a response result on the conversation interface, where the response result includes an execution result of the target service by the target application, where the conversation interface does not belong to the interface of the target application.
  • this method can be applied to an electronic device, taking the electronic device as a mobile phone as an example.
  • the target application can be a local application installed on the mobile phone, and the local application can be a system application or a third-party application.
  • System applications are used to represent applications that are installed on the phone when it leaves the factory.
  • Third-party applications can be applications downloaded by users from the application market.
  • the local application can provide at least one service.
  • a video application can provide a video search service and a video playback service.
  • the user can input an instruction on the session interface.
  • the instruction reaches the preset conditions for triggering the target service
  • the mobile phone can call the target service provided by the target application.
  • the target application can execute the target service, and the mobile phone can target the target service.
  • the execution results of the target service can be displayed in the session interface.
  • the execution result of the target service may be the service result data generated after executing the target service.
  • the execution results may be video search results, such as relevant information of the searched video resources (such as video playback interface, video introduction, video playback link, etc.).
  • the execution result may be the added to-do item. interest.
  • the conversation interface may be a one-screen interface on a mobile phone, or may be a conversation interface of an application, which is not limited in this application.
  • the above video application can search for the video resources of the TV series named "XX" to perform the video search service.
  • the playback of the video resources The card (which may include at least one piece of information such as an introduction to the video resource, a poster, a playback window, etc.) may be displayed on the session interface as a response result of the user's input.
  • the execution result of the video search service by the video application may include the above video resources searched by the video application.
  • the mobile phone can call the target service provided by the local target application based on the instruction input by the user, so that the user does not need to enter the target application.
  • Interface you only need to enter instructions to trigger related services in the session interface, and the mobile phone will call to execute the target service of the target application, which simplifies the user's operation process when using related services, improves the efficiency of triggering services, and the mobile phone Services can not only be triggered by operating the application that provides the service, but can also directly trigger related services by receiving user instructions within a session interface, which improves the flexibility of service provision methods.
  • the target application includes record information related to the execution result.
  • the target application may also generate record information related to the execution result by executing the target service.
  • the user inputs "search for XX TV series" in the conversation interface, and then the target application can generate an execution record of the search video service in the target application after executing the search video service.
  • the search records of the video application may include search records for the "XX" TV series.
  • the The playback records of the video application may include the playback records of the "XX" TV series. That is to say, after the above response result (including the target application's execution result of the target service) is displayed in the session interface, and the user continues to perform operations on the response results (equivalent to operating on the execution results), the target application can also perform operations on the target service.
  • record information related to the execution result (such as a video playback record) is generated in the target application.
  • the mobile phone can not only call the target service of the target application so that the target service is executed, but also the target application that provides the service can also include (for example, storage or Record or display, etc.) record information related to the execution results of the target service. Even if the user triggers the service provided by the target application in an interface or application outside the target application, the execution record of the service can still be saved in the target application, so as to optimize the service provided to the user.
  • the method further includes: in response to the second user input received in the conversation interface, detecting that the semantics of the second user input is consistent with the second user input.
  • the semantics of the preset mark match.
  • the local application includes the target application; wherein the first prompt is used to instruct the user to select a service type from the at least one first service type; the second prompt is used to instruct the user
  • a first instruction is input, where the first instruction is an instruction for triggering a service of the first service type.
  • the user can enter "@" in the conversation interface to search for at least one first service type corresponding to "@". Users only need to enter a tag to search for related services, which simplifies user input operations and improves service search efficiency.
  • the number of the first service types may be at least two. Then the user can search for a service type list by inputting "@" in the session interface, and the service type list includes at least two service types.
  • the search range of service types can be quickly narrowed, making it easier for users to find and trigger the required service types.
  • the mobile phone can display a second prompt on the conversation interface, so that the user can quickly input an instruction that can trigger the service according to the second prompt.
  • the mobile phone can display a first prompt on the conversation interface, and optionally further display a second prompt, so that the user can display the first prompt according to the second prompt.
  • the first prompt word selects the service type to be used, and according to the second prompt word, continue to input instructions that can trigger the service for the selected service type, thereby improving the triggering efficiency of the service.
  • the method further includes: in response to a third user input received in the conversation interface, detecting that the semantics of the third user input is consistent with The semantics of the first service parameter of at least one second service type match, and a third prompt and/or a fourth prompt are displayed on the conversation interface; wherein the service type provided by the local application includes the second service type, the first service parameter is the parameter information required when the local application executes the service of the second service type; wherein the third prompt is used to indicate to the user that the at least one second Select one of the service types; the fourth prompt is used to instruct the user to input a second instruction, where the second instruction is an instruction for triggering a service of the second service type.
  • the number of the first service types may be at least two.
  • local application 1 provides a video playback service
  • local application 2 provides a movie ticket ordering service.
  • These two services require necessary service parameters when executed, here are Video name.
  • the semantics of "XX movie” is that the movie name is "XX”
  • this semantics can match the semantics of the service parameter of the video name of the above two service types, and the mobile phone can determine the service that the user expects to use based on the user input content.
  • Service types include video playback services and movie ticket ordering services.
  • the mobile phone can display a third prompt to prompt the user to select a service type from the video playing service and the movie ticket ordering service.
  • the mobile phone can also display a fourth prompt to prompt the user to enter instructions that can trigger the above two types of services, such as prompting to enter a video name.
  • the mobile phone can determine that the service type that matches the semantics of the input content is the playback provided by local application 1.
  • Video service in which one of the necessary service parameters for playing video service: video name, matches the semantics of "XX drama".
  • the necessary service parameters for the video playing service include not only the video name, but also the video type (movie type or TV series type). Then the mobile phone can output a fourth prompt to prompt the user to enter a video type instruction.
  • the second service type in this embodiment may be the same as or different from the first service type in the above embodiment, and this application does not limit this.
  • the mobile phone can interact with the semantics of the user input content through necessary service parameters of the service type.
  • Line matching is used to determine the service type of the service that the user may wish to use, and the necessary service parameters of the service type are the service parameters that are necessary when the service of this service type is triggered (that is, called).
  • the local application provides services of this service type, it needs to provide services based on the necessary service parameters.
  • the mobile phone determines the service type from the user input content, it combines the necessary service parameters to determine the service type, which can further improve the recognition accuracy and search efficiency of the service type, and can combine the necessary services required by the service type provided by local applications. Parameters to update the prompts can improve the triggering efficiency of the service.
  • the first user input received in the conversation interface in response to the first user input received in the conversation interface, it is detected that the first user input satisfies a preset condition for triggering the target service, including: in response to the first user input received in the conversation interface, detecting that the semantics of the first user input matches the semantics of a unique third service type, and determining that the first user input satisfies a trigger Preset conditions for the target service corresponding to the third service type; wherein, the first preset service type provided by the local application includes the third service type, and the service of the first preset service type is provided by the Local applications execute without service parameters.
  • the third service type is different from the second service type.
  • the necessary service parameters corresponding to the service type need to be provided, and when the service of the third service type is executed, the service parameters are not required, because the service of the third service type is executed. No necessary service parameters are required for execution.
  • the third service type may be the same as or different from the above-mentioned first service type, and this application does not limit this.
  • the service of the third service type does not require necessary service parameters when it is called.
  • viewing the calendar service does not require the user to enter specific date and other service parameters. It only needs to enter "calendar", so that the relationship with the user input content can be determined.
  • the semantically matching service type is the viewing calendar service.
  • the mobile phone can call the calendar viewing service of the calendar application and provide the execution results (i.e. calendar information) to the user for browsing.
  • the mobile phone when the user input content matches the semantics of a unique service type, and the unique service type does not require necessary service parameters when executed, the mobile phone can determine that the user input content can trigger the service. Conditions of the service type, thereby calling the corresponding target application to execute the service of the service type.
  • the service type provided by the target application includes the third service type here, which can improve the service execution efficiency.
  • the first user input received in the conversation interface in response to the first user input received in the conversation interface, it is detected that the first user input satisfies a preset condition for triggering the target service, including: in response to the first user input received in the conversational interface, detecting that the semantics of the first user input matches the semantics of a unique fourth service type, and the semantics of the first user input including a second service parameter, determining that the first user input satisfies a preset condition for triggering the target service corresponding to the fourth service type; wherein the second service parameter is for the target application to execute the fourth service type Parameter information required for the service.
  • the fourth service type requires necessary service parameters when executing the service, and the fourth service type is different from the above-mentioned third service type.
  • the fourth service type may be the same as or different from the above-mentioned first service type and second service type, and this application does not limit this.
  • the mobile phone when the semantics of the user input content can match a unique service type, and the semantics also include service parameters necessary for the unique service type to be executed, the mobile phone can determine the user input The content reaches the conditions for triggering the service of this service type, so that the target service of this service type provided by the target application is called based on the necessary service parameters provided in the semantics of the user input content.
  • the target application can execute the target service according to the service parameters provided by the user, and display the execution result of the target service on the session interface. Then, when there are semantic differences in the necessary service parameters of the service type input by the user, the execution results of the target service can be different. In this way, the target service can be flexibly executed according to the user input content, and the diversity of services provided to users can be improved.
  • the method further includes: in response to a fourth user input received in the conversation interface, detecting that the semantics of the fourth user input is consistent with The semantics of any service type provided by the local application do not match. Based on the fourth user input, a fifth prompt is displayed on the conversation interface; wherein the fifth prompt is used to prompt the user to enter a preset instruction. , the semantics of the preset instruction match the semantics of at least one fifth service type provided by the local application.
  • the service types provided by the local application may include a first type of service that does not require necessary service parameters when executed, and a second type of service that requires necessary service parameters when executed.
  • the semantics of the user input content can be matched with the semantics of the name of the service type. If they do not match, it means that the semantics of the user input content do not match the semantics of the first type of service.
  • the semantics of the user input content can be matched with the semantics of the name of the service type, and the service type The semantics of the necessary service parameters are matched respectively. If the semantics of the user input content neither match the semantics of the name of the service type nor the semantics of the necessary service parameters of the service type, it means that the semantics of the user input content do not match. Matches the semantics of the second type of service.
  • semantics of the user input content does not match the semantics of the first type of service and does not match the semantics of the second type of service, it means that the semantics of the user input content is consistent with the semantics of any service type provided by the local application. None of them match, indicating that the instructions entered by the user are incorrect and no services can be triggered.
  • the mobile phone can prompt the user to enter a preset instruction that can match the semantics of at least one service type, thereby prompting the user to enter a correct instruction that can determine at least one service type to correct the wrong instruction entered by the user.
  • the fifth service type may be the above-mentioned first type of service or the above-mentioned second type of service, which is not limited in this application.
  • the fifth service type may be the same as or different from any of the above-mentioned first to fourth service types, and this application does not limit this.
  • the semantics of the first character of the preset instruction match the first character input by the fourth user.
  • the first character of the preset instruction can be semantically matched with the first character of the user input content, thereby not only achieving the effect of correcting the correct instruction entered by the user, but also achieving The effect of prompting the user with instructions they may expect to enter.
  • displaying the response result on the conversation interface includes: displaying the response result in the form of a conversation message on the conversation interface.
  • the mobile phone can use the response result of the target application to the target service and trigger the target when the user inputs In the session interface of the service instructions, they are displayed in the form of session messages, so that the user does not need to repeatedly enter the instructions for calling the target service, and it is convenient for the user to share the execution results of the target service in the session through the session messages. .
  • the method further includes: in response to the received fifth user input, displaying the target application The target interface; wherein the fifth user input includes input to the response result, and the target interface includes the execution result.
  • the user inputs "Search for XX TV series", and the video application executes the video search service to search for the video resource of the TV series named "XX" and displays the play card of the video resource on the session interface. Then, the user clicks the play card of the video resource in the session interface, and the mobile phone can jump to the display interface of the video application.
  • the application interface can include the video resource searched by the video application.
  • the video resource may include the video playback interface of "XX TV series” and/or the playback introduction of the "XX TV series” and other information, which is not limited by this application.
  • the video resource can be any form of search result information for "XX TV series" by the video application.
  • the play card may include video attribute information such as play link, video name, video introduction, etc. This application does not limit this.
  • a user when a user triggers a certain service, he does not need to enter the application interface that provides the service to perform a service search operation. He only needs to enter instructions that can trigger the service in the session interface provided by this application to realize the provision of the service.
  • the service's application calls the service.
  • the user when the user needs to browse the execution results of the target application for the target service, the user can trigger input to the session interface, and the mobile phone can display the target interface of the target application.
  • the target interface may include the execution results of the target application for the target service.
  • the conversation interface includes the preset mark displayed in the form of a first preset control.
  • This application displays the preset mark in the form of a control, which can facilitate the user to quickly locate the position of the preset mark in the session interface, and facilitate the operation of the preset mark to search for the service type corresponding to the preset mark.
  • any prompt in the conversation interface is displayed in the form of a second preset control.
  • This application displays the prompts in the form of a control, which can facilitate the user to distinguish the prompts from the content input by the user, and prevent the user from confusing the user input instructions with the prompts provided by the mobile phone when inputting text.
  • the first preset control and/or the second preset control includes but is not limited to at least one of the following: bubble, list, hyperlink, Floating window, conversation message, text box.
  • This application can display prompts and/or preset marks through different types of controls, so that users can distinguish prompts and preset marks through controls, or distinguish different prompts, or distinguish different preset marks, and also improve
  • the mobile phone prompt content (including preset marks and/or prompt words) is diversified.
  • embodiments of the present application provide a service invoking method applied to a first electronic device.
  • the method includes: receiving a first user input in a conversation interface, wherein the conversation interface is the first electronic device. Equipment and The conversation interface of the second electronic device; displaying a response result to the first user input on the conversation interface; wherein the response result is obtained by the first electronic device or the second electronic device from a server
  • the response result is the execution result of the target service by the server, wherein the execution result is the execution result of the server based on the preset condition for triggering the target service when detecting that the first user input satisfies the preset condition of triggering the target service.
  • the first user inputs a result of executing the target service.
  • the first electronic device can be a mobile phone
  • the second electronic device can be a smart screen.
  • the mobile phone and the smart screen log in to the same account, and/or when connected to the same Wi-Fi network
  • the mobile phone can display the communication between the mobile phone and the smart screen.
  • Interactive conversational interface can be a server for a mobile phone or a server for a smart screen. This application does not limit this.
  • the server is a server for a smart screen as an example for explanation.
  • the first electronic device and the second electronic device are not limited to mobile phones and smart screens, but can also be any two electronic devices that can interact, and this application does not limit this.
  • the mobile phone can send instructions to the smart screen, and the smart screen can execute the instructions sent by the mobile phone.
  • the session interface can display the response result obtained by the mobile phone or smart screen from the server, and the response result is the execution of the target service by the server. result.
  • the mobile phone can send the instructions input by the user to the server of the smart screen.
  • the server determines that the user input instructions meet the triggering conditions for the target service, the server can execute the target service to obtain the response result.
  • the server can return the response result to the mobile phone, and the mobile phone can display the response result on the session interface.
  • the mobile phone can send the instructions entered by the user to the smart screen.
  • the smart screen can send a request to the server of the smart screen based on the user input content.
  • the server determines that the user input instruction reaches the triggering condition for the target service, it can execute the target. service to get the response result.
  • the server can return the response result to the smart screen. Then, the smart screen sends the response result to the mobile phone to display on the conversation interface.
  • the user can input an instruction that can trigger the target service in the conversation interface where the first electronic device interacts with the second electronic device, and the server executes the target service based on the instruction, and the first electronic device
  • the session interface on the side displays the response result of the server after executing the target service.
  • the above response result may also be the execution result of the target service by the first electronic device (such as a mobile phone), wherein the execution result is that the first electronic device detects the When the first user input satisfies the preset condition for triggering the target service, the result of executing the target service is based on the first user input.
  • the first electronic device such as a mobile phone
  • the above response result may also be the execution result of the target service by the second electronic device (such as a smart screen), wherein the execution result is the execution result of the second electronic device after detecting the When the first user input satisfies a preset condition for triggering the target service, the result of executing the target service is based on the first user input.
  • the smart screen can send the response result to the mobile phone, and the mobile phone can display the response result on the conversation interface.
  • the method further includes: receiving a third user input in the conversation interface; displaying a third prompt and/or a fourth prompt in the conversation interface; wherein the first prompt And/or the second prompt is a prompt generated by the server when it detects that the semantics of the third user input match the semantics of the preset mark.
  • the service type provided by the server includes at least one fourth service type corresponding to the preset mark; wherein, the third prompt is used to indicate that the user is in the at least one fourth service type.
  • Select a service type; the fourth prompt is used to instruct the user to input a second instruction, where the second instruction is an instruction for triggering a service of the fourth service type.
  • the execution result is that when the server detects that the semantics of the first user input matches the semantics of the only second service type, Based on the first user input, the execution result of the target service of the second service type; wherein the first preset service type provided by the server includes the second service type, and the first preset service type It is assumed that services of service type are executed by the server without service parameters.
  • the execution result is that the server detects that the semantics of the first user input match the semantics of the only third service type, and When the semantics input by the first user includes a second service parameter, the execution result of the target service of the third service type; wherein the second service parameter is the execution result of the third service type by the server. Parameter information required for the service.
  • the method further includes: receiving a fourth user input in the conversation interface; displaying a fifth prompt in the conversation interface; wherein, The fifth prompt is a prompt generated based on the fourth user input when the server detects that the semantics of the fourth user input do not match the semantics of any service type provided by the server; wherein , the fifth prompt is used to prompt the user to input a preset instruction, and the semantics of the preset instruction match the semantics of at least one fifth service type provided by the server.
  • the semantics of the first character of the preset instruction match the first character input by the fourth user.
  • displaying the response result on the conversation interface includes:
  • the response result is displayed on the conversation interface in the form of a conversation message.
  • the method further includes: receiving in the conversation interface The fifth user input; displaying the target interface; wherein the fifth user input includes input of the response result, and the target interface includes the execution result of the target service by the server.
  • the conversation interface includes a first The preset mark is displayed in the form of a preset control.
  • any prompt in the conversation interface is displayed in the form of a second preset control.
  • the first preset control and/or the second preset control includes but is not limited to at least one of the following: bubble, list, hyperlink, Floating window, conversation message, text box.
  • the second aspect and any implementation manner of the second aspect respectively correspond to the first aspect and any implementation manner of the first aspect.
  • the technical effects corresponding to the second aspect and any implementation manner of the second aspect may be referred to the technical effects corresponding to the above-mentioned first aspect and any implementation manner of the first aspect, which will not be described again here.
  • inventions of the present application provide an electronic device.
  • the electronic device includes: a memory and a processor, the memory is coupled to the processor; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the first aspect and the method in any implementation of the first aspect, or perform the second aspect and the method in any implementation of the second aspect.
  • embodiments of the present application provide a computer-readable medium for storing a computer program.
  • the electronic device When the computer program is run on an electronic device, the electronic device causes the electronic device to execute the first aspect and the first aspect.
  • the method in any implementation manner, or performing the second aspect and the method in any implementation manner of the second aspect.
  • embodiments of the present application provide a computer program product containing instructions.
  • the computer program product When the computer program product is run on a computer, it causes the computer to execute the first aspect and any one of the implementation methods of the first aspect.
  • the method in the second aspect or perform the method in the second aspect and any one of the implementation manners of the second aspect.
  • embodiments of the present application provide a chip, which includes one or more interface circuits and one or more processors; the interface circuit is used to receive signals from a memory of an electronic device and send them to the processor.
  • the processor sends the signal, and the signal includes computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device is caused to execute the first aspect and any one of the implementation manners of the first aspect. method, or perform the method in the second aspect and any one of the implementation manners of the second aspect.
  • embodiments of the present application provide a system, including a first electronic device, a second electronic device, and a server as described in the second aspect and any implementation manner of the second aspect.
  • Figure 1 is one of the structural schematic diagrams of an exemplary electronic device
  • Figure 2 is a schematic diagram of the software structure of an exemplary electronic device
  • Figure 3 is an exemplary service interaction interface of an electronic device
  • Figure 4 is an exemplary service interaction interface of an electronic device
  • Figure 5 is an exemplary architecture diagram of an electronic device
  • Figure 6a is an exemplary flow chart showing an electronic device providing services
  • Figure 6b is an exemplary flow chart showing an electronic device providing services
  • Figure 6c is an exemplary flow chart showing an electronic device providing services
  • Figure 6d is an exemplary flow chart showing an electronic device providing services
  • Figure 6e is an exemplary flow chart showing an electronic device providing services
  • Figure 7a is an exemplary flow chart showing an electronic device providing services
  • Figure 7b is an exemplary flow chart showing an electronic device providing services
  • Figure 7c is an exemplary flow chart showing an electronic device providing services
  • Figure 7d is an exemplary flow chart showing an electronic device providing services
  • Figure 7e is an exemplary flow chart showing an electronic device providing services
  • Figure 7f is an exemplary flow chart showing an electronic device providing services
  • Figure 7g is an exemplary flow chart showing an electronic device providing services
  • Figure 8a is a schematic diagram illustrating an exemplary application scenario
  • Figure 8b is a schematic diagram illustrating an exemplary application scenario
  • Figure 8c is a schematic diagram illustrating an exemplary application scenario
  • Figure 9a is a schematic diagram illustrating an exemplary application scenario
  • Figure 9b is a schematic diagram illustrating an exemplary application scenario
  • Figure 9c is a schematic diagram illustrating an exemplary application scenario
  • Figure 10 is a schematic structural diagram of a device provided by an embodiment of the present application.
  • a and/or B can mean: A exists alone, A and B exist simultaneously, and they exist alone. B these three situations.
  • first and second in the description and claims of the embodiments of this application are used to distinguish different objects, rather than to describe a specific order of objects.
  • first target object, the second target object, etc. are used to distinguish different target objects, rather than to describe a specific order of the target objects.
  • multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.
  • FIG. 1 shows a schematic structural diagram of an electronic device 100 .
  • the electronic device 100 shown in Figure 1 is only an example of an electronic device.
  • the electronic device 100 can be a terminal, which can also be called a terminal device.
  • the terminal can be a cellular phone or a tablet computer.
  • Devices such as (pad), wearable devices or Internet of Things devices are not limited in this application.
  • the electronic device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations.
  • the various components shown in Figure 1 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.
  • the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2.
  • Mobile communication module 150 wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, And subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) wait.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • NPU neural-network processing unit
  • different processing units can be independent devices or integrated in one or more processors.
  • the controller may be the nerve center and command center of the electronic device 100 .
  • the controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.
  • the processor 110 may also be provided with a memory for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 110 . If the processor 110 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 110 is reduced, thus improving the efficiency of the system.
  • processor 110 may include one or more interfaces.
  • Interfaces may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver and transmitter (universal asynchronous receiver/transmitter (UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and /or universal serial bus (USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • UART universal asynchronous receiver and transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB universal serial bus
  • the USB interface 130 is an interface that complies with the USB standard specification, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.
  • the USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through them. This interface can also be used to connect other electronic devices, such as AR devices, etc.
  • the interface connection relationships between the modules illustrated in the embodiments of the present application are only schematic illustrations and do not constitute a structural limitation of the electronic device 100 .
  • the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • the charging management module 140 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the charging management module 140 may receive charging input from the wired charger through the USB interface 130 .
  • the charging management module 140 may receive wireless charging input through the wireless charging coil of the electronic device 100 . While the charging management module 140 charges the battery 142, it can also provide power to the electronic device through the power management module 141.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, wireless communication module 160, etc.
  • the power management module 141 can also be used to monitor battery capacity, battery cycle times, battery health status (leakage, impedance) and other parameters.
  • the power management module 141 may also be provided in the processor 110 .
  • the power management module 141 and the charging management module 140 may also be provided in the same device.
  • the wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example: Antenna 1 can be reused as a diversity antenna for a wireless LAN. In other embodiments, antennas may be used in conjunction with tuning switches.
  • the mobile communication module 150 can provide solutions for wireless communication including 2G/3G/4G/5G applied on the electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, perform filtering, amplification and other processing on the received electromagnetic waves, and transmit them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves through the antenna 1 for radiation.
  • at least part of the functional modules of the mobile communication module 150 may be disposed in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 may be combined with at least part of the modules of the processor 110 are set up in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194.
  • the modem processor may be a stand-alone device.
  • the modem processor may be independent of the processor 110 and may be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT), and global navigation satellites.
  • WLAN wireless local area networks
  • System global navigation satellite system, GNSS
  • frequency modulation frequency modulation, FM
  • near field communication technology near field communication, NFC
  • infrared technology infrared, IR
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is an image processing microprocessor and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 194 is used to display images, videos, etc.
  • Display 194 includes a display panel.
  • the display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • AMOLED organic light-emitting diode
  • FLED flexible light-emitting diode
  • Miniled MicroLed, Micro-oLed, quantum dot light emitting diode (QLED), etc.
  • the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
  • the electronic device 100 can implement the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • Camera 193 is used to capture still images or video.
  • the object passes through the lens to produce an optical image that is projected onto the photosensitive element.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. Such as saving music, videos, etc. files in external memory card.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes instructions stored in the internal memory 121 to execute various functional applications and data processing of the electronic device 100 .
  • the internal memory 121 may include a program storage area and a data storage area. Among them, the stored program area can store the operating system and at least one application program required for the function (such as sound playback function, image playback function, etc.) functions, etc.) etc.
  • the storage data area may store data created during use of the electronic device 100 (such as audio data, phone book, etc.).
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), etc.
  • the electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playback, recording, etc.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .
  • the buttons 190 include a power button, a volume button, etc.
  • Key 190 may be a mechanical key. It can also be a touch button.
  • the electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .
  • the motor 191 can generate vibration prompts.
  • the motor 191 can be used for vibration prompts for incoming calls and can also be used for touch vibration feedback.
  • touch operations for different applications can correspond to different vibration feedback effects.
  • the motor 191 can also respond to different vibration feedback effects for touch operations in different areas of the display screen 194 .
  • Different application scenarios such as time reminders, receiving information, alarm clocks, games, etc.
  • the touch vibration feedback effect can also be customized.
  • the indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, or may be used to indicate messages, missed calls, notifications, etc.
  • the SIM card interface 195 is used to connect a SIM card.
  • the SIM card can be connected to or separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 .
  • the electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the plurality of cards may be the same or different.
  • the SIM card interface 195 is also compatible with different types of SIM cards.
  • the SIM card interface 195 is also compatible with external memory cards.
  • the electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications.
  • the electronic device 100 uses an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .
  • the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiment of this application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 .
  • FIG. 2 is a software structure block diagram of the electronic device 100 according to the embodiment of the present application.
  • the layered architecture of the electronic device 100 divides the software into several layers, and each layer has clear roles and division of labor.
  • the layers communicate through software interfaces.
  • the Android system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime and system libraries, and kernel layer.
  • the application layer can include a series of application packages.
  • the application package can include camera, gallery, calendar, calling, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
  • the application framework layer provides an application programming interface (API) and programming framework for applications in the application layer.
  • API application programming interface
  • the application framework layer includes some predefined functions.
  • the application framework layer can include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
  • a window manager is used to manage window programs.
  • the window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make this data accessible to applications.
  • Said data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
  • the view system includes visual controls, such as controls that display text, controls that display pictures, etc.
  • a view system can be used to build applications.
  • the display interface can be composed of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide communication functions of the electronic device 100 .
  • call status management including connected, hung up, etc.
  • the resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, etc.
  • the notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a beep sounds, the electronic device vibrates, the indicator light flashes, etc.
  • the system library and runtime layer include system libraries and Android Runtime.
  • System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing libraries (for example: OpenGL ES), 2D graphics engines (for example: SGL), etc.
  • the 3D graphics library is used to implement three-dimensional graphics drawing, image rendering, composition and layer processing, etc.
  • the Android runtime includes core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
  • the core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android.
  • the application layer and application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and application framework layer into binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing.
  • 2D Graphics Engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
  • the components included in the system framework layer, system library and runtime layer shown in Figure 2 do not constitute Specific limitations for the electronic device 100.
  • the electronic device 100 may include more or fewer components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently.
  • electronic devices provide more and more services to users (such as video playback services, e-commerce shopping services, music playback services, radio playback services, etc.).
  • the electronic device can provide an interactive interface for users to select or input required services in the interactive interface.
  • FIG. 3 illustrates a service interaction interface of an electronic device to provide services to users.
  • the display interface of the mobile phone is the interactive interface 201 of the official account of "XX E-commerce".
  • the interactive interface 201 provides a menu control 206.
  • the menu control 206 specifically includes a "Fans Welfare” control 202, a "Shopping” control 203, and "My Services" Each control in the control 204 and the menu control 206 can be used to provide at least one service to the user after being triggered by the user.
  • the mobile phone when the user clicks the "Fan Welfare" control 202, the mobile phone can display the service content of the fan welfare.
  • the mobile phone may display a submenu above the "My Services" control 204 in response to the user operation.
  • Control 205 may include a "Check Order Logistics" control, a "My Shopping Cart” control, a "Consult Customer Service” control, and a "Shipment Service” control.
  • the user can click on any control in the submenu control to trigger the service corresponding to the control.
  • the "Check Order Logistics” control is used to provide query services for order logistics status after being triggered
  • the "My Shopping Cart” control is used to provide services for viewing the contents of the user's shopping cart
  • the "Consult Customer Service” control is used to provide After being triggered, it is used to provide customer service services. After the “Shipment Service” control is triggered, it is used to provide shipping services.
  • the electronic device provides services to the user in the form of a menu in the interactive interface.
  • the user can click on an option in the menu (such as the "Shopping” control 203), or click on a submenu of the menu. options (such as the "Shipment Service” control) to obtain service content.
  • the mobile phone can display service setting instructions (such as "shopping", “my shopping cart”, “consult customer service” and other instructions in Figure 3) in the form of buttons or menus on the interactive interface, and the user can Trigger relevant command operations by clicking buttons or menus to trigger corresponding services.
  • the menus that can be accommodated in the interactive interface are limited, so the number of services that the mobile phone can provide in the interactive interface is limited.
  • the services involved in submenus such as the submenu control 205 are relatively hidden. Only when the user clicks the corresponding option in the menu at the upper level can the mobile phone display the service instructions involved in the submenu, making the service provision method inflexible. .
  • Figure 4 exemplarily shows a service interaction interface of an electronic device to provide services to users.
  • the display interface 101 of the mobile phone includes multiple controls.
  • the multiple controls include: text input box control 103, search control 102, keyboard control 105, and voice control 104.
  • the user can input instructions in the text input box control 103 by operating the keyboard control 105.
  • the user can click the search control 102, and the mobile phone can search for service content in response to the user's input instructions.
  • the user can click the voice control 104 to send instructions to the mobile phone by voice.
  • the mobile phone can respond to the user's operation and recognize the voice instructions input by the user to search for service content.
  • the electronic device provides a text input box or voice input portal in the service interaction interface for users to input text or voice content to trigger relevant instructions.
  • the mobile phone can thus trigger relevant instructions based on the user input content.
  • Serve. In this method of purely autonomous input of instructions, the input content is completely determined by the user.
  • the user input content is highly uncertain. It requires high recognition capabilities of the mobile phone and the cost of using the mobile phone system is high.
  • the instructions recognized by the mobile phone system for the user input content may easily not match the instructions the user expects to input, so that the services recommended by the mobile phone based on the recognized instructions may easily deviate from the services expected by the user, resulting in the service recommended by the system. problem of poor accuracy.
  • this application provides an electronic device.
  • the electronic device may include an information recommendation system and a service module that interacts with the information recommendation system.
  • the electronic device Taking the electronic device as a mobile phone as an example illustrate.
  • the service module may include system services and/or third-party services registered to the information recommendation system.
  • the information recommendation system of this application can provide registered services to users.
  • system services can be used to represent system-related services provided by the mobile phone, such as alarm clock service, calendar service, etc.
  • Third-party services are used to represent services provided by third-party applications.
  • video applications can provide video playback services
  • music applications can provide music playback services
  • map applications can provide navigation services.
  • third-party applications are used to represent applications that are not developed on the mobile phone platform.
  • the information recommendation system may include an identification module, a recommendation module, an execution module, an input and output module, a session and a service display module.
  • the input and output module can be used to display prompts and receive user input.
  • the recognition module can be used to perform semantic recognition on the input content received by the input and output module.
  • the recommendation module can be used to determine whether the service can be triggered based on the semantics identified by the recognition module. When the service cannot be triggered, a prompt is generated based on the above semantics and the service content that the registered service can provide, and the prompt is sent to the input and output module.
  • the execution module can be used to call the corresponding service interface to trigger the service when the recommendation module determines that the service can be triggered.
  • the session and service display module can display the response results of the system or third-party services to the called services to the user interaction interface.
  • the information recommendation system may have more or fewer modules than shown in Figure 5, may combine two or more modules, or may have different module configurations.
  • the various modules shown in Figure 5 may be implemented in software including one or more signal processing and/or application specific integrated circuits.
  • Each module in the information recommendation system can be merged or split, and each module can be partially or fully set in the application layer or application framework layer shown in Figure 2.
  • each module in the information recommendation system can be used as a new module in the application layer or application framework layer, or the functions provided by the modules of this application can be added to existing relevant modules.
  • the architectural configuration of the information recommendation system shown in Figure 2 in this application is not limited to the architecture of the Android system shown in Figure 2, and can also be applied to the architecture of Hongmeng system or IOS system, that is, this application is for information There are no restrictions on the architectural configuration of the recommended system.
  • the information recommendation system can be implemented in the application layer in Figure 2, and this application can implement the functions of this application by providing an application (Application, App).
  • the information recommendation system can be implemented in the application framework layer in Figure 2, so that existing applications in the electronic device can increase the functions of the information recommendation system.
  • the following describes the registration method for system services and/or third-party services to register with the information recommendation system:
  • a preset statement can be added to the configuration file of the system or third-party application service to register the service to this information recommendation system.
  • the information recommendation system of this application can determine the target service with a preset statement added by scanning or querying the configuration file of the system or third-party application.
  • the target service can be determined as the system or third-party application registered to the information recommendation system of this application.
  • the video playback service component of the video application is configured to support the "android.intent.action.VIEW” behavior.
  • the information recommendation system of this application scans/queries the system Declaring a service that supports the "android.intent.action.VIEW” behavior, it can be determined that the video application has registered a video playback service.
  • the system or third-party application configures the information of the service type registered to this information recommendation system (such as playing music, playing videos, booking hotels, etc.) in the configuration file.
  • the information recommendation system of this application scans the configuration file of the local application or system. It is possible to determine the types of services that a local application or system has registered to this information recommendation system.
  • the information recommendation system of this application learns the service type of the local application or system that has been registered to the information recommendation system of this application by scanning and parsing the configuration file of the local application or system.
  • the supported service types have been configured in the configuration file of the third-party application.
  • This application can obtain the service types supported by each application (that is, registered to the information recommendation system of this application) from the application market.
  • the recommendation module in Figure 5 can obtain service information registered to the information recommendation system of this application from the service module.
  • registration method for system services and/or third-party services to register with the information recommendation system is not limited to the above examples, and may also include more registration methods, which will not be described again here.
  • FIG. 6a illustrates a flow chart of services provided by an electronic device.
  • FIG. 6a will be described below in conjunction with FIG. 5 .
  • the process may include the following steps:
  • S301 The mobile phone performs semantic recognition on the user input content and determines the semantics.
  • the information recommendation system of the present application can provide a window for user interaction, and the user can input instructions in the window, so that the input and output module receives user input content.
  • the input and output module can send user input content to the recognition module.
  • the user input content may include the user's real-time input content before triggering the sending operation of the input content.
  • the user inputs content in the text input control 103 in Figure 4.
  • the user Real-time input content can be received by the input and output module and sent to the recognition module in real time.
  • the user input content may also include the user triggering the sending operation of the input content. subsequent user input.
  • the recognition module can perform semantic recognition on the user input content to determine the semantics.
  • the recognition module can preset or request the corpus in real time to perform semantic analysis on the user input content to determine the semantics.
  • S303 The mobile phone determines whether there is a service type matching the semantics.
  • the recognition module can send the recognized semantics to the recommendation module, and the recommendation module can determine whether there is any content related to the above in the registered service types (which can include system services and/or third-party services). Semantically matched service types.
  • the service type in S303 may be the service type of the service that the user may wish to call.
  • the recommendation module can determine that the service type that semantically matches the user's input content is a search video service.
  • the recognition module can detect whether there is content similar to the semantics of the service type in the user's semantics. If the recognition module detects the content, it can determine the service type that matches the semantics.
  • the user inputs "XX movie", and the registered services include video playback service and movie ticket ordering service. Both services have necessary service parameters, here is the video name, then the recommendation module can also combine the semantics of the user input content with The necessary service parameters of each service type are matched to determine the service type corresponding to the semantically matching necessary service parameters.
  • This service type is the service type of the service that the user may wish to call, such as the above-mentioned video playing service and movie ticket ordering service.
  • the recommendation module can match the semantics of the user input content with the semantics of the preset information of the service type of the registered service, where the preset information of the registered service type can include but is not limited to : Service type, and/or, required service parameters of the service type.
  • the recommendation module may then determine the candidate service types among the registered service types as service types that match the semantics of the user input content. That is, the service type of the service that the user may need to call.
  • the semantics of the preset information of the candidate service type match the semantics of the user input content (for example, the semantic similarity is greater than the preset similarity threshold).
  • the recognition module can also determine the service type of services that the user may need based on the semantics of the user input content and further combined with known and available information such as user habits, user preferences, user portraits, user recent usage records, etc.
  • This application does not limit the way the identification module obtains information such as user habits, user preferences, user portraits, and user recent usage records.
  • the mobile phone determines that there is no service type matching the semantics, it means that the service type is missing in the user input content. For example, the instruction input by the user is incorrect and cannot be consistent with the semantics of any registered service type. If matched, the mobile phone proceeds to execution S309 to prompt the user to enter the correct command. Among them, the semantics of the correct instruction can match at least one service type.
  • the recommendation module can send the prompt to the input and output module, and the input and output module can output the prompt according to a certain prompt form.
  • the prompt can be used with the user in the information recommendation system. Displayed in the interactive window.
  • prompt forms may include but are not limited to: bubbles, lists, hyperlinks, floating windows, etc.
  • the recommendation module can send the prompt form of the prompt to the input and output module.
  • the mobile phone may proceed to S305.
  • S305 The mobile phone determines whether the semantics meets the preset conditions for triggering services of this service type.
  • the recommendation module can further determine whether the semantics can satisfy the preset conditions for triggering the service of the service type.
  • the preset conditions mentioned in S305 in Figure 6a may include:
  • the service type is a first service type (the first type of service requires necessary service parameters when triggered), and the semantics contains the same service type as the first service type.
  • the first service type is a video playback service
  • a necessary service parameter of this service is the video name.
  • the service type is a second service type.
  • This second type of service does not require necessary service parameters when triggered.
  • the service type of the calendar application's calendar viewing service is the second service type.
  • the mobile phone may first determine whether the service type matching the semantics is the first service type or the second service type.
  • the mobile phone determines that the service type matching the semantics is the first service type, it continues to determine whether the necessary service parameters corresponding to the first service type are missing in the semantics. If the necessary service parameters are missing, it is determined that the semantics does not satisfy the preset Conditions, if the necessary service parameters are not missing, it is determined that the semantics meets the preset conditions.
  • the mobile phone determines that the service type matching the semantics is the second service type, it is determined that the semantics satisfies the preset conditions.
  • the recommendation module determines that the semantics can meet the preset conditions for triggering services of this service type, indicating that the service can be triggered, and the mobile phone proceeds to execution S307.
  • the recommendation module determines that the service type matching the semantics is the first service type and the semantics contains necessary service parameters of the first service type, it means that the service can be triggered.
  • the recommendation module determines that the service type matching the semantics is the second service type, it means that the service can be triggered.
  • the recommendation module can notify the recognition module that the semantics it recognizes can trigger the service, the recognition module can notify the execution module to trigger the service, and the execution module can call the corresponding service in the service module.
  • the service module can send the call result after the service is called to the session and service display module.
  • the session and service display module can generate service card information based on the call result, and send the service card information to the input and output module, so that the input and output module displays the service card in the window.
  • the service card information may include response result information after the service is called.
  • the response result may be calendar holiday information.
  • the response result may include the playback link of a video requested by the user and the attribute information of the video.
  • the recommendation module determines that the semantics cannot meet the preset conditions for triggering the service of this service type, indicating that the service cannot be triggered, and the mobile phone proceeds to execution S309 to output a prompt.
  • the recommendation module determines that the service type matching the semantics is the first service type, and the semantics lacks necessary service parameters, that is, the semantics does not meet the above preset conditions, the recommendation module can be based on the user missing in the semantics. Information about triggering the service of this service type is used to generate prompts to prompt the user to complete the instructions that can trigger the service and quickly trigger the service.
  • Scenario 1 The user input content corresponds to multiple service types.
  • Figure 6b exemplarily shows the operation flow chart of the mobile phone in the case where the mobile phone determines that the semantics do not meet the preset conditions for triggering the service of the service type in Figure 6a.
  • the mobile phone can execute S706 and S707.
  • S706 The mobile phone determines that there are multiple service types matching the semantics.
  • S707 The mobile phone determines the first prompt based on multiple service types.
  • the first prompt is used to prompt the user to select one service type among multiple service types.
  • the recommendation module determines that there are multiple service types matching the semantics, the recommendation module determines that the semantics cannot satisfy the preset conditions for triggering services of the service type, thereby determining the first prompt.
  • the recommendation module may determine the first prompt based on the multiple service types, optionally further combined with information such as user habits, user preferences, user portraits, user recent usage records, etc.
  • Embodiment 1 The process shown in Figure 6b can be understood with reference to the scenarios shown in Figures 7a and 8a. Scenario 1 in which there are multiple service types corresponding to the user input content is explained below in conjunction with Figures 7a and 8a:
  • Figure 8a exemplarily shows a schematic diagram of an application scenario.
  • the display interface 501 of the mobile phone can be a conversation interface of a group (here, a work group).
  • the display interface 501 includes one or more controls.
  • the controls include but are not limited to: " @" control 502, "#” control 503, "?” control 504, text input box control 505, voice control 509, message sending control 508, etc.
  • the input and output module can receive user input content, here is the information of the "@” control, and send the information of the "@" control to the identification module, and the identification module can identify the preset mark "@", and sends "@" to the recommendation module.
  • the recommendation module shown in Figure 7a may include a first mapping relationship 401 between preset tags and service types, and a second mapping relationship 402 between service types and keywords.
  • the first mapping relationship 401 may include a mapping relationship between preset tags and service types, where each preset tag may map to at least one service type, and the service types mapped by different preset tags may be different, so that the user can pass
  • the system can display keywords for different service type lists.
  • the service types mapped by different preset tags may have overlapping service types, so that the same service type can be passed through multiple preset tags. Search for services using any of the preset tags.
  • the service type list corresponding to "@" includes to-do implementation service, calendar viewing service, and video search service.
  • the list of service types corresponding to the "Send Command" control includes video playback services, video search services, and recently popular services. "Help" and "?” both correspond to the same service type list, which includes video playback service, video search service, recently popular service, TV screen capture service, and remote control service.
  • FIG. 7 a only illustrates part of the data in the first mapping relationship 401 , and the first mapping relationship 401 may include more or less mapping relationships between preset tags and service types than shown in the figure. , this application does not limit this.
  • the preset marks here may include but are not limited to “@”, “send command”, “help”, "?”, etc.
  • the preset mark does not show the "#” mark in Figure 8a, but the principle of the "#” mark is similar to the preset mark shown in Figure 7a, and will not be described again here.
  • Preset marks may include symbols, text, controls and other types of marks. This application does not limit the types of preset marks.
  • the preset marks (including but not limited to "@”, “send command”, “help”, "?”, “#) in the first mapping relationship 401 in Figure 7a can be the user's input box
  • the semantics of the input text content or the voice content input through the voice input portal can also be a specific control corresponding to the above-mentioned preset mark, and this application does not limit this.
  • the above-mentioned preset mark is a specific control.
  • the "@" control 502 can be the preset mark “@” or "#”.
  • Control 503 can be a preset mark "#”
  • control 504 can be a preset mark "?”.
  • the control 6031 is preset to mark "issue command”.
  • the "Help" control 803 is marked "Help” by default.
  • the implementation form of the above preset mark can not only be a specific control, but also the text content input by the user in the text box in the interactive interface or the voice content input through the voice input portal.
  • the input operation of the above-mentioned preset mark can also be realized, and the mobile phone can trigger the corresponding operation.
  • the keywords in the second mapping relationship 402 may be information related to the service type, and the keywords are used to prompt the user for the service type.
  • the keyword may be an action keyword in the service type (for example, the keyword of the to-do service is "to-do").
  • the keyword can also be the name of the service type.
  • the keyword of the to-do list service can also be "to-do list”. This application does not impose any restrictions on the specific content of the keywords, as long as it can achieve the function of prompting the service type.
  • the keywords of each service type in the second mapping relationship 402 can be provided by the system service or a third-party service when registering the service, or can be automatically configured by the information recommendation system in the mobile phone. This application does not Make restrictions.
  • the second mapping relationship 402 shown in FIG. 7a may include: the keyword of the to-do service is "to-do", the keyword of the viewing calendar service is “calendar”, and the keyword of the search video service is “search”, the keyword for the recently popular service is “recently popular”, the keyword for the TV screen capture service is “TV screen capture”, and the keyword for the remote control service is "remote control”.
  • FIG. 7a only illustrates part of the data in the second mapping relationship 402.
  • the second The mapping relationship 402 may include more or less mapping relationships between service types and keywords than shown in the figure, and this application does not limit this.
  • the recommendation module can respond to the user's operation of clicking the "@" control 502 in Figure 8a (1), and through the first mapping relationship 401, it can be determined that the service type list corresponding to the "@" mark includes a to-do service , view calendar services, search video services.
  • the recommendation module may determine according to the second mapping relationship 402 that the keyword corresponding to the to-do service is "to-do", the keyword corresponding to the calendar viewing service is "calendar”, and the keyword corresponding to the search video service is "search”.
  • the recommendation module can send the keywords "to-do", “calendar”, and “search” of each service type in the above-mentioned service type list and the prompt form of each keyword (here in the form of a list) to the input and output module.
  • the mobile phone can display the floating window control 506 by the input and output module in response to the user's operation of clicking the "@" control 502 in Figure 8a(1).
  • the floating window control 506 may include a list of keywords of the above service type list: @To Do, @Calendar, @Search.
  • the display method of the list of keywords in the service type list in this application is not limited to the method shown in the control 506, and this application does not limit the display method.
  • the mobile phone can narrow the scope of the searched services to a list of service types corresponding to the preset mark (here the "@" mark).
  • the mobile phone can prompt the user with the keywords of each service type in the service type list, so that the user can more clearly determine the service type by viewing the keywords and select the service type that needs to be triggered. .
  • the recommendation module can also send prompts for each service type in the service type list determined based on the "@" mark to the input and output module, as shown in Figure 8a(1), in the list of the floating window control 506
  • Each service type can include not only keywords, but also prompts indicating service parameters.
  • the prompt generated by the recommendation module for the to-do service is "to-do”
  • the prompt generated for the calendar service is "add item”
  • the prompt generated for the search video service is "enter the episode name”.
  • the user can not only browse to the keywords in the service type list corresponding to the "@" mark through the floating window control 506, but also see the content prompting the user to continue input, so that the user can complete the input content to meet the predetermined requirements for triggering the service. Set conditions to trigger corresponding services.
  • the display manner of prompts in various embodiments of the present application may be different from the display manner of content input by the user.
  • the text font size of the "@TO DO" floating window control 5061 in the floating window control 506 shown in Figure 8a(2) is different from the text font size of the corresponding prompt "TO DO” floating window control 5062.
  • the text font of the prompt "To-Do List” floating window control 5062 may be an italic font.
  • the text of the "@TO DO" floating window control 5061 in the floating window control 506 shown in Figure 8a(2) can be displayed in dark color (for example, black), and the corresponding prompt "TO DO" floating window control
  • the text of 5062 can be displayed in a light color (e.g. gray). This makes it easier for the user to distinguish between the content that the user has entered and the content that the mobile phone prompts to enter.
  • the ways for the user to trigger the display of relevant information of the service type list by inputting a preset mark may include but are not limited to: Method 1 and Method 2.
  • Method 1 The user can input the preset mark "@” by operating, for example, the text input box control 505 shown in Figure 8a (1), or input the voice of "@" through the voice control 509, so that the mobile phone can display Figure 8a
  • the interface shown in (2) is to improve service search efficiency.
  • Method 2 The user can enter the preset mark "@” by clicking the "@" control 502 as shown in Figure 8a(1) to avoid searching for service types through Method 1, which affects the user's voice or text input experience. .
  • This method Can improve user input experience.
  • Embodiment 2 The process shown in Figure 6b can also be understood with reference to the scenarios shown in Figures 7a, 7e, 9a and 9b. The process will be described below in conjunction with Figures 7a and 9a, as well as Figures 7e and 9b.
  • Scenario 1 that is, the scenario where the user input content corresponds to multiple service types:
  • Figure 9a exemplarily shows a schematic diagram of an application scenario.
  • the display interface 601 of the mobile phone can be a conversation interface for interaction between the mobile phone and the smart screen.
  • the display interface 601 includes one or more controls.
  • the controls include but are not limited to: command and message controls. 602. Text input box control 505, voice control 509, message sending control 508, etc.
  • the mobile phone can display a floating window control 603 in response to the user operation.
  • the floating window control 603 includes controls for sending instructions. 6031, and controls 6032 for sending messages.
  • the display interface 601 is an interactive interface between a mobile phone and a smart screen.
  • the display interface 601 of the mobile phone can be in the command sending mode interface.
  • the mobile phone can send commands to the smart screen to search and trigger the smart screen.
  • the services provided are exemplary.
  • Figure 9a(3), Figure 9b, and Figure 9c are all interfaces in the instruction sending mode.
  • the display interface 601 of the mobile phone can be in the command sending mode interface, and the mobile phone can send a message to the smart screen.
  • This message is an interactive message between the two ends and is not used for searching or triggering services.
  • Figure 9a (1 ) is the interface for message sending mode.
  • the mobile phone can display the control 604 in the display interface 601 in response to the user operation, where , the control 604 includes keywords of the service type list corresponding to the preset mark "issue command", and each keyword is displayed in a bubble.
  • the input and output module can receive a user input operation.
  • the user input operation here is the input of the user clicking on the "Send Instruction" control (ie, control 6031 in Figure 9a(2)). operate.
  • the input and output module can send the information of the control 6031 to the recognition module, and the recognition module can recognize the "send command” and send the "send command” to the recommendation module.
  • the recommendation module can respond to the user's operation of clicking the control 6031 in Figure 9a (1), and determine through the first mapping relationship 401 that the service type list corresponding to the preset mark "issue an instruction" includes video playback services, search Video services, recently popular services.
  • the recommendation module can determine, according to the second mapping relationship 402 in Figure 7a, that the keyword corresponding to the play video service is "play", the keyword corresponding to the search video service is "search”, and the keyword corresponding to the recently popular service is " Popular recently.”
  • the recommendation module can send the keywords "play”, “search”, "recent hits” of each service type in the above-mentioned service type list and the prompt form of each keyword (here in the form of bubbles) to the input and output module.
  • the mobile phone can display the control 604 by the input and output module in response to the user's operation of clicking the control 6031 in Figure 9a(2).
  • the control 604 may include bubbles of keywords of the above-mentioned service type list, such as the "Play" bubble 6041, the "Search" bubble 6042, and the "Recent Hot” bubble 6043.
  • each bubble displayed in the control 604 may be used to indicate that "! needs to continue to be entered when the corresponding service is triggered, while the bubbles without "! may be used to indicate that the corresponding service is triggered. No further instructions are required. For example, if the user clicks on the "recently popular" bubble 6043, the user does not need to continue to enter instructions to trigger the recently popular service. It is understandable that the user can also be prompted in other ways whether he or she needs to continue inputting instructions, and this application does not limit this.
  • the user can also enter "issue an instruction” in the text input box 505 shown in Figure 9a(1), or enter "issue an instruction” in the text input box 505 shown in Figure 8a(1).
  • Triggering the input of the preset mark "Send command” the mobile phone can also respond to the user operation and display the information of the keywords in the service type list corresponding to the "Send command” mark. The principle and display effect are the same and will not be described again here.
  • the user can click the "Play" bubble 6041.
  • the user can also input “play” by operating the keyboard control in the text input box control 505 in Figure 9a(3).
  • the mobile phone referring to Figure 9b(1) or Figure 9b(2), can display the text "Play” corresponding to the "Play" bubble 6041 selected by the user in the text input box control 505, and further in the text A prompt is displayed after the input cursor 507 of the input box control 505.
  • the input and output module can receive the user input content "Play” (for example, the "Play" bubble 6041 clicked by the user in Figure 9a(3), or the user's text input box in Figure 9a(3) Enter the text "play") into control 505 and send "play" to the recognition module.
  • the recognition module can send the semantics of "play” to the recommendation module.
  • the recommendation module can combine the semantics of "play” with the semantics of the registered service type. After matching, the recommendation module can determine the service type that matches the semantics of "play", which may include the video play service 4031 and the music play service 4032 shown in Figure 7e. That is, the mobile phone can determine multiple service types that match the semantics of the user input content.
  • the mobile phone If the mobile phone detects that there are still multiple service types that match the semantics of the instruction, it can continue to output prompts to remind the user to enter a unique service type until the semantics of the user input content reaches the trigger level of the service of the unique service type. condition.
  • the recommendation module when the recommendation module determines that there are multiple service types that match the semantics, the recommendation module can send a prompt for selecting the service type to the input and output module, for example, the prompt is: "video” or “Music”, as shown in Figure 9b(1), after the input cursor 507 of the text input box control 505, a prompt: "Video or Music” 5055 can be displayed to prompt the user to choose to play a video or play music.
  • the recommendation module can also send the determined service type (here, "play video service” and "play music service”) to the recognition module, so that when the recognition module recognizes the semantics of the updated user input content again, it can Refer to the service type determined based on the last user input content to perform semantic recognition to improve the accuracy of semantic recognition and reduce the user's repeated command input.
  • the determined service type here, "play video service” and "play music service
  • the recommendation module can be based on the multiple service types, as well as known and available information such as user habits, user preferences, user portraits, user recent usage records, etc. , among the multiple service types, determine the service type that the user may need to use. For example, the recommendation module automatically selects the video playback service that the user may need to use from the video playback service and the music playback service, combined with the user's recent habit of frequently searching for videos, so that the recommendation module determines the unique service type. Then the mobile phone can combine the process of Figure 6c to prompt the user with the information required to trigger the video playback service. For example, the prompt is "movie name" 5053 as shown in Figure 9b(2).
  • a prompt: "Movie Name” 5053 can be displayed to prompt the user to input the movie name of the video that needs to be played.
  • the recommendation module can also send the determined service type (here, "playing video service”) to the identification module.
  • the recognition module can refer to the service type determined based on the last user input content to perform semantic recognition, so as to improve the accuracy of semantic recognition and reduce the user's repeated command input.
  • the recommendation module determines the semantic matching with the user input content.
  • S301, S303, S305 and S309 shown in Figure 6a can be executed cyclically, so that the process in Figure 6b can be executed cyclically until the mobile phone matches the semantics of the user input content. If the service type is the only one, the process in Figure 6b ends.
  • the user only needs to operate the control corresponding to the preset mark, or input the text or semantics of the preset mark in the text input box or voice input portal, and the mobile phone can enter the preset mark.
  • the keywords of the service type list corresponding to the preset mark are output to the user as prompts, which can implement the recommendation of service instructions of the service type list corresponding to the preset mark, and can narrow the search scope of services for the user.
  • the user can select the service instruction of the required service among the recommended service instructions to complete the instruction input and optionally trigger the corresponding service by continuing to enter the instruction, which is convenient to operate.
  • Embodiment 3 The process shown in Figure 6b can also be understood with reference to the scenarios shown in Figure 7e and Figure 9a(3).
  • scenario 1 i.e. user input content
  • scenario 9a(3) Scenarios where the corresponding service types are multiple
  • the input and output module can receive the input content and send it to the recognition module.
  • the recognition module can recognize that the semantics of the user input content is that the movie name is "Movie Name 1", and the The semantics are sent to the recommendation module.
  • the recommendation module may include a third mapping relationship 403 between service types and service parameters. The service type and service parameters mapped to each other in the third mapping relationship 403 are used to represent the service parameters required when triggering the service of the service type.
  • the necessary service parameters of the to-do service include time and events
  • the necessary service parameters of the add-item service are time and events
  • the necessary service parameters of the search video service are video names
  • the necessary service parameters of the play video service are The necessary service parameters are the video name
  • the necessary service parameters for the music playing service are the song names
  • the necessary service parameters for the movie ticket ordering service are the video names
  • the necessary service parameters for the navigation service are the starting point and the end point.
  • each service parameter shown in the third mapping relationship 403 is only an example of the necessary service parameters of each service type.
  • the necessary service parameters of the movie ticket ordering service can be any service parameter with the semantics of a video name.
  • the necessary service parameters for ordering movie tickets can also be replaced by the movie name.
  • mapping relationship 403 only exemplarily shows the mapping relationship between some service types and their necessary service parameters.
  • the recommendation module of this application may also include more or less mapping relationships between service types and necessary service parameters. , this application does not limit this.
  • the service type may include a video playing service 4031 and a movie ticket ordering service 4033.
  • the service parameters of these two services are video names.
  • the recommendation module can determine the semantics of the user input content by matching the semantics of the user input content "Movie Name 1" with the semantics of the service parameters of each service type in the third mapping relationship 403, and the service parameters of the video playback service 4031. "Video Name”, and the service parameter "Video Name” of the movie ticket ordering service 4033 all match, thereby determining that there are multiple service types that match the semantics of the user input content (including the video playback service 4031 and the movie ticket ordering service 4033).
  • the mobile phone can also use the information of multiple service types (not limited to keywords) as a prompt as mentioned in the first or second embodiment.
  • multiple service types not limited to keywords
  • Provide verbal prompts for the user to select a service type or the mobile phone can automatically select a service that the user may need to use from multiple service types based on user habits, user preferences, user portraits, user recent usage records, etc. type, and generate prompts based on the missing information in the user input content to trigger the service type to prompt the user to enter a complete command.
  • Scenario 2 The service type corresponding to the user input content is unique, but the semantics of the user input content lack the semantics of the necessary service parameters of the service type.
  • Figure 6c exemplarily shows the operation flow chart of the mobile phone in the case where the mobile phone determines that the semantics do not meet the preset conditions for triggering the service of the service type in Figure 6a.
  • the mobile phone after the mobile phone executes S305 and before the mobile phone executes S309, the mobile phone can execute S708 and S709.
  • S708 The mobile phone determines that the service type matching the semantics is a first service type, but the semantics lacks necessary service parameters of the first service type.
  • S709 The mobile phone determines the second prompt based on the missing necessary service parameters.
  • the second prompt is used to prompt the user to supplementally input the above necessary service parameters.
  • the recommendation module determines that there is one service type that matches the semantics, but the necessary service parameters of the service type are missing from the semantics. Then the recommendation module determines that the semantics cannot satisfy the preset conditions for triggering the service of the service type, so that Determine the second prompt.
  • the recommendation module can optionally further combine information such as user habits, user preferences, user portraits, and user recent usage records based on the necessary service parameters of the unique service type that are missing from the semantics. , to determine the second prompt to prompt the user to enter a complete service instruction to trigger related services.
  • this application may also provide a fourth embodiment.
  • Embodiment 4 The process shown in Figure 6c can be understood with reference to the scenarios shown in Figures 7b, 8a, and 8b. Scenario 2 in which necessary service parameters are lacking is described below in conjunction with Figures 7b, 8a, and 8b:
  • FIG 8a(1) For example, please refer to Figure 8a(1).
  • the mobile phone displays the keywords and prompts for each service type in the service type list marked with "@”.
  • the floating window control 506 shown in Figure 8a(2) The user clicks the "@TO DO” floating window control 5061 in the floating window control 506 in Figure 8a(2), or the user can also input "TO DO” in the text input box control 505 according to the display content of the floating window control 506. or "@todo”.
  • the mobile phone can respond to the user operation by displaying "@To Do" as user input content in the text input box control 505, and setting the input cursor 507 after "@To Do".
  • the mobile phone can display a prompt 5051 after the input cursor 507 in the text input box control 505.
  • the text content of the prompt 5051 is "input time and event" to remind the user to complete the information for in the text input box control 505.
  • Service parameters that trigger the to-do service are "input time and event" to remind the user to complete the information for in the text input box control 505.
  • the input and output module can input the content to the user, here it is "@ To Do" Sent to the recognition module, the recognition module can recognize the semantics of the user input content, here is the semantics of "to-do"; then, the recognition module sends the semantics of "to-do" to the recommendation module.
  • the recommendation module can determine the service type whose semantics match the semantics of "to-do" among the registered service types. Here, the unique service type "to-do service” is matched.
  • the recommendation module may include a third mapping relationship 403 between service types and service parameters. The service type and service parameters mapped to each other in the third mapping relationship 403 are used to represent the service parameters required when triggering the service of the service type.
  • the recommendation module can be configured with service parameters of each registered service type (such as navigation service Service parameters include starting point and end point).
  • service parameters of each service type can be preset by the recommendation module, or the recommendation module can obtain or update it regularly or irregularly from the cloud (the cloud of the information recommendation system of this application), or the recommendation module can obtain it from the service provider. Obtain, this application does not impose restrictions on this.
  • the first mapping relationship, the second mapping relationship, the fourth mapping relationship described in various embodiments of this article configured in the recommendation module and the information that triggers the service type (ie, the second service type) that does not require service parameters can be determined by the same reason.
  • the recommendation module can be preset.
  • the recommendation module can also be obtained or updated regularly or irregularly from the cloud (the cloud of the information recommendation system of this application).
  • the recommendation module can also be obtained from the service provider. This application does not limit this.
  • the recommendation module can determine the necessary service parameters required for triggering the "to-do service” by querying the third mapping relationship 403.
  • the service parameters determined here are time and events.
  • the recommendation module can match the semantics of the service parameters necessary for the "to-do service” with the semantics of the user input content to determine whether the necessary service parameters are missing in the user input content. After matching, the recommendation module can determine The user input content lacks time and event information, so the prompt "Enter time and event" is generated and sent to the input and output module. As shown in Figure 8b(1), the input and output module can display the prompt 5051 ("Input time and event") in the text input box control 505.
  • the service type in the third mapping relationship 403 may be the first service type described in the preset conditions mentioned in the above embodiment, wherein when the service of the first service type is triggered, Necessary service parameters are required, for example, the necessary service parameters for the navigation service are the starting point and the ending point.
  • the service parameters in the third mapping relationship 403 are necessary service parameters of the corresponding service type.
  • the prompts generated by the recommendation module can also be "To-do items" as shown in Figure 7b.
  • the input and output module can display the prompts ("To-do items") as shown in Figure 8b(1).
  • the recommendation module when the recommendation module determines that the user input content lacks necessary service parameters of the corresponding service type, it can generate prompts based on user habits, user preferences, user portraits, user recent usage records, etc., to prompt the user to complete the instructions to complete the instructions. Complete the necessary service parameters that are missing.
  • the recommendation module can also send the information of the service type that matches the semantics, here "to-do service", to the recognition module, so that when the recognition module recognizes the semantics of the updated user input content again, you can refer to the The service type whose content was determined last time the user entered is used for semantic recognition to improve the accuracy of semantic recognition and reduce the user's repeated command input.
  • to-do service the information of the service type that matches the semantics
  • the service type corresponding to the last input content by the user is navigation service, and the preset conditions for service triggering are not met. Then after the user inputs content again, if the mobile phone detects that the service type is compared based on the semantics of re-entering the content. The service type determined last time has not changed.
  • the mobile phone can combine the relevant information of the service type that has been determined by the mobile phone (for example, the service type determined last time is navigation service).
  • the mobile phone determines that the service type is navigation service after the user entered content last time, and after the user inputs content again this time, the mobile phone determines the service type to play video service, it means that the service type has changed, and the last determined service can be interrupted. Navigation service information acquisition and related information prompts are generated based on the latest determined service type.
  • this application may also provide a fifth embodiment.
  • Embodiment 5 For the process shown in Figure 6c, you can also refer to the scenarios shown in Figure 7e, Figure 9a, and Figure 9b to understand Solution, the following describes scenario 2 that lacks necessary service parameters in conjunction with Figure 7e, Figure 9a, and Figure 9b:
  • the user clicks the "Send Command” control 6031, and the mobile phone displays the control 604 in response to the user operation; the user clicks the "Play" control 6041 in the control 604, and the mobile phone responds to the user operation.
  • the video playback service that the user may need to use is automatically selected based on user habits, user preferences, user portraits, and user recent usage records.
  • the recommendation module can further combine the semantics of the user input content and determine that the semantics does not include the semantic information of the video name, thereby determining that the user input content lacks necessary service parameters. Then the recommendation module can combine the missing "video name" service parameters, as well as user habits, user preferences, user portraits, user recent usage records and other information to generate prompts to prompt the user to enter complete instructions that can trigger the service. For example, the recommendation module can determine that the user has frequently played movies recently, so the prompt here can be "movie name”. The recommendation module can send the prompt "movie name" to the input and output module. Optionally, the recommendation module may send the determined service type "play video service" to the identification module.
  • the mobile phone when the mobile phone detects the service type corresponding to the semantics of the user input content and requires necessary service parameters when triggered, the mobile phone can combine the semantics of the user input content with the necessary service parameters of the service type. Semantics are matched to determine the necessary service parameters missing in the semantics of the user input content, and based on the semantics of the missing necessary service parameters, optionally, combined with user habits, user preferences, user portraits, user recent usage records and other information , to generate prompts to prompt the user to enter complete instructions that can trigger the service.
  • the mobile phone When the mobile phone provides prompts based on user input content, it can continuously update the prompts based on the service type provided by the service provider (such as a local application) and the service parameters necessary to trigger the service of this service type, that is, to speed up the user input content. The speed at which the conditions that trigger the service can be reached.
  • the service provider such as a local application
  • Scenario 3 The service type corresponding to the user input content is unique, and the service type that matches the semantics of the user input content is the first service type (this type of service requires necessary service parameters when triggered), and the semantics are consistent with the first service type. Necessary service parameters corresponding to the service type.
  • Figure 6d exemplarily shows the operation flow chart of the mobile phone in the case where the mobile phone determines that the semantics satisfy the preset conditions for triggering the service type service in Figure 6a.
  • the mobile phone can execute S701, S704, and S705.
  • S701 The mobile phone determines that the service type matching the semantics is one.
  • S704 The mobile phone detects that the service type is the first service type, and there are necessary service parameters corresponding to the first service type in the semantics.
  • the recommendation module determines that there is one service type matching the semantics, and the unique service type is a first service type.
  • the first service type is used to indicate that this type of service requires necessary service parameters when triggered.
  • the recommendation module determines that the semantics of the user input content includes all necessary parameters corresponding to the unique service type. service parameters, the recommendation module determines that the semantics of the user input content can meet the preset conditions for triggering the service of the unique service type, thereby notifying the identification module to enable the execution module to call the first service corresponding to the unique service type.
  • this application may also provide a sixth embodiment.
  • Embodiment 6 The process shown in Figure 6d can be understood with reference to the scenarios shown in Figures 7a, 7b, 7c, 8a and 8b. The following is combined with Figures 7a, 7b, 7c, 8a and Figures 8b to illustrate scenario 3 (that is, the semantics of the user input content can match a unique service type and have the necessary service parameters corresponding to the service type):
  • the sixth embodiment has the same drawings as those in the first and fourth embodiments, and the description process is similar. The similarities can be referred to each other and will not be described again here.
  • the mobile phone can display "@To Do” as user input content in the text input box.
  • the input cursor 507 is set after "@TODO".
  • the mobile phone can display a prompt 5051 after the input cursor 507 in the text input box control 505.
  • the text content of the prompt 5051 is "input time and event" to remind the user to complete the information for in the text input box control 505.
  • Service parameters that trigger the to-do service As shown in Figure 8b(2), the user inputs the text content "Meeting in Conference Room 2 at 11:00 noon" in the text input box control 505. The user then clicks the message sending control 508.
  • the mobile phone can display the conversation message control 510 in the display interface 501 in response to the user operation.
  • the conversation message control 510 can display the to-do information added by the user in the form of a message or a card.
  • the to-do information here is "To-do meeting in conference room 2 at 11:00 noon.”
  • Figure 8b (2) For an exemplary implementation of the process in Figures 8a to 8b, please refer to the schematic diagrams of the implementation process shown in Figures 7a to 7c. Regarding the description of FIG. 7a and FIG. 7b , reference may be made to the above embodiment, and details will not be described again here. Please refer to Figure 8b (2).
  • the input and output module can convert the text content input by the user "11 noon.” Click “Conference Room 2 for a meeting” and send it to the recognition module.
  • the recognition module can recognize the semantics of "Conference Room 2 for a meeting at 11:00 noon” and send this semantics to the recommendation module.
  • the recommendation module After the user last input content, the recommendation module has determined that the service type is "to-do service”, then the recommendation module can be based on the service parameters (ie, time and events) corresponding to "to-do service” in the third mapping relationship 403, To match the semantics of the service parameters with the semantics of the user input content provided by the recognition module, it can be determined that the time parameter in the necessary service parameters is "11 noon today" and the event parameter is "Meeting in Conference Room 2". Therefore, the necessary service parameters for the determined service type are not missing from the semantics of the user input content.
  • the service parameters ie, time and events
  • the recommendation module can determine that the semantics of the user input content include a unique service type and all necessary service parameters corresponding to the service type, thereby determining that the semantics of the user input content satisfies the triggering conditions of the service type.
  • the recommendation module can also send the optional service parameters to the identification module.
  • the recommendation module can send the service parameters in the semantics of the user input content to the identification module, including the time parameter as "11 o'clock today" and the event parameter as "Meeting in Conference Room 2" .
  • the recommendation module has Type "To-Do Service” is sent to the identification module.
  • the identification module may include the unique service type corresponding to the user's recent input content and the service parameters of the service type passed in by the recommendation module this time.
  • the input and output module can send the user operation to the identification module.
  • the identification module After the identification module determines that the user triggered the operation indicating message sending, it can Send the service type and its service parameters (here, the service parameters of the "To-Do Service") to the execution module.
  • the execution module can call the service interface of the "to-do service” according to the service type, here is the service interface of the to-do service of the calendar application, and use the service parameters of the service type passed in sequence through the recommendation module and the identification module as the call Parameters of the service interface to implement the call of the service interface.
  • the calendar application can respond to the call request of the service interface and insert a to-do item in the date corresponding to "today" in the calendar, and the time of the to-do item is set to correspond to 11 noon. Click "11:00", and the to-do event is "Meeting in Conference Room 2". In this way, the user can use the to-do service of the calendar application without opening the calendar application, and it is automatically added to the calendar application. completed the above to-do items.
  • the calendar application can send the execution result of the "to-do item service", here the information of the added to-do item, to the session and service display module.
  • the session and service display module can send the display form of the to-do item information (message or card, etc.) and the added to-do item information to the input and output module.
  • the display interface 501 can display in the form of a message or card, etc. that after the execution module in Figure 7c calls the "To-Do Service" of the calendar application, the calendar application executes the "To-Do Service”
  • the execution result here is the to-do item information that has been added in the calendar application.
  • the to-do item information here is "To-do meeting in conference room 2 at 11 noon" shown in the session message control 510.
  • the user can click the conversation message control 510 in Figure 8b(3), and the mobile phone can respond to the user operation by switching the display interface from the display interface 501 shown in Figure 8b(3) to the application interface of the calendar application,
  • the application interface can include the above-mentioned to-do information that has been added (for example, "Meeting in Conference Room 2 at 11:00 noon").
  • the user can further edit, view, and other operations on the above-mentioned to-do information in the application interface. This application does not Make restrictions.
  • the mobile phone when the mobile phone detects the service type corresponding to the semantics of the user input content and requires necessary service parameters when triggered, the mobile phone determines that the semantics of the user input content can not only match the service type, but also the semantics When all necessary service parameters corresponding to the service type are included, the mobile phone can determine that the semantics of the user input content satisfies the triggering conditions, thereby triggering related services.
  • users need to trigger a service they do not need to enter the service provider, such as the application interface of a local application. They only need to enter instructions that can trigger the service in the interactive interface provided by the mobile phone to realize the service call to the local application.
  • the operations performed on the service can be synchronized to the corresponding local application that provides the service, so that the local application has the response result of the service call.
  • this application may also provide a seventh embodiment.
  • Embodiment 7 The process shown in Figure 6d can be understood with reference to the scenarios shown in Figures 7e, 7f, 9a and 9b.
  • Scenario 3 (That is, the semantics of the user input content can match a unique service type and have the necessary service parameters of the service type):
  • the seventh embodiment has the same drawings as those in the second and fifth embodiments, and the description process is similar. The similarities can be referred to each other and will not be described again here.
  • the mobile phone can respond to the user The operation displays the floating window control 603, and the user clicks the control 6031 for sending instructions.
  • the mobile phone can display the control 604 in the display interface 601 in response to the user operation.
  • the mobile phone displays the prompt: "Movie Name” 5053 after the input cursor 507 in the text input box control 505 to prompt the user to input The video name of the video to be played.
  • the mobile phone displays the prompt: "Video or Music” 5055 after the input cursor 507 in the text input box control 505.
  • the mobile phone can display the conversation message 605 sent by the mobile phone user in the display interface 601 in response to the user operation.
  • the message content of the conversation message 605 is "@ Smart Screen Plays "Movie Name 1""
  • the display interface 601 also includes the conversation message 606.
  • the message content of the conversation message 606 is "Found the following video for you.”
  • the display interface 601 also includes a play card 607 and a play card 608 located below the conversation message 606.
  • the play card 607 is the play card 1 of application 1 for "movie name 1”
  • the play card 608 is the play card 2 of application 2 for "movie name 1".
  • the input and output module can receive the user input content "Movie Name 1" and send To the recognition module, the recognition module can recognize that the semantics of the user input content is "play the video named 'Movie Name 1'", and send this semantics to the recommendation module.
  • the recommendation module has sent the determined service type to the identification module.
  • the recognition module recognizes the semantics of the user input content "Movie Name 1”
  • it can combine the determined service types to identify the semantics, thereby recognizing the above semantics "Play the video with the name 'Movie Name 1'" ".
  • the recommendation module can compare the semantics with the semantics of the service type (such as playing video service) determined in Figure 7e. match, then when the semantics of the user input content match the video playback service, the recommendation module will also semantically match the semantics of the user input content this time with the service parameters of the video playback service (here is the video name), and recommend The module can determine that the semantics of the user input content include a unique service type and all necessary service parameters corresponding to the service type, thereby determining that the semantics of the user input content satisfies the triggering conditions of the service of the service type.
  • the service type such as playing video service
  • the recommendation module may include a fourth mapping relationship 405 between service providers and service types.
  • the service providers and service types mapped to each other in the fourth mapping relationship are used to indicate that the service provider recommends information to this application.
  • the fourth mapping relationship 405 only exemplifies the mapping relationships between some registered services and their service providers.
  • the fourth mapping relationship 405 may also include more or less mapping relationships between registered services and their service providers. Yes, this application does not limit this.
  • the service providers of the video playback service 4051 include Application 1 and Application 2. That is, there are multiple service providers that can provide services of the service type currently to be triggered.
  • the recommendation module can send the service parameter, that is, the information that the video name is "Movie Name 1" to the identification module, so that the identification module includes the service type passed in in Figure 7e (here is the video playback service) and the service The necessary service parameters corresponding to the type.
  • the input and output module can send the user operation to the identification module.
  • the identification module determines that the user triggered the operation to indicate message sending, the identification module can send the service
  • the type and its service parameters (here are the service parameters of "Play Video Service") are sent to the execution module.
  • the execution module can call the service interface of "play video service” according to the service type, here is the service interface of "play video service” of application 1, and the service interface of "play video service” of application 2, and will be passed through the recommendation module,
  • the service parameters of the service type passed by the identification module in turn are used as parameters for calling the service interface, so as to realize the calling of the service interface.
  • Application 1 and Application 2 can respectively respond to the call request of the corresponding service interface to execute the "Play Video Service”.
  • the video with the name "Movie Name 1” is searched, and Send the search result information (such as the play link of the video "Video Name 1" and the introduction information of the video) to the session and service display module.
  • the search result information such as the play link of the video "Video Name 1" and the introduction information of the video
  • the user does not directly operate Application 1 and Application 2 to search and play videos. Instead, the user only needs to trigger or input the instruction to play the video service in the interactive interface of the service provided by this application to realize the video resources in Application 1 or Application 2. Use of playback services.
  • the session and service display module can send the display form of the above search result information (message or card, etc.) and the search result information to the input and output module.
  • the display interface 601 can display the play link of the video named "Movie Name 1" requested by the user in the form of a message or card, as well as the introduction information of the video.
  • the introduction information here is "Application 1: Play card 1 of "Movie Name 1", "Application 2: Play card of "Movie Name 1"”.
  • the search records of the video "Movie Name 1" by users of this mobile phone can be recorded in Application 1 and Application 2.
  • the playback record of the "Movie Name 1" can be synchronized in Application 1.
  • the playback interface of the video can be displayed in the display interface 601, or can be jumped from the display interface 601 to application 1 Or the playback interface of the "Video Name 1" video in Application 2, this application does not impose restrictions on this.
  • the service interface of the registered service type can be provided by the system service or third-party service to the information recommendation system of this application when registering, or it can be the general corresponding service type configured by the information recommendation system of this application.
  • Service interface The system service or third-party service of the corresponding service type can implement the service interface. This application does not limit this.
  • the mobile phone can analyze the semantics of the user input content and determine whether there is a unique service type matching the semantics and the necessary service parameters corresponding to the service type matching the semantics. Then the mobile phone can determine The semantics of user input content can match a unique service type, and the semantics include the semantics of necessary service parameters corresponding to the unique service type, where the necessary service parameters are necessary parameters when the service of this service type is triggered. information. Then the mobile phone can determine that the user input content satisfies the preset conditions for triggering the service. The corresponding service type is called based on the necessary service parameters input by the user.
  • the user does not need to operate the application that provides the service, and only needs to enter the relevant instructions to trigger the service in the interactive interface provided by this application to realize the use of the service.
  • the operations performed by the user on the triggered service can have response results (such as searching records, playing records, adding to-do, etc.) in the service provider's application. records, etc.).
  • Scenario 4 The service type corresponding to the user input content is unique, and the service type that matches the semantics of the user input content is the second service type (this type of service does not require necessary service parameters when triggered).
  • Figure 6e exemplarily shows the operation flow chart of the mobile phone in the case where the mobile phone determines that the semantics satisfy the preset conditions for triggering the service type service in Figure 6a.
  • the mobile phone can execute S701, S702, and S703.
  • S701 The mobile phone determines that the service type matching the semantics is one.
  • S702 The mobile phone detects that the service type is the second service type.
  • the recommendation module determines that there is one service type matching the semantics, and the only service type is a second service type.
  • the second service type is used to indicate that this type of service does not require necessary service parameters when triggered.
  • the recommendation module may notify the identification module of the determined unique service type information, so that the identification module notifies the execution module to call the second service corresponding to the unique service type.
  • Embodiment 8 The process shown in Figure 6e can be understood with reference to the scenarios shown in Figures 7a, 7d, 8a and 8c.
  • Scenario 4 That is, the service type is unique, and the service of this service type does not require necessary service parameters when triggered
  • This eighth embodiment has the same drawings involved in the first, fourth, and sixth embodiments. The description process is similar. The similarities can be referred to each other and will not be described again here.
  • the mobile phone can display "@Calendar” as user input content in the text input box control 505. within, and set the input cursor 507 after "@calendar".
  • the mobile phone can display a prompt 5052 after the input cursor 507 in the text input box control 505.
  • the text content of the prompt 5052 is "Add Matter" to remind the user to complete the text in the text input box control 505 to trigger the calendar.
  • the principle of adding the service parameters of the matter service and generating the prompt 5052 is similar to the implementation principle of Embodiment 3 in Scenario 1, and will not be described again here.
  • the user does not continue to input content in the text input box control 505, but directly clicks the message sending control 508, then this will trigger the viewing calendar service without service parameters.
  • the mobile phone can display the conversation message control 511 in the display interface 501 in response to the user operation.
  • the session message control 511 may be in the form of a message or a card to display the response result information of the user calling the service by triggering the command input.
  • the response result information here may be calendar holiday information or other related information.
  • the recommendation module may include information 404 that triggers a service type that does not require service parameters (i.e., a second service type).
  • a service type that does not require service parameters i.e., a second service type
  • the viewing calendar service and the recently popular service are exemplarily shown.
  • This application is for triggering a service type that does not require service parameters (i.e., a second service type).
  • the second service type is not limited to the two services listed here, and may also include more or less service types, which is not limited in this application.
  • the recommendation module may match the semantics of "calendar” with the semantics of the second service type, thereby determining that the only service type matching the semantics of "calendar” is "view calendar service”.
  • the recommendation module may send information of the service type "viewing calendar service” to the identification module.
  • the identification module may notify the execution module to call the service interface of the "view calendar service”.
  • the execution module can call the service interface of the "View Calendar Service” of the calendar application. There is no need to pass in service parameters when the execution module calls the service interface.
  • the calendar application can respond to the call request of the service interface, obtain the response result (such as the holiday information of the month to which the current date belongs) and send it to the session and service display module.
  • the session and service display module can send the response result to the input and output module for display, so that the card information with the response result is displayed in the display interface 501 of Figure 8c(3).
  • the recommendation module can determine that the semantics of the user input content include a unique service type, and when the service of this service type does not require necessary service parameters when triggered, it can determine that the semantics of the user input content satisfies the service of this service type. Trigger conditions, and then related services can be called.
  • the mobile phone when the mobile phone detects the service type corresponding to the semantics of the user input content and does not require necessary service parameters when triggering, the mobile phone can determine that the semantics of the user input content satisfies the triggering conditions, thereby triggering the relevant Serve.
  • the service provider such as the application interface of a local application. They only need to enter instructions that can trigger the service in the interactive interface provided by the mobile phone to realize the service call to the local application.
  • the instructions input by the interactive interface are used to call a service, the operations performed on the service can be synchronized to the corresponding local application that provides the service, so that the local application has the response result of the service call.
  • Embodiment 9 For the process shown in Figure 6d, you can also refer to the scenario shown in Figure 9a(3) to understand scenario 4 (that is, the service type is unique, and the service of this service type does not require necessary service parameters when triggered):
  • the user clicks on the "recently popular" bubble 6043 in the control 604 and clicks on the message sending control 508, then the mobile phone can respond to the user operation and determine the semantic match with the "recently popular"
  • the service type is the recently popular service 4041 shown in Figure 7d, thereby calling the service interface of the recently popular service 4041 to obtain the 5 popular movies that have recently been broadcast, and display the play cards of the 5 popular movies in Display interface 601.
  • the implementation principle of this embodiment is similar to that of the eighth embodiment, and will not be described again here.
  • the mobile phone can analyze the semantics of the user input content and determine whether there is a unique service type that matches the semantics. When the service of this unique service type does not require necessary service parameters when triggered, then The mobile phone can determine that the semantics of the user's input content meet the service triggering conditions, thereby mobilizing services of that service type for the user to use the service.
  • Scenario 5 The semantics of the user input content do not match the semantics of any registered service type, and the user input instruction is determined to be incorrect.
  • this scenario 5 may be that in the embodiment of Figure 6a, after the mobile phone determines whether there is a service type matching the semantics of the user input content by executing S303, the mobile phone determines that there is no service type matching the semantics, thereby passing The scene where S309 outputs prompts.
  • Embodiment 10 Scenario 5 is described with reference to Figure 7g and Figure 9c.
  • the user inputs the instruction "balala” 5056 into the text input box control 505 in the display interface 601, and clicks the message sending control 508.
  • the input and output module can obtain the latest information input by the user.
  • the input and output module can "balala” is received and sent to the recognition module.
  • the recognition module can perform semantic recognition of "balala” and send the semantics of "balala” to the recommendation module.
  • the recommendation module matches the semantics of "balala” with the semantics of any service type of the registered service type, determines that there is no service type matching the semantics of "balala”, and matches the semantics of "balala” with the registered service type
  • the semantics of the necessary service parameters are matched, and the service type is not matched through the necessary service parameters, thereby determining that there is no service type matching the semantics of the user input content (that is, the service type is missing), that is, there is an error in the instruction entered by the user.
  • the recommendation module can send information indicating that the user input instruction is incorrect and the service type is not recognized to the recognition module.
  • the recommendation module when generating the prompt, it can generate a preset prompt corresponding to the scenario where the service type cannot be determined (for example, the first prompt in Figure 7a The default tag "help" within a mapping relationship), here is "help".
  • the recommendation module determines that the user input instruction is wrong, it can send the prompt to the input and output module to prompt the user after the user clicks the message sending control 508.
  • the user can avoid inputting during the text input process. Wrong text, and the system keeps outputting prompts (such as "help") to correct the erroneous instructions. In this way, this embodiment can reduce the interference of the prompts on the user's input text when outputting the prompts.
  • the prompt may be "help".
  • the prompt may be output in the form of conversation messages, controls, bubbles, text, lists, etc. This application does not limit this.
  • the prompt sent by the recommendation module to the input and output module also includes "I don't quite understand what you mean, please give me more time to study" shown in the conversation message 802.
  • the recommendation module can also send the prompt form of each prompt (ie, the above-mentioned output method) to the input and output module.
  • the mobile phone displays the message shown in Figure 9c(2).
  • a display interface 601 is shown, and the display interface 601 may include a conversation message 801, as well as a conversation message 802 and a "help" control 803.
  • the message content of the conversation message 801 is "@smart screen balala", and the message content of the conversation message 802 is the prompt "I don't quite understand what you mean, please give me more.” Take the time to study.”
  • the "Help" control 803 may be displayed below the conversation message 802. This application does not limit the layout and display methods of the output conversation messages or prompts.
  • the "Help" control 803 can be used as a prompt to prompt the user whether he or she needs help.
  • the recommendation module determines that the user input instruction is incorrect, in another possible implementation, when generating the prompt, the specified preset service type (for example, keywords for searching video services, recently popular services) are output as prompts.
  • the specified preset service type For example, keywords for searching video services, recently popular services
  • the recommendation module may, in another possible implementation, prompt the user with instructions related to the service type that the user may need to input when generating the prompt.
  • the related instruction may be an instruction with the same single word as the user input content.
  • the prompt sent by the recommendation module to the input and output module can also be "play".
  • the first pinyin letter of "play" in the "play” instruction is b, which is the same as the first letter b of the user input content.
  • the recommendation module can also record information based on the user's usage in the information recommendation system, and/or session context information in the current interactive interface, and/or information such as the user's recent usage habits of the information recommendation system, To determine the service type and service instructions that the user may need, and use the service instructions as prompts. For example, if the user often searches for a certain movie recently, the movie names of multiple movies whose movie types are similar to the movie type can be used as prompts (for example, the prompts are: play movie 1, play movie 2, where , Movie 1 and Movie 2 are movie names) output to recommend services that users may need.
  • the recommendation module can determine the corresponding "Help" semantics according to the first mapping relationship 401.
  • the service type list includes video playback service, video search service, recently popular service, TV screen capture service, and remote control service. Combined with the second mapping relationship 402, the keywords corresponding to each service type in the above service type list are Output as prompt.
  • the mobile phone responds to the user clicking the "Help" control 803, and displays the session message 804 on the display interface 601. Please refer to Figure 9c (3) for the message content 8041 of the session message 804, which will not be described again here. .
  • the mobile phone can respond to the user operation and put the display interface 601 of the mobile phone into the instruction sending mode interface.
  • the instruction sending mode interface the user can Content input through text, voice, or operating controls can be considered as instructions rather than messages. Therefore, services or instructions can be recommended based on the input instructions according to the information recommendation system shown in Figure 5.
  • the user can also enter the text "help" in the text input box control 505 of the interface in the command sending mode (for example, Figure 9c(2)), or enter the symbol "?”, and the mobile phone can respond This user operation displays the interface shown in Figure 9c(3).
  • the electronic device of the present application can provide an interface for interacting with the user, and in the interactive interface, fixed instructions in the form of buttons or menus are combined with free instructions input by the user in the input box.
  • a partial or complete prompt will be given to the command form or content supported by the system.
  • the form and content of the instruction prompt can be further dynamically adjusted according to the content input by the user, so that the user can enter the desired instruction most easily and quickly.
  • the user can choose to continue to enter the completion instruction in the input box according to the prompt, or directly click on the instruction prompt to select an instruction that meets their expectations.
  • This solution can provide various services registered by the system or third parties, and connect users to each other in the interactive interface.
  • the operations performed by the service are responded to the application that provides the service, which can reduce user operations.
  • the prompts can be continuously updated based on the current input content, which can reduce the user's search cost for services, reduce user errors or invalid input, and improve interaction efficiency.
  • the electronic device includes corresponding hardware and/or software modules that perform each function.
  • the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions in conjunction with the embodiments for each specific application, but such implementations should not be considered to be beyond the scope of this application.
  • FIG. 10 shows a schematic block diagram of a device 300 according to an embodiment of the present application.
  • the device 300 may include: a processor 301 and a transceiver/transceiver pin 302, and optionally, a memory 303.
  • bus 304 which includes, in addition to a data bus, a power bus, a control bus, and a status signal bus.
  • bus 304 includes, in addition to a data bus, a power bus, a control bus, and a status signal bus.
  • various buses are referred to as bus 304 in the figure.
  • the memory 303 can be used for instructions in the foregoing method embodiments.
  • the processor 301 can be used to execute instructions in the memory 303, and control the receiving pin to receive signals, and control the transmitting pin to send signals.
  • the device 300 may be the electronic device or a chip of the electronic device in the above method embodiment.
  • This embodiment also provides a computer storage medium that stores computer instructions.
  • the electronic device When the computer instructions are run on an electronic device, the electronic device causes the electronic device to execute the above related method steps to implement the service invocation method in the above embodiment.
  • This embodiment also provides a computer program product.
  • the computer program product When the computer program product is run on a computer, it causes the computer to perform the above related steps to implement the service calling method in the above embodiment.
  • inventions of the present application also provide a device.
  • This device may be a chip, a component or a module.
  • the device may include a connected processor and a memory.
  • the memory is used to store computer execution instructions.
  • the processor can execute computer execution instructions stored in the memory, so that the chip executes the service calling method in each of the above method embodiments.
  • the electronic equipment, computer storage media, computer program products or chips provided in this embodiment are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the corresponding methods provided above. The beneficial effects of the method will not be repeated here.
  • the disclosed devices and methods can be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of modules or units is only a logical function division.
  • there may be other division methods for example, multiple units or components may be combined or can be integrated into another device, or some features can be ignored, or not implemented.
  • the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, and the indirect coupling or communication connection of the devices or units may be in electrical, mechanical or other forms.
  • a unit described as a separate component may or may not be physically separate.
  • a component shown as a unit may be one physical unit or multiple physical units, that is, it may be located in one place, or it may be distributed to multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.
  • the above integrated units can be implemented in the form of hardware or software functional units.
  • Integrated units may be stored in a readable storage medium if they are implemented in the form of software functional units and sold or used as independent products.
  • the technical solutions of the embodiments of the present application are essentially or contribute to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the software product is stored in a storage medium , including several instructions to cause a device (which can be a microcontroller, a chip, etc.) or a processor to execute all or part of the steps of the methods of various embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), magnetic disk or optical disk and other media that can store program code.
  • the steps of the methods or algorithms described in connection with the disclosure of the embodiments of this application can be implemented in hardware or by a processor executing software instructions.
  • Software instructions can be composed of corresponding software modules.
  • the software modules can be stored in random access memory (Random Access Memory, RAM), flash memory, read only memory (Read Only Memory, ROM), erasable programmable read only memory ( Erasable Programmable ROM (EPROM), Electrically Erasable Programmable Read-Only Memory (Electrically EPROM, EEPROM), register, hard disk, removable hard disk, CD-ROM or any other form of storage media well known in the art.
  • an exemplary storage medium is coupled to the processor enabling the processor to read information from the storage medium, And information can be written to the storage medium.
  • the storage medium can also be an integral part of the processor.
  • the processor and storage media may be located in an ASIC. Additionally, the ASIC can be located in a network device. Of course, the processor and storage media can also exist as discrete components in the network device.
  • Computer-readable media includes computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another.
  • Storage media can be any available media that can be accessed by a general purpose or special purpose computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

本申请实施例提供了一种服务调用方法及电子设备,涉及终端设备技术领域,该方法包括:用户在会话界面中输入可触发服务的指令后,手机可执行目标应用提供的该服务,并将目标应用对该服务的执行结果显示在会话界面内,简化了用户在使用相关服务时的操作流程,提升了对服务的触发效率,以及提升了对服务提供方式的灵活性。

Description

服务调用方法及电子设备
本申请要求于2022年03月24日提交中国国家知识产权局、申请号为202210293757.9、申请名称为“服务调用方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及终端设备技术领域,尤其涉及一种服务调用方法及电子设备。
背景技术
随着电子设备的发展,电子设备向用户提供的服务(例如播放视频服务、电商购物服务、播放音乐服务、播放广播服务等)也越来越多。电子设备可提供交互界面,供用户在交互界面中选择或输入所需的服务。
目前,电子设备提供服务的方式主要包括:完全由用户自主搜索服务,或者电子设备提供触发服务的固定按钮。显然,传统方案对服务的触发效率较低、且提供服务的方式灵活性较差,影响用户对服务的使用体验。
发明内容
为了解决上述技术问题,本申请提供一种服务调用方法及电子设备。在该方法中,用户无需操作本地应用,就可使用本地应用提供的服务,电子设备提供服务的方式更加灵活和智能。
第一方面,本申请实施例提供一种服务调用方法。该方法包括:响应于在会话界面中接收到的第一用户输入,检测到所述第一用户输入满足触发目标服务的预设条件,基于所述第一用户输入,调用目标应用的所述目标服务;在所述会话界面显示响应结果,其中,所述响应结果包括所述目标应用对所述目标服务的执行结果,其中,所述会话界面不属于所述目标应用的界面。
示例性的,该方法可应用于电子设备,以电子设备为手机为例进行说明,该目标应用可为手机安装的本地应用,该本地应用可以是系统应用或第三方应用。系统应用用于表示手机出厂时已安装的应用。第三方应用可为用户从应用市场下载的应用。
本地应用可提供至少一种服务,例如视频应用可提供视频搜索服务、视频播放服务。
示例性的,用户可在会话界面输入指令,该指令达到触发目标服务的预设条件时,手机可调用目标应用所提供的该目标服务,那么目标应用可执行该目标服务,手机可目标应用对该目标服务的执行结果可显示在会话界面。
示例性的,目标服务的执行结果可为执行该目标服务后所生成的服务结果数据。
示例性的,在视频搜索服务中,该执行结果可为视频搜索结果,例如搜索到的视频资源的相关信息(例如视频播放界面、视频简介、视频播放链接等)。
示例性的,在待办事项服务(用于添加待办事项)中,执行结果可为添加的待办信 息。
示例性的,该会话界面可以是手机负一屏的界面,也可以是应用的会话界面,本申请对此不做限制。
例如用户在一个会话界面(不属于该视频应用的界面)中输入“搜索XX电视剧”,则上述视频应用可搜索名称为“XX”的电视剧的视频资源以执行视频搜索服务,该视频资源的播放卡片(可包括视频资源的简介、海报、播放窗口等至少一项信息)可作为该用户输入的响应结果显示在该会话界面。示例性的,视频应用对该视频搜索服务的执行结果可包括视频应用搜索到的上述视频资源。
本申请实施例中,用户在会话界面内输入指令后,该指令可触发目标服务时,手机可基于用户输入的指令,来调用本地目标应用所提供的该目标服务,使得用户无需进入目标应用的界面,只需在会话界面内输入触发相关服务的指令,手机就调用以执行目标应用的目标服务,简化了用户在使用相关服务时的操作流程,提升了对服务的触发效率,且手机内的服务不仅可通过对提供该服务的应用进行操作来触发,还可通过在一会话界面内接收用户指令来直接触发相关服务,提升了对服务提供方式的灵活性。
根据第一方面,所述目标应用包括与所述执行结果有关的记录信息。
示例性的,在用户未对会话界面中的响应结果执行操作时,该目标应用也可以因执行该目标服务而生成与该执行结果有关的记录信息。
示例性的,在上述举例中,用户在会话界面中输入“搜索XX电视剧”,则目标应用在执行搜索视频服务后,可在目标应用内生成对于该搜索视频服务的执行记录。示例性的,该视频应用的搜索记录中可包括对“XX”电视剧的搜索记录。
可选地,在用户对会话界面中的响应结果执行操作后,例如用户点击了会话界面中该视频资源的播放卡片(一种执行结果的示例),以对“XX”电视剧进行播放,则该视频应用的播放记录中可包括对“XX”电视剧的播放记录。也就是说,在会话界面中显示上述响应结果(包括目标应用对目标服务的执行结果)后,用户对该响应结果继续执行操作(相当于对执行结果进行了操作),则目标应用也可以对该执行结果执行的操作进行响应,从而在目标应用内生成对该执行结果有关的记录信息(例如视频播放记录)。
本申请实施例中,用户在会话界面输入触发服务的指令后,手机不仅可调用目标应用的目标服务,以使目标服务被执行,而且,提供该服务的目标应用内还可包括(例如存储或记录或显示等)与该目标服务的执行结果有关的记录信息。使得用户即便在该目标应用之外的界面或应用内触发了该目标应用所提供的服务,该目标应用内仍旧可保存对该服务的执行记录,以便于优化对用户提供的服务。
根据第一方面,或者以上第一方面的任意一种实现方式,所述方法还包括:响应于在所述会话界面中接收到的第二用户输入,检测到所述第二用户输入的语义与预设标记的语义相匹配,在本地应用提供的服务类型中,确定与所述预设标记对应的至少一个第一服务类型;在所述会话界面显示第一提示语和/或第二提示语,所述本地应用包括所述目标应用;其中,所述第一提示语用于指示用户在所述至少一个第一服务类型中选择一个服务类型;所述第二提示语用于指示所述用户输入第一指令,其中,所述第一指令为用于触发第一服务类型的服务的指令。
示例性的,用户可在会话界面内输入“@”,来搜索“@”对应的至少一个第一服务类型。用户只需要输入一个标记,即可搜索相关服务,可简化用户的输入操作,提升服务搜索效率。
可选地,该第一服务类型的数量可以是至少两个。那么用户可通过在会话界面输入“@”,来搜索一个服务类型列表,该服务类型列表包括至少两个服务类型。可在手机提供的服务类型较多时,快速的缩小服务类型的搜索范围,便于用户查找并触发所需要的服务类型的服务。
可选地,在与预设标记对应的第一服务类型的数量为一个时,则手机可在会话界面显示第二提示语,以便于用户根据第二提示语,快速输入可触发服务的指令。
可选地,在与预设标记对应的第一服务类型的数量为至少两个时,则手机可在会话界面显示第一提示语,可选地进一步显示第二提示语,以便于用户根据第一提示语筛选所需使用的服务类型,以及根据第二提示语,对选择的服务类型继续输入能够触发该服务的指令,提升服务的触发效率。
根据第一方面,或者以上第一方面的任意一种实现方式,所述方法还包括:响应于在所述会话界面中接收到的第三用户输入,检测到所述第三用户输入的语义与至少一个第二服务类型的第一服务参数的语义相匹配,在所述会话界面显示第三提示语和/或第四提示语;其中,所述本地应用提供的服务类型包括所述第二服务类型,所述第一服务参数为所述本地应用执行所述第二服务类型的服务时所需的参数信息;其中,所述第三提示语用于指示所述用户在所述至少一个第二服务类型中选择一个服务类型;所述第四提示语用于指示所述用户输入第二指令,其中,所述第二指令为用于触发所述第二服务类型的服务的指令。
可选地,该第一服务类型的数量可以是至少两个。
示例性的,用户在会话界面输入“XX电影”,那么本地应用1提供了播放视频服务,本地应用2提供了订购电影票服务,这两个服务在被执行时需要必要的服务参数,这里为视频名称。那么“XX电影”的语义为电影名称为“XX”,那么该语义可与上述两个服务类型的视频名称这一服务参数的语义相匹配,手机可基于用户输入内容确定用户期望使用的服务的服务类型包括播放视频服务和订购电影票服务。手机可显示第三提示语,以提示用户从播放视频服务和订购电影票服务中选择一个服务类型。可选地,手机还可显示第四提示语,来提示用户输入可以触发上述两个类型的服务的指令,例如提示输入视频名称。
示例性的,例如本地应用不包括上述本地应用2,那么用户在会话界面输入某个剧名“XX剧”后,手机可确定与该输入内容的语义匹配的服务类型为本地应用1提供的播放视频服务,其中,播放视频服务的必要服务参数之一:视频名称,与“XX剧”的语义匹配。示例性的,该播放视频服务的必要服务参数不仅包括视频名称,还包括视频类型(电影类型或电视剧类型),那么手机可输出第四提示语,以提示用户输入视频类型的指令。
可选地,本实施方式中的第二服务类型与上述实施方式中的第一服务类型可以相同或不同,本申请对此不做限制。
在本实施例中,手机可通过服务类型的必要服务参数,来与用户输入内容的语义进 行匹配,来确定用户可能希望使用的服务的服务类型,而服务类型的必要服务参数是该服务类型的服务在被触发(即调用)时所必须的服务参数。换言之,本地应用在提供该服务类型的服务时,需要基于该必要服务参数来提供服务。那么手机在对用户输入内容确定服务类型时,结合必要服务参数来确定服务类型,可进一步提升对服务类型的识别准确度和搜索效率,并能够结合本地应用提供的该服务类型所需的必要服务参数,来更新提示语,可提高服务的触发效率。
根据第一方面,或者以上第一方面的任意一种实现方式,所述响应于在会话界面中接收到的第一用户输入,检测到所述第一用户输入满足触发目标服务的预设条件,包括:响应于在所述会话界面中接收到的第一用户输入,检测到所述第一用户输入的语义与唯一的一个第三服务类型的语义相匹配,确定所述第一用户输入满足触发所述第三服务类型对应的目标服务的预设条件;其中,所述本地应用提供的第一预设服务类型包括所述第三服务类型,所述第一预设服务类型的服务由所述本地应用执行时无需服务参数。
示例性的,第三服务类型不同于第二服务类型。其中,第二服务类型的服务在被执行时需要提供该服务类型对应的必要服务参数,而第三服务类型的服务在被执行时,则无需服务参数,因为,第三服务类型的服务在被执行时不需要必要的服务参数。
第三服务类型与上述第一服务类型可以相同或不同,本申请对此不做限制。
示例性的,第三服务类型的服务在被调用时无需必要服务参数,例如查看日历服务,不需要用户输入具体的日期等服务参数,只需要输入“日历”,从而可确定与用户输入内容的语义匹配的服务类型即为查看日历服务。示例性的,当用户输入内容可与唯一的服务类型的语义相匹配,而且该唯一的服务类型是一种不需要必要服务参数就可以被调用而产生执行结果的服务类型,那么可调用该服务类型的服务。例如手机可调用日历应用的查看日历服务,并将执行结果(即日历信息)提供给用户浏览。
在本申请实施例中,当用户输入内容与唯一的服务类型的语义相匹配,且该唯一的服务类型在被执行时不需要必要的服务参数,则手机可确定用户输入内容可达到触发该服务类型的服务的条件,从而调用相应的目标应用执行该服务类型的服务,其中,目标应用提供的服务类型包括这里的第三服务类型,可提升服务执行效率。
根据第一方面,或者以上第一方面的任意一种实现方式,所述响应于在会话界面中接收到的第一用户输入,检测到所述第一用户输入满足触发目标服务的预设条件,包括:响应于在所述会话界面中接收到的第一用户输入,检测到所述第一用户输入的语义与唯一的一个第四服务类型的语义相匹配,且所述第一用户输入的语义包括第二服务参数,确定所述第一用户输入满足触发所述第四服务类型对应的目标服务的预设条件;其中,所述第二服务参数为所述目标应用执行所述第四服务类型的服务时所需的参数信息。
示例性的,第四服务类型的服务在执行时需要必要的服务参数,第四服务类型不同于上述第三服务类型。
示例性的,第四服务类型与上述第一服务类型、第二服务类型可以相同或不同,本申请对此不做限制。
在本申请实施例中,当用户输入内容的语义可与唯一的服务类型相匹配,并且,该语义中还包括该唯一的服务类型在被执行时所必须的服务参数,则手机可确定用户输入 内容达到了触发该服务类型的服务的条件,从而基于用户输入内容的语义中提供的必要服务参数,来调用目标应用提供的该服务类型的目标服务。使得目标应用可按照用户提供的服务参数,来执行该目标服务,以将目标服务的执行结果显示在会话界面。那么在用户输入的该服务类型的必要服务参数存在语义差别时,可使目标服务的执行结果存在差异,这样,可根据用户输入内容灵活的执行目标服务,提升对用户提供的服务的多样性。
根据第一方面,或者以上第一方面的任意一种实现方式,所述方法还包括:响应于在所述会话界面中接收到的第四用户输入,检测到所述第四用户输入的语义与所述本地应用提供的任意服务类型的语义均不匹配,基于所述第四用户输入,在所述会话界面显示第五提示语;其中,所述第五提示语用于提示用户输入预设指令,所述预设指令的语义与所述本地应用提供的至少一个第五服务类型的语义相匹配。
示例性的,本地应用提供的服务类型可包括在执行时不需要必要服务参数的第一类服务,以及在执行时需要必要服务参数的第二类服务。
示例性的,在将用户输入内容的语义与服务类型的语义进行匹配时,如果该服务类型为第一类服务,可将用户输入内容的语义与该服务类型的名称的语义进行匹配,如果二者不匹配,则说明用户输入内容的语义没有与第一类服务的语义相匹配。
示例性的,在将用户输入内容的语义与服务类型的语义进行匹配时,如果该服务类型为第二类服务,可将用户输入内容的语义与该服务类型的名称的语义,以及该服务类型的必要服务参数的语义分别进行匹配,如果用户输入内容的语义既与该服务类型的名称的语义不匹配,且与该服务类型的必要服务参数的语义不匹配,则说明用户输入内容的语义没有与第二类服务的语义相匹配。
示例性的,当用户输入内容的语义与第一类服务的语义不匹配,且与第二类服务的语义不匹配,则说明用户输入内容的语义与本地应用提供的任意一种服务类型的语义均不匹配,说明用户输入的指令错误,无法触发任何服务。
那么手机可提示用户输入能够与至少一个服务类型的语义相匹配的预设指令,从而达到提示用户输入正确的能够确定至少一个服务类型的指令,以纠正用户输入的错误指令。
示例性的,第五服务类型可以是上述第一类服务,也可以是上述第二类服务,本申请对此不做限制。同理,第五服务类型,与上述第一服务类型至第四服务类型中的任意一种服务类型可以相同或不同,本申请对此不做限制。
根据第一方面,或者以上第一方面的任意一种实现方式,所述预设指令的首个字符与所述第四用户输入的首个字符的语义匹配。
示例性的,提示用户输入的预设指令中,该预设指令的首个字符可与用户输入内容的首个字符的语义匹配,从而不仅可达到纠正用户输入正确指令的效果,而且还可达到将用户可能期望输入的指令提示给用户的效果。
根据第一方面,或者以上第一方面的任意一种实现方式,所述在所述会话界面显示响应结果,包括:在所述会话界面以会话消息的形式显示所述响应结果。
示例性的,手机可将目标应用对目标服务执行后的响应结果,在用户输入触发目标 服务的指令的会话界面内,以会话消息的方式显示出来,从而无需用户重复输入用于调用该目标服务的指令,可便于用户通过该会话消息,将对目标服务的执行结果在会话内进行分享。
根据第一方面,或者以上第一方面的任意一种实现方式,所述在所述会话界面显示响应结果之后,所述方法还包括:响应于接收到的第五用户输入,显示所述目标应用的目标界面;其中,所述第五用户输入包括对所述响应结果的输入,所述目标界面包括所述执行结果。
示例性的,用户通过输入“搜索XX电视剧”,视频应用通过执行视频搜索服务,搜索到名称为“XX”的电视剧的视频资源,并将该视频资源的播放卡片显示在会话界面。然后,用户点击该会话界面内该视频资源的播放卡片,那么手机可将显示界面跳转到该视频应用的应用界面,该应用界面可包括视频应用搜索到的该视频资源。
示例性的,该视频资源可以包括“XX电视剧”的视频播放界面,和/或,该“XX电视剧”的播放简介等信息,本申请对此不做限制。该视频资源可以是视频应用对“XX电视剧”的任意形式的搜索结果信息。
示例性的,该播放卡片可包括播放链接、视频名称、视频简介等视频属性信息,本申请对此不做限制。
本申请实施例中,用户在触发某个服务时,无需进入提供该服务的应用界面内执行服务搜索操作,只需要在本申请提供的会话界面内输入可触发该服务的指令,即可实现提供该服务的应用对该服务的调用。并且,用户在需要浏览目标应用对该目标服务的执行结果时,可通过对会话界面触发输入,手机从而可显示该目标应用的目标界面,目标界面可包括目标应用对该目标服务的执行结果。用户在浏览应用对服务的执行结果时,无需手动操作相应的应用,只需在会话界面内触发输入,即可快速实现执行结果的浏览,对服务执行结果的浏览更快捷。
根据第一方面,或者以上第一方面的任意一种实现方式,所述会话界面包括以第一预设控件的形式显示的所述预设标记。本申请以控件方式显示预设标记,可便于用户快速定位预设标记在会话界面中所处的位置,便于操作预设标记,以搜索预设标记对应的服务类型。
根据第一方面,或者以上第一方面的任意一种实现方式,所述会话界面中的任意一个提示语以第二预设控件的形式显示。本申请以控件方式显示提示语,可便于用户区分提示语和用户输入的内容,避免用户在进行文本输入时,混淆用户输入指令与手机提供的提示语。
根据第一方面,或者以上第一方面的任意一种实现方式,所述第一预设控件和/或所述第二预设控件包括但不限于以下至少一种:气泡、列表、超链接、悬浮窗、会话消息、文本框。本申请可通过不同类型的控件来显示提示语和/或预设标记,以便于用户通过控件区分提示语和预设标记,或者,区分不同的提示语,或者区分不同的预设标记,也提升了手机提示内容(包括预设标记和/或提示语)的提示方式的多样性。
第二方面,本申请实施例提供一种服务调用方法,应用于第一电子设备,所述方法包括:接收在会话界面中的第一用户输入,其中,所述会话界面为所述第一电子设备与 所述第二电子设备的会话界面;在所述会话界面显示对所述第一用户输入的响应结果;其中,所述响应结果为所述第一电子设备或所述第二电子设备从服务器获取的;所述响应结果为所述服务器对目标服务的执行结果,其中,所述执行结果为所述服务器在检测到所述第一用户输入满足触发所述目标服务的预设条件时,基于所述第一用户输入执行所述目标服务的结果。
示例性的,第一电子设备可为手机,第二电子设备可为智慧屏,在手机与智慧屏登陆同一账户,和/或,连接同一Wi-Fi网络时,手机可显示手机与智慧屏进行交互的会话界面。示例性的,该服务器可为手机的服务器,还可为智慧屏的服务器,本申请对此不做限制,以该服务器为智慧屏的服务器为例进行说明。另外,第一电子设备和第二电子设备也不限于手机和智慧屏,还可是任何可以交互的两个电子设备,本申请对此不做限制。
示例性的,在该会话界面,手机可向智慧屏发送指令,智慧屏可执行手机发送的指令。
示例性的,在用户在会话界面中输入的指令可达到对目标服务的触发条件时,该会话界面可显示手机或智慧屏从服务器获取的响应结果,该响应结果为服务器对该目标服务的执行结果。
示例性的,手机可将用户输入的指令发送至智慧屏的服务器,服务器在确定用户输入指令达到对目标服务的触发条件时,可执行目标服务,以得到响应结果。服务器可向手机返回该响应结果,手机可将响应结果显示在会话界面。
示例性的,手机可将用户输入的指令发送至智慧屏,智慧屏可基于用户输入内容,向智慧屏的服务器发送请求,服务器在确定用户输入指令达到对目标服务的触发条件时,可执行目标服务,以得到响应结果。服务器可向智慧屏返回该响应结果。然后,智慧屏将该响应结果发送至手机,以显示在该会话界面。
在本申请实施例中,用户可在第一电子设备与第二电子设备进行交互的会话界面内输入可触发目标服务的指令,由服务器基于该指令,来执行目标服务,并由第一电子设备侧的该会话界面显示服务器对该目标服务执行后的响应结果。能够在多设备交互的场景下,实现服务的触发。
在一种可能的实施方式中,上述响应结果还可以是所述第一电子设备(例如手机)对目标服务的执行结果,其中,所述执行结果为所述第一电子设备在检测到所述第一用户输入满足触发所述目标服务的预设条件时,基于所述第一用户输入执行所述目标服务的结果。
在一种可能的实施方式中,上述响应结果还可以是所述第二电子设备(例如智慧屏)对目标服务的执行结果,其中,所述执行结果为所述第二电子设备在检测到所述第一用户输入满足触发所述目标服务的预设条件时,基于所述第一用户输入执行所述目标服务的结果。智慧屏可将该响应结果发送至手机,手机可将响应结果显示在会话界面。
根据第二方面,所述方法还包括:接收在所述会话界面中的第三用户输入;在所述会话界面显示第三提示语和/或第四提示语;其中,所述第一提示语和/或所述第二提示语,为所述服务器在检测到所述第三用户输入的语义与预设标记的语义相匹配时,生成的提 示语;其中,所述服务器提供的服务类型包括与所述预设标记对应的至少一个第四服务类型;其中,所述第三提示语用于指示用户在所述至少一个第四服务类型中选择一个服务类型;所述第四提示语用于指示所述用户输入第二指令,其中,所述第二指令为用于触发第四服务类型的服务的指令。
根据第二方面,或者以上第二方面的任意一种实现方式,接收在所述会话界面中的第二用户输入;在所述会话界面显示第一提示语和/或第二提示语;其中,所述第一提示语和/或所述第二提示语,为所述服务器在检测到所述第二用户输入的语义与至少一个第一服务类型的第一服务参数的语义相匹配时,生成的提示语;其中,所述服务器提供的服务类型包括所述第一服务类型,所述第一服务参数为所述服务器执行所述第一服务类型的服务时所需的参数信息;其中,所述第一提示语用于指示所述用户在所述至少一个第一服务类型中选择一个服务类型;所述第二提示语用于指示所述用户输入第一指令,其中,所述第一指令为用于触发所述第一服务类型的服务的指令。
根据第二方面,或者以上第二方面的任意一种实现方式,所述执行结果为所述服务器在检测到所述第一用户输入的语义与唯一的一个第二服务类型的语义相匹配时,基于所述第一用户输入,对所述第二服务类型的所述目标服务的执行结果;其中,所述服务器提供的第一预设服务类型包括所述第二服务类型,所述第一预设服务类型的服务由所述服务器执行时无需服务参数。
根据第二方面,或者以上第二方面的任意一种实现方式,所述执行结果为所述服务器在检测到所述第一用户输入的语义与唯一的一个第三服务类型的语义相匹配,且所述第一用户输入的语义包括第二服务参数时,对所述第三服务类型的所述目标服务的执行结果;其中,所述第二服务参数为所述服务器执行所述第三服务类型的服务时所需的参数信息。
根据第二方面,或者以上第二方面的任意一种实现方式,所述方法还包括:接收在所述会话界面中的第四用户输入;在所述会话界面显示第五提示语;其中,所述第五提示语,为所述服务器在检测到所述第四用户输入的语义与所述服务器提供的任意服务类型的语义均不匹配时,基于所述第四用户输入生成的提示语;其中,所述第五提示语用于提示用户输入预设指令,所述预设指令的语义与所述服务器提供的至少一个第五服务类型的语义相匹配。
根据第二方面,或者以上第二方面的任意一种实现方式,所述预设指令的首个字符与所述第四用户输入的首个字符的语义匹配。
根据第二方面,或者以上第二方面的任意一种实现方式,所述在所述会话界面显示响应结果,包括:
在所述会话界面以会话消息的形式显示所述响应结果。
根据第二方面,或者以上第二方面的任意一种实现方式,所述在所述会话界面显示对所述第一用户输入的响应结果之后,所述方法还包括:接收在所述会话界面中的第五用户输入;显示目标界面;其中,所述第五用户输入包括对所述响应结果的输入,所述目标界面包括所述服务器对所述目标服务的所述执行结果。
根据第二方面,或者以上第二方面的任意一种实现方式,所述会话界面包括以第一 预设控件的形式显示的所述预设标记。
根据第二方面,或者以上第二方面的任意一种实现方式,所述会话界面中的任意一个提示语以第二预设控件的形式显示。
根据第二方面,或者以上第二方面的任意一种实现方式,所述第一预设控件和/或所述第二预设控件包括但不限于以下至少一种:气泡、列表、超链接、悬浮窗、会话消息、文本框。
第二方面以及第二方面的任意一种实现方式分别与第一方面以及第一方面的任意一种实现方式相对应。第二方面以及第二方面的任意一种实现方式所对应的技术效果可参见上述第一方面以及第一方面的任意一种实现方式所对应的技术效果,此处不再赘述。
第三方面,本申请实施例提供一种电子设备。该电子设备包括:存储器和处理器,所述存储器和所述处理器耦合;所述存储器存储有程序指令,所述程序指令由所述处理器执行时,使得所述电子设备执行如第一方面以及第一方面的任意一种实现方式中的方法,或执行如第二方面以及第二方面的任意一种实现方式中的方法。
第三方面所对应的技术效果可参见上述第一方面以及第一方面的任意一种实现方式所对应的技术效果,此处不再赘述。
第四方面,本申请实施例提供了一种计算机可读介质,用于存储计算机程序,当所述计算机程序在电子设备上运行时,使得所述电子设备执行如第一方面以及第一方面的任意一种实施方式中的方法,或执行如第二方面以及第二方面的任意一种实现方式中的方法。
第四方面所对应的技术效果可参见上述第一方面以及第一方面的任意一种实现方式所对应的技术效果,此处不再赘述。
第五方面,本申请实施例提供了一种包含指令的计算机程序产品,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如第一方面以及第一方面的任意一种实施方式中的方法,或执行如第二方面以及第二方面的任意一种实现方式中的方法。
第五方面所对应的技术效果可参见上述第一方面以及第一方面的任意一种实现方式所对应的技术效果,此处不再赘述。
第六方面,本申请实施例提供了一种芯片,该芯片包括一个或多个接口电路和一个或多个处理器;所述接口电路用于从电子设备的存储器接收信号,并向所述处理器发送所述信号,所述信号包括存储器中存储的计算机指令;当所述处理器执行所述计算机指令时,使得所述电子设备执行如第一方面以及第一方面的任意一种实施方式中的方法,或执行如第二方面以及第二方面的任意一种实现方式中的方法。
第六方面所对应的技术效果可参见上述第一方面以及第一方面的任意一种实现方式所对应的技术效果,此处不再赘述。
第七方面,本申请实施例提供了一种系统,包括如第二方面以及第二方面的任意一种实现方式中所述的第一电子设备、第二电子设备和服务器。
第七方面所对应的技术效果可参见上述第二方面以及第二方面的任意一种实现方式所对应的技术效果,此处不再赘述。
附图说明
为了更清楚地说明本申请实施例的技术方案,下面将对本申请实施例的描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1为示例性示出的电子设备的结构示意图之一;
图2为示例性示出的电子设备的软件结构示意图;
图3为示例性示出的一种电子设备的服务交互界面;
图4为示例性示出的一种电子设备的服务交互界面;
图5为示例性示出的一种电子设备的架构图;
图6a为示例性的示出的一种电子设备提供服务的流程图;
图6b为示例性的示出的一种电子设备提供服务的流程图;
图6c为示例性的示出的一种电子设备提供服务的流程图;
图6d为示例性的示出的一种电子设备提供服务的流程图;
图6e为示例性的示出的一种电子设备提供服务的流程图;
图7a为示例性的示出的一种电子设备提供服务的流程图;
图7b为示例性的示出的一种电子设备提供服务的流程图;
图7c为示例性的示出的一种电子设备提供服务的流程图;
图7d为示例性的示出的一种电子设备提供服务的流程图;
图7e为示例性的示出的一种电子设备提供服务的流程图;
图7f为示例性的示出的一种电子设备提供服务的流程图;
图7g为示例性的示出的一种电子设备提供服务的流程图;
图8a为示例性的示出的一种应用场景的示意图;
图8b为示例性的示出的一种应用场景的示意图;
图8c为示例性的示出的一种应用场景的示意图;
图9a为示例性的示出的一种应用场景的示意图;
图9b为示例性的示出的一种应用场景的示意图;
图9c为示例性的示出的一种应用场景的示意图;
图10为本申请实施例提供的装置的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本文中术语“和/或”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。
本申请实施例的说明书和权利要求书中的术语“第一”和“第二”等是用于区别不同的对象,而不是用于描述对象的特定顺序。例如,第一目标对象和第二目标对象等是用于区别不同的目标对象,而不是用于描述目标对象的特定顺序。
在本申请实施例中,“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。
在本申请实施例的描述中,除非另有说明,“多个”的含义是指两个或两个以上。例如,多个处理单元是指两个或两个以上的处理单元;多个系统是指两个或两个以上的系统。
图1示出了电子设备100的结构示意图。应该理解的是,图1所示电子设备100仅是电子设备的一个范例,可选的,电子设备100可以为终端,也可以称为终端设备,终端可以为蜂窝电话(cellular phone),平板电脑(pad)、可穿戴设备或物联网设备等设备,本申请不做限定。需要说明的是,电子设备100可以具有比图中所示的更多的或者更少的部件,可以组合两个或多个的部件,或者可以具有不同的部件配置。图1中所示出的各种部件可以在包括一个或多个信号处理和/或专用集成电路在内的硬件、软件、或硬件和软件的组合中实现。
电子设备100可以包括:处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
其中,控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
USB接口130是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口130可以用于连接充电器为电子设备100充电,也可以用于电子设备100与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如AR设备等。
可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备100的结构限定。在本申请另一些实施例中,电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,外部存储器,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块 被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放 功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195,或从SIM卡接口195拔出,实现和电子设备100的接触和分离。电子设备100可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡,Micro SIM卡,SIM卡等。同一个SIM卡接口195可以同时插入多张卡。所述多张卡的类型可以相同,也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。电子设备100通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,电子设备100采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在电子设备100中,不能和电子设备100分离。
电子设备100的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本申请实施例以分层架构的Android系统为例,示例性说明电子设备100的软件结构。
图2是本申请实施例的电子设备100的软件结构框图。
电子设备100的分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,以及内核层。
应用程序层可以包括一系列应用程序包。
如图2所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图2所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供电子设备100的通信功能。例如通话状态的管理(包括接通,挂断等)。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
系统库与运行时层包括系统库和安卓运行时(Android Runtime)。系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。3D图形库用于实现三维图形绘图,图像渲染,合成和图层处理等。安卓运行时包括核心库和虚拟机。安卓运行时负责安卓系统的调度和管理。核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
可以理解的是,图2示出的系统框架层、系统库与运行时层包含的部件,并不构成 对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。
随着电子设备的发展,电子设备向用户提供的服务(例如播放视频服务、电商购物服务、播放音乐服务、播放广播服务等)也越来越多。电子设备可提供交互界面,供用户在交互界面中选择或输入所需的服务。
示例性的,图3示例性示出了一种电子设备的服务交互界面,以向用户提供服务。参照图3,以电子设备为手机为例。手机的显示界面为“XX电商”的公众号的交互界面201,交互界面201提供了菜单控件206,菜单控件206具体包括“粉丝福利”控件202、“购物”控件203、“我的服务”控件204,菜单控件206中的每个控件在被用户触发后,可用于向用户提供至少一项服务。
示例性的,用户点击“粉丝福利”控件202,手机可显示粉丝福利的服务内容。用户点击“购物”控件203,手机可显示XX电商的购物界面,以提供购物服务。示例性的,用户点击图3(1)中的“我的服务”控件204,如图3(2)所示,手机可响应于该用户操作,在“我的服务”控件204上方显示子菜单控件205。示例性的,子菜单控件205可包括“查订单物流”控件、“我的购物车”控件、“咨询客服”控件、“寄件服务”控件。用户可通过对子菜单控件中的任意一个控件进行点击操作,来触发该控件对应的服务。
示例性的,“查订单物流”控件被触发后用于提供订单物流状态的查询服务、“我的购物车”控件被触发后用于提供查看用户的购物车内容的服务、“咨询客服”控件被触发后用于提供客服服务、“寄件服务”控件被触发后用于提供寄件服务。
需要说明的是,在图3(1)与图3(2)中,相同的附图标记表示相同的对象,因此,未对各附图的附图标记做逐一解释说明,相互参考即可,这里不再赘述。
在图3示例的方案中,电子设备在交互界面中以菜单的方式来向用户提供服务,用户可通过点击菜单中的选项(例如“购物”控件203),或者,点击该菜单的子菜单中的选项(例如“寄件服务”控件),来获取服务内容。
那么传统技术中,手机可在交互界面以按钮或菜单等形式来显示服务的设定指令(例如图3中的“购物”、“我的购物车”、“咨询客服”等指令),用户可通过点击按钮或菜单触发相关指令操作,以触发相应服务。但是,交互界面中可容纳的菜单有限,使得手机在交互界面中可提供的服务的数量有限。而且,诸如子菜单控件205等子菜单涉及的服务是较为隐蔽的,用户只有点击了上一层级的菜单中的相应选项,手机才可显示子菜单涉及的服务指令,使得服务的提供方式不够灵活。
图4示例性的示出了一种电子设备的服务交互界面,以向用户提供服务。以电子设备为手机为例,手机的显示界面101包括多个控件。示例性的,多个控件包括:文本输入框控件103、搜索控件102、键盘控件105、语音控件104。用户可通过操作键盘控件105来在文本输入框控件103内输入指令,然后,用户可点击搜索控件102,手机可响应于用户操作来对用户输入的指令进行服务内容的搜索。或者,用户可通过点击语音控件104来通过语音的方式发送指令至手机,手机可响应于用户操作,对用户输入的语音指令进行识别,来进行服务内容的搜索。
在图4示例的方案中,电子设备在服务交互界面中提供文本输入框或语音输入入口的方式,来供用户自行输入文本或语音内容来触发相关指令,手机从而可以基于用户输入内容来触发相关服务。这种纯自主输入指令的方式,输入内容完全由用户自主确定,用户输入内容的不确定性强,对于手机的识别能力要求较高,手机系统的使用成本较高。而且,手机系统对用户输入内容所识别的指令,容易与用户期望输入的指令不匹配,使得手机基于识别到的指令所推荐的服务,容易与用户期望的服务出现偏差,造成系统所推荐的服务的准确性较差的问题。
为此,本申请提供了一种电子设备,示例性的,如图5所示,该电子设备可包括信息推荐系统,以及与该信息推荐系统交互的服务模块,以电子设备为手机为例进行说明。
服务模块可包括已注册至该信息推荐系统的系统服务和/或第三方服务。示例性的,本申请的信息推荐系统可将已注册服务提供给用户使用。
示例性的,系统服务可用于表示手机自带的与系统相关的服务,例如闹钟服务、日历服务等。第三方服务用于表示第三方应用提供的服务,例如视频应用可提供视频播放服务,音乐应用可提供音乐播放服务,地图应用可提供导航服务。其中,第三方应用用于表示并非手机平台开发的应用。
该信息推荐系统可包括识别模块、推荐模块、执行模块、输入输出模块、会话及服务显示模块。
示例性的,输入输出模块可用于显示提示语以及接收用户输入内容。
识别模块可用于对输入输出模块接收的输入内容进行语义识别。
推荐模块可用于基于识别模块识别的语义,确定是否可触发服务,在无法触发服务时,基于上述语义以及已注册服务所能够提供的服务内容,来生成提示语,并将提示语发送至输入输出模块。
执行模块可用于在推荐模块确定可触发服务时,调用相应服务接口,触发服务。
会话及服务显示模块,可将系统或三方服务对被调用服务的响应结果,显示至与用户交互的界面中。
其中,该信息推荐系统可以具有比图5中所示的更多的或者更少的模块,可以组合两个或多个的模块,或者可以具有不同的模块配置。图5中所示出的各种模块可以在包括一个或多个信号处理和/或专用集成电路在内的软件中实现。
该信息推荐系统中的各模块可合并或拆分,各模块可以部分或全部设置在图2所示的应用程序层或应用程序框架层。此外,信息推荐系统中的各模块可作为应用程序层或应用程序框架层中的新增模块,或在已有的相关模块中追加本申请的模块提供的功能。此外,本申请对于图2所示的信息推荐系统的架构配置并不限制为图2所示的安卓系统的架构,还可以应用到鸿蒙系统或IOS系统等系统的架构中,即本申请对于信息推荐系统的架构配置不做限制。
示例性的,该信息推荐系统可实现在图2中的应用程序层,本申请可通过提供一款应用程序(Application,App)来实现本申请的功能。
示例性的,该信息推荐系统可实现在图2中的应用程序框架层,以使电子设备中的已有应用程序可增加该信息推荐系统的功能。
示例性的,下面对系统服务和/或第三方服务注册至信息推荐系统的注册方式进行描述:
示例1:
系统或第三方应用的服务的配置文件内可添加有预设声明,以将该服务注册至本信息推荐系统。本申请的信息推荐系统通过扫描或查询系统或第三方应用的配置文件,可以确定添加了预设声明的目标服务,可将目标服务确定为系统或第三方应用注册至本申请的信息推荐系统的服务。
示例性的,以安卓系统的某视频应用为例,该某视频应用的视频播放服务组件下配置声明支持“android.intent.action.VIEW”行为,本申请的信息推荐系统通过扫描/查询系统内声明了支持“android.intent.action.VIEW”行为的服务,可以确定该视频应用已注册视频播放服务。
示例2:
系统或第三方应用在配置文件中配置注册至本信息推荐系统的服务类型(例如播放音乐、播放视频、预定酒店等)的信息,本申请的信息推荐系统通过扫描本地应用或系统的配置文件,可以确定本地应用或系统已注册至本信息推荐系统的服务类型。
示例性的,在服务的配置文件(安卓系统的应用对应AndroidManifest.xml,鸿蒙系统的应用对应config.json)中特定meta字段(如“capability”)配置支持的服务类型(如PLAY_VIDEO、PLAY_MUSIC、BOOK_HOTEL等),本申请的信息推荐系统通过扫描并解析本地应用或系统的配置文件,得知本地应用或系统已注册至本申请的信息推荐系统的服务类型。
示例3:
在第三方应用发布时,第三方应用的配置文件中已经配置了支持的服务类型,本申请可从应用市场获取各应用支持(即注册至本申请的信息推荐系统)的服务类型。
示例性的,图5中的推荐模块可从服务模块获取已注册至本申请的信息推荐系统的服务信息。
需要说明的是,系统服务和/或第三方服务注册至信息推荐系统的注册方式并不限于上述举例,还可包括更多的注册方式,这里不再赘述。
示例性的,图6a示例性的示出了电子设备提供服务的流程图,下面结合图5,来对图6a进行描述。
如图6a所示,该流程可包括如下步骤:
S301,手机对用户输入内容进行语义识别,确定语义。
示例性的,如图5所示,本申请的信息推荐系统可提供与用户交互的窗口,用户可在该窗口内输入指令,以使输入输出模块接收到用户输入内容。示例性的,输入输出模块可将用户输入内容发送至识别模块。
示例性的,该用户输入内容可包括用户在触发对所输入的内容进行发送操作之前的实时输入内容,例如用户在图4的文本输入控件103内输入内容,在用户点击搜索控件102之前,用户实时输入的内容可由输入输出模块接收,以实时的发送给识别模块。
示例性的,该用户输入内容也可以包括用户在触发对所输入的内容进行发送操作之 后的用户输入内容。
示例性的,识别模块可对用户输入内容进行语义识别,以确定语义。
可选的,识别模块可预置或实时请求语料库,来对用户输入内容进行语义分析,以确定语义。
S303,手机判断是否存在与语义匹配的服务类型。
示例性的,如图5所述,识别模块可将识别到的语义发送至推荐模块,推荐模块可在已注册的服务类型(可包括系统服务和/或第三方服务)中判断是否存在与上述语义匹配的服务类型。
示例性的,S303中的服务类型可为用户可能希望调用的服务的服务类型。
例如,用户输入“想看XX电视剧”,已注册服务包括搜索视频服务,那么推荐模块可以确定与该用户输入内容语义匹配的服务类型为搜索视频服务。
示例性的,识别模块可在用户的语义中检测是否存在与服务类型的语义相似的内容,如果识别模块检测到所述内容,则可确定与语义匹配的服务类型。
例如,用户输入“XX电影”,已注册服务包括播放视频服务、订购电影票服务,这两个服务均具有必要服务参数,这里为视频名称,那么推荐模块还可将用户输入内容的语义,与各服务类型的必要服务参数进行匹配,来确定与语义匹配的必要服务参数对应的服务类型,该服务类型即为用户可能希望调用的服务的服务类型,例如上述播放视频服务和订购电影票服务。
在本申请各实施例中,推荐模块可将用户输入内容的语义,与已注册服务的服务类型的预设信息的语义进行匹配,其中,已注册的服务类型的预设信息可包括但不限于:服务类型,和/或,服务类型的必要服务参数。然后,推荐模块可将已注册的服务类型中的候选服务类型确定为与用户输入内容的语义匹配的服务类型。即用户可能需要调用的服务的服务类型。其中,候选服务类型的预设信息的语义与用户输入内容的语义相互匹配(例如语义相似度大于预设相似度阈值)。
可选的,识别模块还可基于用户输入内容的语义,并进一步结合用户习惯、用户喜好、用户画像、用户最近使用记录等已知可用的信息,来确定用户可能需要的服务的服务类型。
本申请对于识别模块获取用户习惯、用户喜好、用户画像、用户最近使用记录等信息的方式不做限制。
可选的,在S303之后,手机确定不存在与该语义匹配的服务类型,则说明用户输入内容中缺少服务类型,例如用户输入的指令存在错误,无法与已注册的任意一个服务类型的语义相匹配,则手机转至执行S309,以提示用户输入正确的指令。其中,正确的指令的语义能够匹配至少一个服务类型。
S309,手机输出提示语。
示例性的,如图5所示,推荐模块可将提示语发送至输入输出模块,输入输出模块可按照一定的提示形式来对提示语进行输出,该提示语可在信息推荐系统提供的与用户交互的窗口内显示。
示例性的,提示形式可包括但不限于:气泡、列表、超链接、悬浮窗等。
可选的,推荐模块可将提示语的提示形式发送至输入输出模块。
可选的,在S303之后,手机确定存在与该语义匹配的服务类型,则手机可转至执行S305。
S305,手机判断所述语义是否满足触发该服务类型的服务的预设条件。
示例性的,如图5所示,推荐模块可在确定存在与该语义匹配的服务类型之后,进一步判断该语义是否可满足触发该服务类型的服务的预设条件。
示例性的,图6a中S305提及的预设条件可以包括:
在一种可能的实施方式中,与该语义匹配的服务类型为一个,且该服务类型为第一服务类型(该第一类型的服务在触发时需要必要服务参数),且语义中存在与该第一服务类型对应的必要服务参数。例如第一服务类型为播放视频服务,该服务的必要服务参数为视频名称。
在一种可能的实施方式中,与该语义匹配的服务类型为一个,且该服务类型为第二服务类型。该第二类型的服务在触发时无需必要服务参数。例如日历应用的查看日历的服务的服务类型为第二服务类型。
可选地,手机在执行S305来判断所述语义是否满足触发该服务类型的服务的预设条件时,可首先判断与该语义匹配的服务类型为第一服务类型还是第二服务类型。在手机确定与语义匹配的服务类型为第一服务类型时,则继续判断该语义中是否缺少与第一服务类型对应的必要服务参数,如果缺少必要服务参数,则确定语义不满足所述预设条件,如果不缺少必要服务参数,则确定语义满足预设条件。在手机确定与语义匹配的服务类型为第二服务类型时,则确定语义满足预设条件。
可选的,在S305之后,推荐模块确定该语义可满足触发该服务类型的服务的预设条件,则说明可触发服务,手机从而转至执行S307。
示例性的,推荐模块在确定与该语义匹配的服务类型为第一服务类型且语义中具备该第一服务类型的必要服务参数,则说明可触发服务。
示例性的,推荐模块在确定与语义匹配的服务类型为第二服务类型,则说明可触发服务。
S307,手机调用服务。
示例性的,如图5所示,推荐模块可通知识别模块其识别到的语义可触发服务,识别模块可通知执行模块来触发服务,执行模块可调用服务模块中的对应服务。
可选的,在相关服务被执行模块调用之后,服务模块可将该服务被调用后的调用结果发送至会话及服务显示模块。会话及服务显示模块可基于该调用结果来生成服务卡片信息,并将该服务卡片信息发送至输入输出模块,以由输入输出模块在窗口中显示该服务卡片。
示例性的,服务卡片信息可包括服务被调用后的响应结果信息,例如查看日历服务被调用后,响应结果可为日历的节假日信息。例如播放视频服务被调用后,响应结果可包括用户请求播放的某视频的播放链接以及该视频的属性信息等。
可选的,在S305之后,推荐模块确定该语义不可满足触发该服务类型的服务的预设条件,则说明无法触发服务,手机从而转至执行S309,以输出提示语。
示例性的,当推荐模块确定与该语义匹配的服务类型为第一服务类型,且该语义缺少必要服务参数,即语义不满足上述预设条件时,推荐模块可基于该语义中所缺少的用于触发该服务类型的服务的信息,来生成提示语,以提示用户补齐能够触发服务的指令,快速触发服务。
此外,从图6a可以看到,在S309之后,用户可按照该提示语继续补充输入指令,那么在用户输入内容发生变化的情况下,可再次触发S301,使得输入输出模块将当前的用户输入内容发送至识别模块,识别模块同样进行语义识别,后续步骤同理,这里不再赘述,直至用户输入内容的语义满足触发相应服务类型的服务的预设条件,否则,推荐模块可不断地根据用户实时输入的内容的语义,以及服务提供方所注册的各类服务所能够提供的服务信息,来更新提示语。
下面结合不同场景,来对图5和图6a的方案进行阐述:
场景1:用户输入内容对应的服务类型为多个。
可选的,在图6a的基础上,图6b示例性的示出了图6a中手机确定语义不满足触发服务类型的服务的预设条件的情况下,手机的操作流程图。
结合图5、参照图6a和图6b,在手机执行S305之后,手机执行S309之前,手机可执行S706和S707。
S706,手机确定与语义匹配的服务类型为多个。
S707,手机基于多个所述服务类型,确定第一提示语。
可选的,该第一提示语用于提示用户在多个所述服务类型中选择一个服务类型。
示例性的,推荐模块确定与该语义匹配的服务类型为多个,则推荐模块确定该语义无法满足触发该服务类型的服务的预设条件,从而确定第一提示语。
示例性的,推荐模块在确定第一提示语时,可基于该多个服务类型,可选地进一步结合用户习惯、用户喜好、用户画像、用户最近使用记录等信息,来确定第一提示语。
实施方式一,对于图6b所示的流程,可参考图7a和图8a所示的场景来理解,下面结合图7a和图8a来阐述用户输入内容对应的服务类型为多个的场景1:
图8a示例性的示出了一种应用场景的示意图。
如图8a所示,手机的显示界面501可为一个群组(这里为工作群)的会话界面,参照图8a(1),显示界面501包括一个或多个控件,控件包括但不限于:“@”控件502、“#”控件503、“?”控件504、文本输入框控件505、语音控件509、消息发送控件508等。
如图8a(1)所示,用户点击“@”控件502。如图7a所示,输入输出模块可接收到用户输入内容,这里为“@”控件的信息,并将“@”控件的信息发送至识别模块,识别模块可识别到预设标记“@”,并将“@”发送至推荐模块。
示例性的,如图7a所示的推荐模块可包括预设标记与服务类型的第一映射关系401,以及服务类型与关键字的第二映射关系402。
示例性的,第一映射关系401可包括预设标记与服务类型的映射关系,其中,每个预设标记可映射至少一个服务类型,不同预设标记映射的服务类型可不同,以使用户通过输入不同的预设标记,系统可显示不同的服务类型列表的关键字。或者,不同预设标记映射的服务类型可存在重叠的服务类型,以使同一服务类型可通过多种预设标记中的 任意一种预设标记来搜索服务。
示例性的,如图7a的第一映射关系401,“@”对应的服务类型列表包括待办实现服务、查看日历服务、搜索视频服务。“发指令”控件对应的服务类型列表包括播放视频服务、搜索视频服务、最近热播服务。“帮助”以及“?”均对应于同一服务类型列表,该服务类型列表包括播放视频服务、搜索视频服务、最近热播服务、电视截屏服务、遥控器服务。
需要说明的是,图7a中仅仅示例性的示出了部分第一映射关系401中的数据,第一映射关系401可包括比图示更多或更少的预设标记与服务类型的映射关系,本申请对此不做限制。
如图7a所示,这里的预设标记可包括但不限于“@”、“发指令”、“帮助”、“?”等。在图7a中,预设标记未示出图8a中的“#”标记,但是“#”标记与图7a中示出的预设标记的原理类似,这里不再赘述。预设标记可包括符号、文本、控件等类型的标记,本申请对于预设标记的类型不做限制。
示例性的,图7a中第一映射关系401中的预设标记(包括但不限于“@”、“发指令”、“帮助”、“?”、“#”),可以是用户在输入框输入的文本内容或通过语音输入入口输入的语音内容的语义,也可以是与上述预设标记对应的特定控件,本申请对此不做限制。
为了便于说明,在本申请的各个实施方式中,均以上述预设标记为特定控件为例进行的描述,例如在图8a中,“@”控件502可为预设标记“@”、“#”控件503可为预设标记“#”、“?”控件504可为预设标记“?”。再如图9a(2)中,控件6031为预设标记“发指令”。又如图9c(2)中,“帮助”控件803为预设标记“帮助”。但是,上述预设标记的实现形式不仅可以是特定控件,也可以是用户在交互界面内的文本框中输入的文本内容或通过语音输入入口输入的语音内容,原理类似,这里不再赘述。换言之,用户在文本框中输入上述预设标记,或通过语音输入入口输入上述预设标记的语义,同样可实现对上述预设标记的输入操作,进而手机可触发相应操作。
示例性的,第二映射关系402中的关键字可为服务类型的相关信息,该关键字用于向用户提示服务类型。示例性的,该关键字可为服务类型中的动作关键字(例如待办事项服务的关键字为“待办”)。示例性的,该关键字还可为服务类型的名字,例如待办事项服务的关键字还可为“待办事项”。本申请对于关键字的具体内容不做限制,只要可达到提示服务类型的作用即可。
此外,第二映射关系402中各服务类型的关键字可由系统服务或第三方服务在注册服务时提供相应服务类型的关键字,也可以由手机中的信息推荐系统自动配置,本申请对此不做限制。
示例性的,图7a示例性的示出的第二映射关系402可包括:待办事项服务的关键字为“待办”,查看日历服务的关键字为“日历”,搜索视频服务的关键字为“搜索”,最近热播服务的关键字为“最近热播”,电视截屏服务的关键字为“电视截屏”,遥控器服务的关键字为“遥控器”。
需要说明的是,图7a中仅仅示例性的示出了部分第二映射关系402中的数据,第二 映射关系402可包括比图示更多或更少的服务类型与关键字的映射关系,本申请对此不做限制。
继续参照图7a,推荐模块可响应于图8a(1)中用户点击“@”控件502的操作,通过第一映射关系401,可确定与“@”标记对应的服务类型列表包括待办事项服务、查看日历服务、搜索视频服务。推荐模块可根据第二映射关系402,来确定待办事项服务对应的关键字为“待办”、查看日历服务对应的关键字为“日历”、搜索视频服务对应的关键字为“搜索”。推荐模块可将上述服务类型列表中各服务类型的关键字“待办”、“日历”、“搜索”以及各关键字的提示形式(这里为列表形式)发送至输入输出模块。
如图8a(2)所示,手机可响应于图8a(1)中用户点击“@”控件502的操作,由输入输出模块显示悬浮窗控件506。悬浮窗控件506可包括上述服务类型列表的关键字的列表:@待办、@日历、@搜索。
需要说明的是,本申请对于服务类型列表的关键字的列表的显示方式并不限于控件506所示的方式,本申请对该显示方式不做限制。
这样,用户只需要输入一个预设标记,这里为点击“@”控件502,手机从而可将搜索的服务的范围缩小至该预设标记(这里为“@”标记)所对应的服务类型列表。并且,用户输入预设标记,手机可将该服务类型列表中各项服务类型的关键字提示给用户,以便于用户通过查看关键字可较为明确的确定服务类型,以选择所需要触发的服务类型。
可选的,推荐模块还可将基于“@”标记所确定的服务类型列表中各项服务类型的提示语发送至输入输出模块,如图8a(1)所示,悬浮窗控件506的列表中每项服务类型不仅可包括关键字,还可包括提示服务参数的提示语。示例性的,推荐模块对待办事项服务生成的提示语为“待办事项”,对日历服务生成的提示语为“添加事项”,对搜索视频服务生成的提示语为“输入剧集名称”。这样,用户不仅可通过悬浮窗控件506浏览到“@”标记对应的服务类型列表的关键字,还可看到提示用户继续输入的内容,以便于用户补全输入内容,以满足触发服务的预设条件,从而触发相应服务。
示例性的,本申请各个实施方式中提示语的显示方式可区别于用户已输入内容的显示方式。例如,图8a(2)所示的悬浮窗控件506内的“@待办”悬浮窗控件5061的文本字号,不同于对应的提示语“待办事项”悬浮窗控件5062的文本字号,此外,提示语“待办事项”悬浮窗控件5062的文本字体可以为斜体字体。又例如,图8a(2)所示的悬浮窗控件506内的“@待办”悬浮窗控件5061的文本可以显示为深色(例如黑色),对应的提示语“待办事项”悬浮窗控件5062的文本可以显示为浅色(例如灰色)。从而便于用户区分用户已输入内容和手机提示输入的内容。
此外,关于用户通过输入预设标记,来触发显示服务类型列表的相关信息的方式,可以包括但不限于:方式1、方式2。
方式1:用户可通过操作例如图8a(1)所示的文本输入框控件505来输入预设标记“@”,或者通过语音控件509来输入“@”的语音,以使手机可显示图8a(2)所示的界面,以提升服务搜索效率。
方式2:用户可通过点击如图8a(1)所示的“@”控件502,来输入预设标记“@”从而避免通过方式1来搜索服务类型,以影响用户进行语音或文本输入的体验。本方式 可提升用户输入体验。
实施方式二,对于图6b所示的流程,还可参考图7a、图7e、图9a及图9b所示的场景来理解,下面结合图7a和图9a,以及图7e和图9b来分别阐述场景1(即用户输入内容对应的服务类型为多个的场景):
图9a示例性的示出了一种应用场景的示意图。
如图9a所示,手机的显示界面601可为手机与智慧屏进行交互的会话界面,参照图9a(1),显示界面601包括一个或多个控件,控件包括但不限于:指令及消息控件602、文本输入框控件505、语音控件509、消息发送控件508等。
如图9a(1)所示,用户点击指令及消息控件602,如图9a(2)所示,手机可响应于该用户操作显示悬浮窗控件603,悬浮窗控件603包括用于发送指令的控件6031,以及用于发送消息的控件6032。示例性的,显示界面601为手机与智慧屏的交互界面,用户点击控件6031则可使手机的显示界面601处于指令发送模式的界面,手机可向智慧屏发送指令,以搜索和触发智慧屏可提供的服务,示例性的,图9a(3)以及图9b、图9c均为指令发送模式的界面。
用户点击控件6032,则可使手机的显示界面601处于指令发送模式的界面,手机可向智慧屏发送消息,该消息为两端交互的消息,并不用于搜索或触发服务,例如图9a(1)为消息发送模式的界面。
示例性的,如图9a(2)所示,用户点击用于发送指令的控件6031,如图9a(3)所示,手机可响应于该用户操作,在显示界面601中显示控件604,其中,控件604包括与预设标记“发指令”对应的服务类型列表的关键字,且各关键字以气泡的方式显示。
示例性的,可参考图7a的流程来理解,输入输出模块可接收到用户输入操作,这里的用户输入操作为用户点击“发指令”控件(即图9a(2)中的控件6031)的输入操作。输入输出模块可将控件6031的信息发送至识别模块,识别模块可识别到“发指令”,并将“发指令”发送至推荐模块。继续参照图7a,推荐模块可响应于图9a(1)中用户点击控件6031的操作,通过第一映射关系401,确定与预设标记“发指令”对应的服务类型列表包括播放视频服务、搜索视频服务、最近热播服务。推荐模块可根据图7a中的第二映射关系402,来确定播放视频服务对应的关键字为“播放”、搜索视频服务对应的关键字为“搜索”、最近热播服务对应的关键字为“最近热播”。推荐模块可将上述服务类型列表中各服务类型的关键字“播放”、“搜索”、“最近热播”以及各关键字的提示形式(这里为气泡形式)发送至输入输出模块。如图9a(3)所示,手机可响应于图9a(2)中用户点击控件6031的操作,由输入输出模块显示控件604。控件604可包括上述服务类型列表的关键字的气泡,例如“播放…”气泡6041、“搜索…”气泡6042、“最近热播”气泡6043。
示例性的,控件604中显示的各气泡的文本内容中带有“…”可用于表示在触发相应服务时需要继续输入指令,而不带有“…”的气泡可用于表示在触发相应服务时不需要继续输入指令。例如用户点击“最近热播”气泡6043,则用户无需继续输入指令,即可触发最近热播服务。可以理解,也可以通过其他方式提示用户是否需要继续输入指令,本申请对此不做限定。
可选地,用户还可在图9a(1)所示的文本输入框505内输入“发指令”,或者,在图8a(1)所示的文本输入框505内输入“发指令”,来触发对预设标记“发指令”的输入,手机同样可响应于该用户操作,显示与“发指令”标记对应的服务类型列表的关键字的信息,原理和显示效果相同,这里不再赘述。
在本实施方式中,请继续参照图9a(3),用户可点击“播放…”气泡6041。可选地,用户还可在图9a(3)中的文本输入框控件505内,通过操作键盘控件,来输入“播放”。手机响应于该用户操作,参照图9b(1)或图9b(2),手机可在文本输入框控件505中显示用户选择的“播放…”气泡6041对应的文本“播放”,并进一步在文本输入框控件505的输入光标507之后显示提示语。
请参照图7e,输入输出模块可接收到用户输入内容“播放”(例如用户在图9a(3)中点击的“播放…”气泡6041,或者,用户在图9a(3)中的文本输入框控件505内输入文本“播放”),并将“播放”发送至识别模块,识别模块可将“播放”的语义发送至推荐模块,推荐模块可将“播放”语义与已注册的服务类型的语义进行匹配,推荐模块可确定与“播放”的语义匹配的服务类型,可包括图7e所示的播放视频服务4031以及播放音乐服务4032。即手机可确定与用户输入内容的语义匹配的服务类型的数量为多个。在手机检测到与该指令的语义匹配的服务类型仍旧是多个,则可继续输出提示语以提醒用户输入唯一的服务类型,直至用户输入内容的语义达到触发该唯一的服务类型的服务的触发条件。
在一种可能的实施方式中,当推荐模块确定与语义匹配的服务类型为多个时,推荐模块可将用于选择服务类型的提示语发送至输入输出模块,例如提示语为:“视频”或“音乐”,如图9b(1)所示,文本输入框控件505的输入光标507之后,可显示提示语:“视频或音乐”5055,以提示用户选择播放视频或播放音乐。可选的,推荐模块还可将确定的服务类型(这里为“播放视频服务”和“播放音乐服务”)发送至识别模块,以便于识别模块对更新后的用户输入内容再次识别语义时,可参考基于上一次用户输入内容已确定的服务类型,来进行语义识别,以提升语义识别的准确度,减少用户的重复指令输入。
在另一种可能的实施方式中,当所确定的服务类型为多个时,推荐模块可基于该多个服务类型,以及用户习惯、用户喜好、用户画像、用户最近使用记录等已知可用的信息,在该多个服务类型中,确定用户可能需要使用的服务类型。示例性的,推荐模块从播放视频服务和播放音乐服务中,结合用户最近经常搜索视频的用户习惯,自动选择了用户可能需要使用的播放视频服务,使得推荐模块确定了唯一的服务类型。那么手机可结合图6c的过程,来将触发该播放视频服务所需要的信息提示给用户,例如提示语为图9b(2)所示的“影片名称”5053。如图9b(2)所示,文本输入框控件505内的输入光标507之后,可显示提示语:“影片名称”5053,以提示用户输入所需要播放的视频的影片名称。可选的,推荐模块还可将确定的服务类型(这里为“播放视频服务”)发送至识别模块。以便于识别模块对更新后的用户输入内容再次识别语义时,可参考基于上一次用户输入内容已确定的服务类型,来进行语义识别,以提升语义识别的准确度,减少用户的重复指令输入。
结合本实施方式二和图6b可以看到,在推荐模块确定与用户输入内容的语义匹配的 服务类型为多个时,在手机输出提示语后,可循环执行图6a所示的S301、S303、S305以及S309,进而使得图6b的过程可循环执行,直至手机对用户输入内容的语义匹配到唯一的服务类型,则图6b的过程结束。
在本申请实施方式一和实施方式二中,用户只需要通过操作预设标记对应的控件,或者,在文本输入框或语音输入入口内输入该预设标记的文本或语义,手机就可以将该预设标记对应的服务类型列表的关键字作为提示语输出给用户,可实现与预设标记对应的服务类型列表的服务指令的推荐,能够为用户缩小服务的搜索范围。在用户继续输入指令时,用户可在推荐的服务指令中选择所需服务的服务指令,即可完成指令输入并可选地通过继续输入指令来触发相应服务,操作便捷。
实施方式三,对于图6b所示的流程,还可参考图7e和图9a(3)所示的场景来理解,下面结合图7e和图9a(3)来阐述上述场景1(即用户输入内容对应的服务类型为多个的场景):
可选地,结合于上述实施方式二中图9a所示的场景,在手机的显示界面为图9a(3)所示的显示界面601时,例如用户在图9a(3)所示的文本输入框控件505中输入“影片名1”,那么输入输出模块可接收到该输入内容并发送至识别模块,识别模块可识别到用户输入内容的语义为电影名称为“影片名1”,并将该语义发送至推荐模块。如图7e所示,推荐模块可包括服务类型与服务参数的第三映射关系403。其中,第三映射关系403中相互映射的服务类型和服务参数用于表示在触发该服务类型的服务时所需要的服务参数。
示例性的,如图7e所示,待办事项服务的必要服务参数包括时间和事件,添加事项服务的必要服务参数为时间和事件,搜索视频服务的必要服务参数为视频名称,播放视频服务的必要服务参数为视频名称,播放音乐服务的必要服务参数为歌曲名称,订购电影票服务的必要服务参数为视频名称,导航服务的必要服务参数为起点和终点。
需要说明的是,第三映射关系403中所示的各个服务参数仅仅作为各服务类型的必要服务参数的示例,例如订购电影票服务的必要服务参数可以是具有视频名称的语义的任意一个服务参数,例如订购电影票服务的必要服务参数还可替换为电影名称。
另外,第三映射关系403仅仅示例性的示出了部分服务类型及其必要服务参数的映射关系,本申请的推荐模块内还可包括更多或更少的服务类型与必要服务参数的映射关系,本申请对此不做限制。
示例性的,如图7e所示,服务类型可包括播放视频服务4031和订购电影票服务4033,这两个服务的服务参数均为视频名称。那么推荐模块通过对用户输入内容“影片名1”的语义与第三映射关系403中各服务类型的服务参数的语义进行匹配,可以确定该用户输入内容的语义,与播放视频服务4031的服务参数“视频名称”,以及订购电影票服务4033的服务参数“视频名称”均匹配,从而确定存在与用户输入内容的语义匹配的多个服务类型(包括播放视频服务4031和订购电影票服务4033)。
在本申请实施例中,在手机基于用户输入内容确定多个服务类型后,手机同样可采用上述实施方式一或实施方式二提及的将多个服务类型的信息(不限于关键字)作为提示语提示给用户供用户选择服务类型,或者,手机可结合用户习惯、用户喜好、用户画像、用户最近使用记录等,来从多个服务类型中自动选择一个用户可能需要使用的服务 类型,并根据用户输入内容中对于触发该服务类型所缺少的信息,来生成提示语,来提示用户输入完整的指令。
场景2:用户输入内容对应的服务类型唯一,但是用户输入内容的语义中缺少该服务类型的必要服务参数的语义。
可选的,在图6a的基础上,图6c示例性的示出了图6a中手机确定语义不满足触发服务类型的服务的预设条件的情况下,手机的操作流程图。
结合图5、参照图6a和图6c,在手机执行S305之后,手机执行S309之前,手机可执行S708和S709。
S708,手机确定与语义匹配的服务类型为一个第一服务类型,但所述语义缺少该第一服务类型的必要服务参数。
S709,手机基于缺少的必要服务参数,确定第二提示语。
可选的,该第二提示语用于提示用户补充输入上述必要服务参数。
示例性的,推荐模块确定与该语义匹配的服务类型为一个,但是该语义中缺少该服务类型的必要服务参数,则推荐模块确定该语义无法满足触发该服务类型的服务的预设条件,从而确定第二提示语。
示例性的,推荐模块在确定第二提示语时,可基于语义中缺少的该唯一的服务类型的必要服务参数,可选地进一步结合用户习惯、用户喜好、用户画像、用户最近使用记录等信息,来确定第二提示语,以提示用户输入完整的服务指令,以触发相关服务。
可选地,可结合于上述实施方式一,本申请还可提供实施方式四。
实施方式四,对于图6c所示的流程,可参考图7b、图8a、图8b所示的场景来理解,下面结合图7b、图8a、图8b来阐述缺少必要服务参数的场景2:
示例性的,请参照图8a(1),用户点击“@”控件502,手机响应于该用户操作,将对应于“@”标记的服务类型列表中各服务类型的关键字以及提示语显示在图8a(2)所示的悬浮窗控件506内。用户点击图8a(2)中悬浮窗控件506内的“@待办”悬浮窗控件5061,或者,用户也可以根据悬浮窗控件506的显示内容,在文本输入框控件505内输入“待办”或“@待办”。如图8b(1)所示,手机可响应于该用户操作,将“@待办”作为用户输入内容显示在文本输入框控件505内,并将输入光标507设置于“@待办”之后。并且,手机可在文本输入框控件505内,位于输入光标507之后显示提示语5051,提示语5051的文本内容为“输入时间和事件”,以提醒用户在文本输入框控件505中补全用于触发待办事项服务的服务参数。
示例性的,请参照图7b,用户点击图8a(2)中悬浮窗控件506内的“@待办”悬浮窗控件5061后,输入输出模块可将用户输入内容,这里为“@待办”发送至识别模块,识别模块可识别到用户输入内容的语义,这里为“待办”的语义;然后,识别模块将“待办”的语义发送至推荐模块。推荐模块可在已注册的服务类型中,确定语义与“待办”的语义匹配的服务类型,这里匹配到服务类型为唯一的服务类型“待办事项服务”。推荐模块可包括服务类型与服务参数的第三映射关系403。其中,第三映射关系403中相互映射的服务类型和服务参数用于表示在触发该服务类型的服务时所需要的服务参数。
示例性的,推荐模块内可配置有各已注册的服务类型的服务参数(例如导航服务的 服务参数包括起点和终点)。其中,各服务类型的服务参数,可以是推荐模块预置,也可以是推荐模块定期或不定期从云端(本申请的信息推荐系统的云端)获取或更新,还可以是推荐模块从服务提供方获取,本申请对此不做限制。
类似的,推荐模块内配置的本文各个实施例所述的第一映射关系、第二映射关系、第四映射关系以及触发无需服务参数的服务类型(即第二服务类型)的信息,同理可由推荐模块预置,也可以是推荐模块定期或不定期从云端(本申请的信息推荐系统的云端)获取或更新,还可以是推荐模块从服务提供方获取,本申请对此不做限制。
推荐模块通过查询第三映射关系403可确定“待办事项服务”的触发需要必要的服务参数,这里确定的服务参数为时间和事件。并且,推荐模块可将“待办事项服务”所必须的服务参数的语义,与用户输入内容的语义进行匹配,以确定用户输入内容中是否缺少必要的服务参数,这里经匹配,推荐模块可以确定用户输入内容中缺少时间和事件的信息,从而生成提示语“输入时间和事件”并发送至输入输出模块。如图8b(1)所示,输入输出模块可将提示语5051(“输入时间和事件”)显示在文本输入框控件505内。
示例性的,如图7e所示,第三映射关系403中的服务类型可为上述实施例提及的预设条件中所描述的第一服务类型,其中,第一服务类型的服务在触发时需要必要的服务参数,例如导航服务的必要服务参数为起点和终点。该第三映射关系403中的服务参数即为对应的服务类型的必要服务参数。
可选的,推荐模块生成的提示语也可以为图7b所示的“待办事项”,例如,输入输出模块可将提示语(“待办事项”)显示在图8b(1)所示的文本输入框控件505内。
可选的,推荐模块在确定用户输入内容缺少相应服务类型的必要服务参数时,可结合用户习惯、用户喜好、用户画像、用户最近使用记录等生成提示语,以提示用户补全指令,以补齐缺少的必要的服务参数。
可选的,推荐模块还可将与语义匹配的服务类型的信息,这里为“待办事项服务”发送至识别模块,以便于识别模块对更新后的用户输入内容再次识别语义时,可参考基于上一次用户输入内容已确定的服务类型,来进行语义识别,以提升语义识别的准确度,减少用户的重复指令输入。
可选的,例如用户上一次输入内容对应的服务类型为导航服务,且没有满足服务触发的预设条件,那么用户再次输入内容后,如果手机基于再次输入内容的语义,检测到服务类型相较于上次确定的服务类型没有发生变化,则手机在确定用户输入内容的语义是否满足预设条件时,可结合手机已确定的该服务类型的相关信息(例如上一次确定了服务类型为导航服务,以及起点信息),来确定语义(例如本次输入内容的语义为终点信息)是否满足预设条件,从而可以确定本次输入内容的语义满足预设条件,避免对用户输入内容的重复信息检测。相反,如果用户在上一次输入内容后,手机确定服务类型为导航服务,本次用户再次输入内容后,手机确定服务类型播放视频服务,则说明服务类型发生了变化,则可中断上一次确定的导航服务的信息获取以及相关信息的提示,而是基于最新确定的服务类型,来生成提示语。
可选地,可结合于上述实施方式二,本申请还可提供实施方式五。
实施方式五,对于图6c所示的流程,还可参考图7e、图9a、图9b所示的场景来理 解,下面结合图7e、图9a、图9b来阐述缺少必要服务参数的场景2:
示例性的,如图9a所示,用户点击“发指令”控件6031,手机响应于该用户操作,显示控件604;用户点击控件604中的“播放…”控件6041,手机响应于该用户操作,在与“播放”语义匹配的播放视频服务和播放音乐服务中,结合用户习惯、用户喜好、用户画像、用户最近使用记录,自动选择了用户可能需要使用的播放视频服务。那么在确定了唯一的服务类型后,从图7e的推荐模块可以看到,第三映射关系403中播放视频服务4031在触发时需要必要的服务参数,这里为“视频名称”。那么推荐模块可进一步结合用户输入内容的语义,确定该语义中并不包括视频名称的语义信息,从而确定用户输入内容缺少必要服务参数。那么推荐模块可结合所缺少的“视频名称”服务参数,以及结合用户习惯、用户喜好、用户画像、用户最近使用记录等信息,来生成提示语,以提示用户输入完整的能够触发服务的指令,示例性的,推荐模块可确定用户最近经常播放电影,那么这里的提示语可为“影片名称”。推荐模块可将提示语“影片名称”发送至输入输出模块。可选的,推荐模块可将确定的服务类型“播放视频服务”发送至识别模块。那么在用户点击图9a(3)中的“播放…”控件6041后,手机可响应于该用户操作,如图9b(2)所示,在文本输入框控件505的输入光标507之后,显示提示语:“影片名称”5053,以提示用户输入所需要播放的视频的影片名称。
在本申请实施例中,当手机检测到用户输入内容的语义所对应的服务类型,在触发时需要必要的服务参数时,那么手机可将用户输入内容的语义与该服务类型的必要服务参数的语义进行匹配,从而确定用户输入内容的语义中缺少的必要的服务参数,并基于所缺少的必要服务参数的语义,可选的,结合用户习惯、用户喜好、用户画像、用户最近使用记录等信息,来生成提示语,以提示用户输入完整的能够触发服务的指令。手机在基于用户输入内容提供提示语时,可基于服务提供方(例如本地应用)所提供的服务类型以及触发该服务类型的服务所必须的服务参数,来不断更新提示语,即加快用户输入内容可达到触发服务的条件的速度。
场景3:用户输入内容对应的服务类型唯一,且与用户输入内容的语义匹配的服务类型为第一服务类型(该类型的服务在触发时需要必要服务参数),且语义中存在与该第一服务类型对应的必要服务参数。
可选的,在图6a的基础上,图6d示例性的示出了图6a中手机确定语义满足触发服务类型的服务的预设条件的情况下,手机的操作流程图。
结合图5、参照图6a和图6d,在手机执行S305之后,手机可执行S701、S704、S705。
S701,手机确定与语义匹配的服务类型为一个。
S704,手机检测到该服务类型为第一服务类型,且语义中存在与该第一服务类型对应的必要服务参数。
S705,手机调用第一服务。
示例性的,推荐模块确定与该语义匹配的服务类型为一个,且该唯一的服务类型为第一服务类型,第一服务类型用于表示该类型的服务在触发时需要必要的服务参数。
那么推荐模块在将用户输入内容的语义,与该唯一的服务类型对应的必要服务参数的语义进行匹配后,确定用户输入内容的语义中包括该唯一的服务类型对应的全部必要 服务参数,则推荐模块确定该用户输入内容的语义可以满足触发该唯一的服务类型的服务的预设条件,从而通知识别模块,来使执行模块调用该唯一的服务类型对应的第一服务。
可选地,可结合于上述实施方式一和实施方式四,本申请还可提供实施方式六。
实施方式六,对于图6d所示的流程,可参考图7a、图7b、图7c、图8a及图8b所示的场景来理解,下面结合图7a、图7b、图7c、图8a及图8b来阐述场景3(即用户输入内容的语义可匹配有唯一的服务类型且具备该服务类型对应的必要服务参数):
本实施方式六与实施方式一、实施方式四中涉及的相同附图,其描述过程类似,相同之处相互参考即可,这里不再赘述。
请参照图8a(1),用户点击“@”控件502,手机将对应于“@”标记的服务类型列表中各服务类型的关键字以及提示语显示在图8a(2)所示的悬浮窗控件506内。用户点击图8a(2)中悬浮窗控件506内的“@待办”悬浮窗控件5061,如图8b(1)所示,手机可将“@待办”作为用户输入内容显示在文本输入框控件505内,并将输入光标507设置于“@待办”之后。并且,手机可在文本输入框控件505内,位于输入光标507之后显示提示语5051,提示语5051的文本内容为“输入时间和事件”,以提醒用户在文本输入框控件505中补全用于触发待办事项服务的服务参数。如图8b(2)所示,用户在文本输入框控件505内输入文本内容“中午11点2号会议室开会”。然后,用户点击消息发送控件508。如图8b(3)所示,手机可响应于用户操作,在显示界面501中显示会话消息控件510。会话消息控件510可以消息或卡片等形式来显示用户添加的待办信息,这里的待办信息为“待办中午11点2号会议室开会”。
示例性的,图8a至图8b的过程的实现方式,可请参照图7a至图7c所示出的实现过程示意图。关于图7a、图7b的描述,可参照上述实施例,这里不再赘述。请参照图8b(2),在文本输入框控件505内输入文本内容“中午11点2号会议室开会”后,如图7c所示,输入输出模块可将该用户输入的文本内容“中午11点2号会议室开会”发送至识别模块,识别模块可识别到“中午11点2号会议室开会”的语义,并将该语义发送至推荐模块。推荐模块在用户上一次输入内容后,已经确定服务类型为“待办事项服务”,那么推荐模块可基于第三映射关系403中“待办事项服务”对应的服务参数(即时间和事件),来将该服务参数的语义,与识别模块提供的用户输入内容的语义进行匹配,这里可确定必要服务参数中的时间参数为“今天中午11点”,事件参数为“2号会议室开会”,因此,用户输入内容的语义中不缺少所确定的服务类型的必要服务参数。
那么推荐模块可确定用户输入内容的语义中包括唯一的服务类型,以及该服务类型对应的全部必要服务参数,从而确定用户输入内容的语义满足该服务类型的服务的触发条件。
可选的,在用户输入内容的语义中还包括该服务类型对应的可选服务参数时,推荐模块还可将该可选服务参数发送至识别模块。
示例性的,如图7c所示,推荐模块可将用户输入内容的语义中的服务参数发送至识别模块,这里包括时间参数为“今天中午11点”,事件参数为“2号会议室开会”。如图7b所示,推荐模块在对用户上一次的输入内容的语义进行分析后,已经将确定的服务类 型“待办事项服务”发送至识别模块。那么识别模块可包括用户最近输入内容对应的唯一的服务类型及本次由推荐模块传入的该服务类型的服务参数。然后,如图8b(2)所示,在用户点击消息发送控件508后,输入输出模块可将该用户操作发送至识别模块,识别模块在确定用户触发用于表示消息发送的操作后,则可将服务类型及其服务参数(这里为“待办事项服务”的服务参数)发送至执行模块。执行模块可按照服务类型,调用“待办事项服务”的服务接口,这里为日历应用的待办事项服务的服务接口,并将经由推荐模块、识别模块依次传递的该服务类型的服务参数作为调用该服务接口的参数,以实现服务接口的调用。作为该待办事项服务的服务提供方,日历应用可以响应于该服务接口的调用请求,在日历中的“今天”对应的日期内插入待办事项,待办事项的时间设置为对应于中午11点的“11:00”,待办事项的事件为“2号会议室开会”,这样,用户没有打开日历应用,就可实现对日历应用的待办事项服务的使用,并且日历应用中自动添加了上述待办事项。
可选的,如图7c所示,日历应用可将对“待办事项服务”的执行结果,这里为已添加的待办事项的信息发送至会话及服务显示模块。会话及服务显示模块可将待办事项的信息的显示形式(消息或卡片等)以及该已添加的待办事项的信息发送至输入输出模块。如图8b(3)所示,显示界面501可以消息或卡片等形式来显示图7c中执行模块对日历应用的“待办事项服务”进行调用后,日历应用执行该“待办事项服务”的执行结果,这里为在日历应用中已添加的待办事项信息,这里的待办事项信息为会话消息控件510中示出的“待办中午11点2号会议室开会”。
可选地,用户可点击图8b(3)中的会话消息控件510,手机可响应于该用户操作,将显示界面从图8b(3)所示的显示界面501切换到日历应用的应用界面,该应用界面可包括已添加的上述待办信息(例如“中午11点2号会议室开会”),用户可在该应用界面进一步对上述待办信息进行编辑、查看等操作,本申请对此不做限制。
在本申请实施例中,当手机检测到用户输入内容的语义所对应的服务类型,在触发时需要必要的服务参数时,手机确定用户输入内容的语义不仅可与该服务类型匹配,该语义还包括了该服务类型对应的全部必要服务参数时,则手机可确定用户输入内容的语义满足触发条件,从而可触发相关服务。用户在需要触发服务时,无需进入服务提供方,例如本地应用的应用界面,只需要在手机提供的交互界面内输入能够触发服务的指令,即可实现对该本地应用的服务调用,用户在该交互界面输入的指令用于调用服务时,对服务所执行的操作,能够同步到提供该服务的对应本地应用内,使得本地应用具有服务调用的响应结果。
可选地,可结合于上述实施方式二和实施方式五,本申请还可提供实施方式七。
实施方式七,对于图6d所示的流程,可参考图7e、图7f、图9a及图9b所示的场景来理解,下面结合图7e、图7f、图9a及图9b来阐述场景3(即用户输入内容的语义可匹配有唯一的服务类型且具备该服务类型的必要服务参数):
本实施方式七与实施方式二、实施方式五中涉及的相同附图,其描述过程类似,相同之处相互参考即可,这里不再赘述。
请参照图9a(1),用户点击指令及消息控件602,如图9a(2)所示,手机可响应于该用户 操作显示悬浮窗控件603,用户点击用于发送指令的控件6031。如图9a(3)所示,手机可响应于该用户操作,在显示界面601中显示控件604。
如图9a(3)所示,用户点击控件604中的“播放…”控件6041。在一种实施方式中,如图9b(2)所示,手机响应于该用户操作,在文本输入框控件505内的输入光标507之后,显示提示语:“影片名称”5053,以提示用户输入所需要播放的视频的影片名称。或者,在另一种实施方式中,如图9b(1)所示,手机响应于该用户操作,在文本输入框控件505内的输入光标507之后,显示提示语:“视频或音乐”5055。
在图9b(1)或图9b(2)之后,如图9b(3)所示,用户继续在文本输入框控件505内输入“影片名1”5054,然后,用户点击消息发送控件508。如图9b(4)所示,手机可响应于用户操作,在显示界面601中显示手机用户发送的会话消息605。示例性的,会话消息605的消息内容为“@智慧屏播放《影片名1》”,并且,显示界面601还包括会话消息606。示例性的,会话消息606的消息内容为“为您找到以下视频”。该显示界面601还包括位于会话消息606下方的播放卡片607和播放卡片608。示例性的,播放卡片607为应用1对《影片名1》的播放卡片1,播放卡片608为应用2对《影片名1》的播放卡片2。
示例性的,图9a至图9b(1)的过程,图9a至图9b(2)的过程的实现方式,可请参照图7a、图7e所示出的实现过程示意图,原理类似,这里不再赘述。关于图7a、图7e的描述,可参照上述实施例,这里不再赘述。请参照图9b(3),在用户在文本输入框控件505内输入文本内容“影片名1”5054后,如图7f所示,输入输出模块可接收到用户输入内容“影片名1”并发送至识别模块,识别模块可识别到用户输入内容的语义为“播放名称为‘影片名1’的视频”,并将该语义发送至推荐模块。
示例性的,如图7e所示,在用户输入“播放”文本之后,推荐模块已将确定的服务类型发送至识别模块。那么在图7f中,识别模块在识别用户输入内容“影片名1”的语义时,可结合已确定的服务类型,来识别语义,从而识别到上述语义“播放名称为‘影片名1’的视频”。
如图7f所示,推荐模块在接收到语义“播放名称为‘影片名1’的视频”后,推荐模块可将该语义,与图7e中确定的服务类型(例如播放视频服务)的语义进行匹配,那么在本次用户输入内容的语义与播放视频服务匹配的情况下,推荐模块还将本次用户输入内容的语义与该播放视频服务的服务参数(这里为视频名称)进行语义匹配,推荐模块可确定用户输入内容的语义中包括唯一的服务类型,以及该服务类型对应的全部必要服务参数,从而确定用户输入内容的语义满足该服务类型的服务的触发条件。
如图7f所示,推荐模块可包括服务提供方与服务类型的第四映射关系405,第四映射关系中相互映射的服务提供方和服务类型,用于表示该服务提供方向本申请的信息推荐系统注册的服务类型。
示例性的,如图7f所示,从第四映射关系405可以看到,应用1和应用2均注册有播放视频服务,日历应用注册有添加事项服务以及查看日历服务,地图应用注册有导航服务等等。第四映射关系405仅示例性的列举了部分已注册服务与其服务提供方的映射关系,该第四映射关系405还可包括更多或更少的已注册服务与其服务提供方的映射关 系,本申请对此不做限制。
示例性的,那么如图7f中的第四映射关系405所示,播放视频服务4051的服务提供方包括应用1和应用2。即存在多个服务提供方可提供当前待触发的服务类型的服务。
可选的,推荐模块可将服务参数,即视频名称为“影片名1”的信息发送至识别模块,使得识别模块包括在图7e中传入的服务类型(这里为视频播放服务)以及该服务类型对应的必要服务参数。
如图9b(3)所示,当用户点击消息发送控件508后,输入输出模块可将该用户操作发送至识别模块,识别模块在确定用户触发用于表示消息发送的操作后,则可将服务类型及其服务参数(这里为“播放视频服务”的服务参数),发送至执行模块。执行模块可按照服务类型,调用“播放视频服务”的服务接口,这里为应用1的“播放视频服务”的服务接口,以及应用2的“播放视频服务”的服务接口,并将经由推荐模块、识别模块依次传递的该服务类型的服务参数作为调用该服务接口的参数,以实现服务接口的调用。作为该“播放视频服务”的服务提供方,应用1和应用2可分别响应于相应服务接口的调用请求,来执行“播放视频服务”,这里为搜索名称为“影片名1”的视频,并将搜索结果的信息(例如“影片名1”的视频的播放链接以及该视频的介绍信息)发送至会话及服务显示模块。这样,用户没有直接操作应用1和应用2进行视频搜索和播放,只需要在本申请提供的服务的交互界面内触发或输入播放视频服务的指令,即可实现对应用1或应用2中视频资源的播放服务的使用。
可选的,如图7f所示,会话及服务显示模块可将上述搜索结果的信息的显示形式(消息或卡片等)以及该搜索结果的信息发送至输入输出模块。如图9b(4)所示,显示界面601可以消息或卡片等形式来显示用户请求播放的名称为“影片名1”的视频的播放链接以及该视频的介绍信息,这里的介绍信息为“应用1:《影片名1》的播放卡片1”,“应用2:《影片名1》的播放卡片”。
可选的,在执行模块调用相应的服务接口后,在应用1和应用2中可记录有本手机的用户对该《影片名1》的视频的搜索记录。例如,在用户点击图9b(4)中的播放卡片607后,可使应用1内同步有该《影片名1》的播放记录。
可选的,用户通过点击播放卡片607或播放卡片608来播放《影片名1》的视频时,该视频的播放界面可以在显示界面601内进行显示,也可以从显示界面601跳转至应用1或应用2中该《影片名1》视频的播放界面,本申请对此不做限制。
此外,对于已注册的服务类型的服务接口,可以是系统服务或第三方服务在注册时提供给本申请的信息推荐系统的,也可以是本申请的信息推荐系统配置的通用的相应服务类型的服务接口,相应服务类型的系统服务或第三方服务可实现该服务接口,本申请对此不做限制。
在本申请实施例中,手机可对用户输入内容的语义进行分析,确定是否存在与该语义匹配的唯一的服务类型,以及与该语义匹配的该服务类型对应的必要服务参数,那么手机可以确定用户输入内容的语义可匹配有唯一的服务类型,且该语义中包括该唯一的服务类型对应的必要服务参数的语义,其中,该必要服务参数为该服务类型的服务在触发时所必须的参数信息。那么手机可确定用户输入内容可满足触发服务的预设条件,从 而基于用户输入的该必要服务参数,来调用相应的服务类型。使得用户无需操作提供服务的应用,只需要在本申请提供的交互界面内输入触发服务的相关指令,即可实现对服务的使用。并且,用户对触发的服务所执行的操作(例如搜索某视频、播放某视频、添加待办等操作),在该服务提供方的应用中可具有响应结果(例如搜索记录、播放记录、添加待办的记录等)。
场景4:用户输入内容对应的服务类型唯一,且与用户输入内容的语义匹配的服务类型为第二服务类型(该类型的服务在触发时无需必要服务参数)。
可选的,在图6a的基础上,图6e示例性的示出了图6a中手机确定语义满足触发服务类型的服务的预设条件的情况下,手机的操作流程图。
结合图5、参照图6a和图6e,在手机执行S305之后,手机可执行S701、S702、S703。
S701,手机确定与语义匹配的服务类型为一个。
S702,手机检测到该服务类型为第二服务类型。
S703,手机调用第二服务。
示例性的,推荐模块确定与该语义匹配的服务类型为一个,且该唯一的服务类型为第二服务类型,第二服务类型用于表示该类型的服务在触发时无需必要的服务参数。
推荐模块可将确定的唯一的服务类型的信息通知至识别模块,来使识别模块通知执行模块调用该唯一的服务类型对应的第二服务。
实施方式八,对于图6e所示的流程,可参考图7a、图7d、图8a和图8c所示的场景来理解,下面结合图7a、图7d、图8a和图8c来阐述场景4(即服务类型唯一,且该服务类型的服务在触发时无需必要的服务参数):
本实施方式八与实施方式一、实施方式四、实施方式六中涉及的相同附图,其描述过程类似,相同之处相互参考即可,这里不再赘述。
请参照图8a(1),用户点击“@”控件502,手机将对应于“@”标记的服务类型列表中各服务类型的关键字以及提示语显示在图8c(1)所示的悬浮窗控件506内。用户点击图8c(1)中悬浮窗控件506内的“@日历”悬浮窗控件5062,如图8c(2)所示,手机可将“@日历”作为用户输入内容显示在文本输入框控件505内,并将输入光标507设置于“@日历”之后。并且,手机可在文本输入框控件505内,位于输入光标507之后显示提示语5052,提示语5052的文本内容为“添加事项”,以提醒用户在文本输入框控件505中补全用于触发日历的添加事项服务的服务参数,生成提示语5052的原理与场景1中的实施方式3的实现原理类似,这里不再赘述。如图8c(2)所示,用户没有继续输入在文本输入框控件505内输入内容,而是直接点击消息发送控件508,那么这将触发无需服务参数的查看日历服务。如图8c(3)所示,手机可响应于用户操作,在显示界面501中显示会话消息控件511。会话消息控件511可以消息或卡片等形式,来显示用户通过触发指令输入而调用服务的响应结果信息,这里的响应结果信息可以为日历的节假日信息或者其他相关信息。
示例性的,从图8a(1)变化至图8c的过程的实现方式,可请参照图7a、图7d所示出的实现过程示意图。关于图7a的描述,可参照上述实施例,这里不再赘述。请参照图8c(2),在文本输入框控件505内输入“@日历”后,手机可输出提示语:“添加事项”5052。然 后,如图8c(2)所示,用户点击消息发送控件508,那么如图7d所示,输入输出模块可将该用户输入的文本内容“@日历”发送至识别模块,识别模块可识别到“日历”的语义,并将该语义发送至推荐模块。推荐模块可包括触发无需服务参数的服务类型(即第二服务类型)的信息404,这里示例性的示出了查看日历服务、最近热播服务,本申请对于触发无需服务参数的服务类型(即第二服务类型)并不限制于这里列举两个服务,还可包括更多或更少的服务类型,本申请对此不做限制。
示例性的,推荐模块可将“日历”语义,与第二服务类型的语义进行匹配,从而确定与该“日历”语义匹配的唯一服务类型为“查看日历服务”。
推荐模块可将服务类型为“查看日历服务”的信息发送至识别模块。识别模块可通知执行模块调用“查看日历服务”的服务接口。执行模块可调用日历应用的“查看日历服务”的服务接口,在执行模块调用该服务接口时无需传入服务参数。日历应用可响应于该服务接口的调用请求,获取响应结果(例如当前日期所属月的节假日信息)并发送至会话及服务显示模块。会话及服务显示模块可将响应结果发送至输入输出模块进行显示,从而在图8c(3)的显示界面501中显示有该响应结果的卡片信息。
本实施方式中,推荐模块可确定用户输入内容的语义中包括唯一的服务类型,且该服务类型的服务在被触发时无需必要服务参数时,可确定用户输入内容的语义满足该服务类型的服务的触发条件,进而可调用相关服务。
在本申请实施例中,当手机检测到用户输入内容的语义所对应的服务类型,在触发时不需要必要的服务参数时,则手机可确定用户输入内容的语义满足触发条件,从而可触发相关服务。用户在需要触发服务时,无需进入服务提供方,例如本地应用的应用界面,只需要在手机提供的交互界面内输入能够触发服务的指令,即可实现对该本地应用的服务调用,用户在该交互界面输入的指令用于调用服务时,对服务所执行的操作,能够同步到提供该服务的对应本地应用内,使得本地应用具有服务调用的响应结果。
实施方式九,对于图6d所示的流程,还可参考图9a(3)所示的场景来理解场景4(即服务类型唯一,且该服务类型的服务在触发时无需必要的服务参数):
如图9a(3)所示,例如用户点击控件604中的“最近热播”气泡6043并点击消息发送控件508,那么手机可响应于该用户操作,确定与该“最近热播”的语义匹配的服务类型为图7d所示的最近热播服务4041,从而调用最近热播服务4041的服务接口,以获取到最近热播的5部热门电影,并将该5部热门电影的播放卡片显示在显示界面601。本实施方式的实现原理与实施方式八类似,这里不再赘述。
在本申请实施例中,手机可对用户输入内容的语义进行分析,确定是否存在与该语义匹配的唯一的服务类型,在该唯一的服务类型的服务在触发时无需必要的服务参数时,则手机可以确定用户输入内容的语义满足服务触发条件,从而调动该服务类型的服务,以供用户使用该服务。
场景5:用户输入内容的语义未与任意已注册的服务类型的语义相匹配,确定用户输入指令错误的场景。
示例性的,本场景5可为图6a实施例中手机通过执行S303判断是否存在与用户输入内容的语义匹配的服务类型后,手机确定不存在与该语义匹配的服务类型,从而通过 S309输出提示语的场景。
实施方式十,结合图7g和图9c来描述场景5。
请参照图9c(1),用户在显示界面601内的文本输入框控件505中输入指令“balala”5056,并点击了消息发送控件508。
在一种可能的实施方式中,如图7g所示,不论用户是否点击了消息发送控件508,只要用户输入内容发生了变化,输入输出模块就可获取用户最新输入的信息,这里输入输出模块可接收到“balala”并发送给识别模块。识别模块可对“balala”进行语义识别,将“balala”的语义发送至推荐模块。推荐模块将该“balala”的语义与已注册服务类型的任意服务类型的语义进行匹配,确定不存在与“balala”的语义匹配的服务类型,以及将“balala”的语义,与已注册服务类型的必要服务参数的语义进行匹配,也没有通过必要服务参数匹配到服务类型,从而确定不存在与用户输入内容语义匹配的服务类型(即缺少服务类型),即用户输入的指令存在错误。可选的,推荐模块可将表示用户输入指令错误,未识别到服务类型的信息发送至识别模块。
可选的,推荐模块在确定用户输入指令错误后,在一种可能的实施方式中,在生成提示语时,可生成对应于无法确定服务类型的场景的预设提示语(例如图7a中第一映射关系内的预设标记“帮助”),这里为“帮助”。
在一种可能的实施方式中,示例性的,如图9c(1)所示,用户在输入“balala”5056之后,点击了消息发送控件508,那么输入输出模块可检测到用户点击了消息发送控件508,并将该用户操作通过识别模块通知至推荐模块。推荐模块在接收到用户点击了消息发送控件508的通知之后,可将基于用户输入的“balala”所生成的提示语发送至输入输出模块。换言之,当推荐模块确定用户输入指令错误的场景下,可在用户点击了消息发送控件508之后,再将提示语发送至输入输出模块以提示给用户,这样,可避免用户在文本输入过程中输入错误的文本,而系统一直输出纠正该错误指令的提示语(例如“帮助”)的情况,这样,本实施方式在输出提示语时,可降低提示语对用户输入文本的干扰。
示例性的,该提示语可以为“帮助”,本申请各实施方式中提示语的输出方式可以是会话消息、控件、气泡、文本、列表等形式,本申请对此不做限制。
可选的,如图9c(2)所示,推荐模块发送至输入输出模块的提示语还包括会话消息802示出的“我不太理解您的意思,请再给我点时间学习吧”。可选的,推荐模块还可将各提示语的提示形式(即上述输出方式)也发送至输入输出模块。
示例性的,如图9c(1)所示,用户在文本输入框控件505中输入“balala”5056,并点击了消息发送控件508,手机可响应于该用户操作,显示图9c(2)所示的显示界面601,该显示界面601可包括会话消息801,以及会话消息802和“帮助”控件803。
示例性的,如图9c(2)所示,会话消息801的消息内容为“@智慧屏balala”,会话消息802的消息内容为提示语“我不太理解您的意思,请再给我点时间学习吧”。示例性的,“帮助”控件803可位于会话消息802下方显示,本申请对于输出的会话消息或提示语之间的布局方式以及显示方式不做限制。
可选地,“帮助”控件803可作为提示语提示用户是否需要帮助。
可选的,推荐模块在确定用户输入指令错误后,在另一种可能的实施方式中,在生成提示语时,可将图7a所示的第二映射关系中的指定的预设服务类型(例如搜索视频服务、最近热播服务)的关键字作为提示语输出。
可选的,推荐模块在确定用户输入指令错误后,在另一种可能的实施方式中,在生成提示语时,还可将用户可能需要输入的服务类型的相关指令提示给用户。
示例性的,该相关指令可以是与用户输入内容存在相同单个字词的指令。示例性的,如图7g所示,推荐模块发送至输入输出模块的提示语还可以是“播放”。其中,“播放”指令的首个字“播”的首个拼音字母为b,与用户输入内容的首个字母b相同。
示例性的,推荐模块还可根据信息推荐系统中该用户的使用记录信息,和/或,当前交互界面内的会话上下文信息,和/或,用户对该信息推荐系统的最近使用习惯等信息,来确定用户可能需要的服务类型及服务指令,以将该服务指令作为提示语。示例性的,用户最近经常搜索某部电影,则可将影片类型与该部电影的影片类型类似的多部电影的电影名称作为提示语(例如提示语为:播放电影1、播放电影2,其中,电影1和电影2为电影名称)输出,以推荐用户可能需要的服务。
在本申请实施例中,在用户输入内容无法确定任意服务类型时,可确定用户输入指令错误,从而在用户输入指令错误时,推荐用户可能需要使用的服务类型的服务指令作为提示语提示用户,能够及时对用户输入的错误指令进行纠正,以便于快速触发用户所需的服务。
可选的,继续参照图9c(2),用户点击“帮助”控件803,与图7a的实现过程类似,请参考图7a,推荐模块可根据第一映射关系401确定与“帮助”语义对应的服务类型列表,这里包括播放视频服务、搜索视频服务、最近热播服务、电视截屏服务、遥控器服务,并结合第二映射关系402,将上述服务类型列表中各项服务类型对应的关键字,以提示语输出。示例性的,参照图9c(3),手机响应于用户点击“帮助”控件803,在显示界面601显示会话消息804,会话消息804的消息内容8041请参照图9c(3),这里不再赘述。
示例性的,可参照图9a(2),用户点击控件6031后,手机可响应于该用户操作,使手机的显示界面601处于指令发送模式的界面,在该指令发送模式的界面内,用户通过文本或语音或操作控件的方式输入的内容均可认为是指令,而非消息,从而可基于输入的指令按照图5所示的信息推荐系统进行服务或指令的推荐。
在一种可能的实施方式中,用户也可以在指令发送模式的界面(例如图9c(2))的文本输入框控件505内输入文本“帮助”,或者输入符号“?”,手机可响应于该用户操作,显示图9c(3)所示的界面。
在本申请实施例中,本申请的电子设备可提供与用户交互的界面,并在该交互界面中将按钮或菜单等形式的固定指令与用户在输入框输入的自由指令相结合,在用户需要进行指令操作或指令输入时,对系统支持的指令形式或内容进行部分或完整提示。并可以在用户输入过程中进一步根据用户输入的内容对指令提示形式和内容进行动态调整,以使用户能够最简便、快捷地输入自己期望的指令。另外,在出现指令提示时,用户可以选择继续在输入框内参照提示输入补全指令,也可以直接点击指令提示选择符合自己期望的指令。该方案可提供系统或第三方注册的各项服务,并将用户在交互界面中对触 发的服务所执行的操作,响应至提供该服务的应用中,可减少用户操作。另外,在用户输入指令的过程中,可结合当前输入内容,不断地更新提示语,可降低用户对服务的搜索成本,能够减少用户出错或无效输入,提高交互效率。
需要说明的是,上述图7a至图7g中相同的附图标记表示相同的对象,因此,未对各附图的附图标记做逐一解释说明,上述各附图中未提及的附图标记可参照图7a至图7g中相同的已提及的附图标记的解释说明,这里不再赘述。
同理,上述图8a至图8c以及图9a至图9c的各附图中相同的附图标记表示相同的对象,因此,未对各附图的附图标记做逐一解释说明,上述各附图中未提及的附图标记可参照图8a至图8c以及图9a至图9c中相同的已提及的附图标记的解释说明,这里不再赘述。
可以理解的是,电子设备为了实现上述功能,其包含了执行各个功能相应的硬件和/或软件模块。结合本文中所公开的实施例描述的各示例的算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。本领域技术人员可以结合实施例对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
一个示例中,图10示出了本申请实施例的一种装置300的示意性框图装置300可包括:处理器301和收发器/收发管脚302,可选的,还包括存储器303。
装置300的各个组件通过总线304耦合在一起,其中总线304除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见,在图中将各种总线都称为总线304。
可选的,存储器303可以用于前述方法实施例中的指令。该处理器301可用于执行存储器303中的指令,并控制接收管脚接收信号,以及控制发送管脚发送信号。
装置300可以是上述方法实施例中的电子设备或电子设备的芯片。
其中,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。
本实施例还提供一种计算机存储介质,该计算机存储介质中存储有计算机指令,当该计算机指令在电子设备上运行时,使得电子设备执行上述相关方法步骤实现上述实施例中的服务调用方法。
本实施例还提供了一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行上述相关步骤,以实现上述实施例中的服务调用方法。
另外,本申请的实施例还提供一种装置,这个装置具体可以是芯片,组件或模块,该装置可包括相连的处理器和存储器;其中,存储器用于存储计算机执行指令,当装置运行时,处理器可执行存储器存储的计算机执行指令,以使芯片执行上述各方法实施例中的服务调用方法。
其中,本实施例提供的电子设备、计算机存储介质、计算机程序产品或芯片均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。
通过以上实施方式的描述,所属领域的技术人员可以了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
本申请各个实施例的任意内容,以及同一实施例的任意内容,均可以自由组合。对上述内容的任意组合均在本申请的范围之内。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。
结合本申请实施例公开内容所描述的方法或者算法的步骤可以硬件的方式来实现,也可以是由处理器执行软件指令的方式来实现。软件指令可以由相应的软件模块组成,软件模块可以被存放于随机存取存储器(Random Access Memory,RAM)、闪存、只读存储器(Read Only Memory,ROM)、可擦除可编程只读存储器(Erasable Programmable ROM,EPROM)、电可擦可编程只读存储器(Electrically EPROM,EEPROM)、寄存器、硬盘、移动硬盘、只读光盘(CD-ROM)或者本领域熟知的任何其它形式的存储介质中。一种示例性的存储介质耦合至处理器,从而使处理器能够从该存储介质读取信息, 且可向该存储介质写入信息。当然,存储介质也可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。另外,该ASIC可以位于网络设备中。当然,处理器和存储介质也可以作为分立组件存在于网络设备中。
本领域技术人员应该可以意识到,在上述一个或多个示例中,本申请实施例所描述的功能可以用硬件、软件、固件或它们的任意组合来实现。当使用软件实现时,可以将这些功能存储在计算机可读介质中或者作为计算机可读介质上的一个或多个指令或代码进行传输。计算机可读介质包括计算机存储介质和通信介质,其中通信介质包括便于从一个地方向另一个地方传送计算机程序的任何介质。存储介质可以是通用或专用计算机能够存取的任何可用介质。
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。

Claims (22)

  1. 一种服务调用方法,其特征在于,包括:
    响应于在会话界面中接收到的第一用户输入,检测到所述第一用户输入满足触发目标服务的预设条件,基于所述第一用户输入,调用目标应用的所述目标服务;
    在所述会话界面显示响应结果,其中,所述响应结果包括所述目标应用对所述目标服务的执行结果,其中,所述会话界面不属于所述目标应用的界面。
  2. 根据权利要求1所述的方法,其特征在于,所述目标应用包括与所述执行结果有关的记录信息。
  3. 根据权利要求1或2所述的方法,其特征在于,所述方法还包括:
    响应于在所述会话界面中接收到的第二用户输入,检测到所述第二用户输入的语义与预设标记的语义相匹配,在本地应用提供的服务类型中,确定与所述预设标记对应的至少一个第一服务类型;
    在所述会话界面显示第一提示语和/或第二提示语,所述本地应用包括所述目标应用;
    其中,所述第一提示语用于指示用户在所述至少一个第一服务类型中选择一个服务类型;所述第二提示语用于指示所述用户输入第一指令,所述第一指令为用于触发第一服务类型的服务的指令。
  4. 根据权利要求1至3中任意一项所述的方法,其特征在于,所述方法还包括:
    响应于在所述会话界面中接收到的第三用户输入,检测到所述第三用户输入的语义与至少一个第二服务类型的第一服务参数的语义相匹配,在所述会话界面显示第三提示语和/或第四提示语;
    其中,所述本地应用提供的服务类型包括所述第二服务类型,所述第一服务参数为所述本地应用执行所述第二服务类型的服务时所需的参数信息;
    其中,所述第三提示语用于指示所述用户在所述至少一个第二服务类型中选择一个服务类型;所述第四提示语用于指示所述用户输入第二指令,所述第二指令为用于触发所述第二服务类型的服务的指令。
  5. 根据权利要求1至4中任意一项所述的方法,其特征在于,所述响应于在会话界面中接收到的第一用户输入,检测到所述第一用户输入满足触发目标服务的预设条件,包括:
    响应于在所述会话界面中接收到的第一用户输入,检测到所述第一用户输入的语义与唯一的一个第三服务类型的语义相匹配,确定所述第一用户输入满足触发所述第三服务类型对应的目标服务的预设条件;
    其中,所述本地应用提供的第一预设服务类型包括所述第三服务类型,所述第一预设服务类型的服务由所述本地应用执行时无需服务参数。
  6. 根据权利要求1至4中任意一项所述的方法,其特征在于,所述响应于在会话界面中接收到的第一用户输入,检测到所述第一用户输入满足触发目标服务的预设条件,包括:
    响应于在所述会话界面中接收到的第一用户输入,检测到所述第一用户输入的语义与唯一的一个第四服务类型的语义相匹配,且所述第一用户输入的语义包括第二服务参数,确定所述第一用户输入满足触发所述第四服务类型对应的目标服务的预设条件;
    其中,所述第二服务参数为所述目标应用执行所述第四服务类型的服务时所需的参数信息。
  7. 根据权利要求1至6中任意一项所述的方法,其特征在于,所述方法还包括:
    响应于在所述会话界面中接收到的第四用户输入,检测到所述第四用户输入的语义与所述本地应用提供的任意服务类型的语义均不匹配,基于所述第四用户输入,在所述会话界面显示第五提示语;
    其中,所述第五提示语用于提示用户输入预设指令,所述预设指令的语义与所述本地应用提供的至少一个第五服务类型的语义相匹配。
  8. 根据权利要求7所述的方法,其特征在于,所述预设指令的首个字符与所述第四用户输入的首个字符的语义匹配。
  9. 根据权利要求1至8中任意一项所述的方法,其特征在于,所述在所述会话界面显示响应结果,包括:
    在所述会话界面以会话消息的形式显示所述响应结果。
  10. 根据权利要求1至9中任意一项所述的方法,其特征在于,所述在所述会话界面显示响应结果之后,所述方法还包括:
    响应于接收到的第五用户输入,显示所述目标应用的目标界面;
    其中,所述第五用户输入包括对所述响应结果的输入,所述目标界面包括所述执行结果。
  11. 根据权利要求1至10中任意一项所述的方法,其特征在于,所述会话界面包括以第一预设控件的形式显示的所述预设标记。
  12. 根据权利要求1至11中任意一项所述的方法,其特征在于,所述会话界面中的任意一个提示语以第二预设控件的形式显示。
  13. 根据权利要求1至12中任意一项所述的方法,其特征在于,所述第一预设控件和/或所述第二预设控件包括但不限于以下至少一种:气泡、列表、超链接、悬浮窗、会 话消息、文本框。
  14. 一种服务调用方法,其特征在于,应用于第一电子设备,所述方法包括:
    接收在会话界面中的第一用户输入,其中,所述会话界面为所述第一电子设备与所述第二电子设备的会话界面;
    在所述会话界面显示对所述第一用户输入的响应结果;
    其中,所述响应结果为所述第一电子设备或所述第二电子设备从服务器获取的;
    所述响应结果为所述服务器对目标服务的执行结果,其中,所述执行结果为所述服务器在检测到所述第一用户输入满足触发所述目标服务的预设条件时,基于所述第一用户输入执行所述目标服务的结果。
  15. 根据权利要求14所述的方法,其特征在于,所述方法还包括:
    接收在所述会话界面中的第二用户输入;
    在所述会话界面显示第一提示语和/或第二提示语;
    其中,所述第一提示语和/或所述第二提示语,为所述服务器在检测到所述第二用户输入的语义与至少一个第一服务类型的第一服务参数的语义相匹配时,生成的提示语;
    其中,所述服务器提供的服务类型包括所述第一服务类型,所述第一服务参数为所述服务器执行所述第一服务类型的服务时所需的参数信息;
    其中,所述第一提示语用于指示所述用户在所述至少一个第一服务类型中选择一个服务类型;所述第二提示语用于指示所述用户输入第一指令,所述第一指令为用于触发所述第一服务类型的服务的指令。
  16. 根据权利要求14或15所述的方法,其特征在于,
    所述执行结果为所述服务器在检测到所述第一用户输入的语义与唯一的一个第二服务类型的语义相匹配时,基于所述第一用户输入,对所述第二服务类型的所述目标服务的执行结果;
    其中,所述服务器提供的第一预设服务类型包括所述第二服务类型,所述第一预设服务类型的服务由所述服务器执行时无需服务参数。
  17. 根据权利要求14至16中任意一项所述的方法,其特征在于,
    所述执行结果为所述服务器在检测到所述第一用户输入的语义与唯一的一个第三服务类型的语义相匹配,且所述第一用户输入的语义包括第二服务参数时,对所述第三服务类型的所述目标服务的执行结果;
    其中,所述第二服务参数为所述服务器执行所述第三服务类型的服务时所需的参数信息。
  18. 一种电子设备,其特征在于,包括:存储器和处理器,所述存储器和所述处理器耦合;所述存储器存储有程序指令,所述程序指令由所述处理器执行时,使得所述电 子设备执行如权利要求1至13,或,14至17中任意一项所述的服务调用方法。
  19. 一种计算机可读存储介质,其特征在于,包括计算机程序,当所述计算机程序在电子设备上运行时,使得所述电子设备执行如权利要求1至13,或,14至17中任意一项所述的服务调用方法。
  20. 一种包含指令的计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1至13,或,14至17中任意一项所述的服务调用方法。
  21. 一种芯片,其特征在于,包括一个或多个接口电路和一个或多个处理器;所述接口电路用于从电子设备的存储器接收信号,并向所述处理器发送所述信号,所述信号包括存储器中存储的计算机指令;当所述处理器执行所述计算机指令时,使得所述电子设备执行权利要求1至13,或,14至17中任意一项所述的服务调用方法。
  22. 一种系统,包括权利要求14至17任一项所述的第一电子设备、第二电子设备和服务器。
PCT/CN2023/081952 2022-03-24 2023-03-16 服务调用方法及电子设备 WO2023179454A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210293757.9A CN116841661A (zh) 2022-03-24 2022-03-24 服务调用方法及电子设备
CN202210293757.9 2022-03-24

Publications (1)

Publication Number Publication Date
WO2023179454A1 true WO2023179454A1 (zh) 2023-09-28

Family

ID=88099874

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/081952 WO2023179454A1 (zh) 2022-03-24 2023-03-16 服务调用方法及电子设备

Country Status (2)

Country Link
CN (1) CN116841661A (zh)
WO (1) WO2023179454A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105247511A (zh) * 2013-06-07 2016-01-13 苹果公司 智能自动化助理
CN111724775A (zh) * 2019-03-22 2020-09-29 华为技术有限公司 一种语音交互方法及电子设备
CN111880645A (zh) * 2019-05-02 2020-11-03 三星电子株式会社 基于用户的语音输入确定目标设备并控制目标设备的服务器及其操作方法
CN115150501A (zh) * 2021-03-30 2022-10-04 华为技术有限公司 一种语音交互方法及电子设备
CN115700451A (zh) * 2021-07-28 2023-02-07 华为技术有限公司 一种服务的推荐方法及电子设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105247511A (zh) * 2013-06-07 2016-01-13 苹果公司 智能自动化助理
CN111724775A (zh) * 2019-03-22 2020-09-29 华为技术有限公司 一种语音交互方法及电子设备
CN111880645A (zh) * 2019-05-02 2020-11-03 三星电子株式会社 基于用户的语音输入确定目标设备并控制目标设备的服务器及其操作方法
CN115150501A (zh) * 2021-03-30 2022-10-04 华为技术有限公司 一种语音交互方法及电子设备
CN115700451A (zh) * 2021-07-28 2023-02-07 华为技术有限公司 一种服务的推荐方法及电子设备

Also Published As

Publication number Publication date
CN116841661A (zh) 2023-10-03

Similar Documents

Publication Publication Date Title
WO2020238356A1 (zh) 界面显示方法、装置、终端及存储介质
WO2021063343A1 (zh) 语音交互方法及装置
US20170235435A1 (en) Electronic device and method of application data display therefor
US20170011010A1 (en) Method for displaying web content and electronic device supporting the same
US20210405767A1 (en) Input Method Candidate Content Recommendation Method and Electronic Device
WO2021175272A1 (zh) 一种应用信息的显示方法及相关设备
US20170295260A1 (en) Platform for interaction via commands and entities
CN111835904A (zh) 一种基于情景感知和用户画像开启应用的方法及电子设备
US10540415B2 (en) Apparatus and method for managing history information in an electronic device
WO2022033432A1 (zh) 内容推荐方法、电子设备和服务器
CN114117225A (zh) 图书推荐方法及图书推荐设备
CN111935353B (zh) 移动终端及其短信显示方法
US20230216732A1 (en) Network Configuration Method and Device
WO2023179454A1 (zh) 服务调用方法及电子设备
WO2020047709A1 (zh) 一种中文输入法候选词的搜索方法、终端及服务器
CN112786022B (zh) 终端、第一语音服务器、第二语音服务器及语音识别方法
KR20160112217A (ko) 전자 장치 및 전자 장치에서의 정보 처리 방법
CN116339562B (zh) 一种快捷输入方法及电子设备
KR20150120123A (ko) 정보 제공 방법 및 장치
WO2024067122A1 (zh) 一种窗口显示方法及电子设备
WO2024067216A1 (zh) 应用程序推荐方法和电子设备
WO2023231645A1 (zh) 搜索方法、装置、电子设备和可读存储介质
WO2024051555A1 (zh) 一种数据查询方法、电子设备及系统
WO2024037346A1 (zh) 页面管理方法及电子设备
WO2022089276A1 (zh) 一种收藏处理的方法及相关装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23773702

Country of ref document: EP

Kind code of ref document: A1