WO2023060897A1

WO2023060897A1 - Processing method, smart device and storage medium

Info

Publication number: WO2023060897A1
Application number: PCT/CN2022/094273
Authority: WO
Inventors: 朱荣昌; 邵刚; 梁文斌
Original assignee: 深圳传音控股股份有限公司
Priority date: 2021-10-14
Filing date: 2022-05-20
Publication date: 2023-04-20

Abstract

The present application discloses a processing method, a terminal and a storage medium. The method comprises: responding to a first preset operation, and/or responding to meeting a first preset condition; processing at least one recommendation interaction instruction on the basis of a first preset policy, the at least one interaction instruction being acquired according to key information; and/or in response to meeting a second preset condition, performing corresponding processing according to a second preset policy; and/or, in response to the first preset operation not meeting the second preset condition and meeting a third preset condition, performing corresponding processing according to a third preset policy. This can improve response efficiency of an smart device during man-machine interaction.

Description

Processing method, smart device and storage medium

related application

This application claims the priority of the Chinese patent application with the application number 202111280217.9 and the title of the invention "processing method, intelligent device and readable storage medium" submitted to the China Patent Office on November 01, 2021, and claims to be filed in November 2021 Submitted to the China Patent Office on the 5th, the application number is 202111308433.X, the title of the invention is "interaction method, intelligent terminal and readable storage medium", and it is required to be submitted to the China Patent Office on October 14, 2021, the application number is 202111194891.5, the invention The priority of the Chinese patent application entitled "Processing Method, Processing Device and Readable Storage Medium", the entire content of which is incorporated by reference in the application.

technical field

The present application relates to the technical field of terminal processing, and in particular to a processing method, an intelligent device, and a storage medium.

Background technique

In terms of intelligent technology for information processing, there are more and more scenarios that require innovative solutions. For example, in terms of human-computer interaction, how to intelligently interact with information on smart devices is a topic that needs to be improved urgently.

During the process of conceiving and implementing this application, the inventors found at least the following problems: smart devices cannot respond quickly and accurately during human-computer interaction, which seriously affects the efficiency of human-computer interaction and results in poor user experience.

The foregoing description is provided to provide general background information and does not necessarily constitute prior art.

technical solution

The main purpose of the present application is to provide a processing method, an intelligent device and a storage medium, aiming at solving the problem of poor human-computer interaction efficiency.

In order to achieve the above purpose, the present application provides a processing method, which includes the following steps: Step S1: responding to the first preset operation, and/or, responding to satisfying the first preset condition; Step S2: based on The first preset strategy processes at least one recommended interaction instruction, wherein the at least one interaction instruction is obtained according to key information; and/or in response to satisfying the second preset condition, corresponding processing is performed according to the second preset strategy; and /or, in response to the first preset operation not satisfying the second preset condition and satisfying a third preset condition, perform corresponding processing according to a third preset strategy.

Optionally, the step S1 includes: step S1A1: obtaining key information in response to the smart device meeting the first preset condition; step S1A2: obtaining at least one recommended interaction instruction according to the key information; the step S2 includes: : Step S2A: Outputting the at least one recommended interaction instruction according to the first preset strategy; wherein, the first preset condition includes at least one of the following: wrong interaction instructions are input for more than a preset number of times, and are not received within a preset time period The correct interaction instruction is received, the preset function trigger information is obtained, the preset identity information is obtained, the associated device is connected, the preset information is received, and the network preset connection is received; the key information includes at least one of the following: error Interaction instructions, instruction keywords in wrong interaction instructions, functions currently used by smart devices, functions to be triggered by smart devices, user identities, application scenarios, interaction result keywords, associated device information, and preset information keywords.

Optionally, step S1A2 includes: after performing the operation according to the voice interaction instruction, when performing the return operation and inputting the voice interaction instruction again, confirming that the voice interaction instruction is a wrong interaction instruction; and/or the same user input the previous When the time interval between the voice interaction instruction and the subsequent voice interaction instruction is greater than the first preset time interval and less than the second preset time interval, it is confirmed that the previous voice interaction instruction is an incorrect interaction instruction.

Optionally, the key information includes the erroneous interaction instruction and/or the instruction keyword in the erroneous interaction instruction, and the step S1A1 includes: combining the erroneous interaction instruction and/or the instruction keyword Matching with the interaction instructions in the database; confirming the interaction instructions whose matching value exceeds the threshold as recommended interaction instructions.

Optionally, matching the wrong interaction instruction and/or the instruction keyword with the interaction instruction in the database includes: confirming the user intention according to the wrong interaction instruction and/or the instruction keyword; acquiring The interaction instruction in the database and the matching value of the user intention.

Optionally, step S2A includes: displaying the erroneous interaction instruction and the recommended interaction instruction related to the erroneous interaction instruction in association on the display interface.

Optionally, the obtaining key information includes: obtaining the function currently used by the smart device according to the display interface of the smart device; the step S1A2 includes: obtaining information associated with the function currently used by the smart device At least one recommended interaction command.

Optionally, the acquiring at least one recommended interaction instruction associated with the function currently used by the smart device includes at least one of the following: acquiring at least one recommended interaction instruction associated with an operable control in the display interface of the smart device Recommending an interaction instruction; obtaining at least one recommended interaction instruction associated with the display content in the display interface of the smart device; obtaining at least one recommendation associated with the previous or next display interface in the current display interface of the smart device Interactive commands.

Optionally, the method further includes: when it is detected that an interface jump occurs, acquiring a new recommended interaction instruction according to the information of the interface after the jump.

Optionally, step S1A2 includes: obtaining the associated device information, the associated device information including: function and location; obtaining at least one recommended interaction instruction according to the associated device information.

Optionally, after step S2A, the method further includes: in response to the first operation and/or the first voice instruction, determining a target recommended interaction instruction from the at least one recommended interaction instruction; and responding according to the target recommended interaction instruction.

Optionally, step S2A includes: monitoring feedback information of the smart device for the interaction instruction; and outputting the at least one recommended interaction instruction when the smart device receives the interaction instruction but does not output feedback information.

Optionally, when the smart device receives an interaction instruction but does not output feedback information, outputting the at least one recommended interaction instruction includes: when the smart device receives an interaction instruction but does not output feedback information, confirming the The interaction instruction is the wrong interaction instruction; the at least one recommended interaction instruction is output according to the wrong interaction instruction; wherein, the at least one recommended interaction instruction includes: a recommended interaction instruction related to the key information and a system general recommended interaction instruction.

Optionally, step S1A2 includes: acquiring a commonly used recommended interaction instruction of the first application as the at least one recommended interaction instruction according to the historical frequently used functions and/or historical interaction instruction usage records of the currently used first application.

Optionally, the method further includes: outputting frequently-used recommended interaction instructions of the first application according to the first preset strategy, and setting the deleted recommended interaction instructions as non-used in response to the deletion of the frequently-used recommended interaction instructions. Recommend interactive commands.

Optionally, step S2A includes: acquiring user information, and if the current user is a new user, outputting a recommendation interaction instruction associated with the key information; and/or, if the current user is an old user, recommending Use records of interactive instructions, determine the commonly used recommended interactive instructions of the current user, output the commonly recommended interactive instructions of the current user; and/or if the current user is an old user, output commonly used recommended interactive instructions, and request display A control for other partial recommended interactive instructions, wherein the control for requesting to display other partial recommended interactive instructions is used to obtain all recommended interactive instructions associated with the key information; and/or obtain the identity information of the current user, the current The user's identity information includes age and/or face image information, if the current user is an old man and/or a child, then voice output the at least one recommended interaction instruction; and/or, if the current user is not an old man and /or the child, the interface outputs the at least one recommended interactive instruction; and/or acquires the software version information of the first application currently in use, and acquires the newly added recommendation of the latest version of the first application according to the software version information After the interaction instruction, the at least one recommended interaction instruction is output, and the newly added recommended interaction instruction is marked.

Optionally, the at least one recommendation interaction instruction includes: a recommendation interaction instruction related to the key information and a general system recommendation interaction instruction; step S2A includes: preferentially displaying and/or highlighting recommendations related to the key information Interactive commands.

Optionally, step S1A2 further includes: when obtaining the recommended interaction instruction from the server fails, obtaining the recommended interaction instruction associated with the key information from the local database.

Optionally, the step S1 includes: step S1AA: obtaining at least one recommended interaction instruction according to key information in response to the first preset operation;

Optionally, the first preset operation includes at least one of the following: an operation of triggering a voice input control; an operation of triggering a voice instruction prompt; an operation of triggering interface switching; inputting wrong interaction instructions exceeding a preset number of times; and /or the key information includes at least one of the following: the instruction keyword in the wrong interaction instruction; the function currently used by the smart device; the function to be triggered by the smart device; the identity of the user; Information of the first application in the device; current browsing content information on the smart device; interaction result keywords; associated device information; preset information keywords.

Optionally, step S2 includes: outputting prompt information, in response to the selection operation, outputting a corresponding recommended interaction instruction according to the selection result; and/or outputting prompt information, responding to no response to the prompt information, according to the first The preset policy outputs the at least one recommended interaction instruction; and/or acquires the attribute information of the at least one recommended interaction instruction, and outputs the at least one recommended interaction instruction in different regions according to the attribute information; and/or Responding to the fact that the smart device does not meet the preset condition, acquiring an associated device associated with the smart device, and sending the at least one recommended interaction instruction to the associated device, so that the associated device outputs the at least one Recommending an interaction instruction; and/or obtaining the quantity of the at least one recommended interaction instruction, and outputting the at least one recommended interaction instruction according to the first sub-preset strategy when the quantity of the at least one recommended interaction instruction exceeds a threshold; And/or, when the quantity of the at least one recommended interaction instruction does not exceed the threshold, the at least one recommended interaction instruction is output according to the second sub-preset strategy.

Optionally, the failure of the smart device to meet the preset conditions includes at least one of the following: the smart device does not have a display device; the smart device display device does not meet the display requirements of the recommended interaction instruction; the smart device Does not have the display authority for recommended interaction instructions; the recommended interaction instructions are related to associated devices.

Optionally, the method further includes: if a non-voice operation is detected before step S1AA, determining a corresponding target interaction instruction from the at least one recommended interaction instruction according to the non-voice operation; outputting the At least one recommended interaction instruction is provided, and the target interaction instruction is marked.

Optionally, the step S1 includes: step S1B: outputting the first interface in response to the first preset operation, and/or outputting the second interface in response to satisfying the first preset condition; the step S2 includes: Step S2B: Execute corresponding processing on the first interface and/or the second interface in response to satisfying a second preset condition.

Optionally, the first preset operation includes at least one of the following: waking up, starting, running or closing at least one preset application or service; obtaining the first information; sending the first information; failing to obtain the first information within a preset time period to the first information; and/or the first interface includes at least one of the following: an update control for updating the first interface; a recommendation instruction associated with the update control; a recommendation with a function different from that of the update control Interaction instructions; the wake-up interface of the preset application or service; the running interface of the preset application or service; the interface of the application or service associated with the preset application or service; associated with the preset application or service The recommended interaction instruction; the control intention corresponding to the first information; the recommended interaction instruction associated with the first information; the interface after responding according to the first information; the recommended interaction instruction associated with the current scene.

Optionally, in the step S1B, in response to the first preset operation, outputting the first interface includes: in response to the running operation of the preset application or service, when the running operation is different from the function of the preset application or service When matching, the first interface is output, and the first interface includes at least one of the following: operation failure information; recommended instructions corresponding to the operation of the preset application or service; corresponding to the application or service associated with the operation operation the recommended instruction corresponding to the associated device associated with the running operation; the recommended instruction corresponding to the functional configuration of the preset application or service; the update control used to update the first interface; A recommendation instruction associated with the control; a recommendation instruction different from the function of the update control; a recommendation instruction and/or an update control associated with the function of updating the preset application or service; and/or, in response to the preset application or the running operation of the service, when the running operation matches the function of the preset application or service, the first interface is output, and the first interface includes at least one of the following: the default application or service a running interface; a recommended instruction corresponding to the running operation; a recommended instruction corresponding to the function configuration of a preset application or service; an update control for updating the first interface; a recommended instruction associated with the update control; A recommendation instruction with a different function of the update control; and/or, in response to the shutdown instruction of the preset application or service, output the first interface, wherein the first interface includes at least one of the following: the interface of the application or service associated with the preset application or service; the recommendation instruction of the application or service associated with the preset application or service; and/or, responding to the closing instruction of the preset application or service and other applications or a service startup instruction, outputting the first interface, where the first interface includes at least one of the following: a recommendation instruction and/or an update control corresponding to a difference between the other application or service and the preset application or service; The recommended instruction and/or update control corresponding to the newly added function of the other application or service relative to the preset application or service; the update control used to update the first interface; the recommendation instruction associated with the update control; A recommendation instruction that is different from the function of the update control; an interface of an application or service associated with the other application or service; a recommendation instruction corresponding to an associated device associated with the other application or service; and/or, responding to the wake-up 1. Start or run at least one preset application or service, if the first information is not obtained within the preset time period, or the wrong interactive instruction is input more than the preset number of times, output the first interface including the recommended interactive instruction, wherein the recommended The interactive instruction is associated with the historical instruction information of the preset application or service, and/or associated with the function of the preset application or service, and/or associated with the current scene; and/or, in response to obtaining the first information, outputting a first interface corresponding to the matching result according to the matching result of the first information and preset information; and/or, in response to obtaining the first information, determining according to the first information or generate a control intent, and output a first interface corresponding to the control intent; and/or, in response to obtaining the first information, and the first information cannot determine or generate a control intent, output a first interface corresponding to the first interface The first interface corresponding to the recommended interactive instruction associated with the information; and/or, in response to the acquisition of the first information, and the first information can determine or generate multiple control intentions, and output an interface corresponding to the multiple control intentions the first interface of .

Optionally, outputting a first interface corresponding to the matching result includes: outputting a first interface for executing the first information in response to the matching of the first information with preset information; and/or, in response to The first information does not match the preset information, and there is preset information whose semantic similarity with the first information is greater than a preset value, outputting a first interface including selection prompt information, the selection prompt information including selection Whether to execute the prompt information of the first information, and/or select whether to store the prompt information of the first information.

Optionally, in response to obtaining the first information, outputting a first interface corresponding to the matching result according to a matching result between the first information and preset information includes: responding to the first information The first language information does not match the preset language information, and a first interface including recommended instructions is output, and the language information of the recommended instructions matches the preset language information and/or the first language information.

Optionally, outputting the first interface corresponding to the control intention includes: responding to the control intention satisfying a preset control intention condition, responding directly according to the control intention, and outputting the first interface after responding to the control intention. An interface; and/or, in response to the control intention not satisfying the preset control intention condition, outputting a first interface including the control intention, and/or outputting information about associated devices associated with the control intention and/or send the first interface including the control intention to the associated device for output; and/or, in response to the control intention not satisfying the preset control intention condition, the output includes a recommended interaction A first interface for instructions, wherein the recommended interaction instruction is associated with the control intention and/or satisfies the preset control intention condition.

Optionally, in response to the control intention meeting the preset control intention condition, responding directly according to the control intention, and outputting the first interface after responding to the control intention includes: responding to the control intention meeting the preset control intention Intention conditions, wake up, start or run at least one preset application or service, and output a first interface including a recommended interaction instruction, and/or the running interface of the preset application or service, wherein the recommended interaction instruction is related to the preset Assume that the application or service is associated, and/or associated with the first information.

Optionally, outputting the first interface corresponding to the multiple control intents includes: determining at least one target control intent from the multiple control intents according to current scene information and/or a selection instruction.

Optionally, after the step of determining at least one target control intention from the plurality of control intentions, it includes: responding to a confirmation operation, and/or responding to the target control intention meeting a preset control intention condition, and/or responding Outputting a first interface in response to the target control intention based on the target control intention; and/or, in response to no confirmation operation being received, and/or the target control intention not satisfying the preset control intention condition, Then output the first interface including the target control intention, and/or the control-associated device outputs the first interface including the target control intention; and/or, in response to not receiving the confirmation operation, and/or the at least one If the target control intention does not satisfy the preset control intention condition, a first interface including recommended interaction instructions is output, wherein the recommended interaction instruction is associated with the target control intention and/or satisfies the preset control intention condition.

Optionally, meeting the first preset condition includes at least one of the following: the current scene information meets the preset scene condition; the current application or service belongs to the preset list; the running result of the current application or service meets the preset result condition; The operation result of the application or service does not meet the preset result condition; the received first information meets the preset information condition; the first interface meets the preset interface condition, wherein the preset interface condition includes at least one of the following: there is a blank area; The font size meets the preset size value; the screen brightness meets the preset brightness value; the input second information is received; the received second information meets the preset information condition, wherein the preset information condition includes at least one of the following: control object For the objects in the first interface; the control intent is the control intent corresponding to the function of the smart device; the control intent is the control intent corresponding to the function of the preset application or service.

Optionally, in the step S1B, in response to satisfying the first preset condition, a second interface is output, including at least one of the following: in response to the first interface satisfying the preset interface condition and receiving the second information, A recommended interaction instruction associated with the second information is displayed on the first interface to output the second interface; in response to the first interface not satisfying the preset interface condition and receiving the second information, the After the first interface is processed, the recommended interactive instruction associated with the second information is displayed on the processed first interface to output the second interface; in response to the received first information meeting the preset information condition, Outputting a second interface corresponding to the first information; outputting the second interface corresponding to the second information in response to the received second information satisfying a preset information condition.

Optionally, performing corresponding processing on the first interface and/or the second interface in the step S2B includes at least one of the following: hiding or closing the first interface and/or the second interface; Merge or merge the first interface and/or the second interface; enlarge or reduce the first interface and/or the second interface; output a third interface; output the first interface and/or the The second interface is sent to the associated device; after processing the first interface and/or the second interface, output to the associated device for output.

Optionally, the smart device includes at least one first display area and at least one second display area, and both the first display area and the second display area display the first interface; the step S2B: responding When the second preset condition is satisfied, performing corresponding processing on the first interface and/or the second interface includes: responding to the first interface satisfying the second preset condition, performing the first display area and the first interface in one of the second display area, or simultaneously process the first interface displayed in the first display area and the second display area.

Optionally, the step S2B: in response to satisfying the second preset condition, performing corresponding processing on the first interface and/or the second interface includes: in response to a movement operation in a non-single-handed mode, moving the The information in the first interface is displayed alternately through the first display area and the second display area; and/or, in response to the movement operation in the single-handed mode, adjust the information in the first interface in the display in the first display area.

Optionally, the step S1 includes: step S1C: acquiring the input first information; the step S2 includes: step S2C, in response to the first information satisfying the second preset condition, performing a corresponding response according to the second preset strategy processing; and/or, in response to the first information not meeting the second preset condition and meeting the third preset condition, performing corresponding processing according to a third preset strategy; the first information meets the second preset condition, Including at least one of the following: the first information includes at least one control intention; at least one control intention can be generated or determined according to the first information; the meeting the third preset condition includes at least one of the following: The second information of the device determines the control intention; the control intention can be determined according to user selection.

Optionally, the control intentions include at least one of the following: historical control intentions; associated control intentions; privacy control intentions; non-privacy control intentions; high-level control intentions; non-high-level control intentions.

Optionally, the performing corresponding processing according to the second preset strategy includes at least one of the following: if there is only one control intention, perform corresponding processing according to the control intention; if there are at least two control intentions, perform corresponding processing according to The preset selection strategy determines the target control intent, and performs corresponding processing according to the target control intent.

Optionally, the second information of the smart device includes at least one of the following: scene information of the smart device; time information of the smart device; location information of the smart device; status information of the smart device ; application or service information of the smart device; trigger object information of the smart device; relationship information between multiple applications or services of the smart device; associated device information of the smart device; user operating habits; The historical interaction records stored by the smart devices; the historical interaction records obtained by downloading from network devices; and the historical interaction records obtained from associated devices.

Optionally, the determining the target control intention according to the second information of the smart device includes: determining or generating intermediate information according to preset rules according to the first information and the second information, and determining according to the intermediate information control intent. Optionally, the preset rules include at least one of the following: if the first information lacks partial information, then determine or generate the partial information according to the second information, so that the first information can be combined with the The partial information determines or generates the intermediate information; if the first information includes the first partial information that cannot be recognized or responded, then determine or generate the second partial information according to the second information, so that the first information can be combined with The second part of information determines or generates the intermediate information.

Optionally, the corresponding processing according to the third preset strategy includes at least one of the following: immediately or delaying or stopping or switching the processing corresponding to the control intention of the smart device; outputting confirmation information, in response to receiving the confirmation Operation, execute the processing corresponding to the control intent on the smart device; copy or transfer the processing corresponding to the control intent to the associated device for execution; execute the processing corresponding to the control intent on the smart device and/or the associated device deal with.

Optionally, the processing method further includes the following step: in response to the first information not satisfying the second preset condition and not satisfying the third preset condition, performing corresponding processing according to a fourth preset policy.

Optionally, the step S1C: before the step of acquiring the input first information, further includes: performing preset processing on the smart device.

The present application also provides a processing method applied to smart devices, wherein the processing method includes: Step S10: Responding to the first preset operation and/or the information of the associated device, determine the control intention and/or obtain at least one recommendation Interacting instructions and/or outputting the first interface; Step S20: Execute corresponding processing on the smart device based on a preset strategy, and/or control associated devices to output.

Optionally, the step S10 includes: step S10A: in response to the first preset operation, obtaining at least one recommended interaction instruction according to the first preset operation and key information; the step S20 includes: step S20A: in response to In the second preset operation, and/or the smart device does not meet the preset condition, at least one recommended interaction instruction is sent to the associated device for output.

Optionally, the key information includes at least one of the following: instruction keywords in the wrong interaction instruction; functions currently used by the smart device; functions to be triggered by the smart device; user identity; Information of the first application in the device; current browsing content information on the smart device; interaction result keywords; associated device information; preset information keywords.

Optionally, the failure of the smart device to meet the preset condition includes at least one of the following: the smart device does not have a display device; the smart device display device does not meet the display requirements of the recommended interaction instruction; the smart device does not Possess display authority for recommended interaction instructions; the recommended interaction instructions are related to associated devices.

Optionally, step S10A includes: determining a user operation intention according to the first preset operation and the key information, obtaining the at least one first recommended interaction instruction according to the user operation intention; and/or obtaining an input The keyword information of the interactive instruction, and obtain the recommended interactive instruction according to the keyword information and key information.

Optionally, step S20A includes: preferentially displaying and/or highlighting recommended interaction instructions related to the associated device on the display screen of the associated device; and/or when the number of the at least one recommended interaction instruction exceeds When the threshold is reached, the at least one recommended interaction instruction is output according to the first preset strategy; and/or, when the number of the at least one recommended interaction instruction does not exceed the threshold, the at least one recommended interaction instruction is output according to the second preset strategy. and/or, obtain the software version information of the first application according to the information of the first application of the smart device in the key information, and obtain the software version information of the first application according to the software version information. After the newly added recommended interactive instruction of the latest version of an application, highlight the newly added recommended interactive instruction; and/or respond to the keyword information of the interactive instruction, obtain from the at least one recommended interactive instruction conforming to the The recommended interaction instruction of the keyword information, in response to the second preset operation, and the smart device does not meet the preset condition, sending the recommended interaction instruction in the at least one recommended interaction instruction that conforms to the keyword information to the associated device to output.

Optionally, the step S10 includes: step S10B: outputting the first interface in response to the first information satisfying the first preset condition, and/or outputting the second interface in response to the second information satisfying the second preset condition ; Step S20B: in response to satisfying a third preset condition, perform corresponding processing on the first interface and/or the second interface.

Optionally, in the step S10B, in response to the first information meeting the first preset condition, outputting the first interface includes at least one of the following: in response to a matching result between the first information and the preset information, outputting the A first interface corresponding to the matching result; in response to the first information including the control intention, output the first interface corresponding to the control intention; in response to the first information being unable to determine or generate the control intention, output the first interface corresponding to the first information The first interface corresponding to the associated recommended interaction instruction; multiple control intentions can be determined or generated in response to the first information, and the first interface corresponding to the multiple control intentions is output.

Optionally, the outputting the first interface corresponding to the control intention includes at least one of the following: responding to the control intention satisfying a preset control intention condition, responding directly according to the control intention, and outputting the response The first interface after the control intention; in response to the control intention not satisfying the preset control intention condition, output the first interface including the control intention, and/or output the associated equipment associated with the control intention information, and/or send the first interface including the control intention to the associated device for output; in response to the control intention not satisfying the preset control intention condition, output the interface including the recommended interaction instruction The first interface, wherein the recommended interaction instruction is associated with the control intention and/or satisfies the preset control intention condition.

Optionally, the outputting the first interface corresponding to the multiple control intents includes: determining at least one target control intent from the multiple control intents according to current scene information and/or a selection instruction.

Optionally, after determining at least one target control intention from the plurality of control intentions, at least one of the following is included: in response to a confirmation operation, and/or in response to the target control intention meeting a preset control intention condition, And/or in response to the target control intention, outputting a first interface in response to the target control intention; in response to not receiving a confirmation operation, in response to the target control intention not meeting the preset control intention condition, then Outputting the first interface including the target control intention, and/or the control-associated device outputting the first interface including the target control intention; in response to not receiving the confirmation operation, and/or in response to the at least one target control intention If the preset control intention condition is not satisfied, a first interface including a recommended interaction instruction is output, wherein the recommended interaction instruction is associated with the target control intention and/or satisfies the preset control intention condition.

Optionally, in step S10B, in response to the first information meeting the first preset condition, outputting the first interface, and/or, responding to the second information meeting the second preset condition, outputting the second interface, including: responding to the The second information is associated with the control intention of the first information, and/or the second user corresponding to the second information is associated with the first user corresponding to the first information, and the first interface and the second interface; and/or, in response to the second information being associated with the first interface, outputting the second interface after closing the first interface.

Optionally, performing corresponding processing on the first interface and/or the second interface in step S20B, including at least one of the following: hiding or closing the first interface and/or the second interface; merging or Merge the first interface and/or the second interface; enlarge or reduce the first interface and/or the second interface; output a third interface; output the first interface and/or the second interface interface to an associated device; after processing the first interface and/or the second interface, output to an associated device for output.

Optionally, step S10 includes: step S10BB: displaying the first interface and/or the second interface in response to the first preset operation; step S20 includes: step S20BB: displaying the first interface and/or the second interface After the interface is processed, the associated device is controlled to output the processed first interface and/or the second interface.

Optionally, the step S10BB includes: in response to the running operation of a preset application or service, when the running operation does not match the function of the preset application or service, displaying the first interface and/or the The second interface, the first interface and/or the second interface includes at least one of the following: information about failure to run; recommended instructions corresponding to running the preset application or service; applications or services associated with the running operation A corresponding recommendation instruction; a recommendation instruction corresponding to an associated device associated with the running operation; a recommendation instruction corresponding to the function configuration of the preset application or service; an update control for updating the first interface; Update the recommended instruction associated with the control; the recommended instruction different from the function of the updated control; and/or, in response to the running operation of the preset application or service, when the running operation matches the function of the preset application or service , displaying the first interface and/or the second interface, the first interface and/or the second interface including at least one of the following: the running interface of the preset application or service; the recommended instruction corresponding to the running operation ; a recommended instruction corresponding to the functional configuration of a preset application or service; an update control for updating the first interface; a recommended instruction associated with the update control; a recommended instruction with a function different from that of the update control; Updating the recommended instruction and/or updating controls associated with the function of the preset application or service; and/or, in response to the closing instruction of the preset application or service, displaying the first interface and/or the second interface, wherein the The first interface and/or the second interface includes at least one of the following: an interface of an application or service associated with the preset application or service; a recommendation instruction for an application or service associated with the preset application or service; and/or Or, in response to the shutdown instruction of the preset application or service and the startup instruction of other applications or services, the first interface and/or the second interface are displayed, and the first interface and/or the second interface include at least one of the following: other Recommended instructions and/or update controls corresponding to differences between the application or service and the preset application or service; recommended instructions and/or update controls corresponding to the new functions of the other application or service relative to the preset application or service An update control for updating the first interface; a recommendation instruction associated with the update control; a recommendation instruction with a function different from that of the update control; an interface of an application or service associated with the other application or service; A recommendation instruction corresponding to an associated device associated with the other application or service; and/or, in response to receiving the input first information, acquiring a control intention included in the first information, and displaying an instruction corresponding to the control intention The first interface and/or the second interface; and/or, in response to receiving the input first information, and the first information cannot determine or generate a control intention, displaying the first information corresponding to the recommended interaction instruction associated with the first information An interface and/or a second interface; and/or, in response to receiving input first information, and the first information can determine or generate a plurality of control intentions, displaying the first corresponding to the plurality of control intentions interface and/or a second interface.

Optionally, the recommended instruction associated with the update control includes at least one of the following: an instruction parallel to the update control, an instruction at a lower level of the update control, an instruction at a higher level of the update control, and an instruction including functions of multiple update controls.

Optionally, the displaying the first interface and/or the second interface corresponding to the control intention includes at least one of the following: in response to the control intention meeting a preset control intention condition, responding directly according to the control intention, And display the first interface and/or the second interface after responding to the control intention; in response to the control intention not satisfying the preset control intention condition, display the first interface and/or the second interface including the control intention Two interfaces, and/or the first interface and/or the second interface displaying the information of the associated device associated with the control intention; in response to the control intention not satisfying the preset control intention condition, displaying a recommended interaction The first interface and/or the second interface of the instruction, wherein the recommended interactive instruction is associated with the control intention and/or satisfies the preset control intention condition.

Optionally, step S20BB: After processing the first interface and/or the second interface, control the associated device to output the processed first interface and/or the second interface, including at least one of the following: One: hiding or closing the first interface and/or the second interface; merging or merging the first interface and/or the second interface; enlarging or reducing the first interface and/or the second interface Two interfaces; controlling the first associated device to output the processed first interface and/or the processed second interface; controlling the second associated device to output the processed first interface and/or processed all The second interface is described; the first associated device is controlled to output the processed first interface, and the second associated device is controlled to output the processed second interface.

Optionally, the processed first interface and the processed second interface are different parts of the same application interface, or different interfaces of the same application.

Optionally, the controlling the first associated device to output the processed first interface and/or the processed second interface includes at least one of the following: responding to the current user of the first associated device and the smart device Matching with the current user, control the first associated device to output the processed first interface and/or the processed second interface; in response to the application or service currently running on the first associated device, and the first interface and/or the second interface The installed or running application or service is matched, and the first associated device is controlled to output the processed first interface and/or the processed second interface; in response to the level of the first associated device meeting the preset level, the first associated device is controlled to output The processed first interface and/or the processed second interface; in response to the priority level of the first associated device being higher than the priority level of the second associated device, controlling the first associated device to output the processed first interface and/or The processed second interface.

Optionally, step S10 includes: step S10C: acquiring the input first information and second information of the smart device, and determining the control intention according to the first information and the second information; step S20 includes: step S20C: according to The control intention and the preset strategy execute corresponding processing on the smart device; the second information of the smart device includes at least one of the following: scene information of the smart device; time information of the smart device; Location information of the smart device; status information of the smart device; application or service information of the smart device; trigger object information of the smart device; relationship information between multiple applications or services of the smart device; Related device information of the smart device; user operating habits; historical interaction records stored by the smart device; historical interaction records obtained by downloading from network devices; historical interaction records obtained from associated devices.

Optionally, the determining the control intention according to the first information and the second information includes: determining or generating intermediate information according to preset rules according to the first information and the second information, and according to the The intermediate information determines the control intent. Optionally, the preset rules include at least one of the following: if the first information lacks partial information, then determine or generate the partial information according to the second information, so that the first information can be combined with the The partial information determines or generates the intermediate information; if the first information includes the first partial information that cannot be recognized or responded, then determine or generate the second partial information according to the second information, so that the first information can be combined with The second part of information determines or generates the intermediate information.

Optionally, the determining the control intention according to the first information and the second information includes at least one of the following: if the first information includes only one control intention, perform corresponding processing according to the control intention ; when there are at least two control intentions included in the first information, determine the target control intention according to a preset selection strategy.

Optionally, the preset selection strategy includes at least one of the following: determining the target control intention according to the second information; determining the target control intention according to user selection.

Optionally, the performing corresponding processing on the smart device includes at least one of the following: immediately or delaying or stopping or switching the processing corresponding to the control intention on the smart device; outputting confirmation information, in response to receiving Confirm the operation, execute the processing corresponding to the control intent on the smart device; copy or transfer the processing corresponding to the control intent to the associated device for execution; execute the corresponding control intent on the smart device and/or associated device processing.

Optionally, the step S10C further includes: when the control intention cannot be determined according to the first information and the second information, performing corresponding processing according to a third preset policy.

Optionally, before the step of acquiring the input first information, it may further include: performing preset processing on the smart device.

Optionally, step S10 includes: step S10CC: in response to the input of the first information does not meet the first preset condition, obtain the second information of the associated device, and determine the control intention according to the first information and the second information ; Step S20 includes: Step S20CC: Execute corresponding processing on the smart device according to the control intention and preset strategy.

Optionally, the first preset condition includes at least one of the following: the first information includes at least one control intention; at least one control intention can be determined or generated according to the first information.

Optionally, the second information includes at least one of the following: user operating habits; historical interaction records; scene information; time information; location information; user status information; application or service information of the associated device; The trigger object information; the relationship information between multiple applications or services of the associated device; the historical interaction record obtained by downloading from the network device.

Optionally, the step S10CC includes at least one of the following: if the first information lacks partial information, then determine or generate the partial information according to the second information, so that the first information can be combined with the partial information information to determine the control intention; if the first information includes the first part of information that cannot be recognized or responded to, then determine or generate the second part of information based on the second information, so that the first information can be combined with the first part of information Two pieces of information determine the control intent.

Optionally, the control intentions include at least one of the following: historical control intentions; association control intentions; non-privacy control intentions; non-high-level control intentions.

Optionally, the step S10CC further includes: when the control intention cannot be determined according to the first information and the second information, performing corresponding processing according to a third preset strategy.

Optionally, before the step S10CC, the method further includes: performing preset processing on the smart device. Optionally, . . . ;

The present application also provides an intelligent device, which includes: a memory, a processor, and a processing program stored in the memory and operable on the processor, when the processing program is executed by the processor The steps of the processing method as described above are realized.

The present application also provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned processing method are realized.

The processing method of the present application includes: responding to a first preset operation, and/or, responding to satisfying a first preset condition; processing at least one recommended interaction instruction based on a first preset strategy, wherein the at least one interaction The instruction is obtained according to the key information; and/or in response to satisfying the second preset condition, corresponding processing is performed according to the second preset strategy; and/or, in response to the first preset operation not satisfying the second preset condition And the third preset condition is met, and corresponding processing is performed according to the third preset policy. Alternatively, the processing method includes: in response to the first preset operation and/or the information of the associated device, determining the control intention and/or acquiring at least one recommended interaction instruction and/or outputting the first interface; executing the smart device based on the preset policy Corresponding processing, and/or controlling associated equipment for output. Through the above method, the smart device can respond quickly during the human-computer interaction process, thereby improving the efficiency of the human-computer interaction.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the accompanying drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, the Under the premise, other drawings can also be obtained based on these drawings.

FIG. 1 is a schematic diagram of a hardware structure of a smart device implementing various embodiments of the present application;

FIG. 2 is a system architecture diagram of a communication network provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of a hardware structure of a controller 140 shown according to an embodiment;

FIG. 4 is a schematic diagram of a hardware structure of a network node 150 according to an embodiment;

FIG. 5 is a schematic diagram of a hardware structure of a network node 160 according to an embodiment;

FIG. 6 is a schematic diagram of a hardware structure of a controller 170 shown according to an embodiment;

FIG. 7 is a schematic diagram of a hardware structure of a network node 180 according to an embodiment;

Fig. 8 is a schematic flowchart of a processing method shown according to the first embodiment;

Fig. 9 is a schematic flowchart of a processing method according to a second embodiment;

Fig. 10 is a schematic diagram of an interface for recommending interactive instructions based on wrong interactive instructions according to the second embodiment;

Fig. 11 is a schematic diagram of a recommended interaction instruction according to the second embodiment;

Fig. 12 is a schematic flowchart of a processing method according to a third embodiment;

Fig. 13 is a schematic diagram of a recommended interaction instruction according to a third embodiment;

Fig. 14 is a schematic flowchart of a processing method according to a fourth embodiment;

15a to 15c are schematic diagrams of application scenarios of the processing method according to the fourth embodiment of the present application;

Fig. 16 is a schematic flowchart of a processing method according to a fifth embodiment;

Fig. 17 is a schematic diagram of the control intent of determining and executing the voice control instruction by the children's watch according to the fifth embodiment of the present application;

FIG. 18 is a schematic flowchart of a processing method shown in the sixth embodiment of the present application;

FIG. 19 is a schematic flowchart of a processing method shown in the seventh embodiment of the present application;

Fig. 20 is a schematic diagram of a recommended interaction instruction according to the seventh embodiment;

Fig. 21 is a schematic flowchart of a processing method according to an eighth embodiment;

Fig. 22 is a schematic flowchart of a processing method according to a ninth embodiment;

Fig. 23 is a schematic flowchart of a processing method according to the tenth embodiment;

Fig. 24 is a schematic flowchart of a processing method according to the eleventh embodiment.

The realization of the purpose, functions and advantages of the present application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. By means of the above drawings, specific embodiments of the present application have been shown, which will be described in more detail hereinafter. These drawings and text descriptions are not intended to limit the scope of the concept of the application in any way, but to illustrate the concept of the application for those skilled in the art by referring to specific embodiments.

Embodiment of this application

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a..." does not exclude the existence of other identical elements in the process, method, article, or device that includes the element. In addition, different implementations of the present application Components, features, and elements with the same name in the example may have the same meaning, or may have different meanings, and the specific meaning shall be determined based on the explanation in the specific embodiment or further combined with the context in the specific embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of this document, first information may also be called second information, and similarly, second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "at" or "when" or "in response to a determination". Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising", "comprising" indicate the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not exclude one or more other features, steps, operations, The existence, occurrence or addition of an element, component, item, species, and/or group. The terms "or", "and/or", "comprising at least one of" and the like used in this application may be interpreted as inclusive, or mean any one or any combination. For example, "including at least one of the following: A, B, C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C", another example, " A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A and B and C". Exceptions to this definition will only arise when combinations of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that although the various steps in the flow chart in the embodiment of the present application are displayed sequentially as indicated by the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the figure may include multiple sub-steps or multiple stages, these sub-steps or stages are not necessarily executed at the same time, but may be executed at different times, and the execution order is not necessarily sequential Instead, it may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.

Depending on the context, the words "if", "if" as used herein may be interpreted as "at" or "when" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrases "if determined" or "if detected (the stated condition or event)" could be interpreted as "when determined" or "in response to the determination" or "when detected (the stated condition or event) )" or "in response to detection of (a stated condition or event)".

It should be noted that in this article, step codes such as S1, S2, S10, and S20 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantive limitation on the order. During implementation, S2 may be executed first and then S1, or S20 may be executed first and then S10, etc., but these should be within the scope of protection of this application.

It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

In the following description, the use of suffixes such as 'module', 'part' or 'unit' for denoting elements is only for facilitating the description of the present application and has no specific meaning by itself. Therefore, 'module', 'part' or 'unit' may be mixedly used.

Smart devices can be implemented in various forms. For example, the smart devices described in this application may include mobile phones, tablet computers, notebook computers, palmtop computers, personal digital assistants (Personal Digital Assistant, PDA), portable media players (Portable Media Player, PMP), navigation devices, Smart devices such as wearable devices, smart bracelets, and pedometers, as well as fixed terminals such as digital TVs and desktop computers.

In the following description, a mobile terminal will be taken as an example, and those skilled in the art will understand that, in addition to being specially used for mobile purpose elements, the configurations according to the embodiments of the present application can also be applied to fixed type terminals.

Please refer to FIG. 1 , which is a schematic diagram of the hardware structure of a mobile terminal implementing various embodiments of the present application. The mobile terminal 100 may include: an RF (Radio Frequency, radio frequency) unit 101, a WiFi module 102, an audio output unit 103, an A /V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in Figure 1 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than those shown in the figure, or combine some components, or different components layout.

Each component of the mobile terminal is specifically introduced below in combination with FIG. 1:

The radio frequency unit 101 can be used for sending and receiving information or receiving and sending signals during a call. Specifically, after receiving the downlink information of the base station, it is processed by the processor 110; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, Global System for Mobile Communications), GPRS (General Packet Radio Service, General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000 , Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access, Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, Time Division Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency division duplex long-term evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution, time-division duplex long-term evolution) and 5G, etc.

WiFi is a short-distance wireless transmission technology. The mobile terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102, which provides users with wireless broadband Internet access. Although FIG. 1 shows a WiFi module 102, it can be understood that it is not an essential component of the mobile terminal, and can be completely omitted as required without changing the essence of the invention.

The audio output unit 103 can store the audio received by the radio frequency unit 101 or the WiFi module 102 or in the memory 109 when the mobile terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, or the like. The audio data is converted into an audio signal and output as sound. Also, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The A/V input unit 104 is used to receive audio or video signals. The A/V input unit 104 may include a graphics processing unit (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processing unit 1041 is used for still pictures or The image data of the video is processed. The processed image frames may be displayed on the display unit 106 . The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage media) or sent via the radio frequency unit 101 or the WiFi module 102 . The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like operating modes, and can process such sound as audio data. The processed audio (voice) data can be converted into a format transmittable to a mobile communication base station via the radio frequency unit 101 for output in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the process of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display when the mobile terminal 100 moves to the ear. panel 1061 and/or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of mobile phone posture (such as horizontal and vertical screen switching, related Games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; as for mobile phones, fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, Other sensors such as thermometers and infrared sensors will not be described in detail here.

The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED), or the like.

The user input unit 107 can be used to receive input numbers or character information, and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072 . The touch panel 1071, also referred to as a touch screen, can collect touch operations of the user on or near it (for example, the user uses any suitable object or accessory such as a finger or a stylus on the touch panel 1071 or near the touch panel 1071). operation), and drive the corresponding connection device according to the preset program. The touch panel 1071 may include two parts, a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates , and then sent to the processor 110, and can receive the command sent by the processor 110 and execute it. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071 , the user input unit 107 may also include other input devices 1072 . Optionally, other input devices 1072 may include, but are not limited to, one or more of physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, etc., which are not specifically described here. limited.

Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits to the processor 110 to determine the type of the touch event, and then the processor 110 determines the touch event according to the touch event. The corresponding visual output is provided on the display panel 1061 . Although in FIG. 1, the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated. The implementation of the input and output functions of the mobile terminal is not specifically limited here.

The interface unit 108 serves as an interface through which at least one external device can be connected with the mobile terminal 100 . For example, an external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 108 can be used to receive input from an external device (for example, data information, power, etc.) transfer data between devices.

The memory 109 can be used to store software programs as well as various data. The memory 109 can mainly include a storage program area and a storage data area. Optionally, the storage program area can store an operating system, at least one function required application program (such as a sound playback function, an image playback function, etc.) etc.; the storage data area can be Store data (such as audio data, phone book, etc.) created according to the use of the mobile phone. In addition, the memory 109 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices.

The processor 110 is the control center of the mobile terminal, and uses various interfaces and lines to connect various parts of the entire mobile terminal, by running or executing software programs and/or modules stored in the memory 109, and calling data stored in the memory 109 , execute various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes operating systems, user interfaces, and application programs, etc. The demodulation processor mainly handles wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 110 .

The mobile terminal 100 can also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 can be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. and other functions.

Although not shown in FIG. 1 , the mobile terminal 100 may also include a Bluetooth module, etc., which will not be repeated here.

In order to facilitate understanding of the embodiments of the present application, the following describes the communication network system on which the mobile terminal of the present application is based.

Please refer to Fig. 2, Fig. 2 is a kind of communication network system architecture diagram that the embodiment of the present application provides, and this communication network system is the LTE system of general mobile communication technology, and this LTE system includes the UE (User Equipment, user equipment) that communication connects sequentially ) 201, E-UTRAN (Evolved UMTS Terrestrial Radio Access Network, Evolved UMTS Terrestrial Radio Access Network) 202, EPC (Evolved Packet Core, Evolved Packet Core Network) 203 and the operator's IP service 204.

Optionally, the UE 201 may be the above-mentioned terminal 100, which will not be repeated here.

E-UTRAN 202 includes eNodeB 2021 and other eNodeB 2022 and so on. Optionally, the eNodeB 2021 can be connected to other eNodeB 2022 through a backhaul (for example, X2 interface), the eNodeB 2021 is connected to the EPC 203 , and the eNodeB 2021 can provide access from the UE 201 to the EPC 203 .

EPC203 may include MME (Mobility Management Entity, Mobility Management Entity) 2031, HSS (Home Subscriber Server, Home Subscriber Server) 2032, other MME2033, SGW (Serving Gate Way, Serving Gateway) 2034, PGW (PDN Gate Way, packet data Network Gateway) 2035 and PCRF (Policy and Charging Rules Function, Policy and Charging Functional Entity) 2036, etc. Optionally, MME2031 is a control node that processes signaling between UE201 and EPC203, and provides bearer and connection management. HSS2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and save some user-specific information about service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide UE 201 IP address allocation and other functions, PCRF2036 is the policy and charging control policy decision point of service data flow and IP bearer resources, it is the policy and charging execution function A unit (not shown) selects and provides available policy and charging control decisions.

IP service 204 can include Internet, Intranet, IMS (IP Multimedia Subsystem, IP Multimedia Subsystem) or other IP services etc.

Although the LTE system is used as an example above, those skilled in the art should know that this application is not only applicable to the LTE system, but also applicable to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new wireless communication systems. The network system (such as 5G), etc., is not limited here.

FIG. 3 is a schematic diagram of a hardware structure of a controller 140 provided in the present application. The controller 140 includes: a memory 1401 and a processor 1402, the memory 1401 is used to store program instructions, and the processor 1402 is used to call the program instructions in the memory 1401 to execute the steps performed by the controller in the first method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

Optionally, the foregoing controller further includes a communication interface 1403 , and the communication interface 1403 may be connected to the processor 1402 through a bus 1404 . The processor 1402 can control the communication interface 1403 to implement the receiving and sending functions of the controller 140 .

FIG. 4 is a schematic diagram of a hardware structure of a network node 150 provided in the present application. The network node 150 includes: a memory 1501 and a processor 1502, the memory 1501 is used to store program instructions, and the processor 1502 is used to call the program instructions in the memory 1501 to execute the steps performed by the first node in the first method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

Optionally, the foregoing controller further includes a communication interface 1503 , and the communication interface 1503 may be connected to the processor 1502 through a bus 1504 . The processor 1502 can control the communication interface 1503 to realize the functions of receiving and sending of the network node 150 .

FIG. 5 is a schematic diagram of a hardware structure of a network node 160 provided in the present application. The network node 160 includes: a memory 1601 and a processor 1602, the memory 1601 is used to store program instructions, and the processor 1602 is used to call the program instructions in the memory 1601 to execute the steps performed by the intermediate node and the tail node in the first method embodiment above, The implementation principles and beneficial effects are similar, and will not be repeated here.

Optionally, the foregoing controller further includes a communication interface 1603 , and the communication interface 1603 may be connected to the processor 1602 through a bus 1604 . The processor 1602 can control the communication interface 1603 to realize the functions of receiving and sending of the network node 160 .

FIG. 6 is a schematic diagram of a hardware structure of a controller 170 provided in the present application. The controller 170 includes: a memory 1701 and a processor 1702, the memory 1701 is used to store program instructions, and the processor 1702 is used to call the program instructions in the memory 1701 to execute the steps performed by the controller in the second method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

FIG. 7 is a schematic diagram of a hardware structure of a network node 180 provided in the present application. The network node 180 includes: a memory 1801 and a processor 1802, the memory 1801 is used to store program instructions, and the processor 1802 is used to call the program instructions in the memory 1801 to execute the steps performed by the head node in the second method embodiment above, and its implementation principle and beneficial effects are similar, and will not be repeated here.

The above-mentioned integrated modules implemented in the form of software function modules can be stored in a computer-readable storage medium. The above-mentioned software function modules are stored in a storage medium, and include several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor (English: processor) to execute the methods of the various embodiments of the present application. partial steps.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. A computer can be a general purpose computer, special purpose computer, computer network, or other programmable device. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g. Coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. Available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, solid state disk, SSD).

Based on the above mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

first embodiment

As shown in FIG. 8, this embodiment provides a processing method applied to a smart device, wherein the processing method includes:

Step S1: responding to the first preset operation, and/or, responding to satisfying the first preset condition;

Step S2: Process at least one recommended interaction instruction based on a first preset strategy, wherein at least one interaction instruction is obtained according to key information; and/or in response to satisfying a second preset condition, perform corresponding processing according to a second preset strategy and/or, in response to the first preset operation not satisfying the second preset condition and satisfying the third preset condition, performing corresponding processing according to a third preset strategy.

Smart devices can include various terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home devices (such as smart TVs, smart speakers, etc.), Internet of Vehicles Devices (such as smart cars, vehicle-mounted terminals, etc.), this embodiment does not limit the specific types of smart devices.

It can be understood that the interaction instruction may not be limited to the voice interaction instruction, but may also be a gesture interaction instruction, a motion interaction instruction, etc., which are not limited here.

Optionally, the first preset operation in step S1 may include, but is not limited to, at least one of the following: an operation that triggers a voice input control; an operation that triggers a voice command prompt; an operation that triggers interface switching; an error input exceeding a preset number of times Interaction instructions; wake up, start, run or close at least one preset application or service; obtain the first information; send the first information; fail to obtain the first information within a preset time period.

Optionally, the preset applications or services may include at least one of the following: applications or services that can be controlled by voice, applications or services that are in the whitelist, applications or services that do not have historical operation records of the current user, applications or services that have the current user An application or service that records historical operations.

Optionally, the first preset condition in step S1 may include, but is not limited to, at least one of the following: wrong interaction instruction input exceeds a preset number of times, no correct interaction instruction is received within a preset duration, and a preset function trigger is obtained. Information, obtained preset identity information, connected with associated devices, received preset information, preset connection with network, current scene information meets preset scene conditions, current application or service belongs to preset list, current application or service The running result of the application meets the preset result condition, the running result of the current application or service does not meet the preset result condition, the received first information meets the preset information condition, the first interface meets the preset interface condition, and the input second information is received . The received second information satisfies a preset information condition.

Optionally, the second information may include at least one of the following: instructions for the first interface, for example, operation instructions, voice control instructions, text control instructions, and gesture control instructions; information associated with functions of the smart device; information associated with information.

Optionally, the key information may include, but is not limited to, at least one of the following: wrong interaction instructions, instruction keywords in the wrong interaction instructions, functions currently used by the smart device, information about the first application in the smart device, information about the first application on the smart device, Current browsing content information, functions to be triggered by smart devices, user identity, application scenarios, interaction result keywords, associated device information, preset information keywords, historical common functions, and common instructions.

Optionally, obtaining at least one recommended instruction according to the key information includes at least one of the following: matching wrong interactive instructions and/or instruction keywords with interactive instructions in the database, and confirming interactive instructions whose matching value exceeds a threshold as recommendations Interaction instructions: obtain associated device information, and obtain at least one recommended interaction instruction according to the associated device information.

Optionally, the associated device information includes: function and location.

In one scenario, when the voice interaction instruction received by the smart device is not recognized or responded, it is confirmed that the received voice interaction instruction is a wrong interaction instruction, or after a certain operation is performed according to the voice interaction instruction, the user immediately When returning to input the voice interaction command again, it is confirmed that the voice interaction command input before is an incorrect interaction command. And/or when the time interval between the previous voice interaction instruction and the subsequent voice interaction instruction input by the same user is greater than the first preset time interval and less than the second preset time interval, it is confirmed that the previous voice interaction instruction is an incorrect interaction instruction. Optionally, when the smart device receives wrong voice interaction instructions multiple times, it executes matching the wrong interaction instructions, and/or the instruction keywords in the wrong interaction instructions with the interaction instructions in the database; Order confirmation is the step for recommending interactive orders.

Exemplarily, after detecting that the input voice interaction command is a wrong interaction command, the input wrong interaction command is converted into voice text information, and the converted voice text information is matched with the voice interaction command model pre-stored in the database , confirm the interaction instruction whose matching value exceeds the threshold as the recommended interaction instruction and output it.

Optionally, step S1 includes: outputting a first interface in response to a first preset operation, and/or outputting a second interface in response to satisfying a first preset condition.

Optionally, in step S1, in response to the first preset operation, outputting the first interface includes at least one of the following:

In response to the running operation of the preset application or service, when the running operation does not match the function of the preset application or service, a first interface is output, and the first interface includes at least one of the following: running failure information; Run the corresponding recommended instruction; the recommended instruction corresponding to the application or service associated with the running operation and/or the associated device; the recommended instruction corresponding to the function configuration of the preset application or service; the update control for updating the first interface; The recommended instruction associated with the control; the recommended instruction that is different from the function of updating the control; the recommended instruction corresponding to the associated device associated with the running operation; the recommended instruction and/or updating the control associated with the function of updating the preset application or service;

In response to the running operation of the preset application or service, when the running operation matches the function of the preset application or service, a first interface is output, and the first interface includes at least one of the following: the running interface of the preset application or service; A recommendation instruction corresponding to the operation; a recommendation instruction corresponding to the function configuration of the preset application or service; an update control for updating the first interface; a recommendation instruction associated with the update control; a recommendation instruction with a function different from that of the update control;

In response to the closing instruction of the preset application or service, the first interface is output, wherein the first interface includes at least one of the following: an interface of the application or service associated with the preset application or service; an application associated with the preset application or service Recommended instructions and/or update controls for other applications or services; recommended instructions and/or update controls for other applications or services that correspond to new functions of preset applications or services;

Outputting a first interface in response to the closing instruction of the preset application or service and the starting instruction of other applications or services, the first interface includes at least one of the following items: a recommendation instruction corresponding to the difference between other applications or services and the preset application or service; An update control for updating the first interface; a recommended instruction associated with the update control; a recommended instruction with a function different from that of the update control; an interface of an application or service associated with other applications or services; an associated device associated with other applications or services Corresponding recommended instructions;

In response to waking up, starting, or running at least one preset application or service, if the first information is not obtained within a preset time period, or the wrong interaction instruction is input for more than a preset number of times, output a first interface including a recommended interaction instruction, wherein, The recommended interaction instruction is associated with the historical instruction information of the preset application or service, and/or associated with the function of the preset application or service, and/or associated with the current scene;

In response to the acquired first information, output a first interface corresponding to the matching result according to the matching result of the first information and the preset information;

In response to acquiring the first information, determine or generate a control intention according to the first information, and output a first interface corresponding to the control intention;

In response to acquiring the first information, and the first information cannot determine or generate a control intention, output a first interface corresponding to a recommended interaction instruction associated with the first information;

In response to acquiring the first information, and the first information can determine or generate multiple control intentions, output a first interface corresponding to the multiple control intentions.

Optionally, in response to the obtained first information, according to the matching result of the first information and the preset information, a first interface corresponding to the matching result is output, including: the first language information and the preset information in response to the first information If the language information does not match, the first interface including the recommended instruction is output, and the language information of the recommended instruction matches the preset language information and/or the first language information.

Optionally, outputting the first interface corresponding to the control intention includes: responding to the control intention meeting the preset control intention condition, responding directly according to the control intention, and outputting the first interface after responding to the control intention; and/or responding to If the control intention does not meet the preset control intention conditions, output the first interface including the control intention, and/or output the first interface of the information of the associated equipment associated with the control intention, and/or send the first interface including the control intention to output to the associated device; and/or in response to the control intention not satisfying the preset control intention condition, then output the first interface including the recommended interaction instruction, wherein the recommended interaction instruction is associated with the control intention and/or meets the preset control intention condition .

Optionally, in response to the control intention meeting the preset control intention condition, responding directly according to the control intention, and outputting the first interface after responding to the control intention includes: responding to the control intention meeting the preset control intention condition, waking up, starting or running At least one preset application or service, and output a first interface including a recommended interaction instruction and/or a running interface of the preset application or service, wherein the recommended interaction instruction is associated with the preset application or service, and/or is associated with the first information associated.

Optionally, the current scene information includes at least one of the following: smart device information, interface information, currently installed, awakened or running application or service information, running information, network information, and associated device information.

Optionally, after the step of determining at least one target control intention from the plurality of control intentions, it includes: responding to the confirmation operation, and/or responding to the target control intention meeting the preset control intention condition, and/or responding to the target control intention , output the first interface after responding to the target control intention; and/or in response to not receiving the confirmation operation, and/or the target control intention does not meet the preset control intention condition, then output the first interface including the target control intention, and/or Or the control associated device outputs the first interface including the target control intention; and/or in response to no confirmation operation is received, and/or at least one target control intention does not meet the preset control intention condition, then output the first interface including the recommended interaction instruction An interface, wherein the recommended interaction instruction is associated with the target control intention and/or satisfies a preset control intention condition.

Optionally, the preset control intention condition may include at least one of the following: a non-high-level control intention, a non-privacy control intention, a control intention capable of responding to a smart device, and a control intention corresponding to a non-preset function.

Optionally, outputting a second interface in response to meeting the first preset condition in step S1 includes at least one of the following: in response to the first interface meeting the preset interface condition and receiving the second information, on the first interface display the recommended interaction instruction associated with the second information in order to output the second interface; in response to the first interface not meeting the preset interface conditions and receiving the second information, after processing the first interface, the processed second interface A recommended interactive instruction associated with the second information is displayed in an interface to output the second interface; in response to the received first information meeting the preset information condition, a second interface corresponding to the first information is output; in response to the received second The information satisfies the preset information condition, and a second interface corresponding to the second information is output.

Optionally, the preset interface condition may include at least one of the following: there is a blank area; font size meets a preset size value; screen brightness meets a preset brightness value.

Optionally, the preset information condition may include at least one of the following: the control object corresponds to the object in the first interface; the control intention is a control intention corresponding to the function of the smart device; the control intention is corresponding to the function of a preset application or service control intent.

Optionally, processing at least one recommended interaction instruction based on the first preset strategy in step S2 includes: acquiring user information; if the current user is a new user, outputting a recommended interaction instruction associated with key information; and/or, If the current user is an old user, according to the usage records of the historical recommended interaction instructions, the frequently used recommended interactive instructions of the current user are determined, and the frequently used recommended interactive instructions of the current user are output.

Exemplarily, when the user is a new user, the recommended interaction instructions associated with the key information are displayed; when the user is an old user, the recommended interaction instructions commonly used by the user among the recommended interaction instructions associated with the key information are displayed. Optionally, when the user is an old user, in addition to displaying the interaction instructions associated with the key information, the user's frequently recommended interaction instructions are also displayed.

Optionally, processing at least one recommended interaction instruction based on the first preset strategy in step S2 includes: acquiring current user identity information, which includes age and/or facial image information; if the current user is an elderly person and/or or a child, output at least one recommended interaction instruction by voice; and/or, if the current user is not an elderly person and/or a child, the interface outputs at least one recommended interaction instruction.

Optionally, processing at least one recommended interaction instruction based on the first preset strategy in step S2 includes:

Obtaining software version information of the first application currently in use;

According to the software version information, a new recommended interactive instruction of the latest version of the first application is acquired;

Output at least one recommended interaction instruction, and mark the newly added recommended interaction instruction.

Optionally, when the first application is updated, the functions of the previous version will change, and when the first application adds new functions, corresponding interactive instructions are also added accordingly.

Exemplarily, when the latest version of the first application has new functions compared with the previous version, the interactive instructions corresponding to the newly added functions are highlighted in the display interface of recommended interactive instructions, such as bolding and marking with new words , underline, etc.

Optionally, the at least one recommended interaction instruction includes: a recommended interaction instruction related to key information and a system-wide recommended interaction instruction; in step S2, the at least one recommended interaction instruction is processed based on the first preset strategy, including: priority display and/or Or highlight recommended interaction instructions related to key information; and/or, obtain attribute information of at least one recommended interaction instruction, and output at least one recommended interaction instruction in different areas according to the attribute information; and/or respond to the smart device not Satisfying preset conditions, obtaining associated devices associated with the smart device, sending at least one recommended interaction instruction to the associated device, so that the associated device outputs at least one recommended interaction instruction; and/or obtaining the number of at least one recommended interaction instruction, When the number of at least one recommended interaction instruction exceeds the threshold, output at least one recommended interaction instruction according to the first preset strategy; and/or, when the number of at least one recommended interaction instruction does not exceed the threshold, output at least one recommended interaction instruction The output is performed according to the second and first preset strategies.

Optionally, the failure of the smart device to meet the preset conditions includes at least one of the following: the smart device does not have a display device; the smart device display device does not meet the display requirements for the recommended interaction instruction; the smart device does not have the display authority for the recommended interaction instruction ; The recommended interaction command is related to the associated device.

Optionally, satisfying the second preset condition in step S2 includes at least one of the following: the smart switch is turned on; conforms to user habits; receives a preset operation instruction; connects with an associated device; the first information includes at least one control intention; At least one control intention can be generated or determined according to the first information.

Optionally, step S2 includes: performing corresponding processing on the first interface and/or the second interface in response to satisfying the second preset condition.

Optionally, corresponding processing is performed on the first interface and/or the second interface in step S2, including at least one of the following: hiding or closing the first interface and/or the second interface; fusing or merging the first interface and/or the second interface Two interfaces; enlarge or reduce the first interface and/or the second interface; output the third interface; output the first interface and/or the second interface to the associated device; after processing the first interface and/or the second interface, output to the associated device for output.

Optionally, the smart device includes a first display area and a second display area, and both the first display area and the second display area display the first interface; Step S2: In response to satisfying the second preset condition, the first interface and/or Or the second interface performs corresponding processing, including: in response to the first interface meeting the second preset condition, processing the first interface in one of the first display area and the second display area, or simultaneously processing the first display area and the first interface displayed in the second display area for processing.

Optionally, in step S2, in response to satisfying the second preset condition, performing corresponding processing on the first interface and/or the second interface includes: passing information in the first interface through The first display area and the second display area are displayed in turn; and/or in response to the movement operation in the single-handed mode, the position of the information in the first interface in the first display area is adjusted.

Optionally, step S2 includes: in response to the first information meeting the second preset condition, performing corresponding processing according to the second preset strategy; and/or, in response to the first information not meeting the second preset condition and meeting the third The preset conditions are correspondingly processed according to the third preset strategy.

Optionally, performing corresponding processing according to the second preset strategy may include at least one of the following: if there is only one control intent, perform corresponding processing according to the control intent; if there are at least two control intents, then determine according to the preset selection strategy Target control intent, and perform corresponding processing according to the target control intent.

Optionally, satisfying the third preset condition may include at least one of the following: the target control intention can be determined according to the second information of the smart device; the target control intention can be determined according to the user selection.

Optionally, the second information of the smart device may include at least one of the following: scene information of the smart device; time information of the smart device; location information of the smart device; status information of the smart device; application or service information of the smart device; Device trigger object information; relationship information between multiple applications or services of smart devices; associated device information of smart devices; user operating habits; historical interaction records stored by smart devices; historical interaction records downloaded from network devices; Historical interaction records obtained from associated devices.

Optionally, determining the target control intention according to the second information of the smart device includes: determining or generating intermediate information according to a preset rule according to the first information and the second information of the smart device, and determining the control intention according to the intermediate information.

Optionally, the preset rule may include at least one of the following items: if the first information lacks partial information, then determine or generate partial information according to the second information of the smart device, so that the first information can be combined with the partial information to determine or generate intermediate information; If the first information includes the first part of information that cannot be recognized or responded to, the second part of information is determined or generated according to the second information of the smart device, so that the first information is combined with the second part of information to determine or generate intermediate information.

Optionally, performing corresponding processing according to the third preset strategy may include at least one of the following: immediately or delay or stop or switch the processing corresponding to the execution of the control intention on the smart device; output confirmation information, and respond to receiving the confirmation operation. The smart device executes the processing corresponding to the control intent; copies or transfers the processing corresponding to the control intent to the associated device for execution; executes the processing corresponding to the control intent on the smart device and/or the associated device.

Optionally, the method further includes the following step: in response to the first information not satisfying the second preset condition and not satisfying the third preset condition, performing corresponding processing according to a fourth preset strategy.

second embodiment

Fig. 9 is a schematic flowchart of a processing method according to a second embodiment of the present application. As shown in Figure 9, an embodiment of the present application provides a processing method applied to smart devices, including:

Step S1A1: Acquiring key information in response to the smart device meeting the first preset condition;

Step S1A2: Obtain at least one recommended interaction instruction according to the key information;

Step S2A: Outputting at least one recommended interaction instruction according to the first preset strategy.

Exemplarily, through the above method, during the human-computer interaction process of the smart device, when the smart device satisfies the first preset condition, determine or generate at least one recommended interaction instruction according to the acquired key information, and follow the first A preset strategy outputs at least one recommended interaction instruction, so that the user of the smart device can perform human-computer interaction with the smart device according to the recommended interaction instruction without remembering a large number of interaction instructions, and can improve the efficiency of human-computer interaction and user experience.

Optionally, step S1A1 may also be: acquiring key information.

Exemplarily, the smart device may directly obtain key information without obtaining the key information when the first preset condition is met. For example, when the voice assistant function is turned on, the smart device directly obtains key information and obtains at least one recommended interaction instruction according to the key information, and then outputs at least one recommended interaction instruction according to the first preset strategy, so that when the smart device starts human-computer interaction The recommended interaction instructions can be prompted to the user, further improving the efficiency of human-computer interaction and user experience.

Optionally, in step S1A1, the first preset condition includes at least one of the following: wrong interaction instruction input exceeds a preset number of times, no correct interaction instruction is received within a preset time period, preset function trigger information is obtained, and Receive the preset identity information, be connected with the associated device, receive the preset information, and connect with the network preset.

It is understandable that the correct interaction command is not received within the preset time period: when the smart device starts the voice control function or other interactive control functions, the timing starts, and the interaction command is not received within the preset time period, or the ok Execute the correct interactive command for the operation; obtain preset function trigger information: it can be obtained function trigger information such as voice control and gesture control, or a certain function needs to use voice command or other interactive commands for cooperative control; obtain preset identity Information: The preset identity information can be users who are not familiar with interactive commands, users who are not good at operating smart devices, or users who have preset the use of voice control, such as users who use smart devices for the first time, the elderly and children, etc.; and The associated device is in the connected state: the smart device can be connected wirelessly and wiredly with the associated device; receiving preset information: receiving interactive instruction recommendation request information, request information to start a certain function; preset connection with the network: the smart device is in the network Connection Status.

Optionally, in step S1A1, the key information includes at least one of the following: wrong interaction instruction, instruction keyword in the wrong interaction instruction, function currently used by the smart device, function to be triggered by the smart device, user identity, application scenario, Interaction result keywords, associated device information, preset information keywords.

Through the above method, the smart device considers whether the smart device satisfies the first preset condition when processing the user request, and then quickly determines the user's intention and outputs a recommended interaction instruction according to the judgment result, so as to make the user experience better.

It can be understood that the interaction instruction may not be limited to the voice interaction instruction, but may also be a gesture interaction instruction, a motion interaction instruction, etc., which are not limited here. In the following content of this application, voice interaction instructions are used as examples. Specifically, when using voice interaction instructions in the process of human-computer interaction, this application is used for smart devices that can be controlled by voice. When using other forms of human-computer interaction In the process, it may also be a smart device performing gesture control, which is not limited here.

Optionally, the display interface of the smart device is provided with a recommended interactive instruction display area, and the recommended interactive instruction display area is used to display the above-mentioned recommended interactive instruction. Optionally, the recommended interaction instruction display area may display the above-mentioned recommended interaction instructions in at least one of the following ways: respectively display one or more recommended interaction instructions in the form of a floating window; respectively display one or more recommended interaction instructions in the form of a pop-up window one or more recommended interaction instructions; one or more recommended interaction instructions are displayed in the form of controls; one or more recommended interaction instructions are displayed in the blank area of the human-computer interaction interface.

For example, when the smart device uses the voice assistant function, it is detected whether the smart device meets the first preset condition; when the smart device does not meet the first preset condition, no operation is performed, or the human-computer interaction process is normally performed, or Obtain key information; when the smart device meets the first preset condition, obtain the key information; then recommend corresponding interactive instructions to the user according to the key information, so that the user can control the smart device according to the recommended interactive instruction and improve user experience.

Optionally, the key information includes the wrong interaction instruction and/or the instruction keyword in the wrong interaction instruction. Step S1A2 includes: matching the wrong interaction instruction and/or the instruction keyword with the interaction instruction in the database; The interactive instructions exceeding the threshold are confirmed as recommended interactive instructions.

Optionally, when errors in input voice interaction instructions are continuously detected, the count is incremented by one, and the erroneous voice interaction instructions are recorded, and the count starts from zero when the human-computer interaction application is started. When it is detected that the number of errors in the input voice interaction instruction exceeds the threshold (eg, 5 times, etc.), the words, words, etc., or words or words with similar meanings that exist in all previous error voice interaction instructions are extracted, and these will be obtained Words or phrases are used as keywords, matched with the voice interaction instruction models pre-stored in the database, and then the interactive instructions whose matching values with all keywords exceed the threshold (for example, 90%) are confirmed as recommended interactive instructions for output, or An interactive instruction whose matching value with a single instruction keyword exceeds a threshold is confirmed as a recommended interactive instruction to be output.

Optionally, after the smart device executes an operation instruction according to the voice interaction instruction, and the user chooses to exit (for example, within 5 seconds, within 10 seconds) the voice interaction application or service, the smart device generates a prompt message asking the user whether to perform voice interaction. For the recommendation of interactive instructions, when the user selects Yes, perform the step of matching wrong interactive instructions and/or instruction keywords with interactive instructions in the database; confirming interactive instructions whose matching value exceeds a threshold as recommended interactive instructions. When the user selects No, directly exit the voice interaction application or service without performing other operations.

Optionally, step S2A includes: displaying, on the display interface, the wrong interaction instruction and the recommended interaction instruction related to the wrong interaction instruction with associated annotations.

Exemplarily, in one scenario, the interaction instructions displayed on the display interface include not only the recommended interaction instructions corresponding to the wrong interaction instructions, but also other interaction instructions, such as common interaction instructions and system interaction instructions. The recommended interactive instructions related to the wrong interactive instructions are very likely to be the interactive instructions that the user wants to use, and these recommended interactive instructions are associated and displayed to display the wrong interactive instructions and recommended interactive instructions at the same time, allowing users to quickly view to improve the user experience.

Please refer to FIG. 10 . FIG. 10 is an application scenario in which the smart device receives an incorrect interaction instruction in the second embodiment. (a) in FIG. 10 is a schematic diagram of a smart device receiving an incorrect interaction instruction. Optionally, after receiving the interaction instruction input by the user, the smart device will recognize the interaction instruction, and if there is an operation instruction corresponding to the interaction instruction, confirm that the input interaction instruction is correct; when there is no operation instruction corresponding to the interaction instruction , to confirm that the input interactive command is wrong. (b) in Figure 10 shows that the smart device searches the database for correct interaction instructions with similar semantics, similar control intentions or matching values exceeding the threshold based on the wrong interaction instructions. (c) in FIG. 10 is a schematic diagram of a display interface for a recommended interactive instruction. Exemplarily, when common interaction instructions, system interaction instructions and recommended interaction instructions are displayed on the display interface at the same time, the wrong interaction instructions are displayed on the left, which displays the matching recommended interaction instructions, and the wrong interaction instructions and the matching recommended interaction instructions Make bold, mark highlight. It can be understood that by displaying the annotation, it is convenient for the user to see the corresponding recommended interaction instruction at the first glance on the interface.

Optionally, in step S1A1, obtaining key information includes: obtaining the function currently used by the smart device according to the display interface of the smart device; step S1A2 includes: obtaining at least one recommended interaction instruction associated with the function currently used by the smart device.

Optionally, the number of acquired recommended interaction instructions is not limited, and may be specifically set according to actual business requirements.

It is understandable that these recommended interaction instructions are mainly operation instruction words that the user may need to use next, so that when the user needs to operate an application, he can directly input the interaction instruction without entering the application interface and performing corresponding operations . Compared with the existing users who need to repeatedly enter the application interface and find the corresponding button at the corresponding position to click, the user operation can be reduced.

In one scenario, when using a music APP of a smart device, all interactive instructions related to the music APP are obtained, and then all interactive instructions are output to a display screen for display.

Exemplarily, when the current terminal is using the music player, all interactive instructions related to the music player are displayed on the screen, such as switching songs, searching for XX songs, entering hot search lists, and so on.

Optionally, acquiring at least one recommended interaction instruction associated with the function currently used by the smart device includes at least one of the following: acquiring at least one recommended interaction instruction associated with an operable control in the display interface of the smart device; At least one recommended interaction instruction associated with the display content in the display interface of the smart device; acquiring at least one recommended interaction instruction associated with the previous or next display interface in the current display interface of the smart device.

Exemplarily, for example: the interface includes the controls of the previous song and the next song, and directly outputs the recommendation instruction "Try to tell me, the previous song and the next song"; the content in the chat interface includes "the meeting will be held tomorrow morning ", directly output "Try to tell me, create a schedule of "meeting tomorrow morning""; it can also be such as: currently playing TV series A, output the recommendation command of "recommended for you, play TV series B".

Exemplarily, multiple application programs are displayed on the display interface, for example, WeChat, Alipay, video, music and so on. Obtain interactive instructions related to multiple applications, for example, enter WeChat, play XX songs, and so on.

Optionally, the method further includes: when it is detected that an interface jump occurs, acquiring a new recommended interaction instruction according to the information of the interface after the jump. In one scenario, when the display interface is switched from the A application to the B application, the displayed recommended interaction instruction is changed from the original A application interaction instruction to the B application interaction instruction.

For example, when the display interface of the smart device is switched from the Meitu APP to the music APP, the displayed recommended interactive instructions are changed from original interactive instructions related to pictures to interactive instructions related to music.

Optionally, step S1A2 includes: obtaining associated device information, where the associated device information includes: function and location; obtaining at least one recommended interaction instruction according to the associated device information.

In one scenario, when a user expects to control an associated device through a smart device, obtain associated device information.

Exemplarily, the user may control the associated device through the smart device according to the above-mentioned recommended interaction instruction. For example, when the user inputs "turn on the X function of XX device", the smart device processes the corresponding associated device according to the above instruction.

Optionally, after step S2A, the method further includes: determining a target recommended interaction instruction from at least one recommended interaction instruction in response to the first operation and/or the first voice instruction; and responding according to the target recommended interaction instruction.

In one scenario, the user can click on the recommended interactive instruction in the screen display interface, or select the recommended interactive instruction in the screen display interface through voice commands, so that the smart device executes the selected target recommended interactive instruction.

For example, when three recommended interaction instructions A, B, and C are sequentially displayed on the screen, the user can select and confirm the target recommended interaction instruction by clicking on any instruction of the three recommended interaction instructions A, B, and C; Input such as "select the first recommended interaction instruction" to confirm the target recommended interaction instruction.

Optionally, step S2A includes: monitoring feedback information of the smart device for the interaction instruction; and outputting at least one recommended interaction instruction when the smart device receives the interaction instruction but does not output feedback information.

In one scenario, after obtaining relevant recommended instructions based on key information, they are not displayed on the screen immediately, but the feedback information of the smart device to the voice instructions is monitored.

Exemplarily, it is judged according to the feedback information of the smart device on the input voice command whether the user input the voice command correctly. When the smart device gives feedback to the input voice command, confirm that the input voice command is correct; when the smart device does not give feedback to the input voice command, confirm that the input voice command is wrong, and output recommended interactive commands at this time, so that users can quickly Finding the correct voice command will not affect the user's operation of the smart device, but can also quickly pop up recommended interactive commands, allowing the user to find the correct voice command and improving user experience.

Optionally, step S1A2 includes: acquiring a commonly used recommended interaction instruction of the first application as at least one recommended interaction instruction according to the historical commonly used functions and/or historical interaction instruction usage records of the first application currently used.

In one scenario, an interaction instruction related to a historical frequently used function of the first application is used as a recommended interaction instruction. In one scenario, according to the use record of the user's historical interaction instructions on the first application, the historical frequently used interactive instructions are confirmed, and the historical frequently used interactive instructions are used as the recommended interactive instructions.

Exemplarily, according to the usage of the first application by users (may be all users), common functions of the first application are obtained, and then interactive instructions related to the common functions of the first application are obtained from the interactive instruction database as recommended interactive instructions .

Optionally, common interaction instructions of other users about the first application may also be obtained, and the common interaction instructions from other users may be used as recommended interaction instructions.

Optionally, the method further includes: outputting common recommended interaction instructions of the first application according to a first preset policy, and setting the deleted recommended interaction instructions as unused recommended interaction instructions in response to deletion of commonly used recommended interaction instructions.

For example, after the commonly used recommended interactive instructions are displayed on the screen, the user can delete the frequently used recommended interactive instructions. Recommend interactive commands.

Optionally, step S2A includes: acquiring user information; if the current user is a new user, outputting recommended interaction instructions associated with key information; and/or, if the current user is an old user, recommending the use of interactive instructions based on history Record, determine the frequently recommended interaction instructions of the current user, and output the frequently recommended interaction instructions of the current user.

Optionally, when the user is an old user, in addition to the user's commonly used recommended interactive instructions, the recommended interactive instruction display interface also includes a control for requesting to display other recommended interactive instructions. Recommend interactive commands.

Optionally, step S2A includes: acquiring current user identity information, which includes age and/or facial image information; if the current user is an elderly person and/or child, outputting at least one recommended interaction instruction by voice; and/or , if the current user is not an elderly person and/or a child, the interface outputs at least one recommended interaction instruction.

Exemplarily, according to the user identity information, it is confirmed whether the user is a child and/or an elderly person. When the user is an elderly person and/or a child, in order to ensure that the child and/or the elderly can accurately learn the recommended interaction instruction, the recommended interaction instruction is displayed on the screen , and at the same time output recommended interactive instructions through voice broadcast.

Optionally, step S2A includes: obtaining software version information of the first application currently in use; obtaining newly added recommended interaction instructions of the latest version of the first application according to the software version information; outputting at least one recommended interaction instruction, and Add recommended interactive instructions for labeling.

Optionally, the at least one recommended interaction instruction includes: a recommended interaction instruction related to key information and a general system recommended interaction instruction;

Step S2A includes: preferentially displaying and/or highlighting recommended interaction instructions related to key information.

Optionally, preferentially displaying and/or highlighting recommended interaction instructions related to key information ensures that users can quickly find interaction instructions related to key information.

Exemplarily, the user is currently using a music APP, and when the recommended interactive instruction includes "open the new song chart" related to the music APP and the system's general interactive command "turn on Bluetooth", the interactive command "open the new song chart" will be displayed first and/or highlight.

Exemplarily, when the smart device is not connected to the network, the recommended interaction instruction cannot be obtained from the server, and at this time, it is obtained from the local database of the smart device.

The application scenarios of the processing method based on the present application will be described below. Please refer to FIG. 11 . FIG. 11 is a schematic diagram of a recommendation interaction instruction according to a second embodiment of the present application. The scene shown in the illustration takes the use on a mobile phone as an example. Figure 11(a) shows the first preset condition detection interface of the smart device, and Figure 11(b) shows the application currently being used by the smart device As for the interface, (c) in FIG. 11 is an interface diagram of the smart device generating recommended interactive instructions according to the currently used application. Exemplarily, after the smart device detects that no interactive instruction has been input for a preset period of time, it acquires that the music application is currently being used, and then acquires an interactive instruction related to the music application, and outputs it to the screen for display. In this way, when the user forgets the interactive command, the user does not need to exit the application currently in use and enter the voice command library to search for the interactive command, but directly obtains the recommended interactive command based on the information of the currently used application, and outputs it for the user to quickly obtain the desired command. The interaction command to use.

In the processing method of the present application, key information is acquired in response to the smart device meeting the first preset condition; at least one recommended interaction instruction is acquired according to the key information; at least one recommended interaction instruction is output according to the first preset strategy. In this way, when the smart device satisfies the first preset condition, the recommended interaction instruction can be output according to the key information, and the recommended interaction instruction can be output when using the voice interaction function, which is convenient for the user to quickly obtain the interaction instruction, and can generate the recommended interaction instruction according to the user's intention , so that users can conduct human-computer interaction more intelligently and conveniently in the process of voice interaction with smart devices, improving voice control efficiency and user experience.

third embodiment

Fig. 12 is a schematic flowchart of a processing method according to a third embodiment of the present application. As shown in Figure 12, a processing method provided by this application is applied to smart devices, including:

Step S1AA: Obtain at least one recommended interaction instruction according to the key information in response to the first preset operation;

Step S2AA: Process at least one recommended interaction instruction based on a first preset strategy.

Exemplarily, through the above method, when the smart device obtains the first preset operation during the human-computer interaction process, the smart device determines or generates the corresponding recommended interaction instruction according to the key information, so that the user of the smart device does not need to Remember that a large number of interaction instructions can also perform human-computer interaction with smart devices according to recommended interaction instructions, and can improve the efficiency and user experience of human-computer interaction.

Optionally, in step S1AA, the first preset operation includes at least one of the following: triggering the operation of the voice input control; triggering the operation of the voice command prompt; triggering the operation of interface switching; inputting more than a preset number of wrong interaction commands .

Optionally, when triggering the operation of the voice input control and triggering the operation of the voice instruction prompt, it is necessary to recommend voice interaction instructions; after the interface is switched, the display content of the interface changes, and the associated interaction instructions also change; the input exceeds A preset number of wrong interaction instructions indicates that the user does not know the correct interaction instruction and needs to be reminded.

Exemplarily, the first preset operation is triggered by the user, and may be an operation of the voice input control triggered by the user. The interface of the smart device or the application program may have a voice input control, and the user may trigger the voice input control to generate a first preset operation, for example, the user may click the voice input control to generate the first preset operation.

Optionally, the key information includes at least one of the following: instruction keywords in the wrong interaction instruction; functions currently used by the smart device; functions to be triggered by the smart device; user identity; information of the first application; current browsing content information on the smart device; interaction result keywords; associated device information; preset information keywords.

Optionally, the key information also includes: historical common functions, common instructions, and the like.

Exemplarily, the instruction keyword in the wrong interaction instruction can be: a certain function, startup, shutdown, etc.; the function currently used by the smart device can be: the function of the smart device system, the function of installing an application on the smart device; The triggered function can be: predict the next function to be used; the user identity can be: old man, child, new user and old user, etc.; the current application scenario can be: in a specific time period, in a specific place, in children's mode , connection status, etc.; the information of the first application in the smart device can be: the application currently being used by the smart device, the running application; the current browsing content information on the smart device can be: the browsing content information on the current display interface of the smart device, Browsing content information in the background; associated device information can be: a device connected to a smart device with a wired connection or a wireless connection.

Optionally, the first preset operation includes at least one of the following: an operation of triggering a voice input control; an operation of triggering a voice command prompt; an operation of triggering interface switching; inputting wrong interaction commands exceeding a preset number of times.

Optionally, step S2AA includes: outputting prompt information; in response to the selection operation, outputting a corresponding recommended interaction instruction according to the selection result; and/or, in response to unresponsive prompt information, outputting at least one recommended interaction instruction according to a first preset strategy instruction.

Exemplarily, after the recommended interaction instruction related to key information is acquired, prompt information is output, for example, display, hide, close, etc. immediately. After the user makes a selection, a recommended interaction instruction is output according to the selection result. If the user's selection operation on the prompt information is not obtained beyond the preset time period, the recommended interaction instruction is directly output to the display screen for display.

Exemplarily, the prompt information is output, so that the user can select the type of the recommended interactive instruction to be output, for example, output the recommended interactive instruction of start, close, selection, etc. types.

Optionally, step S2AA includes: acquiring attribute information of at least one recommended interaction instruction; and outputting at least one recommended interaction instruction in different areas according to the attribute information.

In one scenario, the recommended interactive instruction display interface is divided into multiple regions, and then displayed in different regions according to the attribute information of each recommended interactive instruction.

Optionally, the area on the display interface where the recommended interaction instructions are displayed includes a plurality of sub-areas, and different sub-areas are used to display virtual voice instruction word sets of different applications. Exemplarily, the recommended interaction instructions may include, but not limited to, one or more of music application interaction instructions, radio application interaction instructions, navigation application interaction instructions, social application interaction instructions, and system general interaction instructions. When there are interactive instructions with multiple attributes among the recommended interactive instructions, the interactive instructions corresponding to each application may be displayed in different areas.

Exemplarily, when the recommended interactive instructions include: "start application A", "start application B" and "next page", put "start application A" and "start application B" in the same area for display, and " Next page" is placed in another area for display.

Optionally, step S2AA includes: in response to the fact that the smart device does not meet the preset condition, acquiring associated devices associated with the smart device; sending at least one recommended interaction instruction to the associated device, so that the associated device outputs at least one recommended interaction instruction.

For example, terminal A has no display screen, terminal B is associated with terminal A and has a display screen, after terminal A obtains the recommended interaction instruction, it sends it to terminal B, and terminal B outputs the recommended interaction instruction, so that the user can always visualize human-computer interaction.

Optionally, step S2AA includes: acquiring the quantity of at least one recommended interaction instruction; when the quantity of at least one recommended interaction instruction exceeds a threshold, outputting at least one recommended interaction instruction according to a first preset strategy; and/or, at When the quantity of the at least one recommended interaction instruction does not exceed the threshold, the at least one recommended interaction instruction is output according to the second first preset strategy.

For example, when the display interface of the smart device can display all recommended interactive instructions, all recommended interactive instructions are directly displayed on the same interface without sorting; when the display interface of the smart device cannot display all recommended interactive instructions, priority is given to displaying Commonly used interactive instructions in recommended interactive instructions.

Optionally, the recommended interaction instruction display area may display the above-mentioned recommended interaction instructions in at least one of the following ways: respectively display one or more recommended interaction instructions in the form of a floating window; respectively display one or more recommended interaction instructions in the form of a pop-up window one or more recommended interaction instructions; one or more recommended interaction instructions are displayed in the form of controls; one or more recommended interaction instructions are displayed in the blank area of the human-computer interaction interface.

Optionally, the method further includes: if a non-voice operation is detected before step S1AA, determining a corresponding target interaction instruction from at least one recommended interaction instruction according to the non-voice operation; outputting at least one recommended interaction instruction, and Target interaction instructions are annotated.

Optionally, the user's control intention is obtained according to the non-voice operation, and then the target recommendation interaction instruction that meets the user's intention is marked or highlighted, so that the user can quickly obtain the target interaction instruction and improve user experience.

The application scenarios of the processing method based on the present application will be described below. Please refer to FIG. 13 . FIG. 13 is a schematic diagram of a recommendation interaction instruction according to a third embodiment of the present application. The scene shown in the figure is the scene of the operation that triggers the voice command prompt, and the use on the mobile phone is used as an example for illustration. (a) in FIG. 13 shows the first preset operation trigger interface, and (b) in FIG. 13 shows the display interface for recommended interactive instructions. Exemplarily, after the smart device receives the interactive instruction prompting to trigger the operation, it obtains the application information currently in use, the music application, and then searches the interactive instruction related to the music application from the database, generates the recommended interactive instruction, and outputs it to the screen for display . In this way, when the user receives the user request, the interactive instruction that the user wants to use is output directly according to the currently used application information.

In the processing method of the present application, in response to the first preset operation, at least one recommended interaction instruction is acquired according to key information; and the at least one recommended interaction instruction is processed based on the first preset strategy. In this way, when punishing the first preset operation, it is possible to output recommended interactive instructions based on key information, which is convenient for users to quickly obtain interactive instructions, so that users can conduct human-computer interaction more intelligently and conveniently in the process of voice interaction with smart devices. Improve voice control efficiency and user experience.

Fourth embodiment

Fig. 14 is a schematic flowchart of a processing method according to a fourth embodiment.

In one aspect, the present application first provides a processing method. As shown in Figure 14, the processing method of this embodiment is applied to a smart device, and the processing method includes:

Step S1B: outputting the first interface in response to the first preset operation, and/or outputting the second interface in response to satisfying the first preset condition;

Step S2B: Execute corresponding processing on the first interface and/or the second interface in response to satisfying the second preset condition.

In the above manner, the smart device outputs the first interface in response to the first preset operation, and/or outputs the second interface in response to satisfying the first preset condition, and can output the first interface in response to satisfying the second preset condition. The interface and/or the second interface perform corresponding processing, so the efficiency of human-computer interaction can be effectively improved, the user can enjoy the service intuitively and quickly, and the user experience is improved.

Exemplarily, when the smart device receives the first message through a preset application or service, such as WeChat, for example, "please help call the managers of various departments for a meeting at nine o'clock tomorrow", the output includes recommendations associated with the first message The first interface of the interactive command, for example, outputs the first interface including "create a Tencent conference room" and "create a DingTalk conference room". When the instruction is confirmed, the first interface is updated, wherein the updated first interface may include the running interface of the Tencent meeting.

Optionally, the first preset operation includes at least one of the following: waking up, starting, running or closing at least one preset application or service; obtaining the first information; sending the first information; failing to obtain the second a message.

Optionally, the first information may include at least one of the following: a voice control command, a text control command, a gesture control command, and an operation command. Exemplarily, the smart device can acquire the user's voice control instruction to start the Tencent meeting. The smart TV terminal can obtain the user's text command to execute the control command of turning off the audio and video. The smart home terminal can obtain the user's manual operation instruction to turn on the air conditioner.

Optionally, the first interface may include at least one of the following: an update control for updating the first interface; a recommended instruction associated with the update control; a recommended interaction instruction with a function different from that of the update control; a wake-up interface for preset applications or services ; the running interface of the preset application or service; the interface of the application or service associated with the preset application or service; the recommended interaction instruction associated with the preset application or service; the control intention corresponding to the first information; The recommended interaction instruction; the interface after responding according to the first information; the recommended interaction instruction associated with the current scene.

Optionally, the recommended interaction instruction associated with the preset application or service includes at least one of the following: a recommended instruction associated with the function of the preset application or service, common historical instruction information of the preset application or service, information related to the preset application or service The running state of the service is associated with the corresponding terminal of the preset application or service.

For example, if the preset application or service is a Tencent meeting application or service, the recommended instructions associated with the functions of the preset application or service may include "you can say to enable screen sharing", "you can say to enable mute", " You can say to start sharing files", "You can say to start DingTalk meeting" and so on.

For example, if the first message is "Please help to call the managers of various departments for a meeting at nine o'clock tomorrow" received through WeChat, then the control intent corresponding to the first message can be "establish a meeting room", " Send meeting notice", etc.

Optionally, the recommended interaction instruction associated with the first information includes at least one of the following: a recommended interaction instruction associated with the control intention of the first information, a recommended interaction instruction associated with the content of the first information, and an interaction instruction corresponding to the first information. A recommended interaction instruction associated with the first user, and a recommended interaction instruction associated with the first terminal corresponding to the first information.

For example, if the first message is "Please help call the managers of various departments for a meeting at nine o'clock tomorrow" received through WeChat, the recommended interaction instruction associated with the control intention of the first message may be, for example, "You It can be said to open Tencent Meeting"; the recommended interactive instruction associated with the content of the first information, for example, can be "You can say to set a reminder for the meeting itinerary at nine o'clock"; the recommended interactive instruction associated with the first user corresponding to the first information, For example, it can be "you can say to send a meeting notice to each department manager"; the recommended interactive instruction associated with the first terminal corresponding to the first information can be, for example: "You can say to send a scheduled start-up instruction at 8:30 tomorrow to the meeting room computer" etc.

Optionally, the recommended interaction instructions associated with the current scene include at least one of the following: a recommended interaction instruction associated with the current time, a recommended interaction instruction associated with the current location, a recommended interaction instruction associated with the identity of the current user, a recommended interaction instruction associated with the current Recommended interaction instructions associated with events (eg, applications or services that are currently awakened, started, running, or closed), recommended interaction instructions associated with historical instructions, recommended interaction instructions associated with smart devices, and recommended interaction instructions associated with associated devices.

For example, if the first message is "Please call all department managers for an emergency meeting in ten minutes" received through WeChat, then the recommended interaction instruction associated with the current time may be, for example, "You can say to set up a nine-ten meeting room"; the recommended interaction instruction associated with the current location, for example, can be "You can say that you can hold an emergency meeting online in a meeting room in Shenzhen"; the recommended interaction instruction associated with the current user's identity, for example, can be "You can Said to send a meeting room occupancy request to the administrative department", the recommended interaction instruction associated with the current event (for example, the application or service that is currently awakened, opened, running or closed), for example, can be "You can say that in ten minutes, open WeChat multi-person Voice call"; the recommended interactive command associated with historical commands, for example, can be "You can say to send the historical commands of Tencent Meeting"; the recommended interactive command associated with smart devices, for example, can be "You can say to show the installed conference application or a list of services"; the recommended interactive command associated with the associated device, for example, may be "you can say to send a wake-up command to the computer in the conference room".

Optionally, in step S1B, in response to the first preset operation, outputting the first interface includes at least one of the following:

Optionally, the recommended instruction associated with the update control includes at least one of the following: an instruction parallel to the update control, an instruction at a lower level of the update control, an instruction at a higher level of the update control, and an instruction including functions of multiple update controls. For example, the update control is "next song", the recommended instruction can be "previous song", the update control is "enlarge the picture", the recommended instruction can be "enlarge the picture to 2 times the current size", "zoom the picture", etc. wait.

Optionally, in response to the running operation of the preset application or service, when the running operation does not match the function of the preset application or service, a first interface is output, and the first interface includes a recommendation corresponding to the application or service associated with the running operation instruction. Exemplarily, for example, the user performs the operation of pre-scheduling a webinar meeting on DingTalk, and when there is no webinar meeting function on DingTalk, a first interface is output, and the first interface includes the Tencent meeting with the pre-scheduling webinar meeting function Recommend instructions, and/or the operation interface of the Tencent meeting reservation webinar meeting.

Optionally, outputting the first interface corresponding to the matching result includes: outputting the first interface for executing the first information in response to the first information matching the preset information; and/or responding to the first information matching the preset information No match, and there is preset information whose semantic similarity with the first information is greater than the preset value, output the first interface including selection prompt information, the selection prompt information includes the prompt information for selecting whether to execute the first information, and/or select Whether to store the prompt information of the first message.

Optionally, the preset information may include, but is not limited to, pre-stored instruction information that conforms to user habits, and/or instruction information that the system can respond to. Exemplarily, if the first information is "establish a meeting room", in response to the first information matching the preset information, for example matching "establishing a Tencent meeting room", the first interface for executing "establishing a Tencent meeting room" is output, For example, the wake-up interface of Tencent Conference. If the first information is "pull department members to hold a meeting", in response to the presence of preset information whose semantic similarity with the first information is greater than the preset value, for example, the preset information is "establish a meeting room with department members", then output It includes prompt information whether to execute the first information, and/or prompt information for selecting whether to store the first information. In addition, in response to the confirmation operation of the prompt information, the first information is stored, so that a quick response can be performed when the first information is subsequently received.

Exemplarily, the first language information of the first information does not match the language information preset by the system, for example, the first language information of the first information is Japanese, and the language information preset by the system is Chinese, then output the first language information including the recommended instruction. An interface, wherein the recommended instruction includes the first recommended instruction whose language information matches Japanese, so that the smart device can interact with user groups with multiple languages, and the user experience is better.

Exemplarily, for example, the obtained first information is "establish a meeting room", and multiple control intentions can be determined or generated according to the first information, such as "start a meeting application or service", "establish a Tencent meeting", "open If the function of scheduled meeting in Tencent Meeting is scheduled", etc., the first interface including "starting the meeting application or service", "establishing Tencent meeting", "opening the scheduled meeting function in DingTalk Meeting", etc. can be output, and/or the output includes The first interface of the interface after enabling the scheduled meeting function in Tencent Meeting, etc.

Exemplarily, for example, the obtained first information is "establish a meeting room", and multiple control intentions can be determined or generated according to the first information, such as "start a meeting application or service", "establish a Tencent meeting", "open According to the current scene information, such as the commonly used conference application or service corresponding to the current user is Tencent Meeting, and/or Tencent Meeting is in the wake-up state, etc., the output includes The first interface such as "establishing a Tencent meeting", "activating the scheduled meeting function in the Tencent meeting", and/or outputting the first interface including the interface after enabling the scheduled meeting function in the Tencent meeting, etc.

Optionally, after the step of determining at least one target control intention from the plurality of control intentions, it includes:

In response to the confirmation operation, and/or in response to the target control intention meeting the preset control intention condition, and/or in response to the target control intention, outputting the first interface after responding to the target control intention; and/or

In response to not receiving the confirmation operation, and/or the target control intention does not meet the preset control intention condition, outputting the first interface including the target control intention, and/or the control associated device outputting the first interface including the target control intention; and /or

In response to no confirmation operation being received, and/or at least one target control intention not satisfying a preset control intention condition, a first interface including a recommended interaction instruction is output, wherein the recommended interaction instruction is associated with the target control intention and/or satisfies the preset control intention. Set control intent conditions.

Exemplarily, for example, confirming at least one target control intention includes "establishing a Tencent meeting", "opening the scheduled conference function in the Tencent meeting", after receiving the confirmation operation, and/or the target control intention is a non-high-level control intention and/or Or when the non-privacy control intention and/or the smart device can respond, output the first interface including the interface after enabling the scheduled meeting function in the Tencent meeting. For another example, the confirmed at least one target control intention includes "send a photo", "send Zhang San's photo", and if the confirmation operation is not received, and/or the target control intention does not meet the preset control intention conditions, for example, it is not The privacy control intent is to control the associated device (for example, the device corresponding to Zhang San himself) to output the first interface including "you can say to send Zhang San's photo".

Optionally, the first preset condition in step S1B includes at least one of the following: the current scene information meets the preset scene condition; the current application or service belongs to the preset list; the running result of the current application or service meets the preset result condition; The running result of the current application or service does not meet the preset result condition; the received first information meets the preset information condition; the first interface meets the preset interface condition; the input second information is received; the received second information meets the preset condition Set information conditions.

Optionally, the second information in step S1B may include at least one of the following: instructions for the first interface, for example, operation instructions, voice control instructions, text control instructions, and gesture control instructions; information associated with functions of the smart device ; Information associated with the first information.

Optionally, in step S1B, in response to meeting the first preset condition, a second interface is output, including at least one of the following: in response to the first interface meeting the preset interface condition and receiving the second information, in the first interface Displaying recommended interactive instructions associated with the second information to output the second interface; in response to the first interface not meeting the preset interface conditions and receiving the second information, after processing the first interface, the processed first The recommended interactive instruction associated with the second information is displayed in the interface to output the second interface; in response to the received first information meeting the preset information condition, output the second interface corresponding to the first information; in response to the received second information The preset information condition is met, and a second interface corresponding to the second information is output.

Exemplarily, for example, if the obtained first information is "establish a meeting room" and the first information corresponds to multiple applications or services, such as DingTalk Meeting and Tencent Meeting, then the first interface corresponding to the first information can be output and the second interface, for example, the first interface including the DingTalk meeting icon, the second interface including the Tencent meeting icon, and so on. For another example, the received second information is an operation instruction for the first interface, such as a click operation on the icon of the DingTalk meeting, then output the second interface that responds to the click operation, such as the wake-up interface and the running interface of the DingTalk meeting wait.

Optionally, satisfying the second preset condition in step S2B includes at least one of the following: the smart switch is turned on; user habits are met; a preset operation instruction is received; and an associated device is connected.

Optionally, corresponding processing is performed on the first interface and/or the second interface in step S2B, including at least one of the following: hiding or closing the first interface and/or the second interface; fusing or merging the first interface and/or the second interface Two interfaces; enlarge or reduce the first interface and/or the second interface; output the third interface; output the first interface and/or the second interface to the associated device; after processing the first interface and/or the second interface, output to the associated device for output.

Optionally, the smart device includes a first display area and a second display area, and both the first display area and the second display area display the first interface;

Step S2B: In response to satisfying the second preset condition, perform corresponding processing on the first interface and/or the second interface, including: responding to the first interface satisfying the second preset condition, performing corresponding processing on the first display area and the second display area one of the first interfaces, or simultaneously process the first interfaces displayed in the first display area and the second display area.

Optionally, step S2B: in response to satisfying the second preset condition, performing corresponding processing on the first interface and/or the second interface includes: in response to a mobile operation in a non-single-handed mode, passing information in the first interface through The first display area and the second display area are displayed in turn; and/or in response to the movement operation in the single-handed mode, the position of the information in the first interface in the first display area is adjusted.

Exemplarily, when the smart device is a folding screen mobile phone, in response to the first interface meeting the second preset condition (for example, conforming to the user's habit, conforming to the current scene), and the mobile phone is switched to the folding mode, the first interface is updated , such as adjusting the position and size of the pop-up window suspended on the first interface, and/or closing the second interface, etc., to avoid unnecessary waste of power.

15a to 15c are schematic diagrams of application scenarios of a processing method according to an embodiment of the present application. As shown in Figure 15a, the smart device receives the first message, such as "hold an emergency meeting for all staff at nine o'clock", through a preset application or service, such as WeChat, and outputs the first message including the recommended interactive instruction associated with the first message. The interface, for example, includes the first interface of "establishing a Tencent meeting room" and "establishing a Dingding meeting room" (please refer to Figure 15a), in response to meeting the first preset condition, for example, receiving a request for "establishing a Tencent meeting room" When the instruction is confirmed, and/or when it is detected that Tencent Conference is a commonly used conference application or service, a second interface is output (please refer to FIG. 15b ). Wherein, the second interface may include an interface of a Tencent conference, for example, an interface of a Tencent conference after entering a scheduled conference function. After receiving the confirmation instruction for the second interface, the first interface is updated according to the second interface (please refer to FIG. 15c).

As above, the processing method of this embodiment can output the first interface in response to the first preset operation, and/or output the second interface in response to satisfying the first preset condition, and can respond to satisfying the second preset condition Corresponding processing is performed on the first interface and/or the second interface, so the efficiency of human-computer interaction can be effectively improved, the user can enjoy the service intuitively and quickly, and the user experience is improved.

fifth embodiment

Fig. 16 is a schematic flowchart of a processing method according to the fifth embodiment.

In one aspect, the present application first provides a processing method. As shown in Figure 16, the processing method of this embodiment is applied to a smart device, and the processing method includes:

Step S1C: Obtain the input first information;

Step S2C: In response to the first information meeting the second preset condition, perform corresponding processing according to the second preset strategy; and/or, in response to the first information not meeting the second preset condition and meeting the third preset condition, according to The third preset strategy performs corresponding processing.

Through the above method, when processing a request, the smart device considers whether the request satisfies the second preset condition, and then performs corresponding processing according to the corresponding preset policy according to the judgment result, so as to quickly determine the user's control intention and make the user experience better.

Exemplarily, after acquiring the voice information of the user, the smart device performs semantic analysis, and judges whether the voice information contains a definite control intention according to the semantics of the voice information. If a definite control intent is contained, or a definite control intent can be generated or determined, then the control intent is followed. If it does not contain a definite control intention, or cannot generate or determine a definite control intention, call other information for further comprehensive judgment.

Optionally, the first information may include voice control instructions. Exemplarily, the in-vehicle smart device may obtain the user's voice control instruction to navigate to a nearby hospital.

Optionally, the first information may include text control commands. Exemplarily, the smart computer device can obtain the user's text command to execute the control instruction of playing audio and video.

Optionally, the first information may include an operation instruction. Exemplarily, the smart home terminal may acquire a manual operation instruction that the user needs to turn on the air conditioner.

Optionally, the first information meeting the second preset condition may include: the first information includes at least one control intention. Exemplarily, by analyzing the text control command "navigate to the city hall", the vehicle navigation can make it clear that the user's text command contains the user's control intention to navigate to the city hall.

Optionally, the first information meeting the second preset condition may include: at least one control intention can be generated or determined according to the first information. Exemplarily, the smart speaker can determine that the user's voice control command needs to play the music "Stars and Seas" by analyzing the user's voice control command "It is time to play "Stars and Seas".

Optionally, the control intents may include historical control intents. For example, the user says "I'm hungry, order a takeaway" voice control instruction, and the smart device obtains the user's last voice interaction of "order a takeaway" based on the historical human-computer interaction records, and finally chooses the desired Order a burger for takeout. Therefore, the smart device will order a hamburger takeaway as the control intention of the user's voice control command.

Optionally, the control intent may include an associated control intent. Exemplarily, the control intention associated with the control intention directly obtained from the first information often has a linkage operation. For example, if the user needs to pay for an order, then the user's control intention includes not only running the payment program, but also an associated control intention of opening the corresponding shopping software. For another example, in the control of a smart home, the user issues a voice control command of "it's dawn, let's open the window". The user's control intention includes not only opening the window, but also the associated control intention of turning off the lights. At this time, the smart device not only executes the control intent of opening the window, but also executes the associated control intent of turning off the light.

Optionally, the control intent may include a privacy control intent and/or a non-privacy control intent. Exemplarily, the user needs to send chat records, but the smart device detects that the chat records contain private information. At this point, the smart device needs to generate a prompt message, and after obtaining the user's confirmation, execute the control intent of sending the chat record.

Optionally, the control intentions may include high-level control intentions and/or non-high-level control intentions. In the classification of application programs for smart devices, operations of some application programs involve user privacy, property security, or safe operation of smart devices. If the control intent involves the operation intent of this type of application, it can be classified as a high-level control intent, and correspondingly, the operation intent of other applications can be classified as a non-high-level control intent. For example, a control intent involving a payment action could be classified as a high-level control intent. For example, if the control intention of "clearing the shopping cart" is analyzed according to the first information, and the currently opened shopping software is "official procurement", at this time, "clearing the shopping cart of the public network procurement software" can be classified as high Hierarchical control intent. For high-level control intentions, smart devices can output prompt information first, and then respond according to user confirmation instructions.

Optionally, performing corresponding processing according to the second preset strategy may include: if there is only one control intention, performing corresponding processing according to the control intention. If a unique control intention can be analyzed according to the first information, the smart device can directly execute the user's control intention.

Optionally, performing corresponding processing according to the second preset strategy may include: if there are at least two control intentions, determining a target control intention according to a preset selection strategy, and performing corresponding processing according to the target control intention.

If the control intention analyzed according to the first information may have multiple interpretations, the smart device cannot directly execute it arbitrarily, so as to avoid errors or even accidents. For example, when the unit has two garages, the first garage and the second garage, the user sends out the voice control instruction "charge in the unit's garage", and the smart device can parse out "charge in the unit's first garage" and "charge in the unit's garage". Second Garage Charging" two control intents. At this time, it is necessary to determine which garage of the unit the user needs to park in according to other information in order to obtain the user's target control intention.

Optionally, meeting the third preset condition may include: being able to determine the target control intention according to the second information of the smart device. Exemplarily, the smart device may obtain at least one of current scene information, interface information, current running information, application information and other information as the second information of the smart device, and analyze it together with the first information to determine the target control intention.

Optionally, the second information of the smart device may include scene information of the smart device. Exemplarily, the user sends a voice control instruction of "connect the call" to the mobile phone. At this time, if no other person is found in the space, use the external voice to connect the call; if there are at least two people in the space, use the headset to connect the call.

Optionally, the second information of the smart device may include time information of the smart device. For example, when the user needs the vehicle-mounted smart device to perform a navigation task, if the time of the smart device is between 6:00 am and 6:00 pm at this time, use the first brightness or the first background to display the navigation map screen; if at this time When the time of the smart device is between 6:00 p.m. and 6:00 a.m., the second brightness or the second background is used to display the navigation map screen.

Optionally, the second information of the smart device may include location information of the smart device. For example, when the user needs the smart device to play a video, if the smart device is in the company at this time, use half-screen playback or floating window playback; if the smart device is at home at this time, use full-screen playback.

Optionally, the second information of the smart device may include status information of the smart device. For example, when the user needs the smart device to connect to the video call, if the smart device is in a power-saving state at this time, it will be displayed at the first brightness; otherwise, if the smart device is at the normal state at this time, it will be displayed at the second brightness. Similarly, the smart device may be in a state of exercising, driving, etc., and when executing the user's control intention, the corresponding target control intention can be selected correspondingly.

Optionally, the second information of the smart device may include application or service information of the smart device. Exemplarily, when the user needs to pay, the smart device searches the application software whitelist or blacklist, uses the first payment application in the whitelist for payment, and refuses to use the second payment application in the blacklist for payment.

Optionally, the second information of the smart device may include trigger object information of the smart device. Exemplarily, when the user needs weather forecast information, the smart device detects trigger object information. If it is a child user, it will be displayed in animation, and if it is an elderly user, it will be broadcast in voice mode.

Optionally, the second information of the smart device may include relationship information between multiple applications or services of the smart device.

The relationship information between multiple applications or services may be priority relationship, inter-correlation relationship, relationship between running contents, relationship between running results, location relationship of service interfaces, and the like. For example, when the user needs to view short messages during the running of the actual combat game, the system places the display window of the short message service in the form of a floating window in the corner of the screen that is farthest from the game character.

Optionally, the second information of the smart device may include associated device information of the smart device. For example, when a user needs a smart device to provide a vehicle condition assessment service for family members, the smart device retrieves the current vehicle's location information, speed information, power information, braking information, fuel and electricity information, etc. through the associated on-board equipment.

Optionally, the second information of the smart device may include user operation habits. For example, when the user requests to turn on the air conditioner through the home smart device, the home smart device calls the user's habitual temperature setting, humidity setting, air volume setting, swing setting, and timing duration according to the user's historical operating habits. Action information.

Optionally, the second information of the smart device may include historical interaction records stored by the smart device. Exemplarily, the in-vehicle smart device records the user's unit address in the historical interaction. When the user sends out the voice operation instruction of "navigate to the company", the on-board smart device calls the recorded unit address and wakes up the navigation service as the navigation destination.

Optionally, the second information of the smart device may include historical interaction records obtained by downloading from the network device. Exemplarily, the user purchases a flight ticket from Shanghai to Shenzhen departing at 11:00 am on National Day by using the authenticated identity information through the first smart device. When the user checks the schedule through the second smart device, the second smart device uses the user's identity information to obtain the user's historical ticket purchase records from the first smart device or the ticketing website through the network device, and lists them in the user's schedule in chronological order displayed in .

Optionally, the second information of the smart device may include historical interaction records obtained from associated devices. For example, when the user needs the on-board smart device to navigate to the freight station to pick up goods, the on-board smart device extracts the address information of the freight station from the latest order information or chat information through the associated mobile phone of the user, so as to determine the navigation destination.

Optionally, meeting the third preset condition may include: being able to determine the target control intention according to user selection.

If the control intention analyzed according to the first information may have multiple interpretations, the smart device cannot directly execute it arbitrarily, so as to avoid errors or even accidents. At this time, the smart device can output prompt information, and the user can select the corresponding option according to his real intention, so as to assist the smart device to determine the target control intention. The way of outputting the prompt information can be a voice prompt or an interface prompt, and the user can select and confirm the control intention based on voice commands, touch operation commands, gesture operation commands, and the like.

After the smart device merges the acquired second information of the smart device into the first information, new information can be formed to analyze and obtain the target control intention. Exemplarily, the user sends a voice control command "It's too hot here" to the smart home terminal, if the current outdoor temperature is winter or 5 degrees Celsius, and the indoor temperature is 33 degrees Celsius, then the target control intention at this time is to set The heating is lowered on the existing basis. If the current outdoor temperature is summer or 35 degrees centigrade, and the indoor temperature is 33 degrees centigrade, then the target control intention at this time is to increase the air conditioner on the existing basis.

Optionally, the preset rule may include: if the first information lacks partial information, then determine or generate the partial information according to the second information of the smart device, so that the first information can be combined with the partial information to determine or generate intermediate information.

Exemplarily, the user sends a voice control instruction of "navigate home" to the vehicle-mounted smart device, but the address of the home is not included in the voice control instruction at this time. The on-board smart device can record the address of Zhongjia through the shopping order, so as to form new intermediate information "navigate to ××× community" in combination with the voice control command, and then determine the target control intention.

Optionally, the preset rule may include: if the first information includes the first part of information that cannot be recognized or responded to, then determine or generate the second part of information according to the second information of the smart device, so that the first information can be combined with the second part Information determines or generates intermediate information.

Exemplarily, the user sends a voice control command to the smart device, "If the price of the air ticket from Shanghai to Shenzhen on the National Day is less than 500 yuan, book one for me". Smart devices cannot recognize which platform should be used to book tickets from voice control instructions. At this time, the smart device screens out the most frequently used travel software platform according to the installed travel software platforms, combined with the voice control command, a new intermediate message is formed: "Open the 'Ctrip' application, book a National Day Shanghai-Shenzhen flight The air ticket price is less than 500 yuan", and then the target control intention is determined.

Optionally, performing the corresponding processing according to the third preset policy may include: immediately or delaying or stopping or switching the processing corresponding to the control intention performed on the smart device. When the first information meets the preset condition, the smart device may determine a definite control intention, and at this time, the processing corresponding to the determined control intention may be immediately performed on the smart device. In another case, when the first information does not meet the preset conditions, the smart device may not be able to determine the user's control intention or may determine a wrong control intention, and if it continues to execute, it may cause errors or major accidents and losses. Therefore, it is possible to choose to delay the execution of the processing corresponding to the control intention on the smart device, or to choose to stop the execution of the processing corresponding to the control intention on the smart device.

In another case, when the first information does not meet the preset condition, the smart device may also choose to switch to execute the processing corresponding to the control intention on the smart device. Exemplarily, in the processing of the control intention, the mobile phone may switch to an appropriate or corresponding vehicle-mounted smart device for processing, or switch to another appropriate or corresponding application service for processing. For example, when the mobile phone receives the user's voice control instruction of "switching the sports driving mode", since the mobile phone does not support the switching of the driving mode, the mobile phone can be switched to the associated vehicle-mounted smart device for corresponding processing, and the vehicle-mounted smart device will The driving mode switches to Sport driving mode.

Optionally, performing corresponding processing according to a third preset strategy may include: outputting confirmation information, and performing processing corresponding to the control intention on the smart device in response to receiving the confirmation operation.

When the first information does not meet the preset condition, the analysis of the first information by the smart device may correspond to multiple control intentions, or one control intention may correspond to multiple execution modes. In order to avoid errors or major accidents and losses that may be caused by wrong execution, you can choose to output prompt information or confirmation information to the user first, and the user can choose according to his true intention or execution preference. After the user makes a clear choice on the control intention or execution method, the corresponding processing is performed on the smart device. The way of outputting the prompt information can be a voice prompt or an interface prompt, and the user can select and confirm the control intention based on voice commands, touch operation commands, gesture operation commands, and the like.

Optionally, performing corresponding processing according to the third preset strategy may include: copying or transferring the processing corresponding to the control intention to an associated device for execution. For example, when the mobile phone receives the user's "switching sports driving mode" control instruction, since the mobile phone does not support the switching of driving modes, the mobile phone can be switched to the associated vehicle-mounted smart device for corresponding processing, and the vehicle-mounted smart device Switch the driving mode to Sport driving mode. For example, when the mobile phone receives the user's control instruction of "displaying the image of the rear camera of the car", the mobile phone remotely calls the image information of the rear camera in the vehicle camera. When the mobile phone detects that the distance from the vehicle-mounted smart device is less than the preset distance threshold, the processing task of displaying the image of the car's rear camera is switched to the vehicle-mounted smart device for local execution, which can save processing resources and improve processing efficiency.

Optionally, performing corresponding processing according to the third preset policy may include: executing processing corresponding to the control intention on the smart device and/or associated device. Exemplarily, when a mobile phone or a child's phone watch with child mode enabled needs to perform a large-amount payment function, the synchronization authorization service of the associated parent's mobile phone is required to jointly complete the payment; or, the payment service is directly processed accordingly. During the execution process of the associated device, it may be executed synchronously or switched. In terms of the execution order of the smart device and the associated device, it may be performed sequentially or synchronously, which is not limited in this application.

Optionally, in addition to the method, the method further includes the following step: in response to the fact that the first information does not satisfy the second preset condition and does not satisfy the third preset condition, perform corresponding processing according to a fourth preset policy.

When the first information neither satisfies the second preset condition nor the third preset condition, it cannot be processed according to the second preset strategy, nor can it be processed according to the third preset strategy. At this time, the fourth preset policy is set for processing by the smart device, which can properly respond to the user's instruction and improve user experience. Exemplarily, the smart device cannot determine the control intention through the first information, and the smart device still cannot determine the control intention through the second information of the smart device. At this point, the smart device may request the user to issue an instruction again, or provide third information to determine the control intention. In another embodiment, the smart device may also output prompt information to allow the user to select a corresponding operation. In other embodiments, the smart device may also end this response to release response resources.

Optionally, before the step of acquiring the input first information, the method further includes: performing preset processing on the smart device.

Before the smart device responds to the first information, operations such as starting, running, sleeping, waking up, and exiting the application or service may be performed on the smart device to ensure the accuracy of the response.

Fig. 17 is a schematic diagram of a children's watch determining and executing a control intention of a voice control instruction according to an embodiment of the present application.

As shown in Figure 17, in one embodiment, the children's watch is in a sleep state. The child user wakes up the children's watch and sends out a voice control command: "If the Olympic school is on holiday, help me buy a ticket to grandma's house, I want to eat lunch made by grandma". The human-computer interaction application of the children's watch has been analyzed through voice, and it is found that the voice control command of the child user needs to book a ticket, but it is impossible to directly determine what kind of ticket to book.

Children's watches first need to retrieve public information to see if there is a holiday during the Olympic Games. The children's watch is connected to the router, and the network information is retrieved through the router: It is confirmed that Beijing will have a one-day holiday on August 8, 2008, the day when the Olympic Games opening ceremony will be held. The children's watch determines that the current location is Beijing, so it needs to execute the user's ticket purchase instruction.

The children's watch has determined through historical chat information that the "grandmother's house" is in Zhengzhou City, and there are two modes of travel by plane and train. It is temporarily impossible to determine which mode of travel the child user needs. The children's watch checked the weather forecast and determined that it will rain on August 8th, and there may be severe weather conditions that will affect the grounding of the aircraft. Therefore, make sure to book a train ticket.

Children's Watch After inquiry, there are two options for the departure time of the train ticket that can reach Zhengzhou City before noon on August 8. Therefore, two options pop up to the child user: 1. Express train ticket departing at six o'clock in the morning. 2. The high-speed rail ticket departing at 8:00 in the morning. Since the power is below 20%, the status of the children's watch is in low power mode, so the output option is displayed in a low brightness mode.

After the child user selects the option "2. High-speed rail ticket departing at 8:00 in the morning", it enters the ticket booking stage. Since the smart watch does not support shopping applications, the ticketing service is transferred to the associated child user's smartphone.

Based on the installed travel software platforms, the smart phone screens out the most frequently used travel software platforms recently, and combines voice control commands to form a new message "Open the 'Ctrip' app and book a ticket from Beijing to Zhengzhou on August 8th at 8:00 a.m. Click on the high-speed rail ticket for departure."

When the user needs to pay for the ticket reservation, the mobile phone retrieves the application software whitelist or blacklist, calls the first payment application in the whitelist for payment, and refuses to use the second payment application in the blacklist for payment.

After the first payment application of the smart phone is woken up, according to preset rules, it needs the synchronous authorization service of the associated parent's mobile phone to jointly complete the payment. Therefore, the associated mother's mobile phone is remotely connected to request payment authorization.

During the payment process, the smart phone retrieves the key information of the associated device bank's electronic signature encrypted USB flash drive for encrypted verification.

After the ticket is purchased successfully, because the child user is using the child watch to play the game. Therefore, the children's watch places the display window of successful ticket purchase in the form of a floating window in the corner of the screen farthest from the game character, and displays the picture of successful ticket reservation to the child user in the form of animation.

Sixth embodiment

As shown in Figure 18, this embodiment provides a processing method, including the following steps:

Step S10: In response to the first preset operation and/or the information of the associated device, determine the control intention and/or obtain at least one recommended interaction instruction and/or output the first interface;

Step S20: Execute corresponding processing on the smart device based on the preset strategy, and/or control the associated device to output.

Optionally, step S10 includes: in response to the first preset operation, acquiring at least one recommended interaction instruction according to the first preset operation and key information.

Optionally, the instruction keyword in the error interaction instruction may be: a certain function, startup, shutdown, etc.; the function currently used by the smart device may be: the function of the smart device system, the function of installing an application program on the smart device; The triggered function can be: predict the next function to be used; the user identity can be: old man, child, new user and old user, etc.; the current application scenario can be: in a specific time period, in a specific place, in children's mode , connection status, etc.; the information of the first application in the smart device can be: the application currently being used by the smart device, the running application; the current browsing content information on the smart device can be: the browsing content information on the current display interface of the smart device, Browsing content information in the background; associated device information can be: a device connected to a smart device with a wired connection or a wireless connection.

Optionally, in response to the first preset operation in step S10, obtaining at least one recommended interactive instruction according to the first preset operation and key information includes: obtaining keyword information of the input interactive instruction, Information acquisition recommended interactive instructions.

Optionally, step S10 includes: outputting the first interface in response to the first information satisfying the first preset condition, and/or outputting the second interface in response to the second information satisfying the second preset condition;

Optionally, the first interface may include at least one of the following: an update control for updating the first interface; a recommended instruction associated with the update control; recommended instruction information different from the function of the update control; a wake-up interface for preset applications or services ; the running interface of the preset application or service; the interface of the application or service associated with the preset application or service; the recommended instruction information associated with the preset application or service; the control intention corresponding to the first information; The recommended instruction information; the interface after responding according to the first information; the recommended instruction information associated with the current scene.

Optionally, the recommended instruction information associated with the preset application or service includes at least one of the following: recommended instructions associated with functions of the preset application or service, common historical instruction information of the preset application or service, information related to the preset application or service The running state of the service is associated with the corresponding terminal of the preset application or service.

Optionally, the recommended instruction information associated with the first information includes at least one of the following: recommended instruction information associated with the control intention of the first information, recommended instruction information associated with the content of the first information, and The recommendation instruction information associated with the first user, and the recommendation instruction information associated with the first terminal corresponding to the first information.

Optionally, the recommended instruction information associated with the current scene includes at least one of the following: recommended instruction information associated with the current time, recommended instruction information associated with the current location, recommended instruction information associated with the current user identity, and current Recommended instruction information associated with an event (for example, an application or service that is currently awakened, opened, running, or closed), recommended instruction information associated with historical instructions, recommended instruction information associated with a smart device, and recommended instruction information associated with an associated device.

Optionally, in step S10: in response to the first information satisfying the first preset condition, outputting the first interface includes: in response to the matching result of the first information and the preset information, outputting the first interface corresponding to the matching result; And/or in response to the first information including the control intention, output the first interface corresponding to the control intention; and/or in response to the first information being unable to determine or generate the control intention, output the first interface corresponding to the recommended instruction information associated with the first information An interface; and/or a plurality of control intentions can be determined or generated in response to the first information, and a first interface corresponding to the plurality of control intentions is output.

Optionally, the preset information may include, but is not limited to, pre-stored instruction information that conforms to user habits, and/or instruction information that the system can respond to. For example, if the first information is "Start Navigation", in response to the first information matching the preset information, for example matching "Start AutoNavi", output the first interface for executing "Start AutoNavi", for example , including the wake-up interface of AutoNavi. If the first information is "depart for work", in response to the presence of preset information whose semantic similarity with the first information is greater than the preset value, for example, the preset information is "navigate to the company", then output including whether to execute the first information prompt information, and/or select whether to store the prompt information of the first information. In addition, in response to the confirmation operation of the prompt information, the first information is stored, so that a quick response can be performed when the first information is subsequently received.

Optionally, in response to a matching result of the first information and preset information, outputting a first interface corresponding to the matching result includes: in response to a mismatch between the first language information of the first information and the preset language information, outputting a recommendation including In the first interface of the instruction, the language information of the recommended instruction matches the preset language information and/or the first language information.

Optionally, outputting the first interface corresponding to the control intention includes: responding to the control intention meeting the preset control intention condition, responding directly according to the control intention, and outputting the first interface after responding to the control intention; and/or responding to If the control intention does not meet the preset control intention conditions, output the first interface including the control intention, and/or output the first interface of the information of the associated equipment associated with the control intention, and/or send the first interface including the control intention to output to the associated device; and/or in response to the control intention not satisfying the preset control intention condition, output the first interface including recommended instruction information, wherein the recommended instruction information is associated with the control intention and/or meets the preset control intention condition .

Optionally, in response to the control intention meeting the preset control intention condition, responding directly according to the control intention, and outputting the first interface after responding to the control intention includes: responding to the control intention meeting the preset control intention condition, waking up, starting or running At least one preset application or service, and output a first interface including recommended instruction information and/or a running interface of the preset application or service, wherein the recommended instruction information is associated with the preset application or service, and/or is associated with the first information associated.

Optionally, after the step of determining at least one target control intention from the plurality of control intentions, it includes: responding to the confirmation operation, and/or responding to the target control intention meeting the preset control intention condition, and/or responding to the target control intention , output the first interface after responding to the target control intention; and/or in response to not receiving the confirmation operation, and/or the target control intention does not meet the preset control intention condition, then output the first interface including the target control intention, and/or Or the control associated device outputs the first interface including the target control intention; and/or in response to no confirmation operation is received, and/or at least one target control intention does not meet the preset control intention condition, then output the first interface including the recommended instruction information An interface, wherein the recommended instruction information is associated with the target control intention and/or satisfies a preset control intention condition.

Optionally, in step S10, in response to the second information satisfying the second preset condition, outputting the second interface includes: responding to the association of the second information with the control intention of the first information, and/or the second information corresponding to the second information. The user is associated with the first user corresponding to the first information, and the first interface and the second interface are output; in response to the second information being associated with the first interface, the second interface is output after closing the first interface.

Optionally, step S10 includes: displaying the first interface and/or the second interface in response to the first preset operation.

Optionally, the second interface may include at least one of the following: an update control for updating the second interface; a recommended instruction associated with the update control; recommended instruction information different from the function of the update control; a wake-up interface for preset applications or services ; the running interface of the preset application or service; the interface of the application or service associated with the preset application or service; the recommended instruction information associated with the preset application or service; the control intention corresponding to the first information; The recommended instruction information; the interface after responding according to the first information; the recommended instruction information associated with the current scene.

Optionally, in step S10, in response to the first preset operation, the first interface and/or the second interface are displayed, including at least one of the following:

In response to the running operation of the preset application or service, when the running operation does not match the function of the preset application or service, the first interface and/or the second interface are displayed, and the first interface and/or the second interface include at least one of the following Item: operation failure information; recommended instructions corresponding to the operation of the preset application or service; recommended instructions corresponding to the application or service associated with the running operation and/or associated equipment; recommended instructions corresponding to the functional configuration of the preset application or service; An update control for updating the first interface; a recommended instruction associated with the update control; a recommended instruction with a function different from that of the update control; a recommended instruction corresponding to an associated device associated with the running operation;

In response to the running operation of the preset application or service, when the running operation matches the function of the preset application or service, the first interface and/or the second interface are displayed, and the first interface and/or the second interface include at least one of the following : the running interface of the preset application or service; the recommended instruction corresponding to the running operation; the recommended instruction corresponding to the function configuration of the preset application or service; the update control for updating the first interface; the recommendation instruction associated with the update control; Recommended instructions that are different from the functionality of the update control; recommended instructions and/or update controls associated with the functionality of updating preset applications or services;

In response to the closing instruction of the preset application or service, display the first interface and/or the second interface, wherein the first interface and/or the second interface include at least one of the following: an application or service associated with the preset application or service interface; recommended instructions for applications or services associated with preset applications or services;

In response to the closing instruction of the preset application or service and the starting instruction of other applications or services, the first interface and/or the second interface are displayed, and the first interface and/or the second interface include at least one of the following: other applications or services and Recommended instructions and/or update controls corresponding to differences in preset applications or services; recommended instructions and/or update controls corresponding to new functions of other applications or services relative to preset applications or services; update controls for updating the first interface ; recommended instructions associated with update controls; recommended instructions with functions different from update controls; interfaces of applications or services associated with other applications or services; recommended instructions corresponding to associated devices associated with other applications or services;

In response to receiving the input first information, acquire the control intention included in the first information, and display the first interface and/or the second interface corresponding to the control intention;

In response to receiving the input first information, and the first information cannot determine or generate a control intention, display the first interface and/or the second interface corresponding to the recommended instruction information associated with the first information;

In response to receiving input first information, and the first information can determine or generate multiple control intentions, display the first interface and/or the second interface corresponding to the multiple control intentions.

Optionally, displaying the first interface and/or the second interface corresponding to the control intention includes: responding to the control intention meeting the preset control intention condition, responding directly according to the control intention, and displaying the first interface after responding to the control intention and/or the second interface; and/or in response to the control intention not satisfying the preset control intention condition, displaying the first interface and/or the second interface including the control intention, and/or displaying the information of the associated device associated with the control intention The first interface and/or the second interface of the information; and/or in response to the control intention not meeting the preset control intention condition, displaying the first interface and/or the second interface including the recommended instruction information, wherein the recommended instruction information and The control intention is associated with and/or meets preset control intention conditions.

Optionally, displaying the first interface and/or the second interface corresponding to multiple control intentions includes at least one of the following: displaying the first interface corresponding to the first control intention; displaying the second interface corresponding to the second control intention ; Simultaneously display the first interface corresponding to the first control intention, and the second interface corresponding to the second control intention; display the first interface corresponding to the first control intention, and display the second interface corresponding to the second control intention and the third control intention the second interface; displaying the first interface, and displaying the second interface in response to a user operation instruction.

Optionally, step S10 includes: acquiring the input first information and the second information of the smart device, and determining the control intention according to the first information and the second information.

Through the above method, when processing a request, the smart device can determine the control intention according to the input first information and the second information of the smart device, and then perform corresponding processing according to the determined control intention and the preset strategy, and can quickly determine the user's control intention , making the user experience better.

Exemplarily, after the smart device acquires the voice information of the user, it performs semantic analysis together with the second information of the smart device acquired by the smart device, and judges a certain control intention included in the voice information according to the semantics of the voice information. If a definite control intent is contained, or a definite control intent can be generated or determined, then the control intent is followed. If a certain control intention cannot be generated or determined, according to the second information of the smart device, the control intention is determined and then executed.

Optionally, the first information may include voice control commands, text control commands, and operation commands.

Optionally, the first information satisfies the first preset condition, and may include at least one of the following: the first information includes at least one control intention, and at least one control intention can be generated or determined according to the first information.

Optionally, determining the control intention according to the first information and the second information of the smart device includes: determining or generating intermediate information according to a preset rule according to the first information and the second information of the smart device, and determining the control intention according to the intermediate information.

Optionally, the control intention may include at least one of the following historical control intentions, associated control intentions, privacy control intentions and/or non-privacy control intentions, high-level control intentions, and non-high-level control intentions.

Optionally, according to the first information and the second information of the smart device, determining the control intention may include at least one of the following: if the first information includes only one control intention, perform corresponding processing according to the control intention; the first information includes When there are at least two control intentions, the target control intention is determined according to a preset selection strategy.

Optionally, the preset selection strategy may include: determining the target control intention according to the second information of the smart device.

Exemplarily, the smart device may acquire at least one of current scene information, interface information, current running information, application information and other information as the second information of the smart device, so as to determine the target control intention.

Optionally, the preset selection strategy may include: determining the target control intention according to user selection.

Optionally, the second information of the smart device may include at least one of the following: scene information of the smart device, time information of the smart device, location information of the smart device, status information of the smart device, application or service information of the smart device, Trigger object information of smart devices, relationship information between multiple applications or services of smart devices, associated device information of smart devices, user operating habits, historical interaction records stored by smart devices, historical interaction records downloaded from network devices , Historical interaction records obtained from associated devices.

Optionally, the step of determining the control intention according to the first information and the second information of the smart device further includes: when the control intention cannot be determined according to the first information and the second information of the smart device, perform corresponding processing according to a third preset strategy .

Optionally, step S20 includes: in response to the second preset operation, and/or the smart device does not satisfy the preset condition, sending at least one recommended interaction instruction to the associated device for output.

Optionally, the failure of the smart device to meet the preset conditions includes at least one of the following: the smart device does not have a display device; the smart device display device does not meet the display requirements of the recommended interaction instruction; the smart device does not have the display authority of the recommended interaction instruction; The recommended interaction instruction is related to the associated device.

Optionally, in response to the second preset operation in step S20, and/or the smart device does not meet the preset condition, at least one recommended interaction instruction is sent to the associated device for output, including: prioritizing on the display screen of the associated device Display and/or highlight suggested interactive instructions related to the associated device.

Optionally, in response to the second preset operation in step S20, and/or the smart device does not meet the preset condition, sending at least one recommended interaction instruction to the associated device for output includes: obtaining the quantity of at least one recommended interaction instruction ; When the number of at least one recommended interaction instruction exceeds the threshold, output at least one recommended interaction instruction according to the first preset strategy; and/or, when the number of at least one recommended interaction instruction does not exceed the threshold, output at least one recommended interaction instruction The instruction is output according to the second preset strategy.

Optionally, the key information includes: information of the first application in the smart device; in response to the second preset operation in step S20, and/or the smart device does not meet the preset condition, at least one recommended interaction instruction is sent to the associated The output of the device includes: acquiring software version information of the first application; acquiring new recommended interaction instructions of the latest version of the first application according to the software version information; and outputting the newly added recommended interaction instructions.

Optionally, step S20 includes: performing corresponding processing on the first interface and/or the second interface in response to satisfying a third preset condition.

Optionally, corresponding processing is performed on the first interface and/or the second interface in step S20, including at least one of the following: hiding or closing the first interface and/or the second interface; fusing or merging the first interface and/or the second interface Two interfaces; enlarge or reduce the first interface and/or the second interface; output the third interface; output the first interface and/or the second interface to the associated device; after processing the first interface and/or the second interface, output to the associated device for output.

Optionally, the smart device includes a first display area and a second display area, and both the first display area and the second display area display the first interface; in step S20: in response to satisfying the third preset condition, the first interface and /or the second interface performs corresponding processing, including: in response to the first interface meeting the third preset condition, processing the first interface in one of the first display area and the second display area, or simultaneously processing the first interface The first interface displayed in the display area and the second display area is processed.

Optionally, in step S20: in response to satisfying the third preset condition, performing corresponding processing on the first interface and/or the second interface includes: in response to a mobile operation in a non-single-handed mode, converting information in the first interface to The first display area and the second display area are displayed in turn; and/or the position of the information in the first interface in the first display area is adjusted in response to the movement operation in the one-handed mode.

Exemplarily, when the smart device is a folding mobile phone, in response to the first interface meeting the second preset condition (for example, conforming to the user's habit, conforming to the current scene), and the mobile phone is switched to the folding mode, the first interface is updated, For example, adjust the position and size of the pop-up window suspended on the first interface, and/or close the second interface, etc., to avoid unnecessary waste.

Optionally, step S20 includes: after processing the first interface and/or the second interface, controlling the associated device to output the processed first interface and/or the second interface.

Optionally, in step S20: after processing the first interface and/or the second interface, control the associated device to output the processed first interface and/or the second interface, including at least one of the following: hiding or closing the first interface interface and/or the second interface; merging or merging the first interface and/or the second interface; enlarging or reducing the first interface and/or the second interface; controlling the first associated device to output the processed first interface and/or processing control the second associated device to output the processed first interface and/or the processed second interface; control the first associated device to output the processed first interface, and control the second associated device to output the processed the second interface.

Optionally, controlling the first associated device to output the processed first interface and/or the processed second interface includes at least one of the following items: in response to matching the current user of the first associated device with the current user of the smart device, controlling The first associated device outputs the processed first interface and/or the processed second interface; in response to the application or service currently running on the first associated device, the application or application installed or running on the first interface and/or the second interface Service matching, controlling the first associated device to output the processed first interface and/or the processed second interface; in response to the level of the first associated device meeting the preset level, controlling the first associated device to output the processed first interface and/or the processed second interface; in response to the level of the first associated device being higher than the priority level of the second associated device, controlling the first associated device to output the processed first interface and/or the processed second interface.

Optionally, step S20 includes: performing corresponding processing on the smart device according to the control intention and the preset policy.

Optionally, performing corresponding processing on the smart device may include: immediately or delaying or stopping or switching to perform processing corresponding to the control intention on the smart device. Optionally, performing corresponding processing on the smart device may include: outputting confirmation information, and performing processing corresponding to the control intention on the smart device in response to receiving the confirmation operation. Optionally, performing corresponding processing on the smart device may include: copying or transferring the processing corresponding to the control intention to the associated device for execution. Optionally, performing corresponding processing on the smart device may include: performing processing corresponding to the control intention on the smart device and/or associated device.

Seventh embodiment

Fig. 19 is a schematic flowchart of a processing method according to a seventh embodiment of the present application. As shown in Figure 19, this application provides a processing method applied to smart devices, including:

Step S10A: In response to the first preset operation, at least one recommended interaction instruction is acquired according to the first preset operation and key information;

Step S20A: In response to the second preset operation, and/or the smart device does not satisfy the preset condition, send at least one recommended interaction instruction to the associated device for output.

Exemplarily, through the above method, the smart device can determine the user's operation intention according to the first preset operation and key information, and then obtain the corresponding recommended interaction instruction according to the user's operation intention, and send the recommended interaction instruction to the associated device for output , making the user experience better.

It can be understood that the interaction instruction may not be limited to the voice interaction instruction, but may also be a gesture interaction instruction, a motion interaction instruction, etc., which are not limited here. In the following content of this application, voice interaction instructions are used as examples. When using voice interaction instructions, this application is used for smart devices that can be controlled by voice, but is not limited to smart devices that can be controlled by voice. In other ways, It may also be a smart device for gesture control, which is not limited here.

Optionally, step S10A includes: obtaining keyword information of the input interactive instruction, and obtaining recommended interactive instructions according to the keyword information and key information. Exemplarily, the scope of recommended interaction instructions can be further narrowed by keyword information, for example, when the input keywords are startup and shutdown, start-up recommended interaction instructions and shutdown-related recommended interaction instructions related to key information are obtained. When the user enters the keyword information of the interactive instruction, the recommended interactive instruction matching the keyword is obtained from the interactive instructions obtained according to the key information, which facilitates the user to quickly and accurately obtain the desired interactive instruction, saves time and improves accuracy.

Optionally, step S20A includes: preferentially displaying and/or highlighting recommended interaction instructions related to the associated device on the display screen of the associated device.

When there is an interaction instruction related to the associated device in the recommended interaction instruction, the corresponding interaction instruction is marked, so as to preferentially display and/or highlight the corresponding interaction instruction.

Optionally, step S20A includes: acquiring the quantity of at least one recommended interaction instruction; when the quantity of at least one recommended interaction instruction exceeds a threshold, outputting at least one recommended interaction instruction according to a first preset strategy; and/or, When the quantity of the at least one recommended interaction instruction does not exceed the threshold, the at least one recommended interaction instruction is output according to the second preset strategy.

Optionally, the key information includes: information about the first application in the smart device; step S20A, further includes: acquiring software version information of the first application; and acquiring new recommended interactions of the latest version of the first application according to the software version information Instructions; label and output the newly added recommended interactive instructions.

The application scenarios of the processing method based on the present application will be described below. Please refer to FIG. 20 , which is a schematic diagram of a recommendation interaction instruction according to a seventh embodiment of the present application. Figure 20 (a) shows the recommended interactive instruction type confirmation interface, Figure 20 (b) shows the recommended interactive instruction search interface, and Figure 20 (c) shows the recommended interactive instruction interface displayed by the associated device . Exemplarily, after the acquisition request of the interaction instruction of the associated device of the smart device, the relevant interaction instruction is obtained from the database according to the information of the associated device, such as the application information currently in use, and then sent to each associated device for display on the display screen of the associated device. In this way, the recommended interaction instructions obtained by the user through the smart device can be displayed on the associated device.

In the processing method of the present application, in response to the first preset operation, at least one recommended interactive instruction is acquired according to the first preset operation and key information; in response to the second preset operation, and/or the smart device does not meet the preset condition, the At least one recommended interaction instruction is sent to the associated device for output. In this way, when the smart device does not meet the preset conditions, the acquired recommended interaction instructions can be sent to the associated device, so that the user can obtain the recommended interaction instruction through the associated device, which is convenient for the user and enables the user to interact with the smart device during the voice interaction process. Human-computer interaction can be carried out more intelligently and conveniently, and the efficiency of voice control and user experience can be improved.

Eighth embodiment

The present application also provides a processing method, and FIG. 21 is a schematic flowchart of the processing method according to the eighth embodiment.

Please refer to Figure 21, the processing method is applied to the smart device, and the processing method includes:

S10B: In response to the first information meeting the first preset condition, output the first interface, and/or, in response to the second information meeting the second preset condition, output the second interface;

S20B: Execute corresponding processing on the first interface and/or the second interface in response to satisfying the third preset condition.

In the manner described above, the first interface may be output in response to the first information meeting the first preset condition, and/or the second interface may be output in response to the second information meeting the second preset condition; and in response to meeting the third preset condition Assuming conditions, performing corresponding processing on the first interface and/or the second interface can quickly realize human-computer interaction according to the first information and/or the second information, so as to improve user experience.

Exemplarily, the smart device receives the first information input by the user, such as the voice command "navigate to Haidilao", and outputs the first interface including recommended instructions, such as "you can say navigate to Haidilao in Luohu", and responds Based on the second information input on the first interface, such as "Luohu's", the second interface is output, wherein, the second interface may display a confirmation prompt message of "Navigate to Haidilao in Luohu", and/or respond to "Navigation After receiving the confirmation instruction from the user, enlarge the response result in the second interface and/or delete the confirmation prompt information.

Optionally, the first information may include at least one of the following: voice control instructions, text control instructions, gesture control instructions, and operation instructions.

Exemplarily, the in-vehicle smart device may obtain the user's voice control instruction to navigate to a nearby hospital. The vehicle-mounted terminal can also obtain text control instructions that need to navigate to a nearby hospital. The vehicle-mounted terminal can obtain a manual operation instruction for starting a navigation application or service.

Exemplarily, if the preset application or service is a navigation application or service, the recommended instructions associated with the functions of the preset application or service may include "you can say to avoid congestion", "you can say high speed priority", "you can say Said passing the gas station" and so on.

For example, if the first information is "Xiaode, Xiaode", the control intent corresponding to the first information may be "start Gaode application or service" and so on.

For example, if the first information is "Xiaode, Xiaode, let's go out and date Xiaofang now", the recommended instruction information associated with the control intention of the first information can be, for example, "You can say to navigate to the seabed Fishing"; the recommended instruction information associated with the content of the first information, for example, can be "you can say that you passed the flower shop"; the recommended instruction information associated with the first user corresponding to the first information, for example, can be "you can say that you can help Pay the parking fee", "Help turn on the air conditioner"; the recommended instruction information associated with the first terminal corresponding to the first information, for example, can be: "You can say to send the real-time location to Xiaofang" and so on.

For example, if the first information is "Xiaode, Xiaode, let's go out on a date now", the recommended instruction information associated with the current time may be, for example, "You can say to check the real-time traffic conditions to Xiaomeisha"; Recommended instruction information associated with events (for example, currently waking up, opening, running or closing applications or services, and establishing a connection with the vehicle terminal), such as "you can say to wake up the vehicle", "you can say to send navigation information to the vehicle machine"; the recommended instruction information associated with historical instructions, for example, can be "you can say to turn up the volume"; the recommended instruction information associated with smart devices, for example, can be "you can say to enter sleep mode"; The recommended instruction information may be, for example, "you can say to wake up the car".

Optionally, step S10B: outputting the first interface in response to the first information meeting the first preset condition, including: outputting the first interface corresponding to the matching result in response to the matching result of the first information and the preset information; and /or in response to the first information including the control intention, output the first interface corresponding to the control intention; and/or in response to the first information being unable to determine or generate the control intention, output the first interface corresponding to the recommended instruction information associated with the first information an interface; and/or a plurality of control intentions can be determined or generated in response to the first information, and a first interface corresponding to the plurality of control intentions is output.

Exemplarily, for example, the obtained first information is "start navigation", and multiple control intentions can be determined or generated according to the first information, such as "start Gaode application or service", "start Baidu application or service", Etc., according to the current scene information, such as the Amap application or service is in the wake-up state, the current user frequently uses the Amap application or service, etc., it can output the first interface including "You can say to open the Amap navigation", and/or output Including the first interface of the interface of Gaode navigation and so on.

In response to not receiving a confirmation operation, and/or at least one target control intention does not meet a preset control intention condition, output a first interface including recommended instruction information, wherein the recommended instruction information is associated with the target control intention and/or meets the preset control intention. Set control intent conditions.

Exemplarily, for example, confirming at least one target control intent includes "starting Gaode navigation", after receiving the confirmation operation, and/or the target control intent is a non-high-level control intent and/or a non-privacy control intent and/or a smart device When it is possible to respond, output the first interface including the interface after the AutoNavi navigation is enabled.

Optionally, in step S10B, in response to the second information meeting the second preset condition, the second interface is output, including: responding to the association of the second information with the control intention of the first information, and/or the second information corresponding to the second information. The user is associated with the first user corresponding to the first information, and the first interface and the second interface are output; in response to the second information being associated with the first interface, the second interface is output after closing the first interface.

Optionally, corresponding processing is performed on the first interface and/or the second interface in step S20B, including at least one of the following: hiding or closing the first interface and/or the second interface; merging or merging the first interface and/or the second interface Two interfaces; enlarge or reduce the first interface and/or the second interface; output the third interface; output the first interface and/or the second interface to the associated device; after processing the first interface and/or the second interface, output to the associated device for output.

Optionally, the smart device includes a first display area and a second display area, and both the first display area and the second display area display the first interface; Step S20B: In response to satisfying the third preset condition, the first interface and/or Or the second interface performs corresponding processing, including: in response to the first interface meeting the third preset condition, processing the first interface in one of the first display area and the second display area, or simultaneously processing the first display area and the first interface displayed in the second display area for processing.

Optionally, in step S20B: in response to satisfying the third preset condition, performing corresponding processing on the first interface and/or the second interface includes: in response to a mobile operation in a non-single-handed mode, converting information in the first interface to The first display area and the second display area are displayed in turn; and/or the position of the information in the first interface in the first display area is adjusted in response to the movement operation in the one-handed mode.

As above, in the processing method of this embodiment, the first interface is output in response to the first information satisfying the first preset condition, and/or the second interface is output in response to the second information satisfying the second preset condition, so that the The first information and/or the second information input by the user is output to the first interface and/or the second interface, so that the recommended instruction information can be accurately output according to the user's control intention/current scene, etc., so the efficiency of human-computer interaction can be effectively improved , so that users can enjoy the service intuitively and quickly, improving the user experience.

Ninth embodiment

In another aspect, the present application further provides a processing method, and FIG. 22 is a schematic flowchart of an interaction method according to the ninth embodiment. As shown in Figure 22, in one embodiment, the processing method applied to the smart device includes:

S10BB: display the first interface and/or the second interface in response to the first preset operation;

S20BB: After processing the first interface and/or the second interface, control the associated device to output the processed first interface and/or the second interface.

In the above manner, the smart device displays the first interface and/or the second interface in response to the first preset operation, and after processing the first interface and/or the second interface, controls the associated device to output the processed first interface and /or the second interface can cooperate with associated devices to improve the efficiency of human-computer interaction, so that users can enjoy services intuitively and quickly, and improve user experience.

Exemplarily, the smart device receives an input purchase operation instruction, such as a voice instruction of "buy Ultraman toys", displays the first interface after responding to the purchase operation instruction, and displays key information in the first interface, such as pictures, etc. After zooming in and displaying, shrinking or hiding text, control associated devices, such as children's tablet devices, and output the processed first interface.

Optionally, step S10BB includes at least one of the following:

Optionally, displaying the first interface and/or the second interface corresponding to the control intention includes:

In response to the control intention meeting the preset control intention condition, respond directly according to the control intention, and display the first interface and/or the second interface after responding to the control intention; and/or

In response to the control intention not satisfying the preset control intention condition, displaying the first interface and/or the second interface including the control intention, and/or displaying the first interface and/or the second interface displaying the information of the associated device associated with the control intention interface; and/or

In response to the control intention not satisfying the preset control intention condition, displaying the first interface and/or the second interface including recommended instruction information, wherein the recommended instruction information is associated with the control intention and/or meets the preset control intention condition.

Optionally, step S20BB: After processing the first interface and/or the second interface, control the associated device to output the processed first interface and/or the second interface, including at least one of the following: hiding or closing the first interface and/or the second interface; merge or merge the first interface and/or the second interface; enlarge or reduce the first interface and/or the second interface; control the first associated device to output the processed first interface and/or processed the second interface; control the second associated device to output the processed first interface and/or the processed second interface; control the first associated device to output the processed first interface, and control the second associated device to output the processed Second interface.

Exemplarily, for example, the smart device receives an input purchase operation instruction, such as a voice instruction of "buy Ultraman toys and Barbie dolls", and displays the first interface after responding to "buy Ultraman toys" in the purchase operation instruction , and the second interface after responding to the "Barbie doll" in the purchase operation instruction, and after processing the first interface and the second interface respectively, such as zooming in and displaying pictures, shrinking or hiding text, corresponding output to the first associated device and the second associated device, for example, the son's tablet device and the daughter's tablet device for display. Optionally, the first interface and the second interface may be different interfaces of the same application, for example, the first interface is the response interface after searching for "Ultraman" on Taobao, and the second interface is the response interface after searching "Barbie" on Taobao ; The first interface and the second interface may also be different interfaces of different applications, for example, the first interface is the running interface of Taobao, and the second interface is the running interface of JD.com.

The processing method of this embodiment displays the first interface and/or the second interface in response to the first preset operation; after processing the first interface and/or the second interface, the associated device is controlled to output the processed first interface and /or the second interface, so that the interface interconnection between the smart device and the associated device can be realized, so the efficiency of human-computer interaction can be effectively improved, the user can enjoy the service intuitively and quickly, and the user experience is improved.

Tenth embodiment

On the other hand, the present application further provides a processing method, and FIG. 23 is a schematic flowchart of the processing method according to the tenth embodiment.

Please refer to Figure 23, the processing method is applied to the smart device, and the processing method includes:

Step S10C: Obtain the input first information and the second information of the smart device, and determine the control intention according to the first information and the second information;

Step S20C: Execute corresponding processing on the smart device according to the control intention and the preset policy.

Exemplarily, after the smart device acquires the voice information of the user, it performs semantic analysis together with the second information of the smart device acquired by the smart device, and judges a certain control intention contained in the voice information according to the semantics of the voice information. If a definite control intent is included, or if a definite control intent can be generated or determined, then the control intent is followed. If a certain control intention cannot be generated or determined, according to the second information of the smart device, the control intention is determined and then executed.

Optionally, by parsing the first information, when the first information satisfies the first preset condition, corresponding processing is performed according to the first preset policy. When the first information does not satisfy the first preset condition, it is judged that the first information satisfies the second preset condition, so as to perform corresponding processing according to the second preset policy.

Optionally, the first information meeting the first preset condition may include: the first information includes at least one control intention. Exemplarily, by analyzing the text control command "navigate to the city hall", the vehicle navigation can make it clear that the user's text command contains the user's control intention to navigate to the city hall.

Optionally, the first information meeting the first preset condition may include: at least one control intention can be generated or determined according to the first information. Exemplarily, the smart speaker can determine that the user's voice control command needs to play the music "Stars and Seas" by analyzing the user's voice control command "It is time to play "Stars and Seas".

Exemplarily, the user sends a voice control instruction of "navigate home" to the vehicle-mounted smart device, but the address of the home is not included in the voice control instruction at this time. The vehicle-mounted smart device can use the address of the home in the historical interaction record in the shopping order record to form new intermediate information "navigate to ××× community" in combination with the voice control command, and then further determine the target control intention.

Optionally, the control intentions may include high-level control intentions and/or non-high-level control intentions. In the classification of application programs for smart devices, operations of some application programs involve user privacy, property security, or safe operation of smart devices. If the control intent involves the operation intent of this type of application, it can be classified as a high-level control intent, and correspondingly, the operation intent of other applications can be classified as a non-high-level control intent. For example, control intentions involving payment actions can be classified as high-level control intentions. For example, if the control intention of "clearing the shopping cart" is analyzed according to the first information, and the currently opened shopping software is "official procurement", at this time, "clearing the shopping cart of the public network procurement software" can be classified as high Hierarchical control intent. For high-level control intentions, smart devices can output prompt information first, and then respond according to user confirmation instructions.

Optionally, determining the control intention according to the first information and the second information of the smart device may include: if the first information includes only one control intention, performing corresponding processing according to the control intention. If a unique control intention can be analyzed according to the first information, the smart device can directly execute the user's control intention.

Optionally, determining the control intention according to the first information and the second information of the smart device may include: when at least two control intentions are included in the first information, determining the target control intention according to a preset selection strategy. If the control intention analyzed according to the first information may have multiple interpretations, the smart device cannot directly execute it at will, so as to avoid errors or even accidents. For example, when the unit has two garages, the first garage and the second garage, the user sends out the voice control command "charge in the unit's garage", and the smart device can parse out "charge in the unit's first garage" and "charge in the unit's garage". Second Garage Charging" two control intents. It is necessary to determine which garage of the unit the user needs to park in according to other information in order to obtain the user's target control intention.

Optionally, the preset selection strategy may include: determining the target control intention according to user selection. If the control intention analyzed according to the first information may have multiple interpretations, the smart device cannot directly execute it arbitrarily, so as to avoid errors or even accidents. At this time, the smart device can output prompt information, and the user can select the corresponding option according to his real intention, so as to assist the smart device to determine the target control intention.

Optionally, the second information of the smart device may include scene information of the smart device. Exemplarily, the user sends a voice control instruction of "connect the phone" to the smart device. At this time, if no other person is found in the space, use the external voice to connect the call; if there are at least two people in the space, use the headset to connect the call.

Optionally, the second information of the smart device may include relationship information between multiple applications or services of the smart device. The relationship information between multiple applications or services may be priority relationship, inter-correlation relationship, relationship between running contents, relationship between running results, location relationship of service interfaces, and the like. For example, when the user needs to view short messages during the running of the actual combat game, the system places the display window of the short message service in the form of a floating window in the corner of the screen that is farthest from the game character.

Optionally, the second information of the smart device may include associated device information of the smart device. For example, when a user needs a smart device to provide a vehicle condition assessment service for family members, the smart device retrieves the current vehicle's location information, speed information, power information, braking information, fuel and electricity information, etc. through the associated in-vehicle device.

Optionally, the second information of the smart device may include user operation habits. For example, when the user requests to turn on the air conditioner through the smart home terminal, the smart home terminal retrieves the user's habitual temperature setting, humidity setting, air volume setting, swing setting, timing duration, etc. according to the user's historical operating habits. Action information.

Optionally, the second information of the smart device may include historical interaction records obtained by downloading from network devices. Exemplarily, the user purchases a flight ticket from Shanghai to Shenzhen departing at 11:00 am on National Day by using the authenticated identity information through the first smart device. When the user checks the schedule through the second smart device, the second smart device uses the user's identity information to obtain the user's historical ticket purchase records from the first smart device or the ticketing website through the network device, and lists them in the user's schedule in chronological order displayed in .

Optionally, performing corresponding processing on the smart device may include: immediately or delaying or stopping or switching to perform processing corresponding to the control intention on the smart device. In the case that the first information does not meet the preset condition, the smart device may determine a definite control intention, and at this time, the processing corresponding to the determined control intention may be immediately performed on the smart device. In another case, when the first information does not meet the preset conditions, the smart device may not be able to determine the user's control intention or may determine a wrong control intention, and if it continues to execute, it may cause errors or major accidents and losses. Therefore, it is possible to choose to delay the execution of the processing corresponding to the control intention on the smart device, or to choose to stop the execution of the processing corresponding to the control intention on the smart device. In another case, when the first information does not meet the preset condition, the smart device may also choose to switch to execute the processing corresponding to the control intention on the smart device. Exemplarily, in the processing of the control intention, the mobile phone may switch to an appropriate or corresponding vehicle-mounted smart device for processing, or switch to another appropriate or corresponding application service for processing. For example, when the mobile phone receives the user's voice control instruction of "switching the sports driving mode", since the mobile phone does not support the switching of the driving mode, the mobile phone can be switched to the associated vehicle-mounted smart device for corresponding processing, and the vehicle-mounted smart device will The driving mode switches to Sport driving mode.

Optionally, performing corresponding processing on the smart device may include: outputting confirmation information, and performing processing corresponding to the control intention on the smart device in response to receiving the confirmation operation. When the first information does not meet the preset condition, the analysis of the first information by the smart device may correspond to multiple control intentions, or one control intention may correspond to multiple execution modes. In order to avoid errors or major accidents and losses that may be caused by wrong execution, you can choose to output prompt information or confirmation information to the user first, and the user can choose according to his true intention or execution preference. After the user makes a clear choice on the control intention or execution method, the corresponding processing is performed on the smart device. The way of outputting the prompt information can be a voice prompt or an interface prompt, and the user can select and confirm the control intention based on voice commands, touch operation commands, gesture operation commands, and the like.

Optionally, performing corresponding processing on the smart device may include: copying or transferring the processing corresponding to the control intention to the associated device for execution. For example, when the mobile phone receives the user's "switching sports driving mode" control instruction, since the mobile phone does not support the switching of driving modes, the mobile phone can be switched to the associated vehicle-mounted smart device for corresponding processing, and the vehicle-mounted smart device Switch the driving mode to Sport driving mode. For example, when the mobile phone receives the user's control instruction of "displaying the image of the rear camera of the car", the mobile phone remotely calls the image information of the rear camera in the vehicle camera. When the mobile phone detects that the distance from the vehicle-mounted smart device is less than the preset distance threshold, the processing task of displaying the image of the car's rear camera is switched to the vehicle-mounted smart device for local execution, which can save processing resources and improve processing efficiency.

Optionally, performing corresponding processing on the smart device may include: performing processing corresponding to the control intention on the smart device and/or associated device. Exemplarily, when a mobile phone or a child's phone watch with child mode enabled needs to perform a large-amount payment function, the synchronization authorization service of the associated parent's mobile phone is required to jointly complete the payment; or, the payment service is directly processed accordingly. During the execution process of the associated device, it may be executed synchronously or switched. In terms of the execution order of the smart device and the associated device, it can be performed sequentially or synchronously, which is not limited in this application.

When the first information neither satisfies the first preset condition nor the second preset condition, it cannot be processed according to the first preset strategy, nor can it be processed according to the second preset strategy. That is to say, the control intention cannot be clearly determined according to the first information and the second information of the smart device. At this time, the third preset policy is set for processing by the smart device, which can properly respond to the user's instruction and improve user experience. Exemplarily, the smart device cannot determine the control intention through the first information, and the smart device still cannot determine the control intention through the second information of the smart device. At this point, the smart device may request the user to issue an instruction again, or provide third information to determine the control intention. In another embodiment, the smart device may also output prompt information to allow the user to select a corresponding operation. In other embodiments, the smart device may also end this response to release response resources.

Optionally, before the step of acquiring the input first information, the method further includes: performing preset processing on the smart device. Before the smart device responds to the first information, operations such as starting, running, sleeping, waking up, and exiting the application or service may be performed on the smart device to ensure the accuracy of the response.

Please refer to FIG. 17 , in one embodiment, the children's watch is in a sleep state. The child user wakes up the children's watch and sends out a voice control command: "If the Olympic school is on holiday, help me buy a ticket to grandma's house, I want to eat lunch made by grandma". The human-computer interaction application of the children's watch has been analyzed through voice, and it is found that the voice control command of the child user needs to book a ticket, but it is impossible to directly determine what kind of ticket to book.

Eleventh embodiment

The present application also provides a processing method, and Fig. 24 is a schematic flowchart of the processing method according to the eleventh embodiment. As shown in Figure 24, in an embodiment, the processing method applied to the smart terminal includes:

Step S10CC: In response to the input of the first information does not meet the first preset condition, obtain the second information of the associated device, and determine the control intention according to the first information and the second information;

Step S20CC: Execute corresponding processing on the smart terminal according to the control intention and the preset policy.

Smart terminals can be various terminal devices (such as mobile phones, tablet computers, etc.), wearable smart devices (such as smart watches, smart bracelets, smart headphones, etc.), smart home terminals (such as smart TVs, smart speakers, etc.), Internet of Vehicles Devices (such as smart cars, vehicle-mounted terminals, etc.), through the above method, when the smart terminal processes the input first information, when the first information does not meet the first preset condition, it performs a comprehensive analysis based on the second information of the associated device to determine Control the intention and deal with it according to the corresponding preset strategy, which can quickly determine the user's control intention and make the user experience better.

Exemplarily, after acquiring the voice information of the user, the smart terminal performs semantic analysis, and judges whether the voice information contains a definite control intention according to the semantics of the voice information. If a definite control intent is contained, or a definite control intent can be generated or determined, then the control intent is followed. If there is no definite control intention, or if a definite control intention cannot be generated or determined, the second information of the associated device is retrieved, further combined with the first information to make a comprehensive judgment, so as to determine the control intention and execute the processing.

Optionally, the first information may include voice control instructions. Exemplarily, the vehicle-mounted intelligent terminal can obtain the user's voice control instruction for navigating to a nearby hospital.

Optionally, the first information may include text control commands. Exemplarily, the intelligent computer terminal can obtain the user's text command to execute the control instruction of playing audio and video.

Optionally, by parsing the first information, when the first information satisfies the first preset condition, corresponding processing is performed according to the first preset strategy. When the first information does not satisfy the first preset condition, it is judged that the first information satisfies the second preset condition, so as to perform corresponding processing according to the second preset strategy.

Optionally, the first preset condition may include: the first information includes at least one control intention.

Exemplarily, by analyzing the text control command "navigate to the city hall", the vehicle navigation can make it clear that the user's text command contains the user's control intention to navigate to the city hall.

Optionally, the first preset condition may include: at least one control intention can be determined or generated according to the first information.

Exemplarily, the smart speaker can determine that the user's voice control command needs to play the music "Stars and Seas" by analyzing the user's voice control command "It is time to play "Stars and Seas".

Optionally, the second information may include user operating habits. Exemplarily, when the user requests to turn on the air conditioner through the smart home terminal, the smart home terminal calls the user's habitual temperature setting, humidity setting, air volume setting, and swing setting according to the user's historical operating habits on the associated air conditioner. , Timing duration and other habitual operation information.

Optionally, the second information may include historical interaction records. Exemplarily, the mobile phone may record the user's company address in the historical interaction. When the user sends out the voice operation instruction of "navigate to the company", the vehicle-mounted intelligent terminal calls the unit address recorded in the associated mobile phone, and wakes up the navigation service as the navigation destination. In another embodiment, when the user needs the vehicle-mounted intelligent terminal to navigate to the freight station to pick up goods, the vehicle-mounted intelligent terminal extracts the address information of the freight station from the latest order information or chat information through the associated mobile phone of the user, so as to determine the navigation destination.

Optionally, the second information may include scene information. Exemplarily, the user issues a voice control instruction of "connecting the phone" to the mobile phone. At this time, the mobile phone can call the scene information detected by the smart monitoring device bound to the mobile phone. If no one else is found in the space, use a foreign voice to answer the call; if there are at least two people in the space, use a headset to answer the call.

Optionally, the second information may include time information. Exemplarily, when the user needs to preset the first computer device to send a work email at 9:00 am on October 1st where the associated second computer device is located, the first computer device first retrieves the time information of the second computer device, and Calculate the time difference to send work emails on time at 9:00 am on October 1st where the second computer facility is located.

Optionally, the second information may include location information. Exemplarily, the user sets through the smart home terminal to start making coffee when the family arrives downstairs. The smart home terminal retrieves the positioning location of the associated vehicle or the associated family's mobile phone, so that when the user's family arrives downstairs, the process of making coffee is performed.

Optionally, the second information may include user status information. Exemplarily, the user sets through the smart terminal in the garage to start charging the vehicle after the vehicle is parked in the garage and turned off. The smart terminal in the garage retrieves the running information of the associated vehicle, so that after confirming that the associated vehicle is parked in the garage and turned off, the charging process starts.

Optionally, the second information may include application or service information of the associated device. Exemplarily, when the user issues a payment instruction through the computer, the computer can request the associated camera to start the photographing service to perform face recognition on the user; or request the associated fingerprint collection device to start the fingerprint collection service to perform fingerprint recognition on the user .

Optionally, the second information may include trigger object information of the associated device. Exemplarily, when the user pushes weather forecast information to the associated display device through the smart terminal, the smart terminal requests trigger object information of the associated display device. If the trigger object of the associated device is a child user, it will be displayed in animation, and if the trigger object of the associated device is an elderly user, it will be broadcast in a voice mode.

Optionally, the second information may include relationship information between multiple applications or services of the associated device. The relationship information between multiple applications or services of the associated device may be a priority relationship, an inter-correlation relationship, a relationship between running contents, a relationship between running results, and a location relationship of service interfaces. Exemplarily, when the user needs to view the short message received by the host during the game running through remote control of the host through the computer, the remote host system will place the display window of the short message service in the form of a floating window in the middle of the screen at the furthest distance from the game character. The far corner to display on the user's computer. In another embodiment, when the user needs to purchase travel insurance services while driving, a purchase instruction is sent through the vehicle-mounted intelligent terminal. When the vehicle-mounted intelligent terminal pays through the associated mobile phone, it requests the mobile phone to retrieve the application software white list or black list, so as to use the first payment application in the white list to pay, and refuse to use the second payment application in the black list to pay.

Optionally, the second information may include historical interaction records obtained by downloading from the network device.

Exemplarily, the user purchases an air ticket from Shanghai to Shenzhen departing at 11:00 am on National Day through the first smart terminal using authenticated identity information. When the user checks the schedule through the second smart terminal, the second smart terminal uses the user's identity information to obtain the user's historical ticket purchase records from the associated first smart terminal or the associated ticketing website through the network device, and lists them in chronological order. displayed in the user's calendar.

Optionally, step S10CC may include: if part of the information is missing from the first information, determining or generating part of the information according to the second information, so that the first information can be combined with the part of the information to determine the control intention.

Exemplarily, the user sends a voice control instruction of "navigate home" to the vehicle-mounted intelligent terminal, but the address of the home is not included in the voice control instruction at this time. The vehicle-mounted intelligent terminal can use the address of the home in the historical interaction record in the shopping order record, and combine the voice control command to form new intermediate information "navigate to ××× community", and then determine the target control intention.

Optionally, step S10CC may include: if the first information includes the first part of information that cannot be recognized or responded to, determining or generating the second part of information according to the second information, so that the first information can be combined with the second part of information to determine the control intention .

Exemplarily, the user sends a voice control command to the smart terminal "If the price of the air ticket from Shanghai to Shenzhen on the National Day is 500 yuan, please book one for me". The smart terminal cannot recognize which platform should be used to book tickets from the voice control instructions. At this time, the smart terminal screens out the most frequently used travel software platform according to the installed travel software platform, and combines the voice control command to form a new intermediate message "Open the 'Ctrip' application and book a trip from Shanghai to Shenzhen on the National Day." The air ticket price is less than 500 yuan", and then the target control intention is determined.

Optionally, the control intention may include at least one preset control intention. Specifically, the control intentions may include historical control intentions. For example, the user says "I'm hungry, order a takeaway" voice control instruction, and the smart terminal obtains the user's last voice interaction of "order a takeaway" based on the historical human-computer interaction records, and finally chooses the desired Order a burger for takeout. Therefore, the smart terminal will order a hamburger takeaway as the control intention of the user's voice control command.

Optionally, the control intent may include an associated control intent. For example, the control intentions associated with the control intentions directly obtained from the first information often have linkage operations. For example, if the user needs to pay for an order, then the user's control intention includes not only running the payment program, but also an associated control intention of opening the corresponding shopping software. For another example, in the control of a smart home, the user issues a voice control command of "it's dawn, let's open the window". The user's control intention includes not only opening the window, but also the associated control intention of turning off the lights. At this time, the smart terminal not only executes the control intention of opening the window, but also executes the associated control intention of turning off the light.

Optionally, the control intent may include a privacy control intent and/or a non-privacy control intent. Exemplarily, the user needs to send chat records, but the smart terminal detects that the chat records contain private information. At this time, the smart terminal needs to generate a prompt message, and after obtaining the user's confirmation, execute the control intention of sending the chat record.

Optionally, the control intentions may include high-level control intentions and/or non-high-level control intentions. In the classification of application programs on smart terminals, operations of some application programs involve user privacy, property security, or safe operation of smart terminals. If the control intent involves the operation intent of this type of application, it can be classified as a high-level control intent, and correspondingly, the operation intent of other applications can be classified as a non-high-level control intent. For example, control intentions involving payment actions can be classified as high-level control intentions. For example, if the control intention of "clearing the shopping cart" is analyzed according to the first information, and the currently opened shopping software is "official procurement", at this time, "clearing the shopping cart of the public network procurement software" can be classified as high Hierarchical control intent. For high-level control intentions, the smart terminal can output prompt information first, and then respond according to the user's confirmation instruction.

Optionally, determining the control intention according to the first information and the second information may include: if the first information includes only one control intention, performing corresponding processing according to the control intention. If a unique control intention can be analyzed according to the first information, the smart terminal can directly execute the user's control intention.

Optionally, determining the control intention according to the first information and the second information may include: when at least two control intentions are included in the first information, determining the target control intention according to a preset selection strategy. If the control intention analyzed according to the first information may have multiple interpretations, the smart terminal cannot directly execute it arbitrarily, so as to avoid errors or even accidents. For example, when the unit has two garages, the first garage and the second garage, and the user issues a voice control instruction of "charging in the unit's garage", the smart terminal can parse out "charging in the unit's first garage" and "charging in the unit's garage". Second Garage Charging" two control intents. At this time, it is necessary to determine which garage of the unit the user needs to park in according to other information in order to obtain the user's target control intention.

Optionally, the preset selection strategy may include: determining the target control intention according to the second information. Exemplarily, the smart terminal may obtain at least one of current scene information, interface information, current operation information, application information and other information of the associated device as the second information, so as to determine the target control intention. Optionally, the preset selection strategy may include: determining the target control intention according to user selection.

If the control intention analyzed according to the first information may have multiple interpretations, the smart terminal cannot directly execute it arbitrarily, so as to avoid errors or even accidents. At this time, the smart terminal can output prompt information, and the user can select the corresponding option according to his real intention, so as to assist the smart terminal to determine the target control intention.

Optionally, performing corresponding processing on the smart terminal may include: immediately or delaying or stopping or switching the processing corresponding to the control intention performed on the smart terminal; when the first information does not meet the preset condition, the smart terminal may be able to determine a A clear control intention, at this time, the processing corresponding to the determined control intention can be immediately executed on the smart terminal. In another case, there is a possibility of errors or serious accidents and losses if the processing is continued. Therefore, it is possible to choose to delay the execution of the processing corresponding to the control intention on the smart terminal, or to choose to stop the execution of the processing corresponding to the control intention on the smart terminal. In another case, the smart terminal may also choose to switch to perform the processing corresponding to the control intention on the smart terminal. Exemplarily, in the processing of the control intention, the mobile phone may be switched to an appropriate or corresponding vehicle-mounted intelligent terminal for processing, or switched to another appropriate or corresponding application service for processing. For example, when the mobile phone receives the user's voice control instruction of "switching the sports driving mode", since the mobile phone does not support the switching of the driving mode, the mobile phone can switch to the associated vehicle-mounted intelligent terminal for corresponding processing, and the vehicle-mounted intelligent terminal will The driving mode switches to Sport driving mode.

Optionally, performing corresponding processing on the smart terminal may include: outputting confirmation information, and performing processing corresponding to the control intention on the smart terminal in response to receiving the confirmation operation. In order to avoid errors or major accidents and losses that may be caused by wrong execution, you can choose to output prompt information or confirmation information to the user first, and the user can choose according to his true intention or execution preference. After the user makes a clear choice on the control intention or execution method, the corresponding processing is performed on the smart terminal. The way of outputting the prompt information can be a voice prompt or an interface prompt, and the user can select and confirm the control intention based on voice commands, touch operation commands, gesture operation commands, and the like.

Optionally, performing corresponding processing on the smart terminal may include: copying or transferring the processing corresponding to the control intention to the associated device for execution. For example, when the mobile phone receives the user's control instruction of "switching the sports driving mode", since the mobile phone does not support the switching of the driving mode, the mobile phone can be switched to the associated vehicle-mounted intelligent terminal for corresponding processing, and the vehicle-mounted intelligent terminal Switch the driving mode to Sport driving mode. For example, when the mobile phone receives the user's control instruction of "displaying the image of the rear camera of the car", the mobile phone remotely calls the image information of the rear camera in the vehicle camera. When the mobile phone detects that the distance from the vehicle-mounted intelligent terminal is less than the preset distance threshold, the processing task of displaying the image of the car's rear camera is switched to the vehicle-mounted intelligent terminal for local execution, which can save processing resources and improve processing efficiency.

Optionally, executing corresponding processing on the smart terminal may include: executing processing corresponding to the control intention on the smart terminal and/or associated devices. Exemplarily, when a mobile phone or a child's phone watch with the children's mode turned on needs to perform a large-amount payment function, corresponding synchronization authorization of the associated parent's mobile phone is required to complete the payment together; or, the payment service is directly processed accordingly. During the execution process of the associated device, it may be executed synchronously or switched. The execution sequence of the smart terminal and associated devices may be sequential or synchronous, which is not limited in this application.

Optionally, the step of determining the control intention according to the first information and the second information further includes: when the control intention cannot be determined according to the first information and the second information, performing corresponding processing according to a third preset strategy.

When the first information neither satisfies the first preset condition nor the second preset condition, it cannot be processed according to the first preset strategy, nor can it be processed according to the second preset strategy. That is, the control intention cannot be clearly determined from the first information and the second information. At this time, setting the third preset policy for processing by the smart terminal can properly respond to the user's instruction and improve user experience. Exemplarily, the smart terminal cannot determine the control intention through the first information, and the smart terminal still cannot determine the control intention through the second information. At this point, the smart terminal may request the user to issue an instruction again, or provide third information to determine the control intention. In another embodiment, the smart terminal may also output prompt information to allow the user to select a corresponding operation. In other embodiments, the smart terminal may also end this response to release response resources.

Optionally, before step S10CC, the method may further include: performing preset processing on the smart terminal. Before the smart terminal responds to the first information, operations such as starting, running, sleeping, waking up, and exiting the application or service can be performed on the smart terminal to ensure the accuracy of the response.

After the child user selects the option "2. High-speed rail ticket departing at 8:00 in the morning", it enters the ticket booking stage. Since the smart watch does not support shopping applications, the ticketing service is transferred to the associated child user's smart phone.

When the user needs to pay for the ticket reservation, the smart phone retrieves the application software whitelist or blacklist, invokes the first payment application in the whitelist for payment, and refuses to use the second payment application in the blacklist for payment.

An embodiment of the present application further provides a smart device, the smart device includes a memory and a processor, and a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the processing method in any of the foregoing embodiments are implemented.

An embodiment of the present application further provides a computer-readable storage medium, on which a processing program is stored, and when the processing program is executed by a processor, the steps of the processing method in any of the foregoing embodiments are implemented.

In the embodiment of the smart device and the computer-readable storage medium provided in the embodiment of the present application, all the technical features of any of the above-mentioned processing method embodiments may be included, and the expansion and explanation of the description are basically the same as those of the above-mentioned method embodiments. This will not be repeated here.

An embodiment of the present application further provides a computer program product, the computer program product includes computer program code, and when the computer program code is run on the computer, the computer is made to execute the methods in the above various possible implementation manners.

The embodiment of the present application also provides a chip, including a memory and a processor. The memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the device installed with the chip executes the above various possible implementation modes. Methods.

It can be understood that the above scenario is only an example, and does not constitute a limitation on the application scenario of the technical solution provided by the embodiment of the present application, and the technical solution of the present application can also be applied to other scenarios. For example, those skilled in the art know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

The serial numbers of the above embodiments of the present application are for description only, and do not represent the advantages and disadvantages of the embodiments.

The steps in the methods of the embodiments of the present application can be adjusted, combined and deleted according to actual needs.

Units in the device in the embodiment of the present application may be combined, divided and deleted according to actual needs.

In this application, descriptions of the same or similar terms, concepts, technical solutions and/or application scenarios are generally only described in detail when they appear for the first time, and when they appear repeatedly later, for the sake of brevity, they are generally not repeated. When understanding the technical solutions and other contents of the present application, for the same or similar term concepts, technical solutions and/or application scenario descriptions that are not described in detail later, you can refer to the previous relevant detailed descriptions.

In this application, the description of each embodiment has its own emphasis. For the parts that are not detailed or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

The various technical features of the technical solution of the present application can be combined arbitrarily. For the sake of concise description, all possible combinations of the various technical features in the above-mentioned embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, all It should be regarded as the scope described in this application.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art, and the computer software product is stored in one of the above storage media (such as ROM/RAM, magnetic CD, CD), including several instructions to make a terminal device (which may be a mobile phone, computer, server, controlled terminal, or network device, etc.) execute the method of each embodiment of the present application.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, special purpose computer, a computer network, or other programmable apparatus. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g. Coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media. Usable media may be magnetic media, (eg, floppy disk, memory disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.

The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structures or equivalent process transformations made by using the description of the application and the accompanying drawings are directly or indirectly used in other related technical fields. , are all included in the patent protection scope of the present application in the same way.

Claims

A processing method applied to a smart device, wherein the processing method includes:

Step S1: responding to the first preset operation, and/or, responding to satisfying the first preset condition;

Step S2: Process at least one recommended interaction instruction based on a first preset strategy, wherein the at least one interaction instruction is obtained according to key information; and/or in response to satisfying a second preset condition, proceed according to a second preset strategy Corresponding processing; and/or, in response to the first preset operation not satisfying the second preset condition and satisfying a third preset condition, performing corresponding processing according to a third preset strategy.
The method as claimed in claim 1, wherein,

Said step S1 comprises:

Step S1A1: Obtain key information in response to the smart device meeting a first preset condition;

Step S1A2: Obtain at least one recommended interaction instruction according to the key information;

Described step S2 comprises:

Step S2A: Outputting the at least one recommended interaction instruction according to the first preset strategy;

Wherein, the first preset condition includes at least one of the following: incorrect interaction instruction input exceeds a preset number of times, no correct interaction instruction is received within a preset time period, preset function trigger information is obtained, and preset identity information is obtained , connected to the associated device, received preset information, and connected to the network preset;

The key information includes at least one of the following: wrong interaction instruction, instruction keyword in the wrong interaction instruction, function currently used by the smart device, function to be triggered by the smart device, user identity, application scenario, interaction result keyword, associated device Information, preset information keywords.
The method according to claim 2, wherein step S1A2 comprises:

After performing the operation according to the voice interaction instruction, when the return operation is performed and the input of the voice interaction instruction is performed again, it is confirmed that the voice interaction instruction is a wrong interaction instruction; and/or

When the time interval between the previous voice interaction instruction and the subsequent voice interaction instruction input by the same user is greater than the first preset time interval and shorter than the second preset time interval, it is confirmed that the previous voice interaction instruction is an incorrect interaction instruction.
The method according to claim 2, wherein the key information includes the erroneous interaction instruction and/or instruction keywords in the erroneous interaction instruction, and the step S1A1 includes:

Matching the wrong interaction instruction, and/or the instruction keyword with the interaction instruction in the database;

The interaction instruction whose matching value exceeds the threshold is confirmed as the recommended interaction instruction.
The method according to claim 4, wherein matching the wrong interaction instruction and/or the instruction keyword with the interaction instruction in the database comprises:

confirming the user's intention according to the wrong interaction instruction and/or the instruction keyword;

A matching value between the interaction instruction in the database and the user intention is acquired.
The method according to claim 4, wherein step S2A comprises:

The erroneous interaction instruction and the recommended interaction instruction related to the erroneous interaction instruction are associated and displayed on the display interface.
The method of claim 2, wherein,

The acquiring key information includes: acquiring the functions currently used by the smart device according to the display interface of the smart device;

The step S1A2 includes: acquiring at least one recommended interaction instruction associated with the function currently used by the smart device.
The method according to claim 7, wherein said acquiring at least one recommended interaction instruction associated with the function currently used by said smart device comprises at least one of the following:

Obtaining at least one recommended interaction instruction associated with an operable control in the display interface of the smart device;

Obtaining at least one recommended interaction instruction associated with the display content in the display interface of the smart device;

Acquiring at least one recommended interaction instruction associated with the previous or next display interface in the current display interface of the smart device.
The method of claim 4, further comprising:

When a jump occurs on the interface is detected, a new recommended interaction instruction is acquired according to the interface information after the jump.
The method according to claim 2, wherein step S1A2 comprises:

Obtaining the associated device information, the associated device information including: function, location;

Acquiring at least one recommended interaction instruction according to the associated device information.
The method according to claim 2, wherein, after step S2A, further comprising:

determining a target recommended interaction instruction from the at least one recommended interaction instruction in response to the first operation and/or the first voice instruction;

Respond according to the target recommendation interaction instruction.
The method according to claim 2, wherein, step S2A comprises:

Monitor the feedback information of smart devices to interactive commands;

When the smart device receives the interaction instruction but does not output feedback information, output the at least one recommended interaction instruction.
The method according to claim 12, wherein when the smart device receives an interaction instruction and does not output feedback information, outputting the at least one recommended interaction instruction includes:

When the smart device receives the interaction instruction but does not output feedback information, confirm that the interaction instruction is the wrong interaction instruction;

Outputting the at least one recommended interaction instruction according to the wrong interaction instruction;

Wherein, the at least one recommended interaction instruction includes: a recommended interaction instruction related to the key information and a general system recommended interaction instruction.
The method according to claim 2, wherein step S1A2 comprises:

According to the historical commonly used functions and/or historical interactive instruction usage records of the first application currently used, the commonly used recommended interactive instruction of the first application is acquired as the at least one recommended interactive instruction.
The method of claim 14, further comprising:

Outputting common recommended interaction instructions for the first application according to the first preset strategy,

In response to the instruction deletion of the commonly used recommended interaction instruction, the deleted recommended interaction instruction is set as an infrequently used recommended interaction instruction.
The method according to claim 2, wherein, step S2A comprises:

Obtain user information, and if the current user is a new user, output a recommended interaction instruction associated with the key information; and/or,

If the current user is an old user, then according to the usage record of historical recommended interaction instructions, determine the commonly used recommended interactive instructions of the current user, and output the commonly used recommended interactive instructions of the current user; and/or if the current user is For old users, output commonly used recommended interactive instructions and controls for requesting to display other recommended interactive instructions, wherein the control for requesting to display other recommended interactive instructions is used to obtain all recommended interactive instructions associated with the key information; and / or

Obtaining the identity information of the current user, the identity information of the current user includes age and/or facial image information, and if the current user is an elderly person and/or a child, outputting the at least one recommended interaction instruction by voice; and/or ,

If the current user is not an elderly person and/or a child, the interface outputs the at least one recommended interaction instruction; and/or

Acquiring the software version information of the first application currently in use, according to the software version information, after obtaining the newly added recommended interaction instruction of the latest version of the first application, outputting the at least one recommended interaction instruction, and Add recommended interactive instructions for labeling.
The method according to claim 2, wherein the at least one recommended interaction instruction comprises: a recommended interaction instruction related to the key information and a general system recommended interaction instruction;

Step S2A includes: preferentially displaying and/or highlighting recommended interaction instructions related to the key information.
The method according to claim 2, wherein, step S1A2, further comprising:

When acquiring the recommended interaction instruction from the server fails, acquire the recommended interaction instruction associated with the key information from the local database.
The processing method as claimed in claim 1, wherein,

Said step S1 comprises:

Step S1AA: Obtain at least one recommended interaction instruction according to the key information in response to the first preset operation;
The method of claim 19, wherein the first predetermined operation comprises at least one of the following:

Trigger the operation of the voice input control;

Operations that trigger voice command prompts;

The operation that triggers interface switching;

Entering wrong interactive commands exceeding the preset number of times;

And/or the key information includes at least one of the following:

Instruction keywords in wrong interactive instructions;

The functions currently used by the Smart Device;

The function to be triggered by the smart device;

User ID;

The current application scenario;

Information about the first application in the smart device;

Current browsing content information on the smart device;

Interactive result keywords;

Associated device information;

Default information keywords.
The method according to claim 19, wherein step S2 includes:

Outputting prompt information, in response to the selection operation, outputting a corresponding recommended interaction instruction according to the selection result; and/or,

Outputting prompt information, in response to not responding to the prompt information, outputting the at least one recommended interaction instruction according to the first preset strategy; and/or

Obtain attribute information of the at least one recommended interaction instruction, and output the at least one recommended interaction instruction in different areas according to the attribute information; and/or

Responding to the fact that the smart device does not meet the preset condition, acquiring an associated device associated with the smart device, and sending the at least one recommended interaction instruction to the associated device, so that the associated device outputs the at least one Recommend interactive instructions; and/or

Obtaining the quantity of the at least one recommended interaction instruction, and outputting the at least one recommended interaction instruction according to the first sub-preset strategy when the quantity of the at least one recommended interaction instruction exceeds a threshold; and/or,

When the quantity of the at least one recommended interaction instruction does not exceed the threshold, the at least one recommended interaction instruction is output according to the second sub-preset strategy.
The method according to claim 21, wherein said smart device does not meet preset conditions comprising at least one of the following:

The smart device does not have a display device;

The smart device display device does not meet the display requirements of the recommended interaction instructions;

The smart device does not have the display authority to recommend interactive instructions;

The recommended interaction instruction is related to associated devices.
The method according to claim 19, wherein said method further comprises:

If a non-voice operation is detected before step S1AA, then according to the non-voice operation, determine a corresponding target interaction instruction from the at least one recommended interaction instruction;

Outputting the at least one recommended interaction instruction, and marking the target interaction instruction.
The method of claim 1, wherein,

Said step S1 comprises:

Step S1B: outputting the first interface in response to the first preset operation, and/or outputting the second interface in response to satisfying the first preset condition;

Described step S2 comprises:

Step S2B: Execute corresponding processing on the first interface and/or the second interface in response to satisfying a second preset condition.
The processing method according to claim 24, wherein the first preset operation comprises at least one of the following:

wake up, activate, run or close at least one default application or service;

Obtain the first information;

send the first message;

The first information is not obtained within the preset duration; and/or the first interface includes at least one of the following:

An update control for updating the first interface;

a recommended command associated with said update control;

A recommended interaction instruction different from the function of the update control;

A wake-up interface of the preset application or service;

The running interface of the preset application or service;

an interface of an application or service associated with the preset application or service;

A recommended interaction instruction associated with the preset application or service;

a control intention corresponding to the first information;

A recommended interaction instruction associated with the first information;

an interface after responding according to the first information;

Recommended interaction instructions associated with the current scene.
The processing method according to claim 24, wherein in the step S1B, in response to the first preset operation, outputting the first interface comprises:

In response to the running operation of the preset application or service, when the running operation does not match the function of the preset application or service, the first interface is output, and the first interface includes at least one of the following: failure to run information; a recommended instruction corresponding to the running of the preset application or service; a recommended instruction corresponding to the application or service associated with the running operation; a recommended instruction corresponding to the associated device associated with the running operation; A recommendation instruction corresponding to the function configuration of the application or service; an update control used to update the first interface; a recommendation instruction associated with the update control; a recommendation instruction different from the function of the update control; recommended instructions and/or update controls associated with the functionality of the application or service; and/or,

In response to the running operation of the preset application or service, when the running operation matches the function of the preset application or service, the first interface is output, and the first interface includes at least one of the following: The running interface of the preset application or service; the recommended instruction corresponding to the running operation; the recommended instruction corresponding to the function configuration of the preset application or service; an update control for updating the first interface; a suggested instruction associated with the control; a suggested instruction that functions differently than said update widget; and/or,

Outputting the first interface in response to a closing instruction of the preset application or service, wherein the first interface includes at least one of the following: an interface of an application or service associated with the preset application or service; and A recommendation instruction for an application or service associated with the preset application or service; and/or,

Outputting the first interface in response to the shutdown instruction of the preset application or service and the startup instruction of other applications or services, the first interface includes at least one of the following: the other application or service and the preset The recommended instruction and/or update control corresponding to the difference of the application or service; the recommended instruction and/or update control corresponding to the new function of the other application or service relative to the preset application or service; used to update the first An update control of the interface; a recommended instruction associated with the update control; a recommended instruction with a function different from that of the update control; an interface of an application or service associated with the other application or service; associated with the other application or service recommended instructions for associated devices; and/or,

In response to waking up, starting, or running at least one preset application or service, if the first information is not obtained within a preset time period, or the wrong interaction instruction is input for more than a preset number of times, output a first interface including a recommended interaction instruction, wherein, The recommended interaction instruction is associated with historical instruction information of the preset application or service, and/or associated with the function of the preset application or service, and/or associated with the current scene; and/or,

In response to acquiring the first information, output a first interface corresponding to the matching result according to the matching result of the first information and preset information; and/or,

In response to acquiring the first information, determine or generate a control intention according to the first information, and output a first interface corresponding to the control intention; and/or,

In response to acquiring the first information, and the first information cannot determine or generate a control intention, output a first interface corresponding to a recommended interaction instruction associated with the first information; and/or,

In response to acquiring the first information, and the first information can determine or generate multiple control intentions, output a first interface corresponding to the multiple control intentions.
The processing method according to claim 26, wherein outputting the first interface corresponding to the matching result comprises:

In response to the first information matching the preset information, outputting a first interface for executing the first information; and/or,

In response to the fact that the first information does not match the preset information, and there is preset information whose semantic similarity with the first information is greater than a preset value, outputting a first interface including selection prompt information, the selection prompt information It includes prompt information for selecting whether to execute the first information, and/or prompt information for selecting whether to store the first information.
The processing method according to claim 26, wherein, in response to obtaining the first information, according to the matching result of the first information and preset information, outputting a first interface corresponding to the matching result, comprising:

In response to the fact that the first language information of the first information does not match the preset language information, a first interface including a recommended instruction is output, the language information of the recommended instruction is consistent with the preset language information and/or the first language information. The language information matches.
The processing method according to claim 26, wherein outputting the first interface corresponding to the control intention comprises:

Responding to the control intention meeting the preset control intention condition, responding directly according to the control intention, and outputting the first interface after responding to the control intention; and/or,

In response to the control intention not satisfying the preset control intention condition, outputting a first interface including the control intention, and/or outputting a first interface of information of an associated device associated with the control intention, and/or or sending the first interface including the control intention to an associated device for output; and/or,

In response to the control intention not satisfying the preset control intention condition, outputting a first interface including a recommended interaction instruction, wherein the recommended interaction instruction is associated with the control intention and/or satisfies the preset control intention condition.
The processing method according to claim 29, wherein, in response to the control intention meeting the preset control intention condition, responding directly according to the control intention, and outputting the first interface after responding to the control intention includes:

In response to the control intention meeting the preset control intention condition, wake up, start or run at least one preset application or service, and output the first interface including the recommended interaction instruction, and/or the running interface of the preset application or service , wherein the recommended interaction instruction is associated with the preset application or service, and/or associated with the first information.
The processing method according to claim 26, wherein outputting the first interface corresponding to the plurality of control intentions comprises:

Determine at least one target control intention from the plurality of control intentions according to the current scene information and/or the selection instruction.
The processing method according to claim 31, wherein, after the step of determining at least one target control intention from the plurality of control intentions, comprising:

In response to the confirmation operation, and/or in response to the target control intention meeting a preset control intention condition, and/or in response to the target control intention, outputting a first interface in response to the target control intention; and/or,

In response to no confirmation operation is received, and/or the target control intention does not meet the preset control intention condition, then output a first interface including the target control intention, and/or control the associated device to output a first interface including the target control the first interface of the intent; and/or,

In response to no confirmation operation being received, and/or the at least one target control intention not satisfying the preset control intention condition, output a first interface including a recommended interaction instruction, wherein the recommended interaction instruction is related to the target The control intention is associated with and/or satisfies the preset control intention condition.
The processing method according to claim 24, wherein said satisfying the first preset condition comprises at least one of the following:

The current scene information meets the preset scene conditions;

The current application or service belongs to the default list;

The operation result of the current application or service satisfies the preset result condition;

The running result of the current application or service does not meet the preset result conditions;

The received first information satisfies the preset information condition;

The first interface satisfies preset interface conditions, wherein the preset interface conditions include at least one of the following: there is a blank area; font size meets a preset size value; screen brightness meets a preset brightness value;

receiving the input second information;

The received second information satisfies the preset information condition, wherein the preset information condition includes at least one of the following: the control object corresponds to the object in the first interface; the control intention is a control intention corresponding to the function of the smart device; the control intention is A control intent corresponding to a function of a preset application or service.
The processing method according to claim 24, wherein in the step S1B, in response to satisfying the first preset condition, outputting a second interface includes at least one of the following:

In response to the first interface meeting a preset interface condition and receiving second information, displaying a recommended interaction instruction associated with the second information on the first interface to output the second interface;

In response to the first interface not satisfying the preset interface condition and receiving second information, after processing the first interface, displaying the recommended interaction associated with the second information in the processed first interface an instruction to output the second interface;

outputting a second interface corresponding to the first information in response to the received first information meeting a preset information condition;

In response to the received second information meeting the preset information condition, outputting a second interface corresponding to the second information.
The processing method according to claim 24, wherein in the step S2B, performing corresponding processing on the first interface and/or the second interface includes at least one of the following:

hiding or closing the first interface and/or the second interface;

fusing or merging said first interface and/or said second interface;

Enlarging or reducing the first interface and/or the second interface;

Output the third interface;

outputting the first interface and/or the second interface to an associated device;

After processing the first interface and/or the second interface, output to an associated device for output.
The processing method according to claim 24, wherein the smart device comprises at least one first display area and at least one second display area, and both the first display area and the second display area display the first interface;

The step S2B: in response to satisfying the second preset condition, perform corresponding processing on the first interface and/or the second interface, including:

In response to the first interface meeting the second preset condition, processing the first interface in one of the first display area and the second display area, or simultaneously processing the first interface The first interface displayed in the first display area and the second display area is processed.
The processing method according to claim 36, wherein the step S2B: in response to satisfying the second preset condition, performing corresponding processing on the first interface and/or the second interface comprises:

In response to a mobile operation in a non-single-handed mode, the information in the first interface is displayed alternately through the first display area and the second display area; and/or,

In response to the movement operation in the one-handed mode, the information in the first interface is adjusted to be displayed in the first display area.
The processing method as claimed in claim 1, wherein,

Said step S1 comprises:

Step S1C: Obtain the input first information;

Described step S2 comprises:

In step S2C, in response to the first information meeting a second preset condition, perform corresponding processing according to a second preset policy; and/or,

In response to the first information not meeting the second preset condition and meeting the third preset condition, performing corresponding processing according to a third preset strategy;

The first information satisfies a second preset condition, including at least one of the following:

The first information includes at least one control intent;

at least one control intention can be generated or determined according to the first information;

Said meeting the third preset condition includes at least one of the following:

The control intention can be determined according to the second information of the smart device;

The control intention can be determined according to user selection.
The processing method according to claim 38, wherein the control intention includes at least one of the following:

historical control intent;

associated control intent;

privacy control intent;

non-privacy control intent;

high-level control intent;

Non-high-level control intent.
The processing method according to claim 38, wherein the corresponding processing according to the second preset strategy includes at least one of the following:

If there is only one control intention, perform corresponding processing according to the control intention;

If there are at least two control intentions, the target control intention is determined according to a preset selection strategy, and corresponding processing is performed according to the target control intention.
The processing method according to claim 38, wherein the second information of the smart device includes at least one of the following:

The scene information of the smart device;

Time information of the smart device;

location information of the smart device;

Status information of the smart device;

Application or service information of the smart device;

Trigger object information of the smart device;

Relationship information between multiple applications or services of the smart device;

Associated device information of the smart device;

user operating habits;

The historical interaction record stored by the smart device;

Historical interaction records obtained by downloading from network devices;

Through historical interaction records obtained from associated devices.
The processing method according to claim 40, wherein said determining the target control intention according to the second information of the smart device comprises:

determining or generating intermediate information according to a preset rule according to the first information and the second information, and determining a control intention according to the intermediate information.
The processing method according to claim 42, wherein the preset rules include at least one of the following:

If the first information lacks partial information, then determine or generate the partial information according to the second information, so that the first information can be combined with the partial information to determine or generate the intermediate information;

If the first information includes the first part of information that cannot be recognized or responded to, then determine or generate the second part of information according to the second information, so that the first information can be combined with the second part of information to determine or generate the Describe the intermediate information.
The processing method according to claim 38, wherein the corresponding processing according to the third preset strategy includes at least one of the following:

Immediately or delay or stop or switch the processing corresponding to the execution of the control intention on the smart device;

outputting confirmation information, and executing processing corresponding to the control intention on the smart device in response to receiving the confirmation operation;

Copy or transfer the processing corresponding to the control intention to the associated device for execution;

Execute processing corresponding to the control intention on the smart device and/or associated device.
The processing method according to claim 38, wherein said processing method further comprises the steps of:

In response to the first information not meeting the second preset condition and not meeting the third preset condition, corresponding processing is performed according to a fourth preset strategy.
The processing method according to claim 38, wherein said step S1C: before the step of acquiring the input first information, further includes:

Perform preset processing on the smart device.
A processing method applied to a smart device, wherein the processing method includes:

Step S10: In response to the first preset operation and/or the information of the associated device, determine the control intention and/or obtain at least one recommended interaction instruction and/or output the first interface;

Step S20: Execute corresponding processing on the smart device based on a preset policy, and/or control associated devices to output.
The processing method as claimed in claim 47, wherein,

The step S10 includes:

Step S10A: In response to the first preset operation, at least one recommended interaction instruction is obtained according to the first preset operation and key information;

Described step S20 comprises:

Step S20A: In response to the second preset operation, and/or the smart device does not satisfy the preset condition, send at least one recommended interaction instruction to the associated device for output.
The method of claim 48, wherein the key information includes at least one of the following:

Instruction keywords in wrong interactive instructions;

The functions currently used by the Smart Device;

The function to be triggered by the smart device;

User ID;

The current application scenario;

Information about the first application in the smart device;

Current browsing content information on the smart device;

Interactive result keywords;

Associated device information;

Default information keywords.
The method of claim 48, wherein the failure of the smart device to meet preset conditions comprises at least one of the following:

The smart device does not have a display device;

The smart device display device does not meet the display requirements of the recommended interaction instructions;

The smart device does not have the display authority to recommend interactive instructions;

The recommended interaction instruction is related to associated devices.
The method according to claim 48, wherein step S10A comprises:

Determine the user's operation intention according to the first preset operation and the key information, and acquire the at least one first recommended interaction instruction according to the user's operation intention; and/or

The keyword information of the input interactive instruction is obtained, and the recommended interactive instruction is obtained according to the keyword information and key information.
The method according to claim 48, wherein step S20A comprises:

Prioritizing and/or highlighting recommended interaction instructions related to the associated device on the display screen of the associated device;

When the quantity of the at least one recommended interaction instruction exceeds a threshold, output the at least one recommended interaction instruction according to a first preset strategy; and/or,

When the quantity of the at least one recommended interaction instruction does not exceed a threshold, output the at least one recommended interaction instruction according to a second preset strategy;

According to the information of the first application of the smart device in the key information, obtain the software version information of the first application, and obtain the new recommended interaction of the latest version of the first application according to the software version information After the instruction, highlight the newly added recommended interaction instruction; and/or

Responding to the keyword information of the interaction instruction, acquiring a recommended interaction instruction conforming to the keyword information from the at least one recommended interaction instruction, in response to a second preset operation, and the smart device does not meet the preset condition, Among the at least one recommended interaction instruction, the recommended interaction instruction conforming to the keyword information is sent to an associated device for output.
The processing method of claim 47, wherein,

The step S10 includes:

Step S10B: Outputting the first interface in response to the first information satisfying the first preset condition, and/or outputting the second interface in response to the second information satisfying the second preset condition;

Step S20B: Execute corresponding processing on the first interface and/or the second interface in response to satisfying a third preset condition.
The processing method according to claim 53, wherein, in the step S10B, in response to the first information satisfying the first preset condition, outputting the first interface includes at least one of the following:

In response to a matching result of the first information and preset information, output a first interface corresponding to the matching result;

outputting a first interface corresponding to the control intention in response to the first information including the control intention;

In response to the first information being unable to determine or generate a control intention, output a first interface corresponding to a recommended interaction instruction associated with the first information;

A plurality of control intentions can be determined or generated in response to the first information, and a first interface corresponding to the plurality of control intentions is output.
The processing method according to claim 54, wherein the outputting the first interface corresponding to the control intention includes at least one of the following:

Responding to the control intention meeting the preset control intention condition, responding directly according to the control intention, and outputting a first interface after responding to the control intention;

In response to the control intention not satisfying the preset control intention condition, outputting a first interface including the control intention, and/or outputting a first interface of information of an associated device associated with the control intention, and/or or sending the first interface including the control intention to an associated device for output;

In response to the control intention not satisfying the preset control intention condition, outputting a first interface including a recommended interaction instruction, wherein the recommended interaction instruction is associated with the control intention and/or satisfies the preset control intention condition.
The processing method according to claim 54, wherein said outputting the first interface corresponding to said plurality of control intentions comprises:

Determine at least one target control intention from the plurality of control intentions according to the current scene information and/or the selection instruction.
The processing method according to claim 56, wherein after determining at least one target control intention from the plurality of control intentions, at least one of the following is included:

In response to the confirmation operation, and/or in response to the target control intention meeting a preset control intention condition, and/or in response to the target control intention, outputting a first interface in response to the target control intention;

In response to not receiving the confirmation operation, in response to the target control intention not satisfying the preset control intention condition, outputting a first interface including the target control intention, and/or outputting a control-associated device including the target control Intent's first interface;

In response to no confirmation operation being received, and/or in response to the at least one target control intention not satisfying the preset control intention condition, output a first interface including a recommended interaction instruction, wherein the recommended interaction instruction is related to the The target control intention is associated with and/or the preset control intention condition is satisfied.
The processing method according to claim 53, wherein in step S10B, in response to the first information satisfying the first preset condition, the first interface is output, and/or, in response to the second information satisfying the second preset condition, the second interface is output Two interfaces, including:

In response to the association of the second information with the control intention of the first information, and/or the association of the second user corresponding to the second information with the first user corresponding to the first information, outputting the first interface and the the second interface; and/or,

In response to the second information being associated with the first interface, the second interface is output after the first interface is closed.
The processing method according to claim 53, wherein in step S20B, performing corresponding processing on the first interface and/or the second interface includes at least one of the following:

hiding or closing the first interface and/or the second interface;

fusing or merging said first interface and/or said second interface;

Enlarging or reducing the first interface and/or the second interface;

Output the third interface;

outputting the first interface and/or the second interface to an associated device;

After processing the first interface and/or the second interface, output to an associated device for output.
The processing method as claimed in claim 47, wherein,

Step S10 includes:

Step S10BB: displaying the first interface and/or the second interface in response to the first preset operation;

Step S20 includes:

Step S20BB: After processing the first interface and/or the second interface, control the associated device to output the processed first interface and/or the second interface.
The processing method according to claim 60, wherein said step S10BB comprises:

In response to the running operation of the preset application or service, when the running operation does not match the function of the preset application or service, displaying the first interface and/or the second interface, the first interface And/or the second interface includes at least one of the following: operation failure information; recommended instructions corresponding to the operation of the preset application or service; recommended instructions corresponding to the application or service associated with the operation; A recommendation instruction corresponding to an associated associated device; a recommendation instruction corresponding to the function configuration of the preset application or service; an update control for updating the first interface; a recommendation instruction associated with the update control; Update widgets that function differently from recommended instructions; and/or,

In response to the running operation of the preset application or service, when the running operation matches the function of the preset application or service, displaying the first interface and/or the second interface, the first interface and/or the second interface The interface includes at least one of the following: the running interface of the preset application or service; a recommended instruction corresponding to the running operation; a recommended instruction corresponding to the functional configuration of the preset application or service; used to update the first interface an update control; a recommendation instruction associated with the update control; a recommendation instruction having a function different from that of the update control; a recommendation instruction and/or an update control associated with updating a function of the preset application or service; and/or ,

In response to the closing instruction of the preset application or service, display the first interface and/or the second interface, wherein the first interface and/or the second interface include at least one of the following: associated with the preset application or service The interface of the application or service; the recommended instruction of the application or service associated with the preset application or service; and/or,

In response to the closing instruction of the preset application or service and the starting instruction of other applications or services, displaying the first interface and/or the second interface, the first interface and/or the second interface include at least one of the following: other applications or The recommended instruction and/or update control corresponding to the difference between the service and the preset application or service; the recommended instruction and/or update control corresponding to the new function of the other application or service relative to the preset application or service; An update control for updating the first interface; a recommendation instruction associated with the update control; a recommendation instruction with a function different from that of the update control; an interface of an application or service associated with the other application or service; recommended instructions corresponding to associated devices associated with other applications or services; and/or,

In response to receiving the input first information, acquire the control intention included in the first information, and display the first interface and/or the second interface corresponding to the control intention; and/or,

In response to receiving the input first information, and the first information cannot determine or generate a control intention, display the first interface and/or the second interface corresponding to the recommended interaction instruction associated with the first information; and/or,

In response to receiving input first information, and the first information can determine or generate a plurality of control intentions, display a first interface and/or a second interface corresponding to the plurality of control intentions.
The processing method according to claim 61, wherein the recommended instruction associated with the update control includes at least one of the following:

An instruction juxtaposed with the update control, an instruction for updating the lower level of the control, an instruction for updating the upper level of the control, and an instruction including multiple functions for updating the control.
The processing method according to claim 61, wherein the displaying the first interface and/or the second interface corresponding to the control intention includes at least one of the following:

Responding to the control intention meeting the preset control intention condition, responding directly according to the control intention, and displaying the first interface and/or the second interface after responding to the control intention;

In response to the control intention not meeting the preset control intention condition, displaying the first interface and/or the second interface including the control intention, and/or displaying the information of the associated device associated with the control intention the first interface and/or the second interface;

In response to the control intention not satisfying the preset control intention condition, displaying a first interface and/or a second interface including a recommended interaction instruction, wherein the recommended interaction instruction is associated with the control intention and/or satisfies The preset control intention condition.
The processing method according to claim 60, wherein, step S20BB: After processing the first interface and/or the second interface, control the associated device to output the processed first interface and/or the The second interface includes at least one of the following:

hiding or closing the first interface and/or the second interface;

fusing or merging said first interface and/or said second interface;

Enlarging or reducing the first interface and/or the second interface;

controlling the first associated device to output the processed first interface and/or the processed second interface;

controlling the second associated device to output the processed first interface and/or the processed second interface;

The first associated device is controlled to output the processed first interface, and the second associated device is controlled to output the processed second interface.
The processing method according to claim 64, wherein the processed first interface and the processed second interface are different parts of the same application interface, or different interfaces of the same application.
The processing method according to claim 64, wherein said controlling the first associated device to output the processed first interface and/or the processed second interface includes at least one of the following:

In response to the match between the current user of the first associated device and the current user of the smart device, controlling the first associated device to output the processed first interface and/or the processed second interface;

In response to the application or service currently running on the first associated device matching the application or service installed or running on the first interface and/or the second interface, controlling the first associated device to output the processed first interface and/or the processed second interface;

In response to the level of the first associated device meeting the preset level, controlling the first associated device to output the processed first interface and/or the processed second interface;

In response to the priority level of the first associated device being higher than the priority level of the second associated device, the first associated device is controlled to output the processed first interface and/or the processed second interface.
The processing method of claim 47, wherein,

Step S10 includes:

Step S10C: Obtain the input first information and the second information of the smart device, and determine the control intention according to the first information and the second information;

Step S20 includes:

Step S20C: Execute corresponding processing on the smart device according to the control intention and preset strategy;

The second information of the smart device includes at least one of the following:

The scene information of the smart device;

Time information of the smart device;

location information of the smart device;

Status information of the smart device;

Application or service information of the smart device;

Trigger object information of the smart device;

Relationship information between multiple applications or services of the smart device;

Associated device information of the smart device;

user operating habits;

The historical interaction record stored by the smart device;

Historical interaction records obtained by downloading from network devices;

Through historical interaction records obtained from associated devices.
The processing method according to claim 67, wherein said determining the control intention according to the first information and the second information comprises:

determining or generating intermediate information according to a preset rule according to the first information and the second information, and determining a control intention according to the intermediate information.
The processing method according to claim 68, wherein the preset rules include at least one of the following:

If the first information lacks partial information, then determine or generate the partial information according to the second information, so that the first information can be combined with the partial information to determine or generate the intermediate information;

If the first information includes the first part of information that cannot be recognized or responded to, then determine or generate the second part of information according to the second information, so that the first information can be combined with the second part of information to determine or generate the Describe the intermediate information.
The processing method according to claim 67, wherein the control intention includes at least one of the following:

historical control intent;

associated control intent;

privacy control intent;

non-privacy control intent;

high-level control intent;

Non-high-level control intent.
The processing method according to claim 67, wherein said determining the control intention according to the first information and the second information includes at least one of the following:

If there is only one control intention included in the first information, perform corresponding processing according to the control intention;

When there are at least two control intentions included in the first information, the target control intention is determined according to a preset selection strategy.
The processing method according to claim 71, wherein the preset selection strategy includes at least one of the following:

determining the target control intent based on the second information;

The target control intention is determined according to user selection.
The processing method according to claim 67, wherein said performing corresponding processing on said smart device comprises at least one of the following:

Immediately or delay or stop or switch the execution of the processing corresponding to the control intention on the smart device;

outputting confirmation information, and executing processing corresponding to the control intention on the smart device in response to receiving the confirmation operation;

Copy or transfer the processing corresponding to the control intention to the associated device for execution;

Execute processing corresponding to the control intention on the smart device and/or associated device.
The processing method according to claim 67, wherein, said step S10C, further comprising:

When the control intention cannot be determined according to the first information and the second information, corresponding processing is performed according to a third preset strategy.
The processing method according to claim 67, wherein, before the step of acquiring the input first information, further comprising: performing preset processing on the smart device.
The processing method as claimed in claim 47, wherein,

Step S10 includes:

Step S10CC: In response to the input of the first information does not meet the first preset condition, obtain the second information of the associated device, and determine the control intention according to the first information and the second information;

Step S20 includes:

Step S20CC: Execute corresponding processing on the smart device according to the control intention and the preset strategy.
The processing method according to claim 76, wherein the first preset condition includes at least one of the following:

The first information includes at least one control intent;

At least one control intention can be determined or generated according to the first information.
The processing method according to claim 76, wherein the second information includes at least one of the following:

user operating habits;

historical interaction records;

scene information;

time information;

location information;

user status information;

Application or service information of the associated device;

Trigger object information of the associated device;

Relationship information between multiple applications or services of the associated device;

Historical interaction records obtained by downloading from network devices.
The processing method according to claim 76, wherein said step S10CC comprises at least one of the following:

If the first information lacks partial information, then determine or generate the partial information according to the second information, so that the first information can be combined with the partial information to determine the control intention;

If the first information includes the first part of information that cannot be recognized or responded to, then determine or generate the second part of information according to the second information, so that the first information can be combined with the second part of information to determine the control intention.
The processing method according to claim 76, wherein the control intention includes at least one of the following:

historical control intent;

associated control intent;

non-privacy control intent;

Non-high-level control intent.
The processing method according to claim 76, wherein said determining the control intention according to said first information and said second information comprises at least one of the following:

If there is only one control intention included in the first information, perform corresponding processing according to the control intention;

When there are at least two control intentions included in the first information, the target control intention is determined according to a preset selection strategy.
The processing method according to claim 81, wherein the preset selection strategy includes at least one of the following:

determining the target control intent based on the second information;

The target control intention is determined according to user selection.
The processing method according to claim 76, wherein said performing corresponding processing on said smart device comprises at least one of the following:

Immediately or delay or stop or switch the execution of the processing corresponding to the control intention on the smart device;

outputting confirmation information, and executing processing corresponding to the control intention on the smart device in response to receiving the confirmation operation;

Copy or transfer the processing corresponding to the control intention to the associated device for execution;

Execute processing corresponding to the control intention on the smart device and/or associated device.
The processing method according to claim 76, wherein said step S10CC further comprises:

When the control intention cannot be determined according to the first information and the second information, corresponding processing is performed according to a third preset strategy.
The processing method according to claim 76, wherein, before the step S10CC, further comprising:

Perform preset processing on the smart device.
An intelligent device, wherein the intelligent device includes: a memory, a processor, and a quick search program stored on the memory and operable on the processor, when the quick search program is executed by the processor Implementing the steps of the processing method as claimed in claim 1 or 47.
A storage medium, wherein a computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the processing method according to claim 1 or 47 are realized.