WO2022052713A1

WO2022052713A1 - Interaction method and apparatus, and electronic device

Info

Publication number: WO2022052713A1
Application number: PCT/CN2021/111751
Authority: WO
Inventors: 张子曰; 鲍修远
Original assignee: 华为技术有限公司
Priority date: 2020-09-08
Filing date: 2021-08-10
Publication date: 2022-03-17
Also published as: CN114237776B; CN114237776A

Abstract

Provided are an interaction method and apparatus, and an electronic device, which relate to the technical field of intelligent control. The method comprises: displaying an editing interface, wherein the editing interface comprises a trigger condition and a first execution item, and the first execution item comprises a first external device and first execution content; changing the first execution item into a second execution item in response to a first operation on the first execution item, wherein the second execution item comprises a second external device and second execution content, with the second external device differing from the first external device, and/or the first execution content differing from the second execution content. By means of the technical solution provided by the present application, a user can easily adjust different parameters of execution items by means of different adjustable parameters, such that a parameter setting path can be shortened, and the editing efficiency can be improved.

Description

Interactive method, apparatus and electronic device

This application claims the priority of a Chinese patent application with an application number of 202010937450.9 and an application title of "Interactive Method, Apparatus and Electronic Equipment" filed with the State Intellectual Property Office on September 08, 2020, the entire contents of which are incorporated herein by reference middle.

technical field

The present application relates to the technical field of intelligent control, and in particular, to an interaction method, apparatus and electronic device.

Background technique

With the rapid development of network technology and computer technology, the types and functions of smart devices are also more abundant. How to control smart devices to bring convenience to life has become a concern of people.

For the convenience of users, some application programs (application, APP) provide a smart control function, through which the user can implement quick control of one or more smart devices. In the specific implementation, the APP generally provides different scenarios for the user to choose and arrange. The user can arrange the types and related parameters of the smart devices involved in the scenario according to their needs, so as to realize the control of each scene in the scenario when the scenario is triggered. Smart devices implement corresponding functions. However, the editing efficiency of the current scenes of these APPs is generally not efficient enough.

SUMMARY OF THE INVENTION

In view of this, the present application provides an interactive method, apparatus and electronic device for improving editing efficiency.

In order to achieve the above object, in the first aspect, an embodiment of the present application provides an interaction method, which is applied to an electronic device, including: displaying an editing interface, where the editing interface includes a trigger condition and a first execution item, and the first execution item includes a first external device and first execution content; in response to the first operation on the first execution item, the first execution item is changed to a second execution item, and the second execution item includes a second external device and a second execution content; wherein the second external The device is different from the first external device, and/or the first execution content is different from the second execution content.

The editing interface may be a scene editing interface or other shortcut command editing interface provided by the intelligent control function on the electronic device; the editing interface may include one or more execution items, and the first execution item may be any execution item in the editing interface. item.

The external devices (such as the first external device and the second external device) in the execution item represent the execution device of the execution item, which may be a smart device that establishes an association relationship with the electronic device, such as a user logging in on the electronic device. The smart home device, vehicle-mounted device, or smart health device associated with the account; the execution item can specifically display the device name or other device identifier of the execution device.

The execution content in the execution item may include action content such as opening, closing, or playing, and may also include parameter content such as working mode or multimedia content. For example: the execution item "turn on air purifier A sleep mode", "air purifier A" is the execution device, "open" is the action content, and "sleep mode" is the parameter content.

The execution equipment and execution content in the execution item are adjustable parameters, which can support editing, and the user can select the execution equipment and/or execution content (ie, the first operation) to edit the execution item; for an execution item, the first The execution item means the execution item before editing, and the second execution item means the execution item formed after editing the execution item. When the user edits the execution item again, the second execution item is used as the new first execution item again. .

When responding to the user's first operation, the electronic device can change the content of the execution item in a preset manner. For example, in the execution item in the above example, the user clicks "Open", and the "Open" in the execution item is changed to "Close". The electronic device can also display a corresponding execution item editing interface, and the content of the execution item can be changed by the user's editing operation in the interface; wherein, the execution item editing interface can be an action editing interface corresponding to the action content, a device editing interface corresponding to the execution device, or The parameter editing interface corresponding to the parameter content can be displayed in the form of a full screen or a floating window.

In the above interaction method, the external equipment and the execution content included in the execution item in the editing interface are all adjustable parameters, which can facilitate the user to adjust different parameters of the execution item through different adjustable parameters, thereby shortening the parameter setting path and improving the editing efficiency. .

In a possible implementation of the first aspect, the process of changing the first execution item to the second execution item includes: receiving a second operation on the first external device; in response to the second operation, displaying a plurality of external devices; receiving a third operation of selecting a second external device from among the plurality of external devices; in response to the second operation, changing the first external device to the second external device.

For example: for "turn on air purifier A sleep mode", the user clicks "air purifier A" (ie the second operation), the electronic device can display the corresponding device editing interface, which displays multiple external devices: air purifier A and air purifier B; the user can select the second external device, air purifier B, from multiple external devices (ie, the third operation), and the electronic device correspondingly changes the air purifier A in the execution item to an air purifier. B.

In a possible implementation of the first aspect, the process of changing the first execution item to the second execution item includes: receiving a fourth operation on the first execution content; in response to the fourth operation, displaying a plurality of execution contents; A fifth operation of selecting the second execution content from the plurality of action instructions is received; in response to the fifth operation, the first execution content is changed to the second execution content.

For example: for "turn on the sleep mode of air purifier A", the user clicks "sleep mode" (ie, the fourth operation), the electronic device can display the corresponding parameter editing interface, and the interface displays multiple execution contents: it can be used to select the sleep mode , mode options of automatic mode or manual mode, wind speed options and timing shutdown options; the user can select the second execution content automatic mode (ie the fifth operation) from multiple execution contents, and the electronic device will execute the sleep in the item correspondingly The mode is changed to automatic mode.

In a possible implementation manner of the first aspect, the plurality of external devices are external devices that satisfy preset device parameters. The preset device parameters can be obtained from the target execution instruction corresponding to the execution item, and the target execution instruction can be a device set control instruction that can support controlling multiple smart devices, and an external device that satisfies the preset device parameters forms the target execution instruction. equipment set.

For example: the target execution command is "Open [Air Purifier#Complete Collection]", and "Air Purifier#Complete Collection" is the preset device parameter; if the air purifier associated with the electronic device includes air purifier A and air purifier B, Then, the external devices that satisfy the preset device parameters in the execution items corresponding to the instruction include air purifier A and air purifier B.

In a possible implementation manner of the first aspect, the method further includes: generating an execution flow according to the second execution item and the trigger condition, the execution flow including the execution action corresponding to the trigger condition and the second execution item, and the execution action is used to control The second external device executes the second execution content; in response to satisfying the trigger condition, the execution action is executed.

Specifically, the user can save after editing, and the electronic device can generate the execution flow according to the second execution item and the trigger condition. When the trigger condition is satisfied, the execution action corresponding to the second execution item can be executed.

For example: the second execution item is "open air purifier B automatic mode", the trigger condition is "when the smart door lock is unlocked from 08:00-21:00 every day", the user saves after editing; When the door lock is unlocked and the trigger condition is met, the electronic device can control the air purifier B to open and run the automatic mode.

In a possible implementation of the first aspect, the method further includes: generating a control according to the second execution item and the trigger condition; displaying the control; and controlling the second external device to perform the second execution in response to the sixth operation on the control content.

Specifically, taking the editing interface as the scene editing interface as an example, the electronic device can provide a scene management function, such as providing "My Scene Interface". After editing the scene editing interface, the user can add the corresponding scene to the My Scene interface. in management. The electronic device can generate a control according to the content edited by the user in the scene editing interface, and the control can be a card, an icon or a menu item, etc.; the user can click on the control (ie, the sixth operation), and the electronic device can control the second external device to perform the first operation. 2. Execution content.

Among them, the scene can be a manual scene or an automatic scene. The trigger condition in the manual scene involves manual operation, for example, the trigger condition is: "when the scene card is clicked"; the trigger condition in the automatic scene does not involve manual operation, for example, the trigger condition is: "When the smart door lock is unlocked from 08:00-21:00 every day". Through the above method, the automatic scene can also be triggered manually, which is equivalent to integrating the automatic scene and the manual scene with high similarity into the same scene. Users can also complete scene discovery, scene editing and scene management at one time without dividing the scene. It can be found, arranged and managed many times, which can improve the convenience of users and improve the editing efficiency of scenes to a certain extent.

After the automatic scene is manually triggered, the electronic device can judge the triggering condition of the automatic scene, and determine the execution result according to the judgment result.

Specifically, each scenario may include one or more triggering conditions, and each triggering condition may correspond to a different execution flow. For example, the scene content of a certain scenario includes: execution flow 1 and execution flow 2, where execution flow 1 is: the current When it rains (trigger condition 1), play music a (execute action 1); the execution flow 1 is: when a typhoon blows (trigger condition 2), play music b (execute action 2).

If the automatic scene includes multiple triggering conditions, the electronic device can determine which triggering condition the current situation satisfies. If a certain triggering condition is met, the execution process corresponding to the triggering condition can be executed. If none of the triggering conditions are met, the user can choose to execute it. Which execution process, or can also randomly select an execution process to execute. If the automatic scene includes only one trigger condition, the electronic device can execute the execution flow corresponding to the trigger condition when the trigger condition is met; when the trigger condition is not met, the user can choose whether to execute the execution flow of the automatic scene.

In a possible implementation of the first aspect, the second external device in the second execution item may include multiple, for example: the execution item "turn on air purifier A, air purifier B sleep mode", the external device (that is, the execution device) includes two: air purifier A and air purifier B. When the user adjusts the execution content, the user can adjust the two external devices at the same time, which can further improve the editing efficiency.

In a second aspect, an embodiment of the present application provides an interaction method, including: receiving a user's editing trigger operation on a scene; in response to the editing trigger operation, displaying a scene editing interface of the scene, where the scene editing interface includes all an execution item corresponding to each execution action of the scene, the execution item is used to display the function description text of the corresponding execution action, and the function description text corresponding to the execution action supporting parameter adjustment includes the adjustable parameter of the execution action, The tunable parameters are editable.

In the above interaction method, the scene editing interface displays the function description text of the execution item corresponding to the trigger condition and the execution action, and the function description text can be interspersed with one or more adjustable parameters related to the execution action of the scene, which is convenient for the user. Adjust different parameters of the execution device through different adjustable parameters, so that the parameter setting path can be shortened; moreover, the adjustable parameters are related to the scene, that is, some parameters unrelated to the scene are filtered out when the adjustable parameters are displayed, which can simplify parameter editing Therefore, the above interaction method can improve the editing efficiency of the scene.

In a possible implementation of the second aspect, the method further includes: receiving a user triggering operation on the adjustable parameter, and in response to the triggering operation, displaying a parameter editing interface corresponding to the adjustable parameter .

In a possible implementation manner of the second aspect, the displaying the parameter editing interface corresponding to the adjustable parameter includes: displaying the parameter editing interface corresponding to the adjustable parameter in the form of a floating window. In this way, it is convenient for users to know the tunable parameter that is currently being edited.

In a possible implementation manner of the second aspect, the execution item is a selectable option, and the selection state of each execution item is displayed in the scene editing interface. In this way, the user can choose whether to execute the execution work corresponding to a certain execution item, thereby improving the flexibility of scene editing.

In a possible implementation manner of the second aspect, at least one execution device involved in executing an action includes multiple execution devices, and there is an association relationship between functions executed by the multiple execution devices. This increases the variety of intelligent control functions.

In a possible implementation manner of the second aspect, the execution instructions corresponding to each execution action of the scene include at least one target execution instruction, and the target execution instruction supports controlling multiple objects; The scene editing interface includes: for each target execution instruction, according to the execution item type of the target execution instruction and the corresponding relationship between the preset execution item type and the execution item display rule, displaying all the execution items in the scene editing interface. Specifies the execution item corresponding to the target execution instruction. This can improve development efficiency and generate more reasonable execution items.

In a possible implementation manner of the second aspect, the execution item types include a first type and a second type, and the execution item display rule corresponding to the first type includes: the execution item corresponding to the target execution instruction includes At least one, the execution item corresponding to the target execution instruction is in one-to-one correspondence with the objects included in the set of objects controlled by the target execution instruction, and the execution item corresponding to each object includes an item for adjusting the specified function parameters of the object. Adjustable parameters; the execution item display rule corresponding to the second type includes: the execution item corresponding to the target execution instruction includes one item, and the execution item corresponding to the target execution instruction indicates each object in the object set.

In a possible implementation manner of the second aspect, the execution item display rule corresponding to the second type further includes: if the target execution instruction indicates that the specified function parameter of the object in the object set is adjustable, and the If each object included in the object set has the same or similar specified function parameters, the execution item corresponding to the target execution instruction includes adjustable parameters for adjusting the same or similar specified function parameters.

In this embodiment, multiple objects can be indicated in the same execution item, and adjustable parameters corresponding to the same or similar specified function parameters among the objects can be displayed, so that the user can edit multiple objects at the same time, thereby improving the editing performance. effectiveness.

In a possible implementation manner of the second aspect, the execution item display rule corresponding to the second type further includes: the execution item corresponding to the target execution instruction includes adjustable parameters corresponding to the object set, the The adjustable parameter corresponding to the object set is used to adjust the object controlled by the execution item corresponding to the target execution instruction. In this way, the user can adjust the object controlled by the execution item, thereby improving the flexibility of scene editing.

In a possible implementation manner of the second aspect, the execution instructions corresponding to each execution action of the scene include at least one target execution instruction, and the target execution instruction supports controlling multiple objects; The scene editing interface includes: for each target execution instruction, according to the attribute of the object execution instruction of the target execution instruction and the corresponding relationship between the attribute of the preset object set and the execution item display rule, in the scene editing interface The execution item corresponding to the target execution instruction is displayed.

In a possible implementation manner of the second aspect, the attributes of the object set include an empty set, a complete set, and a specified set, and the execution item display rule corresponding to the empty set includes: the execution item corresponding to the target execution instruction includes one, The execution item corresponding to the target execution instruction includes adjustable parameters corresponding to the object set, wherein the adjustable parameter corresponding to the object set is used to adjust the object controlled by the execution item corresponding to the target execution instruction. When the object set includes multiple objects, the object indicated by the adjustable parameter corresponding to the object set is empty; when the object set includes one object, the object indicated by the adjustable parameter corresponding to the object set is empty. Objects are objects included in the set of objects.

Through the above-mentioned embodiments, scene editing can be made more flexible.

In a possible implementation manner of the second aspect, the execution item display rule corresponding to the empty set further includes: when there are multiple objects included in the object set, displaying in the execution item corresponding to the target execution instruction There is prompt information, and the prompt information is used to prompt the user to adjust the object controlled by the execution item through the adjustable parameter corresponding to the object set. In this way, it is convenient for the user to understand the function of the execution item, thereby improving the user experience.

In a possible implementation manner of the second aspect, the execution item display rule corresponding to the complete set and the specified set includes: the execution item corresponding to the target execution instruction in the scene editing interface indicates that the execution items included in the object set are included. each object.

In a possible implementation manner of the second aspect, a description text of the triggering condition of the scene is displayed in the scene editing interface. In this way, it is convenient for users to understand the triggering conditions of the scene.

In a possible implementation manner of the second aspect, the scenario is an automatic scenario that supports automatic triggering, and the description text includes adjustable parameters of the triggering condition. In this way, the user can also edit the trigger conditions, thereby improving the flexibility of scene editing.

In a possible implementation manner of the second aspect, the method further includes: when a trigger condition of the scene is satisfied, executing an execution action included in the scene; and displaying an execution state of the scene. This makes it easier for users to understand the execution status of the scene.

In a possible implementation manner of the second aspect, after the executing the execution action included in the scenario, the method further includes: if a user triggering operation for terminating the scenario is received, responding to the Terminate the trigger operation, and terminate the execution of the execution action of the scene. This increases the flexibility of scene control.

In a possible implementation manner of the second aspect, the displaying the execution status of the scene includes: displaying the execution status of the scene in a scene card corresponding to the scene.

The method further includes: when the scene is being executed, displaying a termination control in the scene card; then the stopping the triggering operation includes a triggering operation on the termination control.

In a possible implementation of the second aspect, the scene is an automatic scene that supports automatic triggering, and the method further includes: when receiving a scene triggering operation of the scene by the user, responding to the scene triggering operation, execute the execution action included in the scene. In this way, automatic scenes can also be triggered manually, which can improve the convenience of users, and is equivalent to integrating automatic scenes and manual scenes with high similarity into the same scene. It can be completed at one time instead of finding, arranging and managing multiple times, which can improve the convenience of users and improve the efficiency of scene editing to a certain extent.

In a possible implementation manner of the second aspect, the scenario includes at least one trigger condition, and each trigger condition has a corresponding execution action; the triggering operation in response to the scenario executes the execution included in the scenario The action includes: in response to the scene triggering operation, if the scene includes multiple triggering conditions, in the case that at least one triggering condition is satisfied, executing the execution action corresponding to the satisfied triggering condition; if none of the triggering conditions is satisfied In the case of , determine the execution action corresponding to the trigger condition to be executed, and execute the execution action corresponding to the determined trigger condition; if the scene includes a trigger condition, execute the scene when the trigger condition is satisfied of each execution action. This can improve the accuracy of scene execution results.

In a possible implementation manner of the second aspect, the determining the execution action corresponding to the trigger condition to be executed includes: prompting the user to select the execution action corresponding to the trigger condition to be executed; determining the execution action to be executed according to the user's selection operation The execution action corresponding to the trigger condition. This increases the flexibility of scenario execution.

In a third aspect, an embodiment of the present application provides an interaction device, which is applied to an electronic device, including:

a display module, configured to display an editing interface, the editing interface includes a trigger condition and a first execution item, and the first execution item includes a first external device and a first execution content;

a processing module, configured to change the first execution item to a second execution item in response to a first operation on the first execution item, and the second execution item includes a second external device and a second execution content;

Wherein, the second external device is different from the first external device, and/or the first execution content is different from the second execution content.

In a possible implementation manner of the third aspect, the apparatus further includes: an input module;

The input module is used for: receiving a second operation on the first external device;

The display module is further used for: displaying a plurality of external devices in response to the second operation;

The input module is further configured to: receive a third operation of selecting a second external device from the plurality of external devices;

The processing module is further configured to: in response to the second operation, change the first external device to the second external device.

The input module is used for: receiving a fourth operation on the first execution content;

The display module is further configured to: display a plurality of execution contents in response to the fourth operation;

The input module is further configured to: receive a fifth operation of selecting the second execution content from the plurality of action instructions;

The processing module is further configured to: in response to the fifth operation, change the first execution content to the second execution content.

In a possible implementation manner of the third aspect, the plurality of external devices are external devices that satisfy preset device parameters.

In a possible implementation manner of the third aspect, the processing module is further configured to: generate an execution flow according to the second execution item and the trigger condition, the execution flow includes the execution action corresponding to the trigger condition and the second execution item, and the execution action is used for The second external device is controlled to execute the second execution content; in response to satisfying the trigger condition, the execution action is executed.

In a possible implementation of the third aspect, the processing module is further configured to: generate a control according to the second execution item and the trigger condition; the display module is further configured to: display the control; the processing module is further configured to: respond to the control The sixth operation is to control the second external device to execute the second execution content.

In a fourth aspect, an embodiment of the present application provides an interaction device, including:

The input module is used to receive the user's editing trigger operation on the scene;

A display module, configured to display a scene editing interface of the scene in response to the editing trigger operation, where the scene editing interface includes execution items corresponding to each execution action of the scene, and the execution items are used to display corresponding execution items. The function description text of the execution action, the function description text corresponding to the execution action that supports parameter adjustment includes the adjustable parameters of the execution action, and the adjustable parameters can be edited.

In a possible implementation manner of the fourth aspect, the input module is further configured to: receive a user triggering operation on the adjustable parameter; the display module is further configured to display the trigger operation in response to the triggering operation. The parameter editing interface corresponding to the adjustable parameter.

In a possible implementation manner of the fourth aspect, the display module is specifically configured to: display the parameter editing interface corresponding to the adjustable parameter in the form of a floating window.

In a possible implementation manner of the fourth aspect, the execution item is a selectable option, and the selection state of each execution item is displayed in the scene editing interface.

In a possible implementation manner of the fourth aspect, at least one execution device involved in executing an action includes multiple execution devices, and there is an association relationship between functions executed by the multiple execution devices.

In a possible implementation manner of the fourth aspect, the execution instructions corresponding to each execution action of the scene include at least one target execution instruction, and the target execution instruction supports controlling multiple objects; the display module is specifically used for : For each target execution instruction, according to the execution item type of the target execution instruction and the corresponding relationship between the preset execution item type and the execution item display rule, display the corresponding target execution instruction in the scene editing interface. execution item.

In a possible implementation manner of the fourth aspect, the execution item types include a first type and a second type, and the execution item display rule corresponding to the first type includes: the execution item corresponding to the target execution instruction includes At least one, the execution item corresponding to the target execution instruction is in one-to-one correspondence with the objects included in the set of objects controlled by the target execution instruction, and the execution item corresponding to each object includes an item for adjusting the specified function parameters of the object. Adjustable parameters; the execution item display rule corresponding to the second type includes: the execution item corresponding to the target execution instruction includes one item, and the execution item corresponding to the target execution instruction indicates each object in the object set.

In a possible implementation manner of the fourth aspect, the execution item display rule corresponding to the second type further includes: if the target execution instruction indicates that the specified function parameters of the objects in the object set are adjustable, and the If each object included in the object set has the same or similar specified function parameters, the execution item corresponding to the target execution instruction includes adjustable parameters for adjusting the same or similar specified function parameters.

In a possible implementation manner of the fourth aspect, the execution item display rule corresponding to the second type further includes: the execution item corresponding to the target execution instruction includes adjustable parameters corresponding to the object set, the The adjustable parameter corresponding to the object set is used to adjust the object controlled by the execution item corresponding to the target execution instruction.

In a possible implementation manner of the fourth aspect, the execution instructions corresponding to each execution action of the scene include at least one target execution instruction, and the target execution instruction supports controlling multiple objects; the display module is specifically used for : For each target execution instruction, display the target execution in the scene editing interface according to the attributes of the object set of the target execution instruction and the corresponding relationship between the attributes of the preset object set and the execution item display rules The execution item corresponding to the instruction.

In a possible implementation manner of the fourth aspect, the attributes of the object set include an empty set, a complete set, and a specified set, and the execution item display rule corresponding to the empty set includes: the execution item corresponding to the target execution instruction includes one, The execution item corresponding to the target execution instruction includes adjustable parameters corresponding to the object set, wherein the adjustable parameter corresponding to the object set is used to adjust the object controlled by the execution item corresponding to the target execution instruction. When the object set includes multiple objects, the object indicated by the adjustable parameter corresponding to the object set is empty; when the object set includes one object, the object indicated by the adjustable parameter corresponding to the object set is empty. Objects are objects included in the set of objects.

In a possible implementation manner of the fourth aspect, the execution item display rule corresponding to the empty set further includes: when there are multiple objects included in the object set, displaying in the execution item corresponding to the target execution instruction There is prompt information, and the prompt information is used to prompt the user to adjust the object controlled by the execution item through the adjustable parameter corresponding to the object set.

In a possible implementation manner of the fourth aspect, the execution item display rules corresponding to the complete set and the specified set include: the execution item corresponding to the target execution instruction in the scene editing interface indicates that the execution items included in the object set each object.

In a possible implementation manner of the fourth aspect, the scene editing interface displays a description text of the triggering condition of the scene.

In a possible implementation manner of the fourth aspect, the scene is an automatic scene that supports automatic triggering, and the description text includes adjustable parameters of the triggering condition.

In a possible implementation manner of the fourth aspect, the processing module is further configured to: when a trigger condition of the scenario is satisfied, execute an execution action included in the scenario; the display module is further configured to display the The execution state of the scene.

In a possible implementation manner of the fourth aspect, the processing module is further configured to: after executing the execution action included in the scene, if the input module receives a user's termination triggering operation on the scene, respond to The termination triggering operation terminates the execution of the execution action of the scene.

In a possible implementation manner of the fourth aspect, the display module is specifically configured to: display the execution status of the scene in a scene card corresponding to the scene.

The display module is further configured to: display a termination control in the scene card when the scene is being executed; then the stop triggering operation includes a triggering operation for the termination control.

In a possible implementation manner of the fourth aspect, the scene is an automatic scene that supports automatic triggering, and the processing module further user: when the input module receives a scene triggering operation of the scene by the user, respond Trigger an operation on the scene, and execute the execution action included in the scene.

In a possible implementation manner of the fourth aspect, the scene includes at least one trigger condition, and each trigger condition has a corresponding execution action; the processing module is specifically configured to: trigger an operation in response to the scene, if any If the above scenario includes multiple triggering conditions, then if at least one triggering condition is satisfied, the execution action corresponding to the satisfied triggering condition is executed; if none of the triggering conditions are satisfied, the execution action corresponding to the triggering condition to be executed is determined. , and execute the execution action corresponding to the determined trigger condition; if the scene includes a trigger condition, each execution action of the scene is executed under the condition that the trigger condition is satisfied.

In a possible implementation manner of the fourth aspect, the processing module is specifically configured to: prompt the user to select the execution action corresponding to the trigger condition to be executed; and determine the execution action corresponding to the trigger condition to be executed according to the user's selection operation.

In a fifth aspect, an embodiment of the present application provides an electronic device, including: a memory and a processor, where the memory is used to store a computer program; the processor is used to execute the method described in the first aspect or the third aspect when the computer program is invoked.

In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the method described in the first aspect or the third aspect is implemented.

In a seventh aspect, an embodiment of the present application provides a computer program product, which enables an electronic device to execute the method described in the first aspect or the third aspect when the computer program product runs on a device.

In an eighth aspect, an embodiment of the present application provides a chip system, including a processor, where the processor is coupled to a memory, and the processor executes a computer program stored in the memory, so as to implement the first aspect or the third aspect. Methods. Wherein, the chip system may be a single chip or a chip module composed of multiple chips.

It can be understood that, for the beneficial effects of the third aspect to the eighth aspect, reference may be made to the relevant descriptions in the first aspect and the second aspect, which will not be repeated here.

Description of drawings

1 is a schematic diagram of an existing scene editing interface;

2 is a schematic diagram of a system architecture provided by an embodiment of the present application;

3 is a schematic diagram of an application interface provided by an embodiment of the present application;

4 is a schematic diagram of a scene interface of a manual scene and an automatic scene provided by an embodiment of the present application;

5 is a schematic diagram of interface display of a scene card provided by an embodiment of the present application;

FIG. 6 is a schematic diagram of an interaction process provided by an embodiment of the present application;

7-10 are schematic diagrams of other application interfaces provided by the embodiments of the present application;

FIG. 11 is a schematic diagram of constituent elements of an execution item provided by an embodiment of the present application;

FIG. 12 is a schematic diagram of some display styles of execution items provided by an embodiment of the present application;

13 is a schematic flowchart of an execution item display process provided by an embodiment of the present application;

14 is a schematic diagram of other display styles of the execution items provided by the embodiment of the present application;

FIG. 15 is a schematic flowchart of another execution item display process provided by an embodiment of the present application;

FIG. 16 is a schematic structural diagram of an interaction apparatus provided by an embodiment of the present application;

FIG. 17 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

detailed description

The embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. The terms used in the implementation part of the embodiments of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.

FIG. 1 is a schematic diagram of an existing scene editing interface. When the user triggers the editing function of a certain scene provided in the intelligent control APP, as shown in (a) of FIG. 1 , the electronic device displays a scene editing interface 10, and the scene editing interface 10 includes a list of controlled devices 101. It includes device editing options corresponding to each smart device controlled in this scenario, such as smart lamp editing options 1011 , smart socket editing options 1012 , air purifier editing options 1013 , and gateway editing options 1014 shown in the figure.

The user can click the device editing option to edit the control parameters of the corresponding smart device, as shown in (a) in Figure 1. If the user wants to edit the control parameters related to the air purifier, click the air purifier editing option 1013; as shown in Figure 1 As shown in (b) of the above, the electronic device displays the device editing interface 20 of the air purifier, which displays parameter editing options for various control parameters of the air purifier, and the user can select the relevant parameter editing options for editing.

The above scene editing interface mainly displays the list of controlled devices, which is inconvenient for users to understand the scene functions; for each controlled device, the editing operations of various control parameters of the device need to be entered through the device editing options of the device. In this way, the phenomenon of long parameter setting path is easy to occur; in addition, the parameter content of the device editing interface of the device is consistent in various scenarios, and all kinds of editable parameters of the device are listed, so the device editing interface will have parameter excessive In addition, each editing operation of the user can only be edited for a single device, which will affect the efficiency of scene arrangement. In addition, in current scenarios, the functions of a single device are generally controlled, so the device control functions are not diversified enough.

To this end, the embodiments of the present application provide an interaction method, apparatus, and electronic device, so as to facilitate the user's understanding of scene functions, and to improve scene editing efficiency and diversity of device control functions.

First, the system architecture involved in the embodiment of the present application is introduced. FIG. 2 is a schematic diagram of the system architecture provided by the embodiment of the present application. As shown in Figure 2, the system architecture includes cloud servers, electronic devices and smart devices.

Among them, cloud servers, electronic devices and smart devices can communicate with each other. Electronic devices can be portable electronic devices such as mobile phones or tablets, or non-portable electronic devices such as desktop computers; smart devices can be speakers, air conditioners, Smart home devices such as air purifiers, smart lights, smart switches or gateways can also be in-vehicle devices or smart health devices, etc. The number of smart devices can be one or more.

The electronic device can access the cloud server through the logged-in user account, and the cloud server can provide some query services for the electronic device. Specifically, the electronic device can query the type and functional parameters of the smart device associated with the logged-in user account from the cloud server. You can also query the scene information from the cloud server, and you can also query the weather and other Internet service information from the cloud server. Cloud servers can also provide control services for electronic devices. For example, in some scenarios, electronic devices can control smart devices through short-range communication connections such as Bluetooth. In other scenarios, electronic devices can use cloud servers to control smart devices. control.

An intelligent control function may be provided on the electronic device, and the function may be a system function or a function provided by an intelligent control APP. In this embodiment, an intelligent control APP is used as an example for illustration. The electronic device can access the cloud server to obtain services through the user account logged in the smart control APP.

FIG. 3 is a schematic diagram of an application interface provided by an embodiment of the present application. As shown in (a) of FIG. 3 , the intelligent control APP on the electronic device can provide various scenarios in the scene discovery interface 30, as shown in the figure The warm home scene shown, the silent scene here and now, etc.; the user can click the corresponding scene card to view and edit the scene, for example, as shown in (a) and (b) in FIG. 3, the user clicks the warm scene in the scene discovery interface 30. The scene card 301 corresponding to the homecoming scene can open the scene details interface 40 of the warm home scene, where the scene content of the warm home scene can be viewed, and the scene content can be edited. As shown in (b) and (c) of FIG. 3 , after viewing or editing the scene content, the user can click the add to my scene control 401 to add the warm home scene to my scene for management.

It can be understood that the scene is not limited to be presented in the form of a card, it can also be presented in the form of an icon, a title or a menu item, etc., which can be selected as needed during the specific implementation, which is not particularly limited in this embodiment, for the convenience of description. , in the embodiment of the present application, the scene card is used as an example for illustrative description.

The content of the scene is mainly composed of a trigger condition (Trigger) and an execution action (Action). The trigger condition defines what conditions an execution process in the scene will be triggered for execution; The perceived operation steps, wherein a scenario may include one or more execution flows, and each execution flow may include a trigger condition and at least one execution action. For example, as shown in (b) in Figure 3, the trigger condition of the warm home scene is: "When the smart door lock is unlocked from 08:00-21:00 every day", the execution actions include: "Turn on the specified smart light", " Turn on the sleep mode of the air purifier", "The speaker broadcasts the owner, I miss you!", "The mobile phone is connected to the speaker to play the music application A-My Radio".

Among them, the execution action may be requesting Internet services through a cloud server, or requesting device information inquiry or issuing control instructions of the smart device; the execution action may also be invoking the capabilities of the local system, such as making a phone call or sending a message on the electronic device. SMS, etc.; the execution action may also be to control the smart device to execute the target function. That is, Internet service functions, functions on smart devices connected to cloud servers or electronic devices, and functions on electronic devices can all be mapped to perform actions. Among them, Internet services may include querying the weather, querying road conditions, querying logistics, querying sunrise or sunset time, etc.; functions on smart devices may include playing audio, setting the brightness and color of smart lights, turning on or off devices, etc.; on electronic devices The functions of the device can include connecting to a Bluetooth or wireless fidelity (Wi-Fi) network, opening an APP, making a phone call, sending a text message, pop-up notification messages or voice broadcasts, etc.

Each execution action has a corresponding execution device, and the execution device can be a cloud server, a smart device or an electronic device, that is, for a certain execution action, it may be executed on an electronic device, or may be executed on a cloud server or a smart device; To achieve richer functions, the functions of multiple execution devices can also be spliced and combined to form a combined execution action. The execution devices corresponding to the combined execution action include multiple execution devices, and there is an association relationship between the operations performed by each execution device, such as As shown in (b) of Figure 3, the mobile phone is connected to the speaker to play the music application A-My Radio, which includes the functions of two execution devices: the mobile phone is connected to the speaker and the speaker plays the music application A-My Radio in the mobile phone, in which , the relationship between the two functions is: after the mobile phone is connected to the speaker, the music application A-My Radio in the mobile phone can be played through the speaker.

Each execution action in an execution flow can be executed on the same device or on different devices. During specific execution, execution actions that are not executed on the electronic device can be routed by the electronic device to the corresponding device for execution. , that is, for a certain scenario, after satisfying the trigger conditions of the scenario, the electronic device can execute the relevant execution action locally, or request the cloud server to execute the relevant execution action, and can also control the smart device to execute the relevant execution action, or The cloud server controls the smart device to perform related execution actions.

In this embodiment, the scenarios may include manual scenarios and automatic scenarios. In the manual scenario, the user can actively trigger the process in the scenario through operations such as clicking or inputting voice commands, and the automatic scenario can automatically trigger the flow of the process according to the set trigger conditions. implement.

Referring to FIG. 4 , (a) in FIG. 4 is a schematic diagram of the scene content of the manual scene, and (b) in FIG. 4 is a schematic diagram of the scene content of the automatic scene. As shown in (a) of Figure 4, the execution process of the one-key lighting scene can be triggered when the user manually clicks the scene card corresponding to the scene, wherein the execution process includes: turning on the living room ceiling light, and setting its working mode to Leisure mode, and turn on the jellyfish light, set its working mode to daylight mode. As shown in (b) of Figure 4, the execution process of the easy driving scenario can be triggered when the mobile phone is connected to vehicle A during legal working days, wherein the execution process includes: "broadcast driving weather tips", "use map application" A broadcasts traffic navigation from location A to location B" and "Continue to play the last music".

For the convenience of users, a switch function can be provided for automatic scenes. For example, as shown in my scene interface 50 in FIG. 3 , the leaving home with peace of mind, driving with ease, and returning home with ease are all automatic scenes, and the three corresponding The scene cards all include a switch control 501 through which the user can turn on or off the automatic scene; the scene cards corresponding to the one-key lighting scene of the manual scene and the music party scene may not include the switch control 501 .

In order to further improve the convenience of the user, in this embodiment, the automatic scene can also be triggered manually. For example, as shown in (a) of FIG. 5 , the user can click the scene card of the easy driving scene in the My Scene interface, Trigger an easy driving scene. This is equivalent to integrating automatic scenes and manual scenes with high similarity into the same scene. Users can also complete scene discovery, scene arrangement and scene management at one time, instead of finding, arranging and managing multiple times, which can improve user usage. It is convenient and can improve the efficiency of scene editing to a certain extent.

In addition, as shown in Fig. 5, the execution state of the scene can be displayed in the scene card. As shown in (b) of Fig. 5, after the easy driving scene is manually triggered by the user, the corresponding scene card displays the scene's execution status. The execution status is "executing"; as shown in (d) and (e) of Figure 5, in the case that the scene is successfully executed, the scene card can display the execution status of the scene as "executed". If the scene execution fails, the scene card can display the execution status of the scene as "execution failed". For the convenience of the user, as shown in (b) in FIG. 5 , after the scene is triggered, a stop control 502 may be provided on the scene card, and the user can control the scene to stop execution by clicking on the control. Correspondingly, as shown in FIG. 5 As shown in (c), after the scene is terminated, the execution status of the scene can be displayed as "terminated" on the scene card. In addition, in the case of a scene execution failure, an alarm control 503 may also be displayed on the scene card, and the user may click on the control to view the reason for the execution failure.

Wherein, for a certain scenario, if at least one execution flow of the scenario is successfully executed, it can be considered that the execution of the scenario is successful; if all the execution flows of the scenario fail to be executed, it can be considered that the execution of the scenario has failed. For an execution flow, if all or part of the execution actions included in the execution flow are successfully executed, the execution flow can be considered to be executed successfully; if all the execution actions included in the execution flow fail to be executed, the execution flow can be regarded as failed to be executed. Certainly, when a part of the execution actions included in the execution flow fails to be executed, it may also be considered that the execution of the execution flow fails, which can be specifically defined as required, which is not particularly limited in this embodiment.

It can be understood that the execution state of the scene is not limited to be displayed on the scene card, but can also be displayed in the pull-down notification bar or other positions, and the specific display manner is not particularly limited in this embodiment. The execution state of the scene may also include other states, such as the execution action being executed. In addition, the user can also trigger the automatic scene by voice. It can be understood that the functions performed by various manual operations in this embodiment can be implemented by voice. This embodiment mainly describes the manual operation mode.

In this embodiment, after the automatic scene is manually triggered, the electronic device can judge the trigger condition of the automatic scene, and determine the execution result according to the judgment result. For the specific processing process, see FIG. A schematic diagram of an interaction process, as shown in Figure 6, the process may include the following steps:

S101. Receive a scene triggering operation of the automatic scene A by the user.

Specifically, the automatic scene A may be any automatic scene added by the user to my scene. As mentioned above, the user's trigger operation on the automatic scene A may be a user's click operation on the scene card corresponding to the automatic scene A, or a user's voice input operation, and the voice input operation is used to trigger the execution process of the automatic scene A.

S102 , in response to the scene triggering operation, determine whether the automatic scene A includes multiple triggering conditions, if so, go to step S103 , otherwise go to step S107 .

Specifically, each scenario may include one or more triggering conditions, and each triggering condition may correspond to a different execution flow. For example, the scene content of a certain scenario includes: execution flow 1 and execution flow 2, where execution flow 1 is: when it rains time (trigger condition 1), play music a (execute action 1); execution flow 2 is: when a typhoon blows (trigger condition 2), play music b (execute action 2).

After receiving the scene triggering operation of the automatic scene A by the user, the electronic device may judge the number of triggering conditions of the automatic scene A, so as to improve the accuracy of the execution result.

S103: Determine whether at least one trigger condition of the automatic scenario A is satisfied, if yes, go to step S104, otherwise go to step S105.

Specifically, if the automatic scene A includes multiple trigger conditions, the electronic device can determine which trigger condition is satisfied by the current situation. If a certain trigger condition is satisfied, the execution action corresponding to the trigger condition can be executed. The user selects the execution action corresponding to the trigger condition to be executed.

S104. Execute an execution action corresponding to a satisfied trigger condition.

Continuing to take the example in step S102 as an example, if trigger condition 1 is satisfied, that is, it is currently raining, execution action 1 can be performed: playing music a.

S105, reminding the user to select the execution action to be executed.

Specifically, the electronic device can remind the user to select the execution action corresponding to the trigger condition through a pop-up window and/or voice. Correspondingly, the user can select the execution action to be executed in the pop-up window, or select the desired execution action through a voice command. The execution action performed.

S106. Execute the execution action selected by the user.

S107: Determine whether the trigger condition of the automatic scenario A is satisfied, if yes, execute step S108; otherwise, execute step S109.

Specifically, if the automatic scene A includes only one trigger condition, the electronic device can judge whether the current situation satisfies the trigger condition, and if the trigger condition is met, the execution action corresponding to the trigger condition can be executed; if the trigger condition is not met, Then, the user can also choose whether to execute the execution action of the automatic scene A.

S108: Execute the execution action of the automatic scene A.

For example, for the scene "Mute here and now", when the user manually clicks the scene card corresponding to this scene, the current time and the current position of the user are exactly in the "here and now" of the trigger condition, and the electronic device will immediately execute Silent action.

S109 , reminding the user whether to execute the execution action of the automatic scene A.

Similar to step S105, the electronic device can remind the user to select whether to execute the execution action of the automatic scene A through a pop-up window and/or voice, and correspondingly, the user can select whether to execute the execution of the automatic scene A in the pop-up window or through a voice command. action.

S110: After receiving the user's determination operation, perform the execution action of the automatic scene A in response to the determination operation.

If the user determines to execute the execution action of the automatic scene A, the electronic device executes the execution action; if the user cancels the execution of the execution action of the automatic scene A, the electronic device may not execute the execution action.

In step S103 in the above process, when at least one trigger condition of the automatic scene A is not met, the user selects which execution action corresponding to the trigger condition to execute. It can be understood that when at least one trigger condition of the automatic scene A is not met, An execution action corresponding to a trigger condition may also be randomly selected for execution, and may be selected as required during specific implementation, which is not particularly limited in this embodiment.

In order to improve the simplicity, in this embodiment, after the automatic scene is triggered by the user, it is not necessary to judge whether the trigger condition is satisfied. For an automatic scene that includes only one trigger condition, the execution action of the automatic scene can be directly executed; The trigger condition includes a plurality of automatic scenarios, and the user may choose to execute the execution action corresponding to the trigger condition, or may randomly select an execution action corresponding to the trigger condition to execute.

In addition, for the convenience of users, a scene batch start function can also be provided. For example, a one-key start control (not shown) can be provided in the My Scene interface 50, and the user can trigger the control to start the management in the My Scene interface 50. All scenarios; of course, the smart control APP can also provide setting options for selecting which scenarios to start with one key, and the user can start all or some of the scenarios managed in the My Scenes interface 50 through the one-key start control.

It can be understood that the scene batch start function is not limited to the above implementation manner. For example, a one-key start control may not be provided, but is implemented through a predefined touch operation. The specific implementation manner is not particularly limited in this embodiment.

The following describes how to display the scene editing interface.

FIG. 7 is a schematic diagram of an application interface provided by an embodiment of the present application. As shown in (a) and (b) of FIG. 7 , in this embodiment, an editing control 504 may be provided on the scene card, and the user may click the control Open the scene editing interface 60 to edit the scene content. Alternatively, the user can also edit the scene content when opening the scene detail interface 40 shown in FIG. 3 .

It can be understood that the opening method of the scene editing interface 60 is not limited to clicking on the editing control 504, and other methods are also possible. Displays editing options, which the user can select to open the scene editing interface.

As shown in (b) in FIG. 7 , the scene editing interface 60 may include trigger conditions and execution items corresponding to each execution action, the execution items are used to represent the corresponding execution actions, and each execution item displays the corresponding execution action. Function description text, the user can understand the corresponding execution action through the execution item. Among them, the parameters (adjustable parameters for short) that can be adjusted related to the scene in the execution item can be interspersed in the function description text, and the adjustable parameters are displayed in the form of capsules in the figure (such as "Open", "Specify" in Figure 7 ). Parameters such as "smart lights", "air purifier A", etc.) can also be displayed in other forms during specific implementation, such as using a specific color to display adjustable parameters. Each execution item has a corresponding check box, and the user can select or deselect the corresponding execution item through the check box. When the execution item is selected, the execution action corresponding to the execution item will be executed after the scene is triggered; When the execution item is not selected, the execution action corresponding to the execution item will not be executed after the scene is triggered.

The user can click on the adjustable parameter to edit the execution item, and when the electronic device responds to the user's editing operation, the content of the execution item can be changed in a preset manner, such as shown in Figure 8, the user clicks "Open" (see Figure 8). (a)) in the execution item, change "Open" to "Close" (see (b) in Figure 8). The electronic device can also display a corresponding execution item editing interface, and the content of the execution item can be changed by the user's editing operation in the interface; wherein, the execution item editing interface can be an action editing interface corresponding to the action content, a device editing interface corresponding to the execution device, or The parameter editing interface corresponding to the parameter content.

For example, as shown in (a) and (b) of FIG. 9 , after the user clicks the sleep mode, the parameter editing interface 70 corresponding to the working mode of the air purifier A is opened, and the operation of the air purifier A is edited in the parameter editing interface 70 model. In order to facilitate the user to understand the adjustable parameters currently being edited, the open execution item editing interface can be displayed in the form of a floating window, and the user can move the floating window to view the scene editing interface 60 located below the floating window; the scene editing interface 60 is in the editing state The adjustable parameters of can also be highlighted. For example, as shown in (b) of FIG. 9 , the “sleep mode” in the scene editing interface 60 is highlighted by means of shading.

For another example, as shown in FIG. 10 , after the user clicks on “air purifier A”, the device editing interface 80 corresponding to the air purifier is opened. In the device editing interface 80 , the user can select air purifier A and air purifier B. at least one device.

Among them, the metadata information of each parameter in the device editing interface can be pre-defined, and the metadata information can include parameter name, optionality, default value, type (such as list type or input type, etc.), validity rules (such as specifying parameter value) The maximum value, minimum value, string length or no specified limit) and parameter value determination period (for example, before or during editing by the user) and so on. The trigger condition is similar to the execution item, and adjustable parameters (such as "08:00-21:00 every day" and "unlock" parameters in Figure 7) can also be embedded in the description text. The specific implementation of the adjustable parameters is related to the execution item. similar.

FIG. 11 is a schematic diagram of constituent elements of an execution item provided by an embodiment of the present application. As shown in FIG. 11 , an execution item may generally include a plurality of the following elements: action content a, execution device b, and parameter content c, wherein the action content Indicates the specific action of the executing device, the parameter content can indicate the functional parameters of the executing device, and the executing device indicates the device that executes the action. Both the action content and the parameter content belong to the execution content of the executing device. In order to improve readability and facilitate the user's understanding, the parameter content c in the execution item may generally be located after the action content a and the execution device b. The action content a can be located before the execution device b or after the execution device b. The sequence between the action content a, the execution device b, and the parameter content c may be: action content a→execution device b→parameter content c, such as the execution item "turn on the air purifier sleep mode" and the execution item shown in FIG. 11 . "Turn off smart light A, smart light B"; the sequence between action content a, execution device b and parameter content c can also be: execution device b→action content a→parameter content c, for example: as shown in Figure 11 Execute the item "Speaker Play Music Application A-My Radio". Among them, the action content a, the execution device b, and the parameter content c can all be used as adjustable parameters.

In this embodiment, the developer can predefine the execution instructions in the execution process, and when the user opens the scene editing interface (including the aforementioned scene details interface) for the first time, the electronic device can display execution items according to the execution instructions in the execution process. In order to improve the efficiency of scene editing and generate more reasonable execution items, in this embodiment, when running the target execution instruction, the electronic device can display execution items of different styles according to different execution item types, which can also improve development efficiency. , the target execution instruction can be a device set control instruction that can support controlling multiple smart devices or other object set control instructions that can support controlling multiple objects (such as applications); the execution item types of the target execution instruction are different, the corresponding execution item The display rules are different, and the execution items can show different styles when displayed. For ease of understanding, execution items of different styles are used to represent execution items of different display rules. For ease of understanding, the following uses device set control instructions for exemplary description.

FIG. 12 is a schematic diagram of some display styles of the execution items provided by the embodiment of the present application. As shown in FIG. 12 , when defining a device set control instruction, the developer can determine the execution item type (for example, the detailed parameter adjustment class and Quick parameter adjustment class), the electronic device displays the execution items according to the smart device owned by the user, which will be described below with reference to the example in FIG. 12 .

Assumption: User A owns Air Purifier A and Air Purifier B; User B owns Air Purifier C.

Example 1: The developer determines that the execution item type is the detailed parameter adjustment class, and the device set control command is:

Open [Air Purifier# Complete Works] [Specify Function Parameters]

Then the style of the execution item displayed in the scene editing interface on the electronic device held by user A may be:

Turn on the air purifier A to specify the function parameters

Turn on air purifier B to specify function parameters

Then the style of the execution item displayed in the scene editing interface on the electronic device held by user B may be:

Turn on the air purifier C to specify the function parameters

That is, for the detailed parameter adjustment class, if the device set corresponding to the device set control instruction includes several execution devices, several execution items are displayed accordingly; for each execution device, the corresponding execution item displays the specified function for adjusting the execution device. The parameter's tunable (herein referred to as the specified tunable).

Among them, the functional parameters specifically displayed by the air purifier A and the air purifier B may be the same or similar parameters as the specified functional parameters. For example, as shown in FIG. 12, the specified functional parameter of the air purifier A is the sleep mode, and the air The specified function parameter of device B is low noise mode. The functional parameters of air purifier C are displayed in a similar manner to air purifier A and air purifier B.

Example 2: The developer determines that the execution item type is the quick parameter adjustment class, and the device set control command is:

Open [Air Purifier# Complete Works] [Specify Function Parameters]

a. If air purifier A and air purifier B have the same specified function parameters, the style of the execution item displayed in the scene editing interface on the electronic device held by user A can be:

Turn on air purifier A and air purifier B to specify function parameters

Wherein, the functional parameters specifically displayed by the air purifier A and the air purifier B may be the same specified functional parameters. For example, as shown in FIG. 12 , the same specified functional parameters of the air purifier A and the air purifier B are: Low wind mode.

b. If air purifier A and air purifier B do not have the same functional parameters, the adjustable parameters related to the functional parameters of the execution device may not be displayed when the execution item is displayed. Correspondingly, the scene editing interface on the electronic device held by user A may not be displayed. The styles for the execution items shown in can be:

Turn on Air Purifier A, Air Purifier B

User B has only one air purifier, and the display does not involve the existence of the same or similar functional parameters. The style of the execution items displayed in the scene editing interface on the electronic device held by user B can be:

Turn on the air purifier C to specify the function parameters

That is, for the quick parameter adjustment class, the device set control command displays an execution item corresponding to each execution device corresponding to the device set control command. When the device set corresponding to the device set control command includes multiple execution devices, if each execution device If there are the same specified function parameters between devices, the adjustable parameters used to adjust the same function parameters are displayed in the execution item; otherwise, the adjustable parameters used to adjust the specified function parameters (that is, the specified adjustable parameters) are not displayed in the execution item. ). When the device set corresponding to the device set control instruction includes only one execution device, the specified tunable parameter is displayed in the execution item.

It should be noted that when the device set corresponding to the device set control instruction includes multiple execution devices, if there are similar specified function parameters among the execution devices, the adjustable parameters for adjusting the similar function parameters can also be displayed in the execution item. parameter, for the convenience of description, in this embodiment, the case where the same specified function parameter exists between each execution device is used as an example for illustration.

Example 3: For the quick parameter adjustment class, the developer can also define that the functional parameters of the execution device are not adjustable when defining the control command of the device set, and can not display the adjustable parameters related to the functional parameters of the execution device when displaying the execution item. For example, the device set control instruction is:

Open【Air Purifier#Complete Collection】

Turn on Air Purifier A, Air Purifier B

The style of the execution item displayed in the scene editing interface on the electronic device held by user B may be:

Turn on the air purifier C

That is, for the quick parameter adjustment class, when the function parameter of the execution device is not adjustable in the device set control instruction, the specified adjustable parameter used to adjust the specified function parameter is also not displayed in the execution item.

Wherein, the action instruction, execution device and execution content in the above execution item can all be adjustable parameters. When the execution item of the execution item includes multiple execution devices, the execution device included in the execution item can be adjusted through the adjustable parameter corresponding to the execution item. . It can be understood that, the content of the above-mentioned device set control instruction is only an example to reflect its function, and it is not intended to limit the present application.

Based on the above display manner, the electronic device can use the method shown in FIG. 13 to display the execution item corresponding to the device set control instruction in the execution flow. FIG. 13 is a schematic diagram of an execution item display process provided by an embodiment of the present application. As shown in FIG. 13 , the process may include the following steps:

S201. Receive a user's editing trigger operation on the scene.

Specifically, as mentioned above, the editing trigger operation may be the user's click operation on the editing control 504 shown in (a) in FIG. click action.

S202. For each device set control instruction, determine the execution item type of the equipment set control instruction. If the execution item type is a detailed parameter adjustment class, execute step S203; if the execution item type is a quick parameter adjustment class, execute step S204 .

After receiving the user's editing trigger operation on the scene, the electronic device can respond to the operation, and can determine the execution item type for each device set control instruction.

Specifically, the execution item type of the device set control instruction can be determined according to the scene name, that is, the execution item type of each device set control instruction in the same scene can be the same; in order to improve flexibility, the corresponding type can also be set for the device set control instruction in advance. When the scene editing interface is displayed, the execution item type of the equipment set control instruction can be judged according to the type identifier corresponding to the equipment set control instruction, that is, the execution item types of each equipment set control instruction in the same scene can also be different.

It can be understood that the detailed parameter adjustment class and the quick parameter adjustment class are only used to indicate different display modes of execution items, and they can also be other names, such as the first type and the second type. In addition, you can also define more as needed. type, which is not particularly limited in this embodiment.

S203. Display a plurality of execution items vertically, the execution items are in one-to-one correspondence with the execution equipment, and the execution items include specified adjustable parameters.

If the execution item type of the device set control instruction is the detailed parameter adjustment class, multiple execution items can be displayed vertically as shown in Example 1 above, wherein the execution items are in one-to-one correspondence with the execution devices, and the execution items include parameters for adjusting the parameters. The adjustable parameters of the specified function parameters of the execution device (that is, the specified adjustable parameters), and the specified function parameters may be some kind of function parameters of the smart device, such as the working mode of the air purifier, the brightness of the smart lamp, etc.

Among them, the electronic device can query the device information such as the device identification and functional parameters of the execution device corresponding to the device set control instruction through the cloud server, that is, the cloud server can manage the smart device associated with the user account logged in the electronic device, and the electronic device can The set control instruction and the logged-in user account are sent to the cloud server, and the cloud server queries the device information of the corresponding execution device according to the device set control instruction and the user account, and returns it to the electronic device. In order to improve the query efficiency, the electronic device can also locally manage the smart device associated with the user account. When querying, the electronic device can locally query the device identification of the corresponding execution device according to the device set control instruction, and then can send the device identification To the cloud server, after the cloud server queries the device information of the corresponding execution device according to the device identifier, it returns to the electronic device.

S204: Determine whether the function parameter of the execution device corresponding to the device set control instruction is adjustable, and if so, execute step S205; otherwise, execute step S207.

If the execution item type of the device set control instruction is the quick parameter adjustment class, the electronic device can first determine whether the functional parameters of the execution device corresponding to the device set control instruction are adjustable. Taking the device set control instruction shown in the above example as an example, if If the specified function parameters are indicated in the equipment set control instruction, it can be considered that the function parameters of the execution equipment corresponding to the equipment set control instruction are adjustable; if the specified function parameters are not indicated in the equipment set control instruction, it can be considered that the execution equipment corresponding to the equipment set control instruction The function parameters are not adjustable. Of course, it is also possible to judge whether the functional parameters of the execution device corresponding to the control instruction of the device set are adjustable in other ways. Examples are not particularly limited.

S205: Determine whether the execution devices corresponding to the device set control instruction have the same specified function parameters, and if so, execute step S206; otherwise, execute step S207.

If the function parameters of the execution device corresponding to the device set control instruction are adjustable, it can be determined whether the same function parameters exist among the execution devices, and if so, the corresponding adjustable parameters can be displayed in the execution item.

S206. Display an execution item, where the execution item includes adjustable parameters corresponding to the same function parameters.

As shown in item b1 in Figure 12, assuming that air purifier A and air purifier B have the same working mode: low wind mode, air purifier A and air purifier B can be displayed in one execution item, and Display the corresponding adjustable parameter "low wind mode". It can be understood that when there are multiple identical specified function parameters, one function parameter can be selected as the preset parameter value of the adjustable parameter for display. After the user clicks the adjustable parameter, he can view and select other same parameters Function parameter.

S207. Display an execution item, and the execution item does not include the specified adjustable parameter.

If the functional parameters of the execution device corresponding to the device set control instruction are not adjustable, or the execution device corresponding to the device set control instruction does not have the same specified function parameters, each execution device can be displayed in one execution item, but the specified parameters are not displayed. Adjust parameters.

In order to improve processing efficiency, after receiving the user's editing trigger operation on the scene, for each target device set control command, the electronic device can first determine the number of devices corresponding to the target device set control command. In the case of only one device number , you can directly judge whether the function parameters of the execution device corresponding to the control instruction of the device set are adjustable. If it is adjustable, an execution item can be displayed, and the specified adjustable parameters are displayed in the execution item; if it is not adjustable, an execution item is also displayed. , but the specified tunable parameter is not displayed in the execution item.

In addition, in order to improve the display efficiency, after the user opens the scene editing interface for the first time, the electronic device can save the interface description information, and when the user triggers the scene editing interface again, the scene editing interface can be displayed according to the saved interface description information; Accuracy, the scene editing interface can be updated when the execution device corresponding to the execution instruction changes. For example, if user A associates a new air purifier D on the electronic device, the air purifier D can be added to the execution item to display .

In order to improve the flexibility of interface display and improve user experience, in this embodiment, different device set attributes can be defined in advance for the execution items of the device set control instruction, and the electronic device can display different execution items according to the defined device set attributes. style.

FIG. 14 is a schematic diagram of other display styles of the execution items provided by this embodiment of the present application. As shown in FIG. 14 , when defining a device set control instruction, a developer can determine a device set attribute (for example, an empty set, a complete set shown in the figure) and specified set), the electronic device displays the execution items according to the smart device owned by the user, which will be described below with reference to the example in FIG. 14 .

Example of an empty set: A developer-defined device set control instruction can be:

Open [Air Purifier #empty set]

If user A has air purifier A and air purifier B, the style of the execution item displayed in the scene editing interface on the electronic device held by user A can be:

Turn on the designated air purifier

User B owns air purifier C, then the style of the execution item displayed in the scene editing interface on the electronic device held by user B can be:

Turn on the air purifier C

That is, when the device set corresponding to the device set control instruction includes multiple execution devices, the tunable parameters corresponding to the device set can be displayed in an empty set style (herein referred to as empty set tunable parameters). Set parameter value (ie preset execution device), the user can select from the device set corresponding to the device set control instruction when editing the tunable parameter of the empty set. In order to facilitate the user's understanding, the empty set adjustable parameters can include prompt information, and can be highlighted, such as the bold display prompt information shown in Figure 14: specify an air purifier, the bold display prompt information shown in Figure 3 : Specify the smart light. Of course, it is not limited to this highlighting method. For example, it can also be highlighted by a specific color; the prompt information can also be other content.

When the device set corresponding to the device set control instruction includes only one execution device, and the user has no other choice, the execution device can be directly displayed in the execution item. For example, as shown in FIG. The preset parameter value of the adjustable parameter is set to the device name of the execution device corresponding to the device set control instruction.

Complete set example: The device set control command defined by the developer can be:

Open【Air Purifier#Complete Collection】

Turn on Air Purifier A, Air Purifier B

Turn on the air purifier C

That is, for the complete set, the adjustable parameters corresponding to the device set in the execution item include the names of all execution devices in the device set corresponding to the device set control instruction.

Specified Set Example: A developer-defined device set control directive can be:

Turn on [# all lights in the room with the most lights]

All the lights in the room with the largest number of lights of user A include smart light A, smart light B and smart light C, then the style of the execution item displayed in the scene editing interface on the electronic device held by user A can be:

Turn on smart light A, smart light B, smart light C

That is, for a specified set, each execution device corresponding to the specified set can be listed directly in an execution item.

Based on the above display manner, the electronic device can use the method shown in FIG. 15 to display the execution item corresponding to the device set control instruction in the execution flow. FIG. 15 is a schematic diagram of another execution item display flow diagram provided by an embodiment of the present application. As shown in FIG. 15 , after receiving an editing trigger operation on a scene from a user, the electronic device can perform a device set control instruction for each device set control instruction. Attribute judgment. If the device set attribute of the device set control instruction is an empty set, it can be judged whether the number of execution devices included in the device set corresponding to the device set control instruction is one or more. If the number of devices is multiple, then An empty set of tunable parameters containing prompt information can be displayed in the execution item; if the number of devices is one, the device name of the execution device can be displayed in the execution item. If the device set attribute of the device set control instruction is the complete set, the device names of all executing devices corresponding to the device set control instruction can be displayed in the execution item; if the device set attribute of the device set control instruction is the specified set, it can be displayed in the execution item The device name of the execution device corresponding to the specified set is displayed in the execution item.

The device set attribute can be determined according to the content of the device set control instruction. For example, in the device set control instruction in the above example, the content of the instruction indicates an empty set, a complete set or a specified set. The number of executing devices included in the device set corresponding to the device set control instruction can be determined by using the corresponding executing device determination method in FIG. 13 , and details are not repeated here.

For the device set control instructions corresponding to the complete set and the specified set, different execution item types can be defined as shown in FIG. 12 , and different execution item styles are correspondingly displayed when displayed. In this embodiment, the display manner of the trigger condition is similar to the display manner of the execution item, and details are not described herein again.

In the interaction method provided by this embodiment, the function description text of the execution item corresponding to the trigger condition and the execution action is displayed in the scene editing interface, and one or more adjustable parameters related to the execution action of the scene can be interspersed in the function description text, so that It is convenient for users to adjust different parameters of the execution device through different adjustable parameters, thereby shortening the parameter setting path; moreover, the adjustable parameters are related to the scene, that is, some parameters that are not related to the scene are filtered out when the adjustable parameters are displayed, so that the Simplifies the parameter editing interface; in addition, in this embodiment, multiple execution devices with the same or similar functional parameters can be controlled through one execution item, so that the user can edit multiple execution devices at the same time, so this embodiment provides The technical solution can improve the scene editing efficiency. In addition, in this embodiment, the execution items in the scene editing interface can combine the functions of multiple execution devices, so that more diverse device control functions can be implemented.

Based on the same inventive concept, as an implementation of the above method, the embodiment of the present application provides an interactive device, which corresponds to the foregoing method embodiment. For ease of reading, the present device embodiment does not refer to the foregoing method embodiment. The details of the method are described one by one, but it should be clear that the apparatus in this embodiment can correspondingly implement all the contents in the foregoing method embodiments.

FIG. 16 is a schematic structural diagram of an interaction apparatus provided by an embodiment of the present application. As shown in FIG. 16 , the apparatus provided by this embodiment includes a display module 210 , an input module 220 , a processing module 230 , and a communication module 240 .

Among them, the display module 210 is used to support the mobile terminal to perform the interface display operations in the above-mentioned embodiments and/or other processes for the techniques described herein. The display unit may be a touch screen or other hardware or a combination of hardware and software.

The input module 220 is used to receive the user's input on the display interface of the mobile terminal, such as touch input, voice input, gesture input, etc. The input module is used to support the terminal to perform S101 and S110 in the above embodiment and receive the user-determined operation. steps, S201 and/or other processes for the techniques described herein. The input module can be a touch screen or other hardware or a combination of hardware and software.

The processing module 230 is used to support the mobile terminal to perform S102-S110, S202-S207 in the above-described embodiments, the processing operations in FIG. 12, and/or other processes for the techniques described herein.

The communication module 240 is used to support the mobile terminal to perform the operations related to the communication process between the cloud server and the smart device in the above-described embodiments and/or other processes for the techniques described herein.

The apparatus provided in this embodiment may execute the foregoing method embodiments, and the implementation principles and technical effects thereof are similar, and details are not described herein again.

Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. Module completion, that is, dividing the internal structure of the device into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment may be integrated in one processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit, and the above-mentioned integrated units may adopt hardware. It can also be realized in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing from each other, and are not used to limit the protection scope of the present application. For the specific working processes of the units and modules in the above-mentioned system, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

Based on the same inventive concept, an embodiment of the present application further provides an electronic device. Please refer to FIG. 17 , which is a schematic structural diagram of the electronic device provided by the embodiment of the present application.

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195 and so on. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that, the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (sraphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

The controller may be the nerve center and command center of the electronic device 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193 and the like through different I2C bus interfaces. For example, the processor 110 may couple the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate with each other through the I2C bus interface, so as to realize the touch function of the electronic device 100 .

The I2S interface can be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 . In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through a Bluetooth headset.

The PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160 . For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . MIPI interfaces include camera serial interface (CSI), display serial interface (DSI), etc. In some embodiments, the processor 110 communicates with the camera 193 through a CSI interface, so as to realize the photographing function of the electronic device 100 . The processor 110 communicates with the display screen 194 through the DSI interface to implement the display function of the electronic device 100 .

The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface may be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices.

It can be understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The charging management module 140 is used to receive charging input from the charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from the wired charger through the USB interface 130 . In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 charges the battery 142 , it can also supply power to the electronic device through the power management module 141 .

The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives input from the battery 142 and/or the charging management module 140 and supplies power to the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 . The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be provided in the processor 110 . In other embodiments, the power management module 141 and the charging management module 140 may also be provided in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .

The modem processor may include a modulator and a demodulator. Wherein, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and passed to the application processor. The application processor outputs sound signals through audio devices (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or videos through the display screen 194 . In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 110, and may be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR). The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .

In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Synchronous Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN , NFC, FM, and/or IR technology, etc. The GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GNSS), Beidou navigation satellite system (beidou navigation satellite system, BDS), quasi-zenith satellite system (quasi satellite system) -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).

The electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Mini LED, Micro LED, quantum dot light emitting diode (quantum dot light emitting diodes, QLED) and so on. In some embodiments, the electronic device 100 may include one or N display screens 194 , where N is a positive integer greater than one.

The electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process the data fed back by the camera 193 . For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193 .

Camera 193 is used to capture still images or video. The object is projected through the lens to generate an optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.

A digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy and so on.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos of various encoding formats, such as: Moving Picture Experts Group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.

The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process the input information, and can continuously learn by itself. Applications such as intelligent cognition of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing the instructions stored in the internal memory 121 . The internal memory 121 may include a storage program area and a storage data area. The storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 100 and the like. In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.

The audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .

Speaker 170A, also referred to as a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music through the speaker 170A, or listen to a hands-free call.

The receiver 170B, also referred to as "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or a voice message, the voice can be answered by placing the receiver 170B close to the human ear.

The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C through a human mouth, and input the sound signal into the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The earphone jack 170D is used to connect wired earphones. The earphone interface 170D can be the USB interface 130, or can be a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.

The pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be provided on the display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, and the like. The capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the motion attitude of the electronic device 100 . In some embodiments, the angular velocity of electronic device 100 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the shaking angle of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse motion to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenarios.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can detect the opening and closing of the flip holster using the magnetic sensor 180D. In some embodiments, when the electronic device 100 is a flip machine, the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Further, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, characteristics such as automatic unlocking of the flip cover are set.

The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.

Distance sensor 180F for measuring distance. The electronic device 100 can measure the distance through infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. The electronic device 100 emits infrared light to the outside through the light emitting diode. Electronic device 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100 . When insufficient reflected light is detected, the electronic device 100 may determine that there is no object near the electronic device 100 . The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. Proximity light sensor 180G can also be used in holster mode, pocket mode automatically unlocks and locks the screen.

The ambient light sensor 180L is used to sense ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket, so as to prevent accidental touch.

The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking pictures with fingerprints, answering incoming calls with fingerprints, and the like.

The temperature sensor 180J is used to detect the temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 caused by the low temperature. In some other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 , which is different from the location where the display screen 194 is located.

The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the pulse of the human body and receive the blood pressure beating signal. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone, combined with the bone conduction earphone. The audio module 170 can analyze the voice signal based on the vibration signal of the vocal vibration bone block obtained by the bone conduction sensor 180M, so as to realize the voice function. The application processor can analyze the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M, and realize the function of heart rate detection.

The keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. It can also be a touch key. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .

Motor 191 can generate vibrating cues. The motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. The motor 191 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 194 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be contacted and separated from the electronic device 100 by inserting into the SIM card interface 195 or pulling out from the SIM card interface 195 . The electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card and so on. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication. In some embodiments, the electronic device 100 employs an eSIM, ie: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .

The electronic device provided in this embodiment can execute the foregoing method embodiments, and the implementation principles and technical effects thereof are similar, and details are not described herein again.

Embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method described in the foregoing method embodiment is implemented.

The embodiments of the present application further provide a computer program product, when the computer program product runs on the electronic device, the electronic device implements the method described in the above method embodiments when executed.

An embodiment of the present application further provides a chip system, including a processor, where the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement the method described in the above method embodiments. Wherein, the chip system may be a single chip or a chip module composed of multiple chips.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted over a computer-readable storage medium. The computer instructions can be sent from one website site, computer, server or data center to another website site, computer, server or data center for transmission. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that includes an integration of one or more available media. The usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, or a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a Solid State Disk (SSD)), and the like.

Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented. The process can be completed by instructing the relevant hardware by a computer program, and the program can be stored in a computer-readable storage medium. When the program is executed , which may include the processes of the foregoing method embodiments. The aforementioned storage medium may include: ROM or random storage memory RAM, magnetic disks or optical disks and other mediums that can store program codes.

In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

In the embodiments provided in this application, it should be understood that the disclosed apparatus/device and method may be implemented in other manners. For example, the apparatus/equipment embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or Components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

It is to be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described feature, integer, step, operation, element and/or component, but does not exclude one or more other The presence or addition of features, integers, steps, operations, elements, components and/or sets thereof.

It will also be understood that, as used in this specification and the appended claims, the term "and/or" refers to and including any and all possible combinations of one or more of the associated listed items.

As used in the specification of this application and the appended claims, the term "if" may be contextually interpreted as "when" or "once" or "in response to determining" or "in response to detecting ". Similarly, the phrases "if it is determined" or "if the [described condition or event] is detected" may be interpreted, depending on the context, to mean "once it is determined" or "in response to the determination" or "once the [described condition or event] is detected. ]" or "in response to detection of the [described condition or event]".

In addition, in the description of the specification of the present application and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the description, and should not be construed as indicating or implying relative importance.

References in this specification to "one embodiment" or "some embodiments" and the like mean that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically emphasized otherwise. The terms "including", "including", "having" and their variants mean "including but not limited to" unless specifically emphasized otherwise.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features thereof can be equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present application. Scope.

Claims

An interaction method, applied to an electronic device, is characterized in that, comprising:

displaying an editing interface, the editing interface includes a trigger condition and a first execution item, and the first execution item includes a first external device and a first execution content;

In response to the first operation on the first execution item, changing the first execution item to a second execution item, where the second execution item includes a second external device and a second execution content;

Wherein, the second external device is different from the first external device, and/or the first execution content is different from the second execution content.
The method according to claim 1, wherein changing the first execution item to the second execution item comprises:

receiving a second operation on the first external device;

in response to the second operation, displaying a plurality of external devices;

receiving a third operation to select the second external device from the plurality of external devices;

In response to the second operation, the first external device is changed to the second external device.
The method according to claim 1 or 2, wherein changing the first execution item to the second execution item comprises:

receiving a fourth operation on the first execution content;

In response to the fourth operation, displaying a plurality of execution contents;

receiving a fifth operation of selecting the second execution content from the plurality of action instructions;

In response to the fifth operation, the first execution content is changed to the second execution content.
The method according to claim 2 or 3, wherein the plurality of external devices are external devices that satisfy preset device parameters.
The method according to any one of claims 1-4, wherein the method further comprises:

An execution flow is generated according to the second execution item and the trigger condition, and the execution flow includes execution actions corresponding to the trigger condition and the second execution item, and the execution actions are used to control the second external device to execute all Describe the second execution content;

The performing action is performed in response to satisfying the triggering condition.
The method according to any one of claims 1-5, wherein the method further comprises:

Generate a control according to the second execution item and the trigger condition;

display the control;

In response to the sixth operation on the control, the second external device is controlled to execute the second execution content.
An interactive device, applied to electronic equipment, is characterized in that, comprising:

a display module, configured to display an editing interface, the editing interface includes a trigger condition and a first execution item, and the first execution item includes a first external device and a first execution content;

a processing module, configured to, in response to a first operation on the first execution item, change the first execution item to a second execution item, where the second execution item includes a second external device and a second execution content;

Wherein, the second external device is different from the first external device, and/or the first execution content is different from the second execution content.
The device according to claim 7, wherein the device further comprises: an input module;

The input module is used for: receiving a second operation on the first external device;

The display module is further configured to: display a plurality of external devices in response to the second operation;

The input module is further configured to: receive a third operation of selecting the second external device from the plurality of external devices;

The processing module is further configured to: in response to the second operation, change the first external device to the second external device.
The device according to claim 7 or 8, wherein the device further comprises: an input module;

The input module is used for: receiving a fourth operation on the first execution content;

The display module is further configured to: display a plurality of execution contents in response to the fourth operation;

The input module is further configured to: receive a fifth operation of selecting the second execution content from the plurality of action instructions;

The processing module is further configured to: in response to the fifth operation, change the first execution content to the second execution content.
The apparatus according to claim 8 or 9, wherein the plurality of external devices are external devices that satisfy preset device parameters.
The device according to any one of claims 7-10, wherein the processing module is further configured to:

An execution flow is generated according to the second execution item and the trigger condition, and the execution flow includes execution actions corresponding to the trigger condition and the second execution item, and the execution actions are used to control the second external device to execute all Describe the second execution content;

The performing action is performed in response to satisfying the triggering condition.
The device according to any one of claims 7-11, characterized in that,

The processing module is further configured to: generate a control according to the second execution item and the trigger condition;

The display module is further used for: displaying the control;

The processing module is further configured to: control the second external device to execute the second execution content in response to a sixth operation on the control.
An electronic device, characterized in that it comprises: a memory and a processor, where the memory is used to store a computer program; the processor is used to execute the method according to any one of claims 1-6 when the computer program is invoked method.
A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the method according to any one of claims 1-6 is implemented.
A computer program product, when the computer program product is run on an electronic device, causes the electronic device to perform the method of any one of claims 1-6.
A chip system, characterized in that the chip system includes a processor, the processor is coupled with a memory, and the processor executes a computer program stored in the memory, so as to realize the method according to any one of claims 1-6 Methods.