WO2023221995A1 - Intelligent device control method and electronic device - Google Patents

Intelligent device control method and electronic device Download PDF

Info

Publication number
WO2023221995A1
WO2023221995A1 PCT/CN2023/094602 CN2023094602W WO2023221995A1 WO 2023221995 A1 WO2023221995 A1 WO 2023221995A1 CN 2023094602 W CN2023094602 W CN 2023094602W WO 2023221995 A1 WO2023221995 A1 WO 2023221995A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
target
intention
control
user
Prior art date
Application number
PCT/CN2023/094602
Other languages
French (fr)
Chinese (zh)
Inventor
曾立
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023221995A1 publication Critical patent/WO2023221995A1/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS], computer integrated manufacturing [CIM]
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • This application relates to the field of terminal technology, and in particular to intelligent device control methods and electronic devices.
  • embodiments of the present application provide an intelligent device control method and electronic device.
  • the technical solution provided by the embodiments of this application can edit scenes at the granularity of intent without setting multiple devices corresponding to the intent one by one. It can reduce the complexity of scene editing and improve the efficiency of device control.
  • an intelligent device control method is provided, which is applied to a first electronic device or a component (such as a chip system) that supports the first electronic device to implement related functions.
  • the method includes: displaying a first interface, the first interface including identification of one or more intentions; at least one intention among the one or more intentions corresponding to a plurality of electronic devices; in response to the user selecting from the one or more intentions The operation of selecting a target intention is to add the target intention to a target scene; when the triggering conditions of the target scene are met, control one or more target electronic devices to execute the target intention.
  • the one or more target electronic devices are electronic devices corresponding to the target intention.
  • the smart panel displays an interface 404 (the first interface).
  • the interface 404 includes identification of multiple intentions (such as the intention cards “Lights Fully On” and “Lights Fully Off” in area 404a , "Combined light (brightness 60%)”).
  • the smart panel adds the target intention to the viewing mode scene. (i.e. target scenario).
  • the smart panel controls one or more target electronic devices to execute the target intention.
  • the target electronic device includes a second electronic device and a third electronic device, and controlling one or more target electronic devices to execute the target intention includes:
  • the smart panel sends the first control instruction to the light 1 corresponding to the combined light intention, and sends the second control instruction to the light 2 corresponding to the combined light intention.
  • Light 1 and Lamp 2 jointly performs the combined lamp intent (brightness 60%), and the total brightness of lamp 1 and lamp 2 is 60%.
  • the target intention includes a first target intention and a second target intention;
  • the target electronic device includes a second electronic device and a third electronic device;
  • Controlling one or more target electronic devices to perform the target intent includes:
  • the viewing mode scene includes a combined light intention (first target intention) and a temperature intention (second target intention).
  • the smart panel sends a first control instruction to the lamp (second electronic device) in the living room.
  • the first control instruction is used to control the lamp in the living room to turn on and adjust the brightness to 60%.
  • the smart panel also sends a second control instruction to, for example, the air conditioner (third electronic device) in the living room.
  • the second control instruction is used to control the air conditioner to perform the temperature adjustment intention.
  • the first interface also includes identification of multiple spaces in the whole house; the first space and the second space of the plurality of spaces; the identification of the first space is selected; the one The or multiple intentions include intentions that are executable by the electronic device in the first space.
  • the interface 404 may also include identification of multiple spaces in the whole house (such as the whole house, the living room (an example of the first space), and the dining room (an example of the second space)). logo). Among them, the logo of the living room is selected (for example, filled with black and displayed).
  • the plurality of intentions contained in area 404a of interface 404 include intentions that are executable by electronic devices in the living room.
  • the method further includes:
  • the smart panel receives the user's operation on the logo of the restaurant and displays the interface 1101 (ie, the second interface).
  • the interface 1101 includes the logo of the intention that can be executed by the electronic device in the restaurant.
  • the identity of the second space is selected; the one or more intentions are multiple intentions, and the multiple intentions also include intentions that are executable by electronic devices in the second space.
  • the logo of the restaurant and the logo of the living room are both selected.
  • the multiple intentions of the area 404a of the interface 1203 include: intentions that can be executed by the electronic devices in the restaurant and intentions that can be executed by the electronic devices in the living room. Intentions (like Humidity’s Intention Cards (mid-range)).
  • Wuxi can edit and set up multiple devices one by one. .
  • the identification of the intention executable by the electronic device in the first space and the identification of the intention executable by the electronic device in the second space have different user interface UI effects.
  • the identification of intentions executable by electronic devices in the restaurant and the identification of intentions executable by electronic devices in the living room have different user interface UI effects.
  • the user can clearly identify the intentions belonging to different spaces, so that the user can quickly select the required intention in the required space and add the required intention to the target scene, which improves the efficiency of scene editing.
  • control parameter corresponding to the target intention is the first control parameter
  • the method further includes: receiving a second operation of user input;
  • the second control parameter input by the user through the first control is received, so that the control parameter corresponding to the target intention is adjusted to the second control parameter.
  • the target intention is a combination light intention
  • the initial brightness (first control parameter) corresponding to the combination light intention is 30%
  • the smart panel receives the user's operation of long pressing the combination light intention card 404k (Second operation).
  • the smart panel displays a brightness adjustment bar 404m (first control).
  • the smart panel receives the latest brightness (second control parameter) input by the user through the brightness adjustment bar 404m, so that the brightness corresponding to the combination lamp intention is adjusted to the latest brightness (for example, 60%).
  • the user can adjust the control parameters corresponding to the target intention in the target scene, which can meet the user's device control needs and improve the flexibility of device control.
  • the one or more intentions belong to one or more subsystems.
  • the one or more intentions may correspond to the lighting subsystem, heating and cooling fresh air subsystem, sunshade subsystem, etc.
  • the one or more intentions include all lights on, all lights off, and combination lights on (brightness parameter is 60%)
  • the corresponding subsystem is the lighting subsystem.
  • the one or more intentions include fully on lights, fully off lights, turning on combination lights (brightness parameter is 60%)
  • constant temperature intention, constant humidity intention the corresponding subsystems are lighting subsystem and heating and cooling fresh air subsystem.
  • an intelligent device control method applied to a first electronic device, and the method includes:
  • a fourth interface is displayed, the fourth interface includes the target intention and an identification of one or more electronic devices in the first group, the first A group is associated with the user information; the one or more electronic devices are used to execute the target intent, and the one or more electronic devices include the target electronic device;
  • the target electronic device is instructed to execute the target intention, and the user information includes any one or more of the following information: the user's location, the user's behavior, and the current time.
  • the smart panel displays an interface 1603 (the third interface), and the interface 1603 includes identification of multiple intentions.
  • the smart panel can jump to the interface 1607 (the fourth interface) corresponding to the music playback intention as shown in Figure 16B.
  • the interface 1607 includes the music playback intention. (target intent) and the identification of one or more electronic devices in the living room group (such as the identification of speaker 1 and the identification of speaker 2).
  • the living room group is determined based on user information.
  • the smart panel receives the user's feedback on the target electricity in the living room group.
  • the smart panel instructs the speaker 1 to perform the music playback intention.
  • the target electronic device group that the user wants to control can be determined based on the user information, and then the identification of the target electronic device group and the identification of each electronic device in the target electronic device group can be displayed, so that the user can browse the target electronic device
  • the identification of each electronic device in the device group makes it easy to quickly find the target electronic device you want to control, and then control the target electronic device, which helps improve the efficiency of device control.
  • receiving the user's operation on the identification of the target electronic device includes:
  • the fourth interface further includes an identification of a second group, and the second group includes other electronic devices that can execute the target intention.
  • the interface 1607 not only includes the identification of the electronic devices in the living room (the first group), but also includes the identification of the second group such as the master bedroom, the secondary bedroom, and the study room. In this way, it is convenient for users to find and understand the equipment status of each space in the whole house.
  • the distance between the identifier of the second group and the identifier of the target intention is greater than the distance between the identifier of the first group and the identifier of the target intention.
  • the distance between the logo of the second group such as the study and the logo of the central intention (music playing intention 163) is greater than the distance between the logo of the living room (ie the first group) and the logo of the central intention.
  • the distance between the logo of the living room and the logo of the central intention is close, it is conducive to quickly operating the logo of the electronic device in the living room, so as to control the corresponding electronic device.
  • the fourth interface further includes a third control parameter of the target electronic device, and the third control parameter is determined based on the user information.
  • the interface 1601 also includes third control parameters such as recommended brightness and recommended color temperature.
  • the method further includes:
  • the fourth control parameter corresponding to the target electronic device input by the user is received, so that the control parameter of the target electronic device is adjusted to the fourth control parameter.
  • the smart panel can also receive a color temperature (such as 5500K) input by the user. Subsequently, the smart panel can control the lights in the study to turn on and adjust the color temperature to 5500K.
  • the one or more intentions belong to one or more subsystems.
  • lighting subsystem audio and video subsystem.
  • an intelligent device control method including:
  • the first electronic device displays a first interface, the first interface includes identification of multiple intentions; at least one intention among the one or more intentions corresponds to multiple electronic devices;
  • the first electronic device adds the target intention to the target scene in response to the user's operation of selecting a target intention from the one or more intentions;
  • the first electronic device When the trigger condition of the target scene is met, the first electronic device sends a control instruction to one or more target electronic devices, where the one or more target electronic devices are electronic devices corresponding to the target intention;
  • the target electronic device receives the control instruction from the first electronic device and executes the target intention according to the control instruction.
  • the target electronic device includes a second electronic device and a third electronic device
  • the first electronic device sends a control instruction to one or more target electronic devices, including: sending a first control instruction to the second electronic device, and sending a second control instruction to the third electronic device, so that the The second electronic device and the third electronic device jointly execute the target intention;
  • the target electronic device receives the control instruction from the first electronic device and executes the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device. the first control instruction, and execute the target intention according to the first control instruction; the third electronic device is configured to receive the second control instruction from the first electronic device, and execute the target intention according to the second The control instructions execute the target intent.
  • the target intention includes a first target intention and a second target intention;
  • the target electronic device includes a second electronic device and a third electronic device;
  • the first electronic device sends control instructions to one or more target electronic devices, including:
  • the target electronic device receives the control instruction from the first electronic device and executes the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device. the first control instruction, and indicating the first target intention according to the first control instruction; the third electronic device is configured to receive the second control instruction from the first electronic device, and according to the The second control instruction executes the second target intention.
  • the first interface also includes identification of multiple spaces in the whole house; the first space and the second space of the plurality of spaces; the identification of the first space is selected; the one The or multiple intentions include intentions that are executable by the electronic device in the first space.
  • the method further includes: the first electronic device receiving the user's operation on the identification of the second space and displaying a second interface, the second interface including the second Identification of the intent executable by electronic devices in space.
  • the identity of the second space is selected; the one or more intentions are multiple intentions, and the multiple intentions also include intentions that are executable by electronic devices in the second space.
  • the identification of the intention executable by the electronic device in the first space and the identification of the intention executable by the electronic device in the second space have different user interface UI effects.
  • control parameter corresponding to the target intention is the first control parameter
  • the method further includes: the first electronic device receiving a second operation input by the user; in response to the second operation, displaying a first control, the first control being used to input a second control corresponding to the target intention.
  • Parameter receiving the second control parameter input by the user through the first control, so that the control parameter corresponding to the target intention is adjusted to the second control parameter.
  • the one or more intentions belong to one or more subsystems.
  • an intelligent device control method including:
  • the first electronic device displays a third interface, the third interface includes identification of one or more intentions, and at least one intention among the one or more intentions corresponds to multiple electronic devices;
  • the first electronic device displays a fourth interface in response to the user's operation of selecting a target intention from the one or more intentions, the fourth interface including the target intention and an identification of one or more electronic devices in the first group,
  • the first group is associated with the user information; the one or more electronic devices are used to execute the target intention, and the one or more electronic devices include a target electronic device;
  • the first electronic device receives a user's operation on the identification of the target electronic device
  • the first electronic device sends a control instruction to the target electronic device.
  • the control instruction is used to instruct the target electronic device to execute the target intention.
  • the user information includes any one or more of the following: Information: the user's location, the user's behavior, and the current time.
  • the target electronic device receives the control instruction from the first electronic device and executes the target intention according to the control instruction.
  • receiving the user's operation on the identification of the target electronic device includes:
  • the fourth interface further includes an identification of a second group, and the second group includes other electronic devices that can execute the target intention.
  • the distance between the identifier of the second group and the identifier of the target intention is greater than the distance between the identifier of the first group and the identifier of the target intention.
  • the fourth interface further includes a third control parameter of the target electronic device, and the third control parameter is determined based on the user information.
  • the method further includes:
  • the fourth control parameter corresponding to the target electronic device input by the user is received, so that the control parameter of the target electronic device is adjusted to the fourth control parameter.
  • an intelligent equipment control system including:
  • a first electronic device configured to display a first interface, where the first interface includes identification of one or more intentions; at least one of the one or more intentions corresponds to multiple electronic devices;
  • the first electronic device is further configured to send a control instruction to one or more target electronic devices when the trigger condition of the target scene is met, wherein the one or more target electronic devices correspond to the target intention.
  • electronic equipment
  • the target electronic device is configured to receive the control instruction from the first electronic device and execute the target intention according to the control instruction.
  • the target electronic device includes a second electronic device and a third electronic device
  • the first electronic device is used to send a control instruction to one or more target electronic devices, including: sending a first control instruction to the second electronic device, and sending a second control instruction to the third electronic device, to causing the second electronic device and the third electronic device to jointly execute the target intention;
  • the target electronic device is configured to receive the control instruction from the first electronic device and execute the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device.
  • the device receives the first control instruction and executes the target intention according to the first control instruction; the third electronic device is used to receive the second control instruction from the first electronic device and execute the target intention according to the first control instruction.
  • the second control instruction executes the Goal intention.
  • the target intention includes a first target intention and a second target intention;
  • the target electronic device includes a second electronic device and a third electronic device;
  • the first electronic device is used to send control instructions to one or more target electronic devices, including:
  • the target electronic device is configured to receive the control instruction from the first electronic device and execute the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device.
  • the device receives the first control instruction and indicates the first target intention according to the first control instruction; the third electronic device is used to receive the second control instruction from the first electronic device, and The second target intention is executed according to the second control instruction.
  • the first interface also includes identification of multiple spaces in the whole house; the first space and the second space of the plurality of spaces; the identification of the first space is selected; the one The or multiple intentions include intentions that are executable by the electronic device in the first space.
  • the first electronic device is also used for:
  • the identity of the second space is selected; the one or more intentions are multiple intentions, and the multiple intentions also include intentions that are executable by electronic devices in the second space.
  • the identification of the intention executable by the electronic device in the first space and the identification of the intention executable by the electronic device in the second space have different user interface UI effects.
  • control parameter corresponding to the target intention is the first control parameter
  • the first electronic device is also used to perform the following operations:
  • the second control parameter input by the user through the first control is received, so that the control parameter corresponding to the target intention is adjusted to the second control parameter.
  • the one or more intentions belong to one or more subsystems.
  • an intelligent equipment control system including:
  • a first electronic device configured to display a third interface, where the third interface includes identification of one or more intentions, at least one of the one or more intentions corresponding to multiple electronic devices;
  • the first electronic device is further configured to, in response to the user's operation of selecting a target intention from the one or more intentions, display a fourth interface, the fourth interface including the target intention and one or more electronic devices in the first group.
  • the identification of the device, the first group is associated with the user information; the one or more electronic devices are used to execute the target intention, and the one or more electronic devices include the target electronic device;
  • the first electronic device is also configured to receive a user's operation on the identification of the target electronic device
  • the first electronic device is further configured to send a control instruction to the target electronic device in response to the operation.
  • the control instruction is used to instruct the target electronic device to execute the target intention.
  • the user information includes any of the following: Item or multiple pieces of information: the user's location, the user's behavior, and the current time.
  • the target electronic device is configured to receive a control instruction from the first electronic device and execute the target intention according to the control instruction.
  • receiving the user's operation on the identification of the target electronic device includes:
  • the fourth interface further includes an identification of a second group, and the second group includes other electronic devices that can execute the target intention.
  • the distance between the identifier of the second group and the identifier of the target intention is greater than the distance between the identifier of the first group and the identifier of the target intention.
  • the fourth interface further includes a third control parameter of the target electronic device, and the third control parameter is determined based on the user information.
  • the first electronic device is also used for:
  • the fourth control parameter corresponding to the target electronic device input by the user is received, so that the control parameter of the target electronic device is adjusted to the fourth control parameter.
  • the one or more intentions belong to one or more subsystems.
  • embodiments of the present application provide an electronic device that has the function of implementing the smart device control method described in any of the above aspects and any of the possible implementations.
  • This function can be implemented by hardware, or can be implemented by hardware and corresponding software.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • a computer-readable storage medium stores a computer program (which may also be referred to as instructions or codes).
  • the computer program When the computer program is executed by an electronic device, it causes the electronic device to perform any aspect or the method of any implementation in any aspect.
  • embodiments of the present application provide a computer program product, which when the computer program product is run on an electronic device, causes the electronic device to execute any aspect or the method of any implementation in any aspect.
  • inventions of the present application provide a circuit system.
  • the circuit system includes a processing circuit, and the processing circuit is configured to perform any aspect or the method of any implementation in any aspect.
  • embodiments of the present application provide a chip system, including at least one processor and at least one interface circuit.
  • the at least one interface circuit is used to perform transceiver functions and send instructions to at least one processor.
  • the processor executes instructions
  • at least one processor executes any aspect or a method of any implementation in any aspect.
  • Figure 1 is a schematic diagram of a scene editing method in related technologies
  • FIG. 2 is a schematic diagram of the system architecture provided by the embodiment of this application.
  • Figure 3A is a schematic diagram of a whole-house division subsystem provided by an embodiment of the present application.
  • Figure 3B is a schematic diagram of the subsystems and atomic capabilities corresponding to the leaving home scenario provided by the embodiment of the present application;
  • Figure 4 is a schematic diagram of the hardware structure of the first electronic device provided by an embodiment of the present application.
  • Figure 5 is a schematic diagram of the software structure of the first electronic device provided by the embodiment of the present application.
  • FIG. 6 is a schematic diagram of the system architecture provided by the embodiment of this application.
  • Figures 7-9 are schematic interface diagrams provided by embodiments of the present application.
  • Figure 10 is a schematic diagram of the correlation of scenarios, equipment, and subsystems provided by the embodiment of this application;
  • Figure 11 is a schematic diagram 10 of the interface provided by the embodiment of the present application.
  • Figure 12A is a schematic diagram of the interface provided by the embodiment of the present application.
  • Figure 12B is a schematic diagram of the interface provided by the embodiment of the present application.
  • Figure 12C is a schematic diagram of the interface provided by the embodiment of the present application.
  • Figure 13 is a schematic diagram of a movie viewing mode scene provided by an embodiment of the present application.
  • FIGS 14 and 15 are schematic interface diagrams provided by embodiments of the present application.
  • Figure 16A is a schematic diagram of the interface provided by the embodiment of the present application.
  • Figure 16B is a schematic diagram of the interface provided by the embodiment of the present application.
  • FIGS 17-22 are schematic interface diagrams provided by embodiments of the present application.
  • Figure 23 is a schematic structural diagram of a first electronic device provided by an embodiment of the present application.
  • Smart home equipment is intelligent equipment, including audio and video equipment (such as large screen equipment, Bluetooth speakers, etc.), lighting equipment (such as ceiling lamps, table lamps, spotlights, etc.), environmental Environmental control equipment (such as air conditioners, air purifiers, etc.), anti-theft alarm equipment (such as human body sensors, cameras, etc.), etc.
  • the air conditioner can receive control commands sent by the user through the mobile phone.
  • the air conditioner receives the "turn on" command input by the user through the mobile phone and can be started automatically.
  • the air conditioner receives the command "Adjust the temperature to 26°C" input by the user through the mobile phone, and can automatically adjust the temperature to 26°C.
  • a smart home application (such as a smart life application) is installed in the electronic device (such as a mobile phone).
  • the electronic device can be paired with the smart home device through the smart home application to manage and control the smart home device.
  • the electronic device needs to establish a connection with the smart home device in advance and configure the smart home device.
  • a smart life application is installed in the mobile phone
  • the smart life application is launched on the mobile phone, and the scene interface 201 shown in (a) in Figure 1 is displayed.
  • the interface 202 shown in (b) in Figure 1 is displayed.
  • the mobile phone receives the user's operation to create the scene, such as receiving the user's addition of conditions for controlling smart home devices and tasks that need to be performed by the smart home device. Task operation.
  • the user can click the add condition control 26 and add a condition for controlling the smart home device, such as adding a trigger condition "when the scene card is clicked" as shown in (f) of Figure 1 .
  • the mobile phone detects that the user clicks on the scene card of the scene, it can control the smart home device to perform the corresponding task.
  • the interface 203 shown in (c) of Figure 1 is displayed.
  • the mobile phone detects the user's click on the smart device control 23 it determines that the user needs to add a task to control the smart device, and displays the interface 204 shown in (d) of Figure 1.
  • the interface 204 includes controllable smart devices.
  • the mobile phone can jump to the interface 205 shown in (e) of Figure 1.
  • Interface 205 includes information that controls executable operations.
  • the mobile phone can jump to the interface 206 shown in (f) of Figure 1.
  • the interface 206 includes the control 24. After detecting the user's click on the control 24, the mobile phone can jump to the interface 203 shown in (c) of Figure 1. After that, the user can click the "smart device” option 23, and the mobile phone can jump to the interface 204 shown in (d) of Figure 1, and select other devices as the devices that need to be controlled in the scene to be created.
  • FIG. 2 is a schematic diagram of an intelligent device control system to which this method is applicable.
  • the smart device control system can manage and control smart devices on a home basis.
  • a family can also be called a whole house, and the whole house can be divided into different spaces.
  • the whole house includes the entrance hallway, kitchen, dining room, living room, balcony, master bedroom, secondary bedroom, bathroom, etc.
  • the whole-house system may include a first electronic device 100 that may be used to control a second electronic device 200 (such as an Internet of things (IoT) device).
  • the first electronic device 100 includes but is not limited to a mobile phone, a PC, a tablet computer, a smart home control panel (which may be referred to as a smart panel), etc.
  • the first electronic device 100 may be equipped with a device for controlling the second electronic device. 200 applications.
  • the application can be a system pre-installed application or a non-pre-installed application (such as an application downloaded from the application market).
  • the system pre-installed application includes a part of the system application (such as a service, component, or plug-in in the system application), or an independent application pre-installed in the first electronic device 100 .
  • independent applications have independent application icons.
  • the application may be a smart life application.
  • the first electronic device 100 can also control the second electronic device 200 through the control center.
  • the control center may be a shortcut control page displayed by the first electronic device 100 in response to the user's sliding operation from the upper right corner or top of the screen.
  • the first electronic device 100 can also control the second electronic device 200 through the corresponding function menu on the negative screen.
  • the negative screen may be the system service capability entry page displayed by the first electronic device 100 in response to the user's right swipe operation on the leftmost main interface.
  • the embodiments of the present application do not limit the specific manner in which the first electronic device 100 controls the second electronic device 200 .
  • a second electronic device 200 (for example, an IoT device) is also provided throughout the house.
  • the second electronic device 200 may also be called a controlled device, and the second electronic device 200 may be controlled by the first electronic device 100 .
  • the kitchen is equipped with rice cookers or electric pressure cookers, gas equipment, etc.;
  • the living room is equipped with speakers (such as smart speakers), TVs (such as smart TVs, also called smart screens, large screens, etc.), routing equipment, etc.
  • the second electronic device 200 includes but is not limited to a smart TV, a smart speaker, a smart TV, and a body fat scale.
  • Lamps such as ceiling lamps, smart desk lamps, aromatherapy lamps, etc.
  • sweeping robots smart clothes drying racks, smart rice cookers, air purifiers, humidifiers, desktop computers, routing equipment, smart sockets, water dispensers, smart refrigerators, smart air conditioners, smart Smart home devices such as switches and smart door locks.
  • the second electronic device 200 may not be a smart home device, but may be other types of devices, such as a personal computer (PC), tablet, mobile phone, smart remote control, etc.
  • PC personal computer
  • tablet mobile phone
  • smart remote control etc.
  • the embodiment of the present application does not limit the specific form of the second electronic device 200.
  • a certain device among the second electronic devices 200 may serve as a master device for controlling other second electronic devices 200 .
  • second electronic devices 200 there are many types of second electronic devices 200, and subsystems can be divided according to the functions of the second electronic device 200, such as lighting subsystems, environment subsystems, security subsystems, etc.
  • Each subsystem can correspond to one or more intents.
  • Each subsystem includes one or more devices.
  • intent is used to express user expectations, which may include, for example: turning on/off lights, playing music, turning off purification, turning on purification, fully opening curtains, fully opening curtains, constant temperature, constant humidity, etc.
  • the lighting subsystem includes various types of lights (including but not limited to ambient lights), and the corresponding intentions of the lighting subsystem may include: fully on lights, fully off lights, and turning on combination lights (brightness parameter is 60%).
  • the heating and cooling fresh air subsystem includes various types of equipment that can adjust temperature and humidity.
  • the corresponding purposes of the cooling and heating fresh air subsystem include: constant temperature purpose, constant humidity purpose, constant purification purpose, etc.
  • the sunshade subsystem includes various devices that can achieve sunshade.
  • the intentions that the sunshade subsystem can achieve include: fully opening the curtains and fully closing the curtains.
  • each intention can be implemented by one or more devices, or that each intention corresponds to one or more devices.
  • Each device can implement one or more intents.
  • the intention to adjust the light can be represented by lamps and/or Or curtain implementation.
  • curtains they can not only adjust light, but also achieve sunshade and sun protection.
  • the first electronic device 100 can instruct the second electronic device 200 to execute the user's intention.
  • multiple devices in one or more subsystems can be freely combined and integrated into a hyper terminal.
  • Each device can become a functional module for each other, realizing mutual assistance and resource sharing.
  • the system may also include a central device 300.
  • the central device 300 is also called a hub, a central control system, a host, etc.
  • the central device 300 can be used to divide the equipment in the whole house into multiple subsystems, abstract the capabilities of the devices in the subsystems according to the subsystem granularity, and form the atomic capabilities of the subsystems.
  • the atomic capabilities can adapt to different type device.
  • the hub device 300 can also generate a configuration file of the subsystem according to the atomic capabilities of the subsystem.
  • Figure 3A shows the subsystems included in the whole house, including but not limited to the following subsystems: security, lighting, network, heating and cooling fresh air, audio and video entertainment, furniture, water use, energy consumption, home appliances, and sunshade.
  • the atomic capabilities of different subsystems need to be called to meet the user's device control needs.
  • the security subsystem, lighting subsystem, and heating and cooling fresh air subsystem need to be called in the leaving home scenario.
  • the central device 300 abstracts the capabilities of each device in the lighting subsystem (including but not limited to the living room lamp, floor lamp, and curtain shown in Figure 3B) to form one or more atomic capabilities of the lighting subsystem (such as lighting mode, switch control, precise dimming, etc.).
  • Table 1 below shows a possible example of a configuration file for a lighting subsystem. From Table 1, the lighting subsystem can be abstracted into atomic capabilities such as lighting mode, switch control, and precise dimming.
  • the subsystem configuration file also includes the identification of the devices included in the subsystem.
  • the atomic capabilities of a subsystem may be obtained by abstracting the capabilities of some devices in the subsystem, or may be obtained by abstracting the capabilities of all devices in the subsystem.
  • An atomic capability of a subsystem corresponds to one or more devices in the subsystem.
  • the atomic capability of ambient light can be realized by multiple smart lights, that is, multiple smart lights can be used to jointly create light and shadow effects with a specific atmosphere.
  • the atomic ability of adjusting brightness can be realized by multiple smart lamps. Among them, the brightness of smart lamp A is adjusted to brightness A, the brightness of smart lamp B is adjusted to brightness B, the brightness of smart lamp C is adjusted to brightness C, and the brightness of smart lamp C is adjusted to brightness C. A, C, and B jointly create a light and shadow scene whose brightness is the target brightness.
  • one intention can correspond to one or more atomic capabilities
  • one atomic capability can also correspond to one or more intentions.
  • the embodiments of this application do not limit the specific correspondence between intentions and atomic capabilities.
  • intentions can include: turning on/off lights, music playing, constant temperature, constant humidity, purification off, curtains fully open, curtains fully closed, etc.
  • the intention to turn on the light may correspond to the sleep light, reading light, ambient light, partition lighting, and full light shown in Table 1.
  • Atomic abilities such as on, main light, etc.
  • the first electronic device 100 can use the executable intentions of the subsystems as the granularity of scene arrangement or editing, instead of using the device as the granularity of scene arrangement. .
  • an intention can be executed by multiple smart home devices. Therefore, in some cases, the user performs one scene orchestration based on intent granularity, which is equivalent to performing multiple scene orchestrations based on device granularity, which greatly It simplifies the user's scene arrangement operations and improves the efficiency of scene arrangement. Or, in other designs, users can add multiple intents to the scene to be created, each of which can be executed by one or more smart home devices.
  • the atomic capabilities of a subsystem can be updated on a periodic or preset basis.
  • the lighting subsystem includes reading lights, wall and door light strips, ceiling light strips, etc. Later, if the reading light is damaged and it is detected that the reading light is not online for a long time, the relevant atomic capabilities of the reading light can be removed from the lighting subsystem and the configuration file of the lighting subsystem can be updated.
  • the central device of each room or each area or the central device of the whole house can exist alone, or can be integrated with the second electronic device or the first electronic device into one device, or it can be a device in other forms. This application does not limit this.
  • the system may also include a server.
  • the server can be used to maintain subsystem configuration files.
  • the system also includes a routing device (such as a router).
  • a routing device such as a router. Routing equipment is used to connect to a local area network or the Internet, using a specific protocol to select and set the path for sending signals.
  • the second electronic device 200 is connected to the router and transmits data with devices in the local area network or devices in the Internet through the Wi-Fi channel established by the router.
  • the hub device 300 can be integrated with the routing device into one device.
  • the hub device 300 and the routing device are integrated into the routing device, that is, the routing device has the function of the hub device 300 .
  • the routing device can be one or more routing devices among the sub-master routing devices, or it can be an independent routing device.
  • the above content is only an example of a system to which the device control method is applicable.
  • the system may also include more or less devices, or different device layout locations, etc.
  • the first electronic device 100, the second electronic device 200, the server, and the central device 300 in the embodiment of the present application can be implemented by different devices.
  • the server and central device in the embodiment of the present application can be implemented by the device in Figure 4.
  • Figure 4 shows a schematic diagram of the hardware structure of the device provided by the embodiment of the present application.
  • the device includes at least one processor 501, communication line 502, memory 503 and at least one communication interface 504.
  • the memory 503 may also be included in the processor 501.
  • the structures illustrated in the embodiments of the present application do not constitute specific limitations on the electronic equipment.
  • the electronic device may include more or less components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently.
  • the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 501 can be a general central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more processors used to control the execution of the program of the present application. integrated circuit.
  • CPU central processing unit
  • ASIC application-specific integrated circuit
  • Communication line 502 may include a path that carries information between the above-mentioned components.
  • the communication interface may be a module, Circuits, buses, interfaces, transceivers, or other devices that enable communication functions and are used to communicate with other devices.
  • the transceiver can be an independently configured transmitter, which can be used to send information to other devices.
  • the transceiver can also be an independently configured receiver, which can be used to receive information from other devices. The device receives the information.
  • the transceiver may also be a component that integrates the functions of sending and receiving information. The embodiments of this application do not limit the specific implementation of the transceiver.
  • the memory 503 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (random access memory (RAM)) or other type that can store information and instructions.
  • a dynamic storage device can also be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be used by a computer Any other medium for access, but not limited to this.
  • the memory may exist independently and be connected to the processor through the communication line 502 . Memory can also be integrated with the processor.
  • the memory 503 is used to store computer execution instructions for implementing the solution of the present application, and is controlled by the processor 501 for execution.
  • the processor 501 is used to execute computer execution instructions stored in the memory 503, thereby implementing the methods provided by the following embodiments of the application.
  • the computer execution instructions in the embodiments of the present application may also be called application codes, instructions, computer programs or other names, which are not specifically limited in the embodiments of the present application.
  • the processor 501 may include one or more CPUs, such as CPU0 and CPU1 in FIG. 4 .
  • the electronic device may include multiple processors, such as the processor 501 and the processor 507 in FIG. 4 .
  • processors may be a single-CPU processor or a multi-CPU processor.
  • a processor here may refer to one or more devices, circuits, and/or processing cores for processing data (eg, computer program instructions).
  • the structure illustrated in Figure 4 does not constitute a specific limitation on the electronic device.
  • the electronic device may include more or less components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently.
  • the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
  • the device shown in Figure 4 may be a general device or a special device, and the embodiment of this application does not limit the type of device.
  • the device is a smart panel, which is a dedicated device used to control smart home devices.
  • the device is a mobile phone, which is a general device that can control smart home devices.
  • the software system of the electronic device may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiment of the present invention uses a layered architecture
  • the system is taken as an example to illustrate the software structure of the electronic device.
  • FIG. 5 is a software structure block diagram of the first electronic device 100 according to an embodiment of the present invention.
  • the layered architecture divides the software into several layers, and each layer has clear roles and division of labor.
  • the layers communicate through software interfaces.
  • the Android system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime (Android runtime) and system libraries, and kernel layer.
  • the application layer can include a series of applications.
  • applications can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
  • the application program also includes smart home management applications and basic services.
  • basic services open the management capabilities of smart devices to the system.
  • the smart home management application can call the basic service to query the smart home device to be controlled, and/or call the basic service to control the smart home device.
  • the smart home management application can be a smart life application.
  • Smart home applications can also be other applications with similar functions.
  • the smart home management application may be an original system application or a third-party application.
  • the embodiments of this application do not limit the types of smart home management applications.
  • smart life applications are mainly used as examples.
  • the application framework layer provides an application programming interface (API) and programming framework for applications in the application layer.
  • API application programming interface
  • the application framework layer includes some predefined functions.
  • the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
  • a window manager is used to manage window programs.
  • the window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • Content providers are used to store and retrieve data and make this data accessible to applications. Said data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
  • the view system includes visual controls, such as controls that display text, controls that display pictures, etc.
  • a view system can be used to build applications.
  • the display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the phone manager is used to provide communication functions of the first electronic device 100 . For example, call status management (including connected, hung up, etc.).
  • the resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, etc.
  • the notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a prompt sound is emitted, the terminal vibrates, and the indicator light flashes, etc.
  • Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.
  • the core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android.
  • the application layer and application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and application framework layer into binary files.
  • the virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.
  • System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing.
  • 2D Graphics Engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
  • the first electronic device 100 includes smart life applications and smart life basic services (such as HiLinkSVC).
  • Smart life applications provide a smart user interface (UI) for the whole house.
  • UI smart user interface
  • smart life applications call basic smart life services through the interface provided by software tool development kits (such as HiLink Kit SDK (software development kit)), so that various UIs can be presented through smart life applications.
  • the UI includes a UI for intent management or a UI for scene management, etc.
  • the UI may include an interface in the form of a card.
  • the smart life application can provide interface 402 as shown in Figure 7 and so on. Users can control smart home devices through the interface provided by the smart life application.
  • the smart life basic service can store the configuration files of each subsystem.
  • the configuration file of the subsystem can be obtained from the first server.
  • Smart life basic services can include the following modules:
  • the intent management module is used to manage the intent of the subsystem according to the configuration file of the subsystem.
  • the user can combine certain intentions to form a new intention.
  • users can combine lights, curtains, fresh air equipment and other intentions to generate a new "comfortable environment" intention.
  • the device control parameters corresponding to the intention can be adjusted.
  • intents may be deleted or added.
  • new intentions such as birthday party, warm homecoming, whole-house dehumidification, and whole-house ventilation can be generated.
  • the hub device 300 includes a device list management module, a blacklist management module, a fine-tuning data management module, and a batch management module.
  • the device list management module is used to obtain any one or more of the following information: the subsystem list under Home/Region/Room, the configuration file of each subsystem, and the instantiation in each subsystem A list of devices and a list of intentions that each subsystem can implement.
  • the blacklist management module is used to add/delete/modify/query blacklist devices in each subsystem.
  • the combination light can be one or more lights.
  • the batch management module is used to divide the equipment in the whole house into multiple subsystems and abstract the capabilities of the subsystems to obtain one or more atomic capabilities that the subsystems can implement.
  • the hub device 300 stores a list of all devices, a list of blacklisted devices, and intended fine-tuning parameters.
  • the hub device 300 may obtain the device list, the list of blacklisted devices, and the intended fine-tuning parameters from the server.
  • each electronic device may include more or fewer modules than shown in the figure, or combine certain modules, or split certain modules, or have different module layouts.
  • the illustrated modules may be implemented in hardware, software, or a combination of software and hardware.
  • a smart device control panel which may be referred to as a smart panel
  • the application for managing smart home devices as a smart life application as an example.
  • the electronic device after the electronic device is connected to the local area network, it can discover other electronic devices that are connected to the same local area network and/or logged in to the same account. For example, a user registers for a smart life application and obtains the username and password of the account. During the subsequent network configuration process of new electronic equipment, users can log in to the account through other electronic devices that have been configured to the network (such as mobile phones) to assist in the network configuration of the new electronic equipment. Then, the server divides the electronic devices under the same account into the same home to implement home-based electronic device management. Optionally, the server manages one or more homes, which include one or more subsystems. Each subsystem includes one or more electronic devices.
  • the smart panel After logging in to the smart life application, the smart panel detects the user's operation of adding an electronic device and sends the device information of the newly added electronic device to the server.
  • the server determines the electronic device ID and sends the electronic device to the server.
  • the device is divided into the home corresponding to the current login account of the smart panel to complete the network configuration of the electronic device.
  • the smart panel sends the device information of the newly added electronic device to the server, and the server determines the electronic device ID and divides the electronic device into the home corresponding to the smart panel.
  • the user can edit the scene through the electronic device.
  • the first electronic device displays an interface 401, and the interface 401 includes scene options 401a.
  • the electronic device can jump to interface 402 as shown in (b) of Figure 7 .
  • the interface 402 includes cards corresponding to the whole house and cards corresponding to each space in the whole house (such as the card 402a corresponding to the living room).
  • the card corresponding to each space also includes controls for setting the corresponding space scene. Taking the card 402a corresponding to the living room as an example, the card 402a is provided with a control 402b for setting the living room scene.
  • the same intention may correspond to different presentation forms, for example, it may be displayed in different forms of intention cards in the interface.
  • the intention to turn on the light as an example, as a possible implementation method, for the intention to turn on the light, in some situations (such as some fine lighting scenes or ambient lighting scenes) or in certain spaces, the user adds the intention to turn on the light to the target scene. , it may be that you want to turn on all the lights in a certain space in the target scene, then the smart panel displays the intention to turn on the lights with the "all lights on" intention card.
  • the smart panel can display the intention of specific lights in the whole house space.
  • Cards for example, can display specific intention cards such as wall and door light strips, ceiling light strips, etc.
  • the smart panel displays the intention to turn on the lights in the restaurant in the form of a "lights fully on” intention card. Users can add the "lights on” intent to the meal scene. In this way, later, when the trigger conditions of the meal scene are met, the smart panel can control the lights in the restaurant to be fully turned on to meet the user's lighting needs in the meal scene.
  • the smart panel displays the "ceiling light strip" intention card.
  • the smart panel can also display intent cards for other lights in the living room. Users can add intent cards for multiple lights in the living room to the target scene. Subsequently, when the trigger conditions of the target scene are met, the smart panel can To control multiple lights in the living room to turn on.
  • the electronic device can jump to the interface 403 shown in (c) of Figure 7.
  • the interface 403 includes one or more scenes corresponding to the living room. For example, entering the living room scene, leaving the living room scene, reading scene, party mode scene.
  • interface 403 also includes scene creation controls 403a.
  • the electronic device may provide an interface through which the user can input information such as the name of the scene to be created, the trigger condition to be created, and so on.
  • the electronic device can jump to interface 404 as shown in (d) of Figure 7 , and the user can edit the scene to be created through interface 404.
  • the trigger condition for the movie viewing mode scene to be created is: the user clicks on the card.
  • the scene editing function when providing the scene editing function to the user, the scene editing function can be provided to the user at the granularity of intention.
  • the user It is no longer necessary to select the devices that need to be controlled in the scene to be created one by one. Instead, you can select the intention, and the system will accurately calculate the best device or devices to complete the intention.
  • the interface 404 includes an area 404a and an area 404b.
  • Area 404b may be called a scene editing area.
  • Area 404a may be called an intention display area, and area 404a includes identification of one or more intentions corresponding to multiple subsystems.
  • Each intent can be implemented by one or more devices.
  • the identifier of the intention can be presented in the form of a card, and the card used to express the intention can be called an intention card.
  • the smart panel can query the configuration files of each subsystem and determine the atomic capabilities of each subsystem and the corresponding intentions of each atomic capability based on the configuration files. For example, the smart panel can query the configuration file of the lighting subsystem shown in Table 1, and based on the configuration file, determine the atomic capabilities of the lighting subsystem and the intentions corresponding to each atomic capability, and can display the corresponding intentions of the lighting subsystem.
  • the following intention cards are presented in the area 404a of the interface 404: the lights corresponding to the lighting subsystem are fully on, the lights are fully off, and the combination light is on (brightness parameter is 60%); the heating and cooling fresh air subsystem corresponds to The constant temperature, constant humidity and purification are turned off; the curtains corresponding to the sunshade subsystem are fully open and the curtains are fully closed.
  • the electronic device may add the intention card selected by the user to the scene to be created. For example, as shown in (d) of Figure 7, in response to the user's operation of dragging the temperature adjustment card 404d from the area 404a to the area 404b, the electronic device adds the temperature adjustment card to the scene to be created, that is, the intention of temperature adjustment is added to the scene to be created. Create a scene.
  • the user's operation of dragging the temperature adjustment card 404d from the area 404a to the area 404b can also be the user's click operation on the temperature adjustment card 404d, which is not limited in this application.
  • the electronic device in response to the user's operation of dragging the combined light (brightness 60%) card and the curtain full closing card from area 404a to area 404b, the electronic device adds the combined light intention (brightness 60%) and the curtain full closing intention to the waiting area.
  • the created viewing mode scene includes the intention to turn on the combination light (brightness parameter is 60%), the intention to adjust the temperature (adjust the temperature to a constant temperature of 24 degrees), and the intention to fully close the curtains.
  • the user can drag other intention cards, and the electronic device can add the corresponding intention to the scene to be created based on the user's drag operation.
  • the interface 404 also includes a control for displaying hidden intention cards in the corresponding subsystem.
  • the interface 404 includes a control 404f.
  • the electronic device can display the interface 405 as shown in Figure 7 (e), and the area of the interface 405 404a medium package Including other intention cards in the lighting subsystem, such as the intention card to turn on the combination light (color temperature 5500 Kelvin (K)).
  • the user can drag the intention card that turns on the combination light (color temperature 5500K) from area 404a to area 404b, thereby adding the intention to turn on the combination light (color temperature 6500K) to the viewing mode scene to be created.
  • the first electronic device may display the hidden intention card in the corresponding subsystem based on other operations of the user. For example, as shown in (a) of Figure 8, if the first electronic device detects that the user performs a left sliding operation near the label 404g of the lighting subsystem of the interface 404, then as shown in (b) of Figure 8, the electronic device may display The intention card 404h for turning off the hidden reading light in the lighting subsystem and the intention card 404i for turning off the wall door light strip are hidden.
  • the user can drag the intention card 404h to turn off the reading light and the intention to turn off the wall door light strip 404i from the area 404a to the area 404b, thereby adding the intention to turn off the reading light and the intention to turn off the wall door light strip to the scene to be created. It can be seen that in this solution, the user can create the target scene by making a simple selection on the current interface (such as dragging the intention card to the scene editing area 404b), which avoids the need for the user to repeat the operation as shown in Figure 1 Switching multiple interfaces for scene editing leads to low scene editing efficiency.
  • the user when creating a scene, the user can combine multiple intentions to generate a scene that can meet the device control needs. For example, combining the intentions of turning on warm lights, curtains, and fresh air equipment to generate a "comfortable environment" scene.
  • the first electronic device may receive the user's modification operation on the intention and modify the intention.
  • the intention card in the intention display area 404a such as the intention card 404h to turn off the reading light, the intention card 404k to turn on and adjust the brightness of the combination light
  • the smart panel adds these intentions to the viewing mode scene.
  • the electronic device can display the brightness adjustment bar 404m on the intention card 404k.
  • the user can drag the brightness adjustment bar 404m to adjust the brightness of the combination light (for example, adjust the brightness of the combination light to 30%).
  • the electronic device can receive the user's operations on other intention cards and adjust the control parameters of the electronic device that can achieve the corresponding intention.
  • Figure 10 shows the relationship between scenarios and devices or subsystems.
  • a scene created by a user is usually associated with multiple devices (for example, each scene is associated with an average of 7 devices). Therefore, in the scenario editing scheme with device granularity, the user needs to switch to the interfaces of multiple devices (such as the interface of the air conditioner and the interfaces of other devices shown in Figure 1), and add the corresponding devices to a scene to be created.
  • the user needs to adjust the brightness of multiple lights in the living room when editing a scene, then using the scene editing method of related technologies, the user needs to arrange the multiple lights one by one.
  • each scene is associated with 1.2 subsystems (or other number of subsystems).
  • Each subsystem The system consists of one or more devices, and scene editing is performed at the granularity of the subsystem's intent. Among them, an intention can usually be executed by multiple devices. Therefore, in some cases, a user's scene editing based on intent granularity is equivalent to multiple scene editing based on device granularity. This enables unified control of devices across multiple spaces without having to orchestrate each device individually through multiple interfaces.
  • the user when editing a scene, the user only needs to drag the combination light intention (brightness parameter 60%) logo of the lighting subsystem to the scene editing area through the current interface to complete the scene editing. In this way, the user's operations when arranging scenes are simplified, and the efficiency of scene arranging can be improved.
  • the An electronic device can save the movie viewing mode scene created this time.
  • the electronic device displays an interface 501.
  • the interface 501 includes a card 501a of the viewing mode scene created through the above process.
  • a control 501b for modifying the scene in the viewing mode can be set on the card 501a.
  • the scene can be executed when the trigger condition is met. For example, as shown in (a) of Figure 11, if the user's operation of clicking card 501a is detected, the electronic device can execute each intention corresponding to the above-created viewing mode scene, that is, the electronic device indicates that the brightness parameter 60% can be achieved One or more lights in the living room are turned on; the electronic device indicates that the reading lights, wall door light strips, and ceiling light strips are turned off; the electronic device indicates that all curtains in the living room are closed; the electronic device indicates equipment that can achieve temperature adjustment purposes (such as air conditioner A in the living room) Adjust the temperature to 24 degrees.
  • the electronic device after detecting the user's click on the control 501b on the card 501a, the electronic device can pop up a pop-up window 502 as shown in Figure 11 (b).
  • the pop-up window 502 includes each intention card included in the movie viewing mode scene.
  • the electronic device may display the brightness adjustment bar 502b on the logo 502a. The user can drag the brightness adjustment bar 502b to adjust the brightness of the combination light (for example, adjust the brightness of the combination light to 30%).
  • the electronic device can receive the user's operations on other intention cards and adjust the control parameters of the electronic device that can achieve the corresponding intention.
  • users can also add or delete intents to created scenarios.
  • the pop-up window 502 also includes an intention display area 502d of the living room-related subsystem.
  • the user can perform a sliding operation in the intention display area 502d to display the intention cards of each subsystem.
  • the intention display area 502 displays the intention card of the lighting subsystem (turning on combination lights, reading lights, and wall door light strips).
  • the smart panel in response to the user performing a swipe-up operation in the intention display area 502d, the smart panel displays the intention cards (temperature, humidity, purification) of the heating and cooling fresh air subsystem in the intention display area 502d.
  • the scene editing interface 404 may include a space identification bar 1104.
  • the space identification column 1104 includes identification of multiple spaces throughout the house. For example, space signs for the whole house, living room, dining room, etc.
  • the space identification bar 1104 may be displayed when the smart panel opens the scene editing interface 404 . Or, in other examples, after the smart panel displays the scene editing interface 404, the space identification bar 1104 is displayed in response to a specific operation by the user. For example, after the smart panel displays the scene editing interface 404, in response to the user's right sliding operation from the left edge of the screen, the smart panel displays the space identification bar 1104 on the scene editing interface 404.
  • the first electronic device may switch to the target space.
  • scene editing interface For example, as shown in (a) of Figure 12A, the smart panel displays the scene editing interface 404 of the living room. Afterwards, as shown in (b) of FIG. 12A , after detecting the user's operation of clicking on the restaurant space label 1102, the smart panel displays the scene editing interface 1101 of the restaurant. It can be seen that by operating the space tag set in the current interface, the user can control the smart panel to switch between spaces, so that the user can easily and quickly enter the scene editing interface of other spaces, and the scene editing efficiency is high.
  • the space sidebar 1104 may also include a control 1103.
  • Control 1103 is used to add space labels (such as study room, bathroom, etc. space labels).
  • FIG. 12A mainly takes an example of an interface presenting an intention identifier corresponding to a certain space.
  • an interface may present an intention identifier corresponding to multiple spaces.
  • the smart panel displays an interface 1203.
  • the interface 1203 includes labels for multiple spaces (such as a restaurant label 1203a and a living room label 1203b).
  • the smart panel displays the intention card corresponding to the restaurant and the intention card corresponding to the living room in the intention display area 404b.
  • the UI effect of the intention card corresponding to the restaurant can be different from the UI effect of the intention card corresponding to the living room, so that the user can distinguish the intention cards of different spaces.
  • the UI effect of the intent card corresponding to the restaurant is similar to the UI effect of the space label 1203a of the restaurant (for example, if the background color of the space label 1203a corresponding to the restaurant is red, then the background color of the intent card corresponding to the restaurant is also set to red), the UI effect of the intention card corresponding to the living room is similar to the UI effect of the space label 1203b of the living room.
  • the smart panel displays an interface 1201 , and the interface 1201 includes a space identification bar 1204 .
  • the UI effect of each space identifier in the space identifier bar 1204 and the space identifier bar 1104 shown in (a) of FIG. 12A may be different.
  • the shape of the space sign such as the living room is circular
  • the shape of the space sign of the living room is a rectangle.
  • the space identifier may be displayed together with the interface 1201.
  • the smart panel may display the space identification bar 1204 on the interface 1201 in response to the user's specific operation (such as a right swipe operation on the left edge of the screen).
  • the space identification bar includes control 1201a.
  • the smart panel may pop up a pop-up window 1201b.
  • the smart panel may display the space label 1201c of the restaurant in the interface 1201 .
  • the smart panel can display the intention card corresponding to the restaurant (such as card 1201d) and the intention card corresponding to the living room in the interface 1201.
  • the UI effects of the intention identifiers corresponding to different spaces can be different, so that the user can identify the space to which the corresponding intention belongs.
  • the frame of the intention card corresponding to the living room is displayed normally, and the frame of the intention card corresponding to the restaurant is displayed in bold.
  • the user can adjust parameters of the viewing mode scene. For example, after receiving the user's operation to adjust the scene parameters, the smart panel can pop up a pop-up window 1202 as shown in (c) of Figure 12C. The user can adjust the scene parameters (such as the brightness of the combination light) through the pop-up window 1202. Adjustment.
  • the first electronic device detects whether a trigger condition for executing the target scene is met, and when the trigger condition is met, the first electronic device executes the target scene. For example, taking the trigger condition for executing the viewing mode scene as clicking on the card corresponding to the viewing mode scene, when the smart panel detects that the user clicks on the card 501a as shown in (a) of Figure 11, the smart panel may instruct the viewer to Perform corresponding operations on the devices in one or more spaces associated with the shadow mode scene.
  • the smart panel obtains the intention corresponding to the viewing mode scene.
  • the brightness of the combination light is 60%
  • the reading light is turned off
  • the wall door light strip is turned off.
  • the ceiling light strip is turned off
  • the temperature is 24 degrees
  • the curtains are fully closed, the cards are dragged from the intention display area 404a to the scene editing area 404b.
  • the smart panel determines that the corresponding intention of the viewing mode scene is: turn on the combination light in the living room and adjust the brightness of the combination light to 60%, turn off the reading light in the living room, turn off the wall door light strip in the living room, turn off the ceiling light strip in the living room, Adjust the temperature in the living room to 24 degrees (target temperature) and close all curtains in the living room. Then, the smart panel can determine the target device that can realize the one or more target intentions based on one or more target intentions corresponding to the movie viewing mode scene, and instruct the target device to perform corresponding operations.
  • the smart panel can obtain the parameters of multiple lights in the living room and determine one or more target lights that can achieve 60% brightness based on the parameters of the multiple lights.
  • the target lamp may be one or more lamps that can achieve 60% brightness and have the best energy-saving effect.
  • the target light can be one or more lights that can achieve 60% brightness and have a color temperature that is optimal for movie viewing.
  • the target light can also be other types of lights.
  • the smart panel determines that the target lights that need to be controlled in the viewing mode scene are Lamp 1 - Lamp 3.
  • users can also combine multiple intentions to create new scenarios such as birthday parties, warm home, whole-house dehumidification, and whole-house ventilation.
  • the smart panel can obtain the parameters of a device in the living room that can implement temperature control functions (which can be referred to as a temperature control device for short), and determine the target temperature control device for adjusting the temperature of the living room to the target temperature from multiple temperature control devices.
  • the target temperature control device can be an electric heater or air conditioner or other temperature control device.
  • smart panels can also identify other target devices to use to achieve the target intent.
  • the above only lists exemplary methods for determining the target device. It should be understood that the first electronic device (such as a smart panel) can also use other methods to determine the target device that can achieve the target intention.
  • Figure 14 shows another example of the scene editing interface provided by the embodiment of the present application.
  • users can switch to the scene editing interface of the corresponding space through the space label.
  • the smart panel displays a scene editing interface 1401 for the whole house.
  • the scene editing interface 1401 includes labels 1401a for each scene (which may be referred to as scene labels).
  • scene tags include but are not limited to tags for leaving home scenes, tags for returning home scenes, tags for sleeping scenes, tags for reading scenes, etc. Users can select the label of a scene to edit the scene.
  • the smart panel can display the intent near the center of the display screen.
  • the intent displayed near the center of the display screen can be called a central intent.
  • the smart panel displays the central intention (leaving home) near the center of the display screen, and the user can edit the leaving home scene through the interface 1401.
  • the interface 1401 also includes a control 1401b, which is used to add scene tags.
  • interface 1401 also includes identification of various subsystems of the whole house. For example, it includes the identification of the security subsystem 1401c. For another example, it also includes the logo of the audio and video subsystem, the logo of the lighting subsystem, and the logo of the heating and cooling fresh air subsystem.
  • the user can select the identity of the target subsystem from the identities of each subsystem, and the smart panel can add the achievable intentions of the target subsystem to the away-from-home scenario. For example, as shown in (a) of Figure 14, the user drags the logo 1401c of the security subsystem in the direction of the central intention (leaving home). As shown in (b) of Figure 14, when it is detected that the logo 1401c of the security subsystem is in contact with the center. After an intent (leaving home) collision (called a collision operation) or proximity (for example, the distance is less than a preset threshold), the smart panel determines that the user wants to add a security subsystem-achievable intent to the leaving home scene.
  • an intent leaving home
  • smart panels add intents achievable by default to security subsystems to away-from-home scenarios.
  • smart panels can provide an interface through which users can adjust the intent that the security subsystem can achieve.
  • the smart panel pops up a pop-up window 1401d.
  • the pop-up window 1401d includes cards with one or more intentions that can be realized by the security subsystem (such as smart door lock closing cards, infrared curtain fully opening cards).
  • the user can add the corresponding intent to the target scene by selecting one or more intent cards.
  • one or more intent cards are activated by default, that is, if the user does not remove the intent, the intent is added to the target scene by default.
  • the user can delete some intentions, or the user can make certain intentions invalid in the away-from-home scenario through certain operations.
  • the intention 1401e will be deactivated, that is, the intention 1401e will not be added in the leaving-home scene. , but the card with intention 1401e can be retained in the pop-up window 1401d.
  • the UI effect of the deactivated intention is different from the UI effect of the activated intention.
  • the intention 1401e of the deactivation state is displayed with a UI effect with a bold border, or the intention of the deactivation state is displayed in gray (not shown in the figure).
  • the smart panel displays a prompt box 1401g to prompt the user whether to remove Selected intent.
  • the smart panel removes the intent 1401f from the pop-up window 1401d, that is, it no longer displays the intent 1401f on the pop-up window 1401d.
  • the pop-up window 1401d also includes a control 1401h, which is used to add intent to the target scene (such as leaving home scene). Similar to the solution in the previous embodiment, in the solution corresponding to Figure 14, the intended parameters can also be adjusted. For the specific method of adjusting the intention parameters, please refer to the relevant descriptions of the previous embodiments, and will not be described again here.
  • the smart panel can recommend to the user intents to be added to the scene for each scene.
  • the smart panel can determine the common intentions contained in the movie-watching mode scene based on big data analysis or other methods, and based on the common intentions in the movie-watching mode scene, As shown in Figure 15, cards with commonly used intentions are displayed in area 404a of the scene editing interface 406.
  • cards with commonly used intentions in the movie viewing mode scene include: intention cards for combination lights (brightness 60%), intention cards for temperature, Intention card to close the curtains completely.
  • the scene editing interface 406 may also include a control 404f.
  • the smart panel may display other intention cards corresponding to the lighting subsystem. Users can select some intent cards from other intent cards and add the selected intent cards to the scene to be created.
  • Embodiments of the present application also provide a smart device control method.
  • the first electronic device can determine a group of second electronic devices that the user desires to control (which can be called a target electronic device group) based on user information and user intentions, and can Display the identification of the target electronic device group and the target intent that can be achieved in the target electronic device group (such as Identification of each electronic device indicating the intention to turn on the light.
  • the target electronic device group may be an electronic device group in the living room, an electronic device group in the master bedroom, etc.
  • the identification of the target electronic device group can be living room, master bedroom, etc.
  • the smart panel displays an interface 401, and the interface 401 includes a whole-house control option 401b.
  • the smart panel can jump to the interface 1602 shown in (a) of Figure 16A.
  • the intention identification column 161 is displayed in the interface 1602 , and the intention identification column 161 is used to display the intention identification of the intention.
  • the interface 1602 includes the identification of the electronic devices in the master bedroom that can realize the intention of turning on the lights (for example, the identification of the ceiling lamp, spotlight, table lamp, and floor lamp in the interface 1602 as shown in (a) of FIG. 16A ).
  • Users can operate the signs of electronic devices in the master bedroom to control the corresponding electronic devices. For example, the user moves the sign of the spotlight to collide with the sign of the central intention (turning on the light).
  • the smart panel controls the spotlight to turn on.
  • the user moves the logo of the spotlight and the logo of the floor lamp toward the center intention.
  • the smart panel controls the spotlight and the floor lamp to turn on.
  • the smart panel determines the target electronic device in the master bedroom that the user wants to control, and controls the target.
  • the electronic device executes the intention to turn on the light.
  • the smart panel assumes that the user wants to control all the devices in the master bedroom that can achieve the intention of turning on the lights, then the smart panel controls the master bedroom to achieve the intention of turning on the lights. All equipment (such as ceiling lights, spotlights, table lamps, floor lamps) execute the intention of turning on the lights.
  • the smart panel determines that the current time period is 8:00 pm (usually the time to go home from get off work) based on the user information, and the smart panel determines that the user wants to To control the turning on of the ceiling light in the master bedroom.
  • the interface 1602 may also include identification of other electronic device groups that can realize the intention of turning on the lights (such as identification of the living room, second bedroom, and study room).
  • identification of other electronic device groups that can realize the intention of turning on the lights and the central intention is the first distance
  • the electronic device group that the user wants to control (which can be called the target electronic device group)
  • the distance between the logo and the central intention is the second distance
  • the first distance is greater than the second distance. That is to say, the logo of the target electronic device group is closer to the central intention, so that the user can drag the logo of the target electronic device in the target electronic device group until it collides with the central intention, thereby facilitating the user to control the target electronic device.
  • the distance between the logo of the master bedroom and the central intention is closer, which can shorten the time for the user to perform the collision operation. Drag distance to reduce device control time and improve device control efficiency.
  • the user is in the living room, and when the user opens the control interface corresponding to the intention to turn on the lights, the smart panel can determine based on the user's location that the user wants to control the electronic equipment in the living room, and the smart panel displays Interface 1603 includes identification of electronic devices in the living room that can realize the intention of turning on lights, such as identification of ceiling lights, spotlights, desk lamps, and floor lamps in interface 1603 as shown in (b) of Figure 16A .
  • the smart panel can determine based on the current time that the user wants to control the electronic equipment in the master bedroom, and then display it on the control interface.
  • the logos of each curtain in the master bedroom can be used to realize the curtain closing intention.
  • the user can conveniently control and close the curtains in the master bedroom by operating the logos of the curtains in the master bedroom.
  • the smart panel can also display on the control interface the identification of other device groups that can realize the curtain closing intention.
  • the user can switch intents. For example, as shown in (b) of Figure 16A, the smart panel displays an interface 1603 corresponding to the intention to turn on the lights 162. Subsequently, as shown in FIG. 16B, after detecting that the user clicks on the mark of the music playback intention in the intention mark bar 1607, the smart panel displays the interface 1607 corresponding to the music playback intention.
  • the smart panel in addition to the target electronic device group determined by the smart panel based on user information, the user also wants to control devices in other electronic device groups.
  • the smart panel can control the target electronic device group according to the user's operation. Identify other electronic devices the user wants to control.
  • the smart panel in response to the user's operation on the identification of the electronic device group, the smart panel can display the identification of the electronic device in the electronic device group, and the user can control the electronic device through the identification of the electronic device.
  • the user can drag the logo of the corresponding electronic device in the master bedroom (such as the logo of the ceiling light and spotlight) to the Collision with the central intention (turn on the lights), or drag the logo of the corresponding electronic device in the master bedroom to a position where the distance from the central intention is less than a certain threshold, to trigger the smart panel to control the corresponding electronic device to execute the intention to turn on the lights.
  • the logo of the corresponding electronic device in the master bedroom such as the logo of the ceiling light and spotlight
  • the smart panel can display the pop-up window 170 shown in Figure 17,
  • the pop-up window 170 includes the identification of each electronic device in the second bedroom that can realize the intention of turning on the light (such as the identification of a desk lamp and a ceiling light).
  • the smart panel controls the corresponding electronic device to execute the intention of turning on the light. For example, in response to the user clicking on the logo of the desk lamp and ceiling light in the second bedroom, the smart panel controls the desk lamp and ceiling light in the second bedroom to turn on.
  • the smart panel may display the identity of the target electronic device group, but does not display the identity of each electronic device in the target electronic device group.
  • the user is located in the master bedroom.
  • the smart panel can determine based on the user's location that the user wants to control the electronic equipment in the master bedroom, then The smart panel displays an interface 1605.
  • the interface 1605 includes a logo 164 of the master bedroom.
  • the interface 1605 may also include: identification of other electronic device groups that can realize the intention of turning on the lights, such as identification of the living room, second bedroom, and study room.
  • identification of other electronic device groups that can realize the intention of turning on the lights, such as identification of the living room, second bedroom, and study room.
  • the distance between the master bedroom logo and the central intention is smaller than the distance between the other group logos and the central intention. In this way, it is convenient for the user to drag the master bedroom logo to collide with the central intention.
  • the smart panel determines on its own the target electronic device in the master bedroom that the user wants to control that can achieve the intention of turning on the lights. For example, the smart panel determines that the user wants to control all the devices in the master bedroom that can turn on the lights. For another example, based on user information, the smart panel determines that the device in the master bedroom that the user wants to control that can achieve the intention of turning on the lights is a spotlight.
  • the smart panel pops up a pop-up window that includes devices in the master bedroom that can realize the intention of turning on the lights.
  • the smart panel determines the target electronic device that the user wants to control.
  • the smart panel may employ other methods to determine the target electronic device that the user wants to control.
  • the user is located in the living room, and when the user opens the control interface corresponding to the intention to turn on the lights, the smart panel can determine based on the user's location that the user wants to control the electronic equipment in the living room, then the smart panel The panel displays an interface 1606, and the interface 1606 includes a logo 172 of the living room.
  • the interface 1606 includes a logo 172 of the living room.
  • the distance between graphs is smaller than the distance between other group identities and the central intent. In this way, it is convenient for users to drag the living room logo to collide with the central intention.
  • a smart panel can determine control parameters of a target electronic device in a group of electronic devices.
  • the smart panel displays an interface 401, and the interface 401 includes a whole-house control option 401b. After receiving the operation of the user clicking on the whole house control option 401b, the smart panel can jump to the interface 1601 shown in (b) of Figure 19.
  • the interface 1601 displays an intention identification bar 161, and the intention identification bar 161 is used to display the intention of the intention. logo.
  • the light-on intention indicator 162 displayed in the intention indicator column 161 is highlighted to indicate that the interface 1601 currently displayed on the smart panel is the control interface for the light-on intention corresponding to the light-on intention indicator 162 .
  • the central intention currently displayed by the smart panel is the intention to turn on the light.
  • the user can click the sign 162 of the intention to turn on the lights, and in response to the user's operation, the smart panel can display the intention to turn on the lights near the center of the screen (called the center intention 163).
  • the smart panel can display a group of electronic devices that can realize the intention to turn on the lights around the central intention (the intention to turn on the lights).
  • the master bedroom contains electronic devices that can realize the intention of turning on the lights. Therefore, the smart panel displays the identification of the master bedroom group (such as the circle indicated by reference numeral 164 displayed on the interface 1601).
  • the smart panel can also display on the interface 1601 a group of other electronic devices that can realize the intention of turning on the lights (such as a group of electronic devices in the living room, second bedroom, and study room).
  • the smart panel can obtain authorized user information, determine the control parameters of the devices in the corresponding group based on the user information, and prompt the user with the corresponding control parameters.
  • user information includes but is not limited to one or more of the following information: user location, time, user behavior.
  • the smart panel learns that users usually read or study in the study room from 8:30 to 10:00 pm based on the user information obtained historically. Then, if the current time is 9:00 pm, when the user opens the interface 1601, the smart panel can display the recommended control parameters of the devices in each corresponding group on the interface 1601.
  • the recommended control parameters are suitable for reading or learning scenarios.
  • the smart panel in (b) of Figure 19 displays a study mark as shown in reference numeral 165 on the interface 1601, a reading suggestion brightness of 30% as shown in reference numeral 166, and a reading suggestion as shown in reference numeral 167. Reading recommended color temperature is 5000K.
  • users can adjust the recommended control parameters displayed on the smart panel. For example, as shown in (c) of FIG. 19 , the user can long press the recommended color temperature card shown as mark 167 to adjust to the new color temperature of 5500K. After that, as shown in (d) of FIG. 19 , the user can drag the study room logo 165 in the direction of the central intention (turning on the lights). After detecting that the study room logo 165 collides with the central intention, the smart panel can send a control instruction to a target device in the study room that can realize the lighting intention (brightness is 30%, color temperature is 5500K), and the target device executes the lighting intention. There can be one or more target devices.
  • the target devices are lamp 1 and lamp 2, the combined brightness of lamp 1 and lamp 2 is 30%, and the combined color temperature is 5500K.
  • the target device is lamp 3, the brightness of lamp 3 is the recommended brightness of 30%, and the color temperature is the recommended color temperature of 5500K.
  • the smart panel can recommend to the user device control parameters that are suitable for the current scene (such as reading or learning scenes) and can achieve the target intention based on user information. For example, it can recommend to users the brightness parameters and color temperature parameters of devices that are suitable for reading scenes and can achieve the intention of turning on the lights. It can be seen that the smart panel can provide users with personalized guidance related to device control, so as to effectively guide users to control smart devices.
  • the smart panel displays an interface 1604.
  • the interface 1604 includes the Electronic devices that can realize the intention to turn on the light (such as spotlights, ceiling lights, etc.) and the recommended brightness (30%) and recommended color temperature (5500K) corresponding to the intention to turn on the light.
  • the smart panel in response to the user's operation of dragging the spotlight logo toward the center, the smart panel controls the spotlight in the master bedroom to turn on.
  • the brightness of the spotlight is 30% and the color temperature is 5500K.
  • the recommended control parameters corresponding to different electronic device groups can be presented as different UI effects.
  • a card 166 with recommended brightness and a card 167 with recommended color temperature for electronic devices in the study that can turn on lights is displayed with the first UI effect (such as a slash from upper right to lower left).
  • the first UI effect such as a slash from upper right to lower left.
  • the user can drag the sign of the study room in the direction of the central intention (turn on the lights).
  • the smart panel After detecting that the study room logo collides with the central intention, the smart panel can send control instructions to the target device in the study room that can achieve the intention to turn on the lights (brightness is 30%, color temperature is 5000K), and the target device executes the intention to turn on the lights. For another example, the user can drag the logo of the living room in the direction of the central intention (turning on the lights). After detecting that the logo of the living room collides with the central intention, the smart panel can send control instructions to the target device in the living room that can achieve the intention to turn on the lights (brightness is 35%, color temperature is 5500K), and the target device executes the intention to turn on the lights.
  • the above example uses the smart panel to determine the recommended control parameters of the corresponding electronic device based on user information.
  • the smart panel can also determine the recommended control parameters of the corresponding electronic device based on other information.
  • the user can also select multiple intentions, and the smart panel can combine multiple intentions. For example, as shown in FIG. 22 , after detecting the user's operation of selecting the intention to turn on the lights 162 and the intention to play music from the intention identification bar 161 , the smart panel displays the central intention (turning on the lights, playing music) near the center of the screen. In response to the user dragging the master bedroom logo to collide with the central intention, or the user dragging the master bedroom logo to be less than a certain distance from the central intention, the smart panel can control the lights in the master bedroom to turn on and control the speakers in the master bedroom. Wait for the device to perform music playback.
  • the smart panel can also determine the device control parameters corresponding to the intention to turn on lights and the intention to play music based on user information. For example, if the current time is 10:00 pm, the smart panel determines that the recommended volume corresponding to the music playback intention is xx decibels (dB), and displays a card with the recommended volume as marked 168. In this way, it is possible to effectively guide the user to control related devices with music playback intentions, so as to avoid disturbing nearby neighbors during music playback.
  • dB decibels
  • the layout of the scene editing interface can also be to display the trigger conditions of the scene in the right column of the scene editing interface, and to display the intention cards of the subsystems in the lower area of the scene editing interface.
  • the operations on the controls in the interface are only examples.
  • the user can trigger the first electronic device to perform the target operation by performing a certain operation on the target control in the interface.
  • Other operations may also be defined, and when it is detected that the user performs the other operations on the target control, the first electronic device performs the target operation.
  • groups may also be divided according to other dividing standards.
  • groups can be divided according to the distance between the device and the user. Devices whose distance from the user is less than a first threshold can be divided into the first group.
  • the smart panel can display the identification of each device in the first group, so that the user can control the nearby devices.
  • the smart panel can determine the electronic device group that the user wants to control based on the user information, and can determine recommended control parameters for the target electronic device in the electronic device group based on the user information.
  • the devices in the embodiments of the present application include hardware structures and/or software modules corresponding to each function.
  • the embodiments of this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the technical solutions of the embodiments of the present application.
  • Embodiments of the present application can divide the electronic device into functional units according to the above method examples.
  • each functional unit can be divided corresponding to each function, or two or more functions can be integrated into one processing unit.
  • the above integrated units can be implemented in the form of hardware or software functional units. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods.
  • FIG 23 shows a schematic block diagram of the first electronic device provided in the embodiment of the present application.
  • the information transmission device may be the above-mentioned receiving device or sending device.
  • the first electronic device 3300 may exist in the form of software, or may be a chip that can be used in the device.
  • the first electronic device 3300 includes: a processing unit 3303, a transceiver unit 3302, and a display unit 3301.
  • the transceiver unit 3302 can also be divided into a sending unit (not shown in Figure 23) and a receiving unit (not shown in Figure 23).
  • the sending unit is used to support the first electronic device 3300 in sending information to other devices.
  • the receiving unit is used to support the first electronic device 3300 to receive information from other devices.
  • Display unit 3301 is used to support display content.
  • the first electronic device 3300 may also include a storage unit 1701 (not shown in the figure) for storing program codes and data of the first electronic device 3300.
  • the data may include but is not limited to original data or intermediate data.
  • the processing unit 3303 may be a controller or the processor 501 and/or the processor 507 shown in FIG. 4 , for example, it may be a central processing unit (Central Processing Unit, CPU), a general-purpose processor, a digital signal Processing (Digital Signal Processing, DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with this disclosure.
  • the processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of DSP and microprocessors, and so on.
  • the transceiver unit 3302 may be the communication interface 504 shown in Figure 4, or may be a transceiver circuit, transceiver, radio frequency device, etc.
  • the storage unit 1701 may be the memory 503 shown in FIG. 4 .
  • the display unit 3301 may include a display screen.
  • An embodiment of the present application also provides an electronic device, including one or more processors and one or more memories.
  • the one or more memories are coupled to one or more processors.
  • the one or more memories are used to store computer program codes.
  • the computer program codes include computer instructions.
  • the electronic device causes the electronic device to execute The above related method steps implement the information transmission method in the above embodiment.
  • An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, and the memory is used to store programs or instructions. When the program or instructions are executed by the processor, the The chip system implements the method in any of the above method embodiments.
  • processors in the chip system there may be one or more processors in the chip system.
  • the processor can be implemented in hardware or software.
  • the processor may be a logic circuit, an integrated circuit, or the like.
  • the processor may be a general-purpose processor implemented by reading software code stored in memory.
  • the memory may be integrated with the processor or may be provided separately from the processor, which is not limited by this application.
  • the memory can be a non-transient processor, such as a read-only memory ROM, which can be integrated on the same chip as the processor, or can be separately provided on different chips.
  • This application describes the type of memory, and the relationship between the memory and the processor. There is no specific limitation on how the processor is configured.
  • the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or a system on chip (SoC), or It can be a central processing unit (CPU), a network processor (NP), a digital signal processing circuit (DSP), or a microcontroller unit , MCU), it can also be a programmable logic device (PLD) or other integrated chip.
  • FPGA field programmable gate array
  • ASIC application specific integrated circuit
  • SoC system on chip
  • CPU central processing unit
  • NP network processor
  • DSP digital signal processing circuit
  • MCU microcontroller unit
  • PLD programmable logic device
  • each step in the above method embodiment can be completed by an integrated logic circuit of hardware in the processor or instructions in the form of software.
  • the method steps disclosed in conjunction with the embodiments of this application can be directly implemented by a hardware processor, or executed by a combination of hardware and software modules in the processor.
  • Embodiments of the present application also provide a computer-readable storage medium.
  • Computer instructions are stored in the computer-readable storage medium.
  • the electronic device causes the electronic device to execute the above related method steps to implement the above embodiments. information transmission method.
  • An embodiment of the present application also provides a computer program product.
  • the computer program product When the computer program product is run on a computer, it causes the computer to perform the above related steps to implement the information transmission method in the above embodiment.
  • inventions of the present application also provide a device.
  • the device may be a component or module.
  • the device may include a connected processor and a memory.
  • the memory is used to store computer execution instructions. When the device runs When the processor executes the computer execution instructions stored in the memory, the device executes the information transmission method in each of the above method embodiments.
  • the electronic devices, computer-readable storage media, computer program products or chips provided by the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the above provided The beneficial effects of the corresponding methods will not be described again here.
  • This embodiment can divide the electronic device into functional modules according to the above method examples.
  • each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module.
  • the above integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. In actual implementation, there may be other division methods.
  • the disclosed method can be implemented in other ways.
  • the terminal device embodiments described above are only illustrative.
  • the division of modules or units is only a logical function division.
  • there may be other division methods, such as multiple units or components. can be combined or can be integrated into another system, or some features can be ignored, or not implemented.
  • the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, indirect coupling or communication connection of modules or units, which may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit.
  • the above integrated units can be implemented in the form of hardware or software functional units.
  • the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium.
  • the technical solution of the present application is essentially or contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in various embodiments of the application.
  • the aforementioned storage media include: flash memory, mobile hard drive Various media that can store program instructions, such as disk, read-only memory, random access memory, magnetic disk or optical disk.

Abstract

An intelligent device control method and an electronic device. A scenario can be edited with an intent as the granularity, there is no need to set, one by one, a plurality of devices corresponding to the intent, such that the complexity of scenario editing can be reduced, and the efficiency of device control can be improved. The method can be applied to a first electronic device or a component (such as a chip system) that supports the first electronic device to implement related functions. The method comprises: displaying a first interface, wherein the first interface comprises an identifier of one or more intents, and at least one of the one or more intents corresponds to a plurality of electronic devices; in response to an operation of a user selecting a target intent from the one or more intents, adding the target intent into a target scenario; and when a trigger condition of the target scenario is met, controlling one or more target electronic devices to execute the target intent, wherein the one or more target electronic devices are electronic devices corresponding to the target intent.

Description

智能设备控制方法及电子设备Intelligent device control method and electronic device
本申请要求于2022年05月19日提交中国专利局、申请号为202210546887.9、申请名称为“智能设备控制方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims priority to the Chinese patent application filed with the China Patent Office on May 19, 2022, with the application number 202210546887.9 and the application name "Intelligent Device Control Method and Electronic Device", the entire content of which is incorporated into this application by reference. .
技术领域Technical field
本申请涉及终端技术领域,尤其涉及智能设备控制方法及电子设备。This application relates to the field of terminal technology, and in particular to intelligent device control methods and electronic devices.
背景技术Background technique
目前,用户拥有的设备越来越多。比如在家庭场景中,可以通过物联网技术将家中的各种设备连接到一起形成智能家居系统,实现设备的集中控制,为用户提供家电控制、照明控制、防盗报警等多种功能。Currently, users own more and more devices. For example, in home scenarios, various devices in the home can be connected together through the Internet of Things technology to form a smart home system, achieving centralized control of devices and providing users with multiple functions such as home appliance control, lighting control, and anti-theft alarms.
但是,由于设备数量众多,用户如需操作多个设备,需要在智能家居应用中切换不同界面,才能分别找到需要控制的多个设备,用户操作繁琐,耗费时间。However, due to the large number of devices, if users need to operate multiple devices, they need to switch between different interfaces in the smart home application to find the multiple devices that need to be controlled. The user operation is cumbersome and time-consuming.
发明内容Contents of the invention
为了解决上述的技术问题,本申请实施例提供了一种智能设备控制方法及电子设备。本申请实施例提供的技术方案,能够以意图为粒度对场景进行编辑,无需对意图对应的多个设备一一进行设置,能够降低场景编辑的复杂度,提升设备控制的效率。In order to solve the above technical problems, embodiments of the present application provide an intelligent device control method and electronic device. The technical solution provided by the embodiments of this application can edit scenes at the granularity of intent without setting multiple devices corresponding to the intent one by one. It can reduce the complexity of scene editing and improve the efficiency of device control.
为了实现上述的技术目的,本申请实施例提供了如下技术方案:In order to achieve the above technical objectives, the embodiments of this application provide the following technical solutions:
第一方面,提供一种智能设备控制方法,应用于第一电子设备或支持第一电子设备实现相关功能的组件(比如芯片系统)。该方法包括:显示第一界面,所述第一界面包括一个或多个意图的标识;一个或多个意图中至少一个意图对应多个电子设备;响应于用户从所述一个或多个意图中选择目标意图的操作,将所述目标意图添加到目标场景中;在满足所述目标场景的触发条件时,控制一个或多个目标电子设备执行所述目标意图。其中,所述一个或多个目标电子设备为所述目标意图对应的电子设备。In a first aspect, an intelligent device control method is provided, which is applied to a first electronic device or a component (such as a chip system) that supports the first electronic device to implement related functions. The method includes: displaying a first interface, the first interface including identification of one or more intentions; at least one intention among the one or more intentions corresponding to a plurality of electronic devices; in response to the user selecting from the one or more intentions The operation of selecting a target intention is to add the target intention to a target scene; when the triggering conditions of the target scene are met, control one or more target electronic devices to execute the target intention. Wherein, the one or more target electronic devices are electronic devices corresponding to the target intention.
该方案中,在当前的场景编辑界面(第一界面),用户可以以意图为粒度进行场景编辑,无需意图对应的多个设备一一进行设置,避免因反复切换界面导致的操作繁琐,节约场景编辑的用时,使得设备控制的效率有所提升。In this solution, in the current scene editing interface (the first interface), users can edit scenes at the granularity of intent, without setting multiple devices corresponding to the intent one by one. This avoids cumbersome operations caused by repeated interface switching and saves scenes. The time spent on editing improves the efficiency of device control.
示例性的,如图7的(d),智能面板显示界面404(第一界面),界面404包括多个意图的标识(比如区域404a中的意图卡片“灯全开”、“灯全关”、“组合灯(亮度60%)”)。响应于用户从区域404a中多个意图卡片中选择目标意图(比如组合灯(亮度60%)、温度24度、窗帘全关的意图卡片)的操作,智能面板将目标意图添加到观影模式场景(即目标场景)中。Exemplarily, as shown in (d) of Figure 7 , the smart panel displays an interface 404 (the first interface). The interface 404 includes identification of multiple intentions (such as the intention cards "Lights Fully On" and "Lights Fully Off" in area 404a , "Combined light (brightness 60%)"). In response to the user's operation of selecting a target intention from multiple intention cards in area 404a (such as an intention card with combination lights (brightness 60%), temperature 24 degrees, and curtains fully closed), the smart panel adds the target intention to the viewing mode scene. (i.e. target scenario).
后续,在满足所述目标场景的触发条件(比如如图7的(d)所示的条件404j)时,智能面板控制一个或多个目标电子设备执行目标意图。Subsequently, when the triggering condition of the target scene is met (such as condition 404j shown in (d) of Figure 7 ), the smart panel controls one or more target electronic devices to execute the target intention.
在一种可能的设计中,所述目标电子设备包括第二电子设备和第三电子设备,所述控制一个或多个目标电子设备执行所述目标意图,包括:In a possible design, the target electronic device includes a second electronic device and a third electronic device, and controlling one or more target electronic devices to execute the target intention includes:
向所述第二电子设备发送第一控制指令,向所述第三电子设备发送第二控制指令, 使得所述第二电子设备和所述第三电子设备共同执行所述目标意图。sending a first control instruction to the second electronic device, and sending a second control instruction to the third electronic device, The second electronic device and the third electronic device are caused to jointly execute the target intention.
示例性的,假设目标场景中包括组合灯意图(60%),智能面板向组合灯意图对应的灯1发送第一控制指令,向组合灯意图对应的灯2发送第二控制指令,灯1和灯2共同执行组合灯意图(亮度60%),灯1和灯2的总亮度为60%。For example, assuming that the target scene includes the combined light intention (60%), the smart panel sends the first control instruction to the light 1 corresponding to the combined light intention, and sends the second control instruction to the light 2 corresponding to the combined light intention. Light 1 and Lamp 2 jointly performs the combined lamp intent (brightness 60%), and the total brightness of lamp 1 and lamp 2 is 60%.
在一种可能的设计中,所述目标意图包括第一目标意图和第二目标意图;所述目标电子设备包括第二电子设备和第三电子设备;In a possible design, the target intention includes a first target intention and a second target intention; the target electronic device includes a second electronic device and a third electronic device;
控制一个或多个目标电子设备执行所述目标意图,包括:Controlling one or more target electronic devices to perform the target intent includes:
向所述第二电子设备发送第一控制指令,所述第一控制指令用于控制所述第二电子设备执行所述第一目标意图;Send a first control instruction to the second electronic device, the first control instruction being used to control the second electronic device to execute the first target intention;
向所述第三电子设备发送第二控制指令,所述第二控制指令用于控制所述第三电子设备执行所述第二目标意图。Send a second control instruction to the third electronic device, where the second control instruction is used to control the third electronic device to execute the second target intention.
示例性的,如图7的(d),观影模式场景(目标场景)包括组合灯意图(第一目标意图)和温度意图(第二目标意图)。智能面板向客厅中的灯(第二电子设备)发送第一控制指令,该第一控制指令用于控制客厅中的灯开启,并调整至60%亮度。智能面板还向客厅中的比如空调(第三电子设备)发送第二控制指令,该第二控制指令用于控制空调执行温度调整意图。Exemplarily, as shown in (d) of FIG. 7 , the viewing mode scene (target scene) includes a combined light intention (first target intention) and a temperature intention (second target intention). The smart panel sends a first control instruction to the lamp (second electronic device) in the living room. The first control instruction is used to control the lamp in the living room to turn on and adjust the brightness to 60%. The smart panel also sends a second control instruction to, for example, the air conditioner (third electronic device) in the living room. The second control instruction is used to control the air conditioner to perform the temperature adjustment intention.
在一种可能的设计中,所述第一界面还包括全屋的多个空间的标识;所述多个空间第一空间和第二空间;所述第一空间的标识被选中;所述一个或多个意图包括所述第一空间中电子设备可执行的意图。In a possible design, the first interface also includes identification of multiple spaces in the whole house; the first space and the second space of the plurality of spaces; the identification of the first space is selected; the one The or multiple intentions include intentions that are executable by the electronic device in the first space.
示例性的,如图12A的(a),界面404还可以包括全屋的多个空间的标识(比如全屋、客厅(第一空间的一个示例)、餐厅(第二空间的一个示例)的标识)。其中,客厅的标识被选中(比如以黑色填充显示)。界面404的区域404a包含的多个意图包括客厅中电子设备可执行的意图。For example, as shown in (a) of FIG. 12A , the interface 404 may also include identification of multiple spaces in the whole house (such as the whole house, the living room (an example of the first space), and the dining room (an example of the second space)). logo). Among them, the logo of the living room is selected (for example, filled with black and displayed). The plurality of intentions contained in area 404a of interface 404 include intentions that are executable by electronic devices in the living room.
在一种可能的设计中,所述方法还包括:In a possible design, the method further includes:
接收所述用户对所述第二空间的标识的操作,显示第二界面,所述第二界面包括所述第二空间中电子设备可执行的意图的标识。Receive the user's operation on the identification of the second space and display a second interface, where the second interface includes an identification of an intention executable by the electronic device in the second space.
示例性的,如图12A的(b),智能面板接收用户对餐厅的标识的操作,显示界面1101(即第二界面),界面1101包括餐厅中电子设备可执行的意图的标识。For example, as shown in (b) of FIG. 12A , the smart panel receives the user's operation on the logo of the restaurant and displays the interface 1101 (ie, the second interface). The interface 1101 includes the logo of the intention that can be executed by the electronic device in the restaurant.
如此,用户可以方便的切换空间,并对各空间的场景进行编辑。In this way, users can easily switch spaces and edit the scenes in each space.
在一种可能的设计中,所述第二空间的标识被选中;所述一个或多个意图为多个意图,所述多个意图还包括所述第二空间中电子设备可执行的意图。In a possible design, the identity of the second space is selected; the one or more intentions are multiple intentions, and the multiple intentions also include intentions that are executable by electronic devices in the second space.
示例性的,如图12B,界面1203中,餐厅的标识以及客厅的标识均被选中,界面1203的区域404a的多个意图包括:餐厅中电子设备可执行的意图以及客厅中电子设备可执行的意图(比如湿度的意图卡片(中档))。For example, as shown in Figure 12B, in the interface 1203, the logo of the restaurant and the logo of the living room are both selected. The multiple intentions of the area 404a of the interface 1203 include: intentions that can be executed by the electronic devices in the restaurant and intentions that can be executed by the electronic devices in the living room. Intentions (like Humidity’s Intention Cards (mid-range)).
如此,可以通过一个界面展示多个空间中的意图,以便于将跨空间的多个意图进行组合,生成目标场景,满足用户的场景构建需求,同时,无锡针对多个设备一一进行编辑、设置。In this way, intentions in multiple spaces can be displayed through one interface, so that multiple intentions across spaces can be combined to generate target scenes to meet the user's scene construction needs. At the same time, Wuxi can edit and set up multiple devices one by one. .
在一种可能的设计中,所述第一空间中电子设备可执行的意图的标识与所述第二空间中电子设备可执行的意图的标识具有不同用户界面UI效果。 In a possible design, the identification of the intention executable by the electronic device in the first space and the identification of the intention executable by the electronic device in the second space have different user interface UI effects.
示例性的,如图12B,餐厅中电子设备可执行的意图的标识与客厅中电子设备可执行的意图的标识(比如湿度的意图卡片(中档))具有不同用户界面UI效果。For example, as shown in FIG. 12B , the identification of intentions executable by electronic devices in the restaurant and the identification of intentions executable by electronic devices in the living room (such as the intention card of humidity (mid-range)) have different user interface UI effects.
如此,用户可以清晰的辨别属于不同空间的意图,以便于用户快速选择所需空间的所需意图,并将所需意图添加到目标场景中,提升了场景编辑的效率。In this way, the user can clearly identify the intentions belonging to different spaces, so that the user can quickly select the required intention in the required space and add the required intention to the target scene, which improves the efficiency of scene editing.
在一种可能的设计中,所述目标意图对应的控制参数为第一控制参数;In a possible design, the control parameter corresponding to the target intention is the first control parameter;
所述方法还包括:接收用户输入的第二操作;The method further includes: receiving a second operation of user input;
响应于所述第二操作,显示第一控件,所述第一控件用于输入所述目标意图对应的第二控制参数;In response to the second operation, display a first control, the first control being used to input a second control parameter corresponding to the target intention;
接收所述用户通过所述第一控件输入的第二控制参数,使得所述目标意图对应的控制参数调整为所述第二控制参数。The second control parameter input by the user through the first control is received, so that the control parameter corresponding to the target intention is adjusted to the second control parameter.
示例性的,如图9的(b),假设目标意图为组合灯意图,组合灯意图对应的初始亮度(第一控制参数)为30%,智能面板接收用户长按组合灯意图卡片404k的操作(第二操作)。响应于该长按操作,智能面板显示亮度调节条404m(第一控件)。智能面板接收用户通过亮度调节条404m输入的最新亮度(第二控制参数),使得组合灯意图对应的亮度调整为最新亮度(比如60%)。For example, as shown in (b) of Figure 9 , assuming that the target intention is a combination light intention, the initial brightness (first control parameter) corresponding to the combination light intention is 30%, and the smart panel receives the user's operation of long pressing the combination light intention card 404k (Second operation). In response to the long press operation, the smart panel displays a brightness adjustment bar 404m (first control). The smart panel receives the latest brightness (second control parameter) input by the user through the brightness adjustment bar 404m, so that the brightness corresponding to the combination lamp intention is adjusted to the latest brightness (for example, 60%).
如此,用户可以针对目标场景中目标意图对应的控制参数进行调整,能够满足用户的设备控制需求,提升设备控制的灵活性。In this way, the user can adjust the control parameters corresponding to the target intention in the target scene, which can meet the user's device control needs and improve the flexibility of device control.
在一种可能的设计中,所述一个或多个意图属于一个或多个子系统。In one possible design, the one or more intentions belong to one or more subsystems.
示例性的,该一个或多个意图可以对应照明子系统、冷暖新风子系统、遮阳子系统等。例如,当该一个或多个意图包括灯全开、灯全关、开启组合灯(亮度参数为60%),其对应的子系统为照明子系统。又例如,当该一个或多个意图包括灯全开、灯全关、开启组合灯(亮度参数为60%)、恒温意图、恒湿意图时,其对应的子系统为照明子系统和冷暖新风子系统。For example, the one or more intentions may correspond to the lighting subsystem, heating and cooling fresh air subsystem, sunshade subsystem, etc. For example, when the one or more intentions include all lights on, all lights off, and combination lights on (brightness parameter is 60%), the corresponding subsystem is the lighting subsystem. For another example, when the one or more intentions include fully on lights, fully off lights, turning on combination lights (brightness parameter is 60%), constant temperature intention, constant humidity intention, the corresponding subsystems are lighting subsystem and heating and cooling fresh air subsystem.
第二方面,提供一种智能设备控制方法,应用于第一电子设备,所述方法包括:In a second aspect, an intelligent device control method is provided, applied to a first electronic device, and the method includes:
显示第三界面,所述第三界面包括一个或多个意图的标识,所述一个或多个意图中至少一个意图对应多个电子设备;Display a third interface, the third interface including identification of one or more intentions, at least one of the one or more intentions corresponding to multiple electronic devices;
响应于用户从所述一个或多个意图中选择目标意图的操作,显示第四界面,所述第四界面包括目标意图以及第一群组中一个或多个电子设备的标识,所述第一群组与所述用户信息关联;所述一个或多个电子设备用于执行所述目标意图,所述一个或多个电子设备包括目标电子设备;In response to the user's operation of selecting a target intention from the one or more intentions, a fourth interface is displayed, the fourth interface includes the target intention and an identification of one or more electronic devices in the first group, the first A group is associated with the user information; the one or more electronic devices are used to execute the target intent, and the one or more electronic devices include the target electronic device;
接收用户对所述目标电子设备的标识的操作;Receive a user's operation on the identification of the target electronic device;
响应于所述操作,指示所述目标电子设备执行所述目标意图,所述用户信息包括如下任一项或多项信息:所述用户的位置、所述用户的行为、当前时间。In response to the operation, the target electronic device is instructed to execute the target intention, and the user information includes any one or more of the following information: the user's location, the user's behavior, and the current time.
示例性的,如图16A的(b)所示,智能面板显示界面1603(第三界面),界面1603包括多个意图的标识。响应于用户从多个意图中选择目标意图(音乐播放的意图)的操作,智能面板可以跳转到如图16B所示音乐播放意图对应的界面1607(第四界面),界面1607包括音乐播放意图(目标意图)以及客厅群组中一个或多个电子设备的标识(比如音箱1的标识和音箱2的标识)。Exemplarily, as shown in (b) of FIG. 16A , the smart panel displays an interface 1603 (the third interface), and the interface 1603 includes identification of multiple intentions. In response to the user's operation of selecting a target intention (intention for music playback) from multiple intentions, the smart panel can jump to the interface 1607 (the fourth interface) corresponding to the music playback intention as shown in Figure 16B. The interface 1607 includes the music playback intention. (target intent) and the identification of one or more electronic devices in the living room group (such as the identification of speaker 1 and the identification of speaker 2).
其中,客厅群组是根据用户信息确定的。智能面板接收用户对客厅群组中目标电 子设备的标识(比如音箱1的标识)的操作,响应于该操作,智能面板指示音箱1执行音乐播放意图。Among them, the living room group is determined based on user information. The smart panel receives the user's feedback on the target electricity in the living room group. In response to the operation of the identification of the sub-device (such as the identification of the speaker 1), the smart panel instructs the speaker 1 to perform the music playback intention.
该方案中,可以根据用户信息确定用户想要控制的目标电子设备群组,进而可以显示目标电子设备群组的标识以及目标电子设备群组中各电子设备的标识,使得用户可以通过浏览目标电子设备群组中各电子设备的标识,方便快速的查找到想要控制的目标电子设备,进而对目标电子设备进行控制,有助于提升设备控制的效率。In this solution, the target electronic device group that the user wants to control can be determined based on the user information, and then the identification of the target electronic device group and the identification of each electronic device in the target electronic device group can be displayed, so that the user can browse the target electronic device The identification of each electronic device in the device group makes it easy to quickly find the target electronic device you want to control, and then control the target electronic device, which helps improve the efficiency of device control.
在一种可能的设计中,接收用户对所述目标电子设备的标识的操作,包括:In one possible design, receiving the user's operation on the identification of the target electronic device includes:
接收用户将所述目标电子设备的标识移向所述目标意图的标识的操作。An operation of the user to move the identification of the target electronic device toward the identification of the target intention is received.
在一种可能的设计中,所述第四界面还包括第二群组的标识,所述第二群组包括可执行所述目标意图的其他电子设备。In a possible design, the fourth interface further includes an identification of a second group, and the second group includes other electronic devices that can execute the target intention.
示例性的,如图16B,界面1607除了包括客厅(第一群组)中电子设备的标识,还包括主卧、次卧、书房等第二群组的标识。如此,便于用户查找、了解全屋中各空间的设备情况。For example, as shown in FIG. 16B , the interface 1607 not only includes the identification of the electronic devices in the living room (the first group), but also includes the identification of the second group such as the master bedroom, the secondary bedroom, and the study room. In this way, it is convenient for users to find and understand the equipment status of each space in the whole house.
在一种可能的设计中,所述第二群组的标识与所述目标意图的标识的距离大于所述第一群组的标识与所述目标意图的标识的距离。示例性的,如图16B,书房等第二群组的标识与中心意图(音乐播放意图163)的标识的距离大于客厅(即第一群组)的标识与中心意图的标识的距离。如此,由于客厅的标识与中心意图的标识之间距离较近,有利于快速对客厅中的电子设备的标识进行操作,以便于控制相应电子设备。In a possible design, the distance between the identifier of the second group and the identifier of the target intention is greater than the distance between the identifier of the first group and the identifier of the target intention. For example, as shown in Figure 16B, the distance between the logo of the second group such as the study and the logo of the central intention (music playing intention 163) is greater than the distance between the logo of the living room (ie the first group) and the logo of the central intention. In this way, since the distance between the logo of the living room and the logo of the central intention is close, it is conducive to quickly operating the logo of the electronic device in the living room, so as to control the corresponding electronic device.
在一种可能的设计中,所述第四界面还包括所述目标电子设备的第三控制参数,所述第三控制参数是根据所述用户信息确定的。In a possible design, the fourth interface further includes a third control parameter of the target electronic device, and the third control parameter is determined based on the user information.
示例性的,如图19(b),界面1601还包括建议亮度、建议色温等第三控制参数。For example, as shown in Figure 19(b), the interface 1601 also includes third control parameters such as recommended brightness and recommended color temperature.
在一种可能的设计中,所述方法还包括:In a possible design, the method further includes:
接收所述用户输入的所述目标电子设备对应的第四控制参数,使得所述目标电子设备的控制参数调整为所述第四控制参数。示例性的,如图19的(c),智能面板还可以接收用户输入的色温(比如5500K)。后续,智能面板可以控制书房中的灯开启,并调整至色温5500K。The fourth control parameter corresponding to the target electronic device input by the user is received, so that the control parameter of the target electronic device is adjusted to the fourth control parameter. For example, as shown in (c) of Figure 19, the smart panel can also receive a color temperature (such as 5500K) input by the user. Subsequently, the smart panel can control the lights in the study to turn on and adjust the color temperature to 5500K.
在一种可能的设计中,所述一个或多个意图属于一个或多个子系统。例如,照明子系统,影音子系统。In one possible design, the one or more intentions belong to one or more subsystems. For example, lighting subsystem, audio and video subsystem.
第三方面,提供一种智能设备控制方法,包括:In the third aspect, an intelligent device control method is provided, including:
第一电子设备显示第一界面,所述第一界面包括一个多个意图的标识;所述一个或多个意图中至少一个意图对应多个电子设备;The first electronic device displays a first interface, the first interface includes identification of multiple intentions; at least one intention among the one or more intentions corresponds to multiple electronic devices;
所述第一电子设备响应于用户从所述一个或多个意图中选择目标意图的操作,将所述目标意图添加到目标场景中;The first electronic device adds the target intention to the target scene in response to the user's operation of selecting a target intention from the one or more intentions;
所述第一电子设备在满足所述目标场景的触发条件时,向一个或多个目标电子设备发送控制指令,其中,所述一个或多个目标电子设备为所述目标意图对应的电子设备;When the trigger condition of the target scene is met, the first electronic device sends a control instruction to one or more target electronic devices, where the one or more target electronic devices are electronic devices corresponding to the target intention;
所述目标电子设备从所述第一电子设备接收所述控制指令,并根据所述控制指令执行所述目标意图。The target electronic device receives the control instruction from the first electronic device and executes the target intention according to the control instruction.
在一种可能的设计中,所述目标电子设备包括第二电子设备和第三电子设备; In a possible design, the target electronic device includes a second electronic device and a third electronic device;
所述第一电子设备向一个或多个目标电子设备发送控制指令,包括:向所述第二电子设备发送第一控制指令,向所述第三电子设备发送第二控制指令,以使得所述第二电子设备和所述第三电子设备共同执行所述目标意图;The first electronic device sends a control instruction to one or more target electronic devices, including: sending a first control instruction to the second electronic device, and sending a second control instruction to the third electronic device, so that the The second electronic device and the third electronic device jointly execute the target intention;
所述目标电子设备从所述第一电子设备接收所述控制指令,并根据所述控制指令执行所述目标意图,包括:所述第二电子设备,用于从所述第一电子设备接收所述第一控制指令,并根据所述第一控制指令执行所述目标意图;所述第三电子设备,用于从所述第一电子设备接收所述第二控制指令,并根据所述第二控制指令执行所述目标意图。The target electronic device receives the control instruction from the first electronic device and executes the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device. the first control instruction, and execute the target intention according to the first control instruction; the third electronic device is configured to receive the second control instruction from the first electronic device, and execute the target intention according to the second The control instructions execute the target intent.
在一种可能的设计中,所述目标意图包括第一目标意图和第二目标意图;所述目标电子设备包括第二电子设备和第三电子设备;In a possible design, the target intention includes a first target intention and a second target intention; the target electronic device includes a second electronic device and a third electronic device;
所述第一电子设备向一个或多个目标电子设备发送控制指令,包括:The first electronic device sends control instructions to one or more target electronic devices, including:
向所述第二电子设备发送第一控制指令,所述第一控制指令用于控制所述第二电子设备执行所述第一目标意图;Send a first control instruction to the second electronic device, the first control instruction being used to control the second electronic device to execute the first target intention;
向所述第三电子设备发送第二控制指令,所述第二控制指令用于控制所述第三电子设备执行所述第二目标意图;Send a second control instruction to the third electronic device, the second control instruction being used to control the third electronic device to execute the second target intention;
所述目标电子设备从所述第一电子设备接收所述控制指令,并根据所述控制指令执行所述目标意图,包括:所述第二电子设备,用于从所述第一电子设备接收所述第一控制指令,并根据所述第一控制指令指示所述第一目标意图;所述第三电子设备,用于从所述第一电子设备接收所述第二控制指令,并根据所述第二控制指令执行所述第二目标意图。The target electronic device receives the control instruction from the first electronic device and executes the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device. the first control instruction, and indicating the first target intention according to the first control instruction; the third electronic device is configured to receive the second control instruction from the first electronic device, and according to the The second control instruction executes the second target intention.
在一种可能的设计中,所述第一界面还包括全屋的多个空间的标识;所述多个空间第一空间和第二空间;所述第一空间的标识被选中;所述一个或多个意图包括所述第一空间中电子设备可执行的意图。In a possible design, the first interface also includes identification of multiple spaces in the whole house; the first space and the second space of the plurality of spaces; the identification of the first space is selected; the one The or multiple intentions include intentions that are executable by the electronic device in the first space.
在一种可能的设计中,所述方法还包括:所述第一电子设备接收所述用户对所述第二空间的标识的操作,显示第二界面,所述第二界面包括所述第二空间中电子设备可执行的意图的标识。In a possible design, the method further includes: the first electronic device receiving the user's operation on the identification of the second space and displaying a second interface, the second interface including the second Identification of the intent executable by electronic devices in space.
在一种可能的设计中,所述第二空间的标识被选中;所述一个或多个意图为多个意图,所述多个意图还包括所述第二空间中电子设备可执行的意图。In a possible design, the identity of the second space is selected; the one or more intentions are multiple intentions, and the multiple intentions also include intentions that are executable by electronic devices in the second space.
在一种可能的设计中,所述第一空间中电子设备可执行的意图的标识与所述第二空间中电子设备可执行的意图的标识具有不同用户界面UI效果。In a possible design, the identification of the intention executable by the electronic device in the first space and the identification of the intention executable by the electronic device in the second space have different user interface UI effects.
在一种可能的设计中,所述目标意图对应的控制参数为第一控制参数;In a possible design, the control parameter corresponding to the target intention is the first control parameter;
所述方法还包括:所述第一电子设备接收用户输入的第二操作;响应于所述第二操作,显示第一控件,所述第一控件用于输入所述目标意图对应的第二控制参数;接收所述用户通过所述第一控件输入的第二控制参数,使得所述目标意图对应的控制参数调整为所述第二控制参数。The method further includes: the first electronic device receiving a second operation input by the user; in response to the second operation, displaying a first control, the first control being used to input a second control corresponding to the target intention. Parameter: receiving the second control parameter input by the user through the first control, so that the control parameter corresponding to the target intention is adjusted to the second control parameter.
在一种可能的设计中,所述一个或多个意图属于一个或多个子系统。In one possible design, the one or more intentions belong to one or more subsystems.
第四方面,提供一种智能设备控制方法,所述方法包括:In a fourth aspect, an intelligent device control method is provided, the method including:
第一电子设备显示第三界面,所述第三界面包括一个或多个意图的标识,所述一个或多个意图中至少一个意图对应多个电子设备; The first electronic device displays a third interface, the third interface includes identification of one or more intentions, and at least one intention among the one or more intentions corresponds to multiple electronic devices;
第一电子设备响应于用户从所述一个或多个意图中选择目标意图的操作,显示第四界面,所述第四界面包括目标意图以及第一群组中一个或多个电子设备的标识,所述第一群组与所述用户信息关联;所述一个或多个电子设备用于执行所述目标意图,所述一个或多个电子设备包括目标电子设备;The first electronic device displays a fourth interface in response to the user's operation of selecting a target intention from the one or more intentions, the fourth interface including the target intention and an identification of one or more electronic devices in the first group, The first group is associated with the user information; the one or more electronic devices are used to execute the target intention, and the one or more electronic devices include a target electronic device;
第一电子设备接收用户对所述目标电子设备的标识的操作;The first electronic device receives a user's operation on the identification of the target electronic device;
第一电子设备响应于所述操作,向所述目标电子设备发送控制指令,所述控制指令用于指示所述目标电子设备执行所述目标意图,所述用户信息包括如下任一项或多项信息:所述用户的位置、所述用户的行为、当前时间。In response to the operation, the first electronic device sends a control instruction to the target electronic device. The control instruction is used to instruct the target electronic device to execute the target intention. The user information includes any one or more of the following: Information: the user's location, the user's behavior, and the current time.
目标电子设备从第一电子设备接收控制指令,并根据所述控制指令执行所述目标意图。The target electronic device receives the control instruction from the first electronic device and executes the target intention according to the control instruction.
在一种可能的设计中,接收用户对所述目标电子设备的标识的操作,包括:In one possible design, receiving the user's operation on the identification of the target electronic device includes:
接收用户将所述目标电子设备的标识移向所述目标意图的标识的操作。An operation of the user to move the identification of the target electronic device toward the identification of the target intention is received.
在一种可能的设计中,所述第四界面还包括第二群组的标识,所述第二群组包括可执行所述目标意图的其他电子设备。In a possible design, the fourth interface further includes an identification of a second group, and the second group includes other electronic devices that can execute the target intention.
在一种可能的设计中,所述第二群组的标识与所述目标意图的标识的距离大于所述第一群组的标识与所述目标意图的标识的距离。In a possible design, the distance between the identifier of the second group and the identifier of the target intention is greater than the distance between the identifier of the first group and the identifier of the target intention.
在一种可能的设计中,所述第四界面还包括所述目标电子设备的第三控制参数,所述第三控制参数是根据所述用户信息确定的。In a possible design, the fourth interface further includes a third control parameter of the target electronic device, and the third control parameter is determined based on the user information.
在一种可能的设计中,所述方法还包括:In a possible design, the method further includes:
接收所述用户输入的所述目标电子设备对应的第四控制参数,使得所述目标电子设备的控制参数调整为所述第四控制参数。The fourth control parameter corresponding to the target electronic device input by the user is received, so that the control parameter of the target electronic device is adjusted to the fourth control parameter.
第五方面,提供一种智能设备控制系统,包括:In the fifth aspect, an intelligent equipment control system is provided, including:
第一电子设备,用于显示第一界面,所述第一界面包括一个或多个意图的标识;所述一个或多个意图中至少一个意图对应多个电子设备;A first electronic device configured to display a first interface, where the first interface includes identification of one or more intentions; at least one of the one or more intentions corresponds to multiple electronic devices;
所述第一电子设备,还用于响应于用户从所述一个或多个意图中选择目标意图的操作,将所述目标意图添加到目标场景中;The first electronic device is further configured to add the target intention to the target scene in response to the user's operation of selecting a target intention from the one or more intentions;
所述第一电子设备,还用于在满足所述目标场景的触发条件时,向一个或多个目标电子设备发送控制指令,其中,所述一个或多个目标电子设备为所述目标意图对应的电子设备;The first electronic device is further configured to send a control instruction to one or more target electronic devices when the trigger condition of the target scene is met, wherein the one or more target electronic devices correspond to the target intention. electronic equipment;
所述目标电子设备,用于从所述第一电子设备接收所述控制指令,并根据所述控制指令执行所述目标意图。The target electronic device is configured to receive the control instruction from the first electronic device and execute the target intention according to the control instruction.
在一种可能的设计中,所述目标电子设备包括第二电子设备和第三电子设备;In a possible design, the target electronic device includes a second electronic device and a third electronic device;
所述第一电子设备,用于向一个或多个目标电子设备发送控制指令,包括:向所述第二电子设备发送第一控制指令,向所述第三电子设备发送第二控制指令,以使得所述第二电子设备和所述第三电子设备共同执行所述目标意图;The first electronic device is used to send a control instruction to one or more target electronic devices, including: sending a first control instruction to the second electronic device, and sending a second control instruction to the third electronic device, to causing the second electronic device and the third electronic device to jointly execute the target intention;
所述目标电子设备,用于从所述第一电子设备接收所述控制指令,并根据所述控制指令执行所述目标意图,包括:所述第二电子设备,用于从所述第一电子设备接收所述第一控制指令,并根据所述第一控制指令执行所述目标意图;所述第三电子设备,用于从所述第一电子设备接收所述第二控制指令,并根据所述第二控制指令执行所述 目标意图。The target electronic device is configured to receive the control instruction from the first electronic device and execute the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device. The device receives the first control instruction and executes the target intention according to the first control instruction; the third electronic device is used to receive the second control instruction from the first electronic device and execute the target intention according to the first control instruction. The second control instruction executes the Goal intention.
在一种可能的设计中,所述目标意图包括第一目标意图和第二目标意图;所述目标电子设备包括第二电子设备和第三电子设备;In a possible design, the target intention includes a first target intention and a second target intention; the target electronic device includes a second electronic device and a third electronic device;
所述第一电子设备,用于向一个或多个目标电子设备发送控制指令,包括:The first electronic device is used to send control instructions to one or more target electronic devices, including:
向所述第二电子设备发送第一控制指令,所述第一控制指令用于控制所述第二电子设备执行所述第一目标意图;Send a first control instruction to the second electronic device, the first control instruction being used to control the second electronic device to execute the first target intention;
向所述第三电子设备发送第二控制指令,所述第二控制指令用于控制所述第三电子设备执行所述第二目标意图;Send a second control instruction to the third electronic device, the second control instruction being used to control the third electronic device to execute the second target intention;
所述目标电子设备,用于从所述第一电子设备接收所述控制指令,并根据所述控制指令执行所述目标意图,包括:所述第二电子设备,用于从所述第一电子设备接收所述第一控制指令,并根据所述第一控制指令指示所述第一目标意图;所述第三电子设备,用于从所述第一电子设备接收所述第二控制指令,并根据所述第二控制指令执行所述第二目标意图。The target electronic device is configured to receive the control instruction from the first electronic device and execute the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device. The device receives the first control instruction and indicates the first target intention according to the first control instruction; the third electronic device is used to receive the second control instruction from the first electronic device, and The second target intention is executed according to the second control instruction.
在一种可能的设计中,所述第一界面还包括全屋的多个空间的标识;所述多个空间第一空间和第二空间;所述第一空间的标识被选中;所述一个或多个意图包括所述第一空间中电子设备可执行的意图。In a possible design, the first interface also includes identification of multiple spaces in the whole house; the first space and the second space of the plurality of spaces; the identification of the first space is selected; the one The or multiple intentions include intentions that are executable by the electronic device in the first space.
在一种可能的设计中,所述第一电子设备,还用于:In a possible design, the first electronic device is also used for:
接收所述用户对所述第二空间的标识的操作,显示第二界面,所述第二界面包括所述第二空间中电子设备可执行的意图的标识。Receive the user's operation on the identification of the second space and display a second interface, where the second interface includes an identification of an intention executable by the electronic device in the second space.
在一种可能的设计中,所述第二空间的标识被选中;所述一个或多个意图为多个意图,所述多个意图还包括所述第二空间中电子设备可执行的意图。In a possible design, the identity of the second space is selected; the one or more intentions are multiple intentions, and the multiple intentions also include intentions that are executable by electronic devices in the second space.
在一种可能的设计中,所述第一空间中电子设备可执行的意图的标识与所述第二空间中电子设备可执行的意图的标识具有不同用户界面UI效果。In a possible design, the identification of the intention executable by the electronic device in the first space and the identification of the intention executable by the electronic device in the second space have different user interface UI effects.
在一种可能的设计中,所述目标意图对应的控制参数为第一控制参数;In a possible design, the control parameter corresponding to the target intention is the first control parameter;
所述第一电子设备,还用于执行如下操作:The first electronic device is also used to perform the following operations:
接收用户输入的第二操作;A second operation that receives user input;
响应于所述第二操作,显示第一控件,所述第一控件用于输入所述目标意图对应的第二控制参数;In response to the second operation, display a first control, the first control being used to input a second control parameter corresponding to the target intention;
接收所述用户通过所述第一控件输入的第二控制参数,使得所述目标意图对应的控制参数调整为所述第二控制参数。The second control parameter input by the user through the first control is received, so that the control parameter corresponding to the target intention is adjusted to the second control parameter.
在一种可能的设计中,所述一个或多个意图属于一个或多个子系统。In one possible design, the one or more intentions belong to one or more subsystems.
第六方面,提供一种智能设备控制系统,包括:In the sixth aspect, an intelligent equipment control system is provided, including:
第一电子设备,用于显示第三界面,所述第三界面包括一个或多个意图的标识,所述一个或多个意图中至少一个意图对应多个电子设备;A first electronic device configured to display a third interface, where the third interface includes identification of one or more intentions, at least one of the one or more intentions corresponding to multiple electronic devices;
第一电子设备,还用于响应于用户从所述一个或多个意图中选择目标意图的操作,显示第四界面,所述第四界面包括目标意图以及第一群组中一个或多个电子设备的标识,所述第一群组与所述用户信息关联;所述一个或多个电子设备用于执行所述目标意图,所述一个或多个电子设备包括目标电子设备;The first electronic device is further configured to, in response to the user's operation of selecting a target intention from the one or more intentions, display a fourth interface, the fourth interface including the target intention and one or more electronic devices in the first group. The identification of the device, the first group is associated with the user information; the one or more electronic devices are used to execute the target intention, and the one or more electronic devices include the target electronic device;
第一电子设备,还用于接收用户对所述目标电子设备的标识的操作; The first electronic device is also configured to receive a user's operation on the identification of the target electronic device;
第一电子设备,还用于响应于所述操作,向所述目标电子设备发送控制指令,所述控制指令用于指示所述目标电子设备执行所述目标意图,所述用户信息包括如下任一项或多项信息:所述用户的位置、所述用户的行为、当前时间。The first electronic device is further configured to send a control instruction to the target electronic device in response to the operation. The control instruction is used to instruct the target electronic device to execute the target intention. The user information includes any of the following: Item or multiple pieces of information: the user's location, the user's behavior, and the current time.
目标电子设备,用于从第一电子设备接收控制指令,并根据所述控制指令执行所述目标意图。The target electronic device is configured to receive a control instruction from the first electronic device and execute the target intention according to the control instruction.
在一种可能的设计中,接收用户对所述目标电子设备的标识的操作,包括:In one possible design, receiving the user's operation on the identification of the target electronic device includes:
接收用户将所述目标电子设备的标识移向所述目标意图的标识的操作。An operation of the user to move the identification of the target electronic device toward the identification of the target intention is received.
在一种可能的设计中,所述第四界面还包括第二群组的标识,所述第二群组包括可执行所述目标意图的其他电子设备。In a possible design, the fourth interface further includes an identification of a second group, and the second group includes other electronic devices that can execute the target intention.
在一种可能的设计中,所述第二群组的标识与所述目标意图的标识的距离大于所述第一群组的标识与所述目标意图的标识的距离。In a possible design, the distance between the identifier of the second group and the identifier of the target intention is greater than the distance between the identifier of the first group and the identifier of the target intention.
在一种可能的设计中,所述第四界面还包括所述目标电子设备的第三控制参数,所述第三控制参数是根据所述用户信息确定的。In a possible design, the fourth interface further includes a third control parameter of the target electronic device, and the third control parameter is determined based on the user information.
在一种可能的设计中,所述第一电子设备,还用于:In a possible design, the first electronic device is also used for:
接收所述用户输入的所述目标电子设备对应的第四控制参数,使得所述目标电子设备的控制参数调整为所述第四控制参数。The fourth control parameter corresponding to the target electronic device input by the user is received, so that the control parameter of the target electronic device is adjusted to the fourth control parameter.
在一种可能的设计中,所述一个或多个意图属于一个或多个子系统。In one possible design, the one or more intentions belong to one or more subsystems.
第七方面,本申请实施例提供一种电子设备,该电子设备具有实现如上述任一方面及其中任一种可能的实现方式中所述的智能设备控制方法的功能。该功能可以通过硬件实现,也可以通过硬件执行相应地软件实现。该硬件或软件包括一个或多个与上述功能相对应的模块。In a seventh aspect, embodiments of the present application provide an electronic device that has the function of implementing the smart device control method described in any of the above aspects and any of the possible implementations. This function can be implemented by hardware, or can be implemented by hardware and corresponding software. The hardware or software includes one or more modules corresponding to the above functions.
第八方面,提供一种计算机可读存储介质。计算机可读存储介质存储有计算机程序(也可称为指令或代码),当该计算机程序被电子设备执行时,使得电子设备执行任一方面或任一方面中任意一种实施方式的方法。In an eighth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program (which may also be referred to as instructions or codes). When the computer program is executed by an electronic device, it causes the electronic device to perform any aspect or the method of any implementation in any aspect.
第九方面,本申请实施例提供一种计算机程序产品,当计算机程序产品在电子设备上运行时,使得电子设备执行任一方面或任一方面中任意一种实施方式的方法。In a ninth aspect, embodiments of the present application provide a computer program product, which when the computer program product is run on an electronic device, causes the electronic device to execute any aspect or the method of any implementation in any aspect.
第十方面,本申请实施例提供一种电路系统,电路系统包括处理电路,处理电路被配置为执行任一方面或任一方面中任意一种实施方式的方法。In a tenth aspect, embodiments of the present application provide a circuit system. The circuit system includes a processing circuit, and the processing circuit is configured to perform any aspect or the method of any implementation in any aspect.
第十一方面,本申请实施例提供一种芯片系统,包括至少一个处理器和至少一个接口电路,至少一个接口电路用于执行收发功能,并将指令发送给至少一个处理器,当至少一个处理器执行指令时,至少一个处理器执行任一方面或任一方面中任意一种实施方式的方法。In an eleventh aspect, embodiments of the present application provide a chip system, including at least one processor and at least one interface circuit. The at least one interface circuit is used to perform transceiver functions and send instructions to at least one processor. When at least one processes When the processor executes instructions, at least one processor executes any aspect or a method of any implementation in any aspect.
附图说明Description of the drawings
图1为相关技术中场景编辑方法的示意图;Figure 1 is a schematic diagram of a scene editing method in related technologies;
图2为本申请实施例提供的系统架构示意图;Figure 2 is a schematic diagram of the system architecture provided by the embodiment of this application;
图3A为本申请实施例提供的全屋划分子系统的示意图;Figure 3A is a schematic diagram of a whole-house division subsystem provided by an embodiment of the present application;
图3B为本申请实施例提供的离家场景对应的子系统以及原子能力示意图;Figure 3B is a schematic diagram of the subsystems and atomic capabilities corresponding to the leaving home scenario provided by the embodiment of the present application;
图4为本申请实施例提供的第一电子设备的硬件结构示意图;Figure 4 is a schematic diagram of the hardware structure of the first electronic device provided by an embodiment of the present application;
图5为本申请实施例提供的第一电子设备的软件结构示意图; Figure 5 is a schematic diagram of the software structure of the first electronic device provided by the embodiment of the present application;
图6为本申请实施例提供的系统架构示意图;Figure 6 is a schematic diagram of the system architecture provided by the embodiment of this application;
图7-图9为本申请实施例提供的界面示意图;Figures 7-9 are schematic interface diagrams provided by embodiments of the present application;
图10为本申请实施例提供的场景、设备、子系统的关联示意图;Figure 10 is a schematic diagram of the correlation of scenarios, equipment, and subsystems provided by the embodiment of this application;
图11为本申请实施例提供的界面示意图十;Figure 11 is a schematic diagram 10 of the interface provided by the embodiment of the present application;
图12A为本申请实施例提供的界面示意图;Figure 12A is a schematic diagram of the interface provided by the embodiment of the present application;
图12B为本申请实施例提供的界面示意图;Figure 12B is a schematic diagram of the interface provided by the embodiment of the present application;
图12C为本申请实施例提供的界面示意图;Figure 12C is a schematic diagram of the interface provided by the embodiment of the present application;
图13为本申请实施例提供的观影模式场景的示意图;Figure 13 is a schematic diagram of a movie viewing mode scene provided by an embodiment of the present application;
图14、图15为本申请实施例提供的界面示意图;Figures 14 and 15 are schematic interface diagrams provided by embodiments of the present application;
图16A为本申请实施例提供的界面示意图;Figure 16A is a schematic diagram of the interface provided by the embodiment of the present application;
图16B为本申请实施例提供的界面示意图;Figure 16B is a schematic diagram of the interface provided by the embodiment of the present application;
图17-图22为本申请实施例提供的界面示意图;Figures 17-22 are schematic interface diagrams provided by embodiments of the present application;
图23为本申请实施例提供的第一电子设备的结构示意图。Figure 23 is a schematic structural diagram of a first electronic device provided by an embodiment of the present application.
具体实施方式Detailed ways
下面结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。其中,在本申请实施例的描述中,以下实施例中所使用的术语只是为了描述特定实施例的目的,而并非旨在作为对本申请的限制。如在本申请的说明书和所附权利要求书中所使用的那样,单数表达形式“一个”、“一种”、“所述”、“上述”、“该”和“这一”旨在包括例如“一个或多个”这种表达形式,除非其上下文中明确地有相反指示。还应当理解,在本申请以下各实施例中,“至少一个”、“一个或多个”是指一个或两个以上(包含两个)。The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and appended claims of this application, the singular expressions "a," "an," "the," "above," "the" and "the" are intended to include For example, the expression "one or more" unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, "at least one" and "one or more" refer to one or more than two (including two).
在本说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此,在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例,而是意味着“一个或多个但不是所有的实施例”,除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”,除非是以其他方式另外特别强调。术语“连接”包括直接连接和间接连接,除非另外说明。“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。Reference in this specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Therefore, the phrases "in one embodiment", "in some embodiments", "in other embodiments", "in other embodiments", etc. appearing in different places in this specification are not necessarily References are made to the same embodiment, but rather to "one or more but not all embodiments" unless specifically stated otherwise. The terms “including,” “includes,” “having,” and variations thereof all mean “including but not limited to,” unless otherwise specifically emphasized. The term "connected" includes both direct and indirect connections unless otherwise stated. “First” and “second” are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features.
在本申请实施例中,“示例性地”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性地”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用“示例性地”或者“例如”等词旨在以具体方式呈现相关概念。In the embodiments of this application, words such as "exemplarily" or "for example" are used to represent examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "such as" in the embodiments of the present application is not to be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.
在一些场景中,各种各样的电子设备已经进入人们的生活,针对电子设备家庭使用场景提出智能家居系统的概念,以住宅为平台,利用物联网、自动控制等技术,智能家居系统实现将与家居生活有关的各个电子设备、应用有机的结合在一起。其中,智能家居系统中的电子设备例如为智能家居设备。智能家居设备为智能设备,如包括音视频设备(如大屏设备、蓝牙音箱等)、照明设备(如顶灯、台灯、射灯等)、环 境控制设备(如空调、空气净化器等)、防盗报警设备(如人体传感器、摄像头等)等。In some scenarios, various electronic devices have entered people's lives. The concept of smart home system is proposed for home use scenarios of electronic devices. Using the residence as a platform, using the Internet of Things, automatic control and other technologies, the smart home system realizes Various electronic devices and applications related to home life are organically combined. Among them, the electronic devices in the smart home system are, for example, smart home devices. Smart home equipment is intelligent equipment, including audio and video equipment (such as large screen equipment, Bluetooth speakers, etc.), lighting equipment (such as ceiling lamps, table lamps, spotlights, etc.), environmental Environmental control equipment (such as air conditioners, air purifiers, etc.), anti-theft alarm equipment (such as human body sensors, cameras, etc.), etc.
示例性的,假设空调作为智能家居设备,与手机连接,空调可以接收用户通过手机发送的控制命令。例如,空调接收用户通过手机输入的“打开”的命令,可自动启动。又例如,空调接收用户通过手机输入的“调节温度至26℃”的命令,可自动调节温度至26℃。可选的,电子设备(如手机)中安装有智能家居应用(如智慧生活应用),电子设备可以通过智能家居应用与智能家居设备配对,管理和控制智能家居设备。For example, assuming that the air conditioner is connected to a mobile phone as a smart home device, the air conditioner can receive control commands sent by the user through the mobile phone. For example, the air conditioner receives the "turn on" command input by the user through the mobile phone and can be started automatically. For another example, the air conditioner receives the command "Adjust the temperature to 26°C" input by the user through the mobile phone, and can automatically adjust the temperature to 26°C. Optionally, a smart home application (such as a smart life application) is installed in the electronic device (such as a mobile phone). The electronic device can be paired with the smart home device through the smart home application to manage and control the smart home device.
但是,如需实现上述智能家居设备的控制,电子设备需要预先与智能家居设备建立连接,并对智能家居设备进行配置。However, in order to control the above-mentioned smart home devices, the electronic device needs to establish a connection with the smart home device in advance and configure the smart home device.
示例性的,假设手机中安装有智慧生活应用,手机启动智慧生活应用,显示如图1中(a)所示的场景界面201。手机检测到用户点击添加控件21的操作后,显示如图1中(b)所示界面202,手机接收用户创建场景的操作,如接收用户添加控制智能家居设备的条件和需要智能家居设备执行的任务的操作。比如,用户可以点击添加条件控件26,并添加控制智能家居设备的条件,比如添加如图1的(f)所示的触发条件“当点击场景卡片时”。如此一来,后续,当手机检测到用户点击该场景的场景卡片时,可以控制智能家居设备执行相应任务。For example, it is assumed that a smart life application is installed in the mobile phone, the smart life application is launched on the mobile phone, and the scene interface 201 shown in (a) in Figure 1 is displayed. After the mobile phone detects the user's operation of clicking on the add control 21, the interface 202 shown in (b) in Figure 1 is displayed. The mobile phone receives the user's operation to create the scene, such as receiving the user's addition of conditions for controlling smart home devices and tasks that need to be performed by the smart home device. Task operation. For example, the user can click the add condition control 26 and add a condition for controlling the smart home device, such as adding a trigger condition "when the scene card is clicked" as shown in (f) of Figure 1 . In this way, when the mobile phone detects that the user clicks on the scene card of the scene, it can control the smart home device to perform the corresponding task.
再比如,如图1中(b),手机检测到用户点击添加任务控件22的操作后,显示如图1中(c)所示界面203。在界面203上,手机检测到用户点击智能设备控件23的操作后,确定用户需要添加控制智能设备的任务,可显示图1的(d)所示界面204,界面204包括可控制的智能设备。检测到用户点击“客厅的空调”选项27,手机可跳转到如图1的(e)所示界面205。界面205包括控制可执行的操作的信息。假设检测到用户点击“打开”选项28,手机可跳转到图1的(f)所示界面206,界面206包括控件24。检测到用户点击控件24的操作后,手机可跳转到图1的(c)所示界面203。之后,用户可以点击“智能设备”选项23,手机可跳转到图1的(d)所示界面204,选择其他设备作为待创建场景所需控制的设备。For another example, as shown in (b) of Figure 1, after the mobile phone detects that the user clicks on the add task control 22, the interface 203 shown in (c) of Figure 1 is displayed. On the interface 203, after the mobile phone detects the user's click on the smart device control 23, it determines that the user needs to add a task to control the smart device, and displays the interface 204 shown in (d) of Figure 1. The interface 204 includes controllable smart devices. When it is detected that the user clicks on the "air conditioner in the living room" option 27, the mobile phone can jump to the interface 205 shown in (e) of Figure 1. Interface 205 includes information that controls executable operations. Assuming that it is detected that the user clicks the "Open" option 28, the mobile phone can jump to the interface 206 shown in (f) of Figure 1. The interface 206 includes the control 24. After detecting the user's click on the control 24, the mobile phone can jump to the interface 203 shown in (c) of Figure 1. After that, the user can click the "smart device" option 23, and the mobile phone can jump to the interface 204 shown in (d) of Figure 1, and select other devices as the devices that need to be controlled in the scene to be created.
可以看出,如图1所述的场景编辑过程,用户需要对场景中需要控制的设备分别进行设置,需要反复切换多个界面,场景编辑过程复杂,用户操作难度较大。It can be seen that in the scene editing process as shown in Figure 1, the user needs to separately set the devices that need to be controlled in the scene, and needs to repeatedly switch multiple interfaces. The scene editing process is complicated and the user operation is difficult.
为了解决上述技术问题,本申请实施例提供一种智能设备的控制方法,以意图为场景编排粒度。由于一个意图通常可由一个多个智能家居设备实现,因此,在某些情况下,用户进行一次基于意图粒度的场景编排,即相当于进行了多次基于设备粒度的场景编排,极大简化了用户的场景编排操作,提升了场景编排效率。示例性地,图2为该方法适用的一种智能设备控制系统的示意图。如图2所示,智能设备控制系统可以以家庭(home)为单位对智能设备进行管控。其中,一个家庭又可称为一个全屋,全屋可以划分为不同空间,比如全屋包括入户过道、厨房、餐厅、客厅、阳台、主卧、次卧、卫生间等。In order to solve the above technical problems, embodiments of the present application provide a control method for smart devices, with the intention of orchestrating the granularity of the scene. Since an intention can usually be implemented by multiple smart home devices, in some cases, the user performs one scene orchestration based on the intent granularity, which is equivalent to performing multiple scene orchestrations based on the device granularity, which greatly simplifies the user's The scene arrangement operation improves the efficiency of scene arrangement. Exemplarily, FIG. 2 is a schematic diagram of an intelligent device control system to which this method is applicable. As shown in Figure 2, the smart device control system can manage and control smart devices on a home basis. Among them, a family can also be called a whole house, and the whole house can be divided into different spaces. For example, the whole house includes the entrance hallway, kitchen, dining room, living room, balcony, master bedroom, secondary bedroom, bathroom, etc.
全屋系统可以包括第一电子设备100,第一电子设备100可以用于控制第二电子设备200(比如物联网(internet of things,IoT)设备)。第一电子设备100包括但不限于是手机、PC、平板电脑、智能家居控制面板(可简称为智能面板)等。The whole-house system may include a first electronic device 100 that may be used to control a second electronic device 200 (such as an Internet of things (IoT) device). The first electronic device 100 includes but is not limited to a mobile phone, a PC, a tablet computer, a smart home control panel (which may be referred to as a smart panel), etc.
作为一种可能的实现方式,第一电子设备100可以安装有用于控制第二电子设备 200的应用程序。该应用程序可以是系统预装应用,或非预装应用(比如从应用市场下载的应用)。应理解:系统预装应用包括系统应用的一部分(例如系统应用中的服务,组件,或插件),或者,预先安装在第一电子设备100内的独立应用。可以理解,独立应用具有独立的应用图标。示例性的,该应用程序可以是智慧生活应用。As a possible implementation, the first electronic device 100 may be equipped with a device for controlling the second electronic device. 200 applications. The application can be a system pre-installed application or a non-pre-installed application (such as an application downloaded from the application market). It should be understood that the system pre-installed application includes a part of the system application (such as a service, component, or plug-in in the system application), or an independent application pre-installed in the first electronic device 100 . It is understood that independent applications have independent application icons. By way of example, the application may be a smart life application.
或者,第一电子设备100还可以通过控制中心控制第二电子设备200。示例性的,控制中心可以是第一电子设备100响应于用户从屏幕右上角或顶端下滑的操作,所显示的快捷控制页面。Alternatively, the first electronic device 100 can also control the second electronic device 200 through the control center. For example, the control center may be a shortcut control page displayed by the first electronic device 100 in response to the user's sliding operation from the upper right corner or top of the screen.
或者,第一电子设备100还可以通过负一屏中的相应功能菜单控制第二电子设备200。示例性的,负一屏可以是第一电子设备100响应于用户在最左侧主界面上的右滑操作,所显示的系统服务能力入口页面。Alternatively, the first electronic device 100 can also control the second electronic device 200 through the corresponding function menu on the negative screen. For example, the negative screen may be the system service capability entry page displayed by the first electronic device 100 in response to the user's right swipe operation on the leftmost main interface.
其中,本申请实施例对第一电子设备100用于控制第二电子设备200的具体方式不做限制。The embodiments of the present application do not limit the specific manner in which the first electronic device 100 controls the second electronic device 200 .
全屋还设置有第二电子设备200(比如,IoT设备)。第二电子设备200也可称为受控设备,第二电子设备200可以由第一电子设备100进行控制。比如,厨房设置有电饭煲或电压力锅、燃气设备等;客厅设置有音箱(比如,智能音箱)、电视(比如,智能电视,也称为智慧屏、大屏等)、路由设备等。A second electronic device 200 (for example, an IoT device) is also provided throughout the house. The second electronic device 200 may also be called a controlled device, and the second electronic device 200 may be controlled by the first electronic device 100 . For example, the kitchen is equipped with rice cookers or electric pressure cookers, gas equipment, etc.; the living room is equipped with speakers (such as smart speakers), TVs (such as smart TVs, also called smart screens, large screens, etc.), routing equipment, etc.
需要说明的是,虽然在图2中,第二电子设备200仅示出智能电视、体脂称,但本领域技术人员应当知晓,第二电子设备200包括但不限于智能电视、智能音箱、智能灯具(如吸顶灯、智能台灯、香薰灯等)、扫地机器人、智能晾衣架、智能电饭煲、空气净化器、加湿器、台式电脑、路由设备、智能插座、饮水机、智能冰箱、智能空调、智能开关、智能门锁等智能家居设备。需要说明的是,第二电子设备200也可以不是智能家居设备,而是其他类型设备,比如个人电脑(person computer,PC)、平板电脑、手机、智能遥控器等。本申请实施例对第二电子设备200的具体形式不做限定。It should be noted that although in FIG. 2 , the second electronic device 200 only shows a smart TV and a body fat scale, those skilled in the art should know that the second electronic device 200 includes but is not limited to a smart TV, a smart speaker, a smart TV, and a body fat scale. Lamps (such as ceiling lamps, smart desk lamps, aromatherapy lamps, etc.), sweeping robots, smart clothes drying racks, smart rice cookers, air purifiers, humidifiers, desktop computers, routing equipment, smart sockets, water dispensers, smart refrigerators, smart air conditioners, smart Smart home devices such as switches and smart door locks. It should be noted that the second electronic device 200 may not be a smart home device, but may be other types of devices, such as a personal computer (PC), tablet, mobile phone, smart remote control, etc. The embodiment of the present application does not limit the specific form of the second electronic device 200.
在一些示例中,第二电子设备200中的某一个设备可以作为主设备,用于控制其他第二电子设备200。In some examples, a certain device among the second electronic devices 200 may serve as a master device for controlling other second electronic devices 200 .
在一些实施例中,第二电子设备200的种类众多,可以按照第二电子设备200的功能,划分子系统,如照明子系统、环境子系统、安防子系统等。每个子系统可以对应于一个或多个意图。每个子系统包括一个或多个设备。In some embodiments, there are many types of second electronic devices 200, and subsystems can be divided according to the functions of the second electronic device 200, such as lighting subsystems, environment subsystems, security subsystems, etc. Each subsystem can correspond to one or more intents. Each subsystem includes one or more devices.
示例性的,在智能家居应用场景中,意图用于表达用户期望,例如可以包括:开/关灯、音乐播放、净化关闭、净化开启、窗帘全开、窗帘全开、恒温、恒湿等。For example, in a smart home application scenario, intent is used to express user expectations, which may include, for example: turning on/off lights, playing music, turning off purification, turning on purification, fully opening curtains, fully opening curtains, constant temperature, constant humidity, etc.
示例性的,照明子系统包括各种类型的灯(包括但不限于氛围灯),照明子系统对应的意图可以包括:灯全开、灯全关、开启组合灯(亮度参数为60%)。For example, the lighting subsystem includes various types of lights (including but not limited to ambient lights), and the corresponding intentions of the lighting subsystem may include: fully on lights, fully off lights, and turning on combination lights (brightness parameter is 60%).
再示例性的,冷暖新风子系统包括各类能够调节温度、调节湿度的设备,冷暖新风子系统对应的意图包括:恒温意图、恒湿意图、恒净意图等。As another example, the heating and cooling fresh air subsystem includes various types of equipment that can adjust temperature and humidity. The corresponding purposes of the cooling and heating fresh air subsystem include: constant temperature purpose, constant humidity purpose, constant purification purpose, etc.
再示例性的,遮阳子系统包括各类可实现遮阳的装置,遮阳子系统可实现的意图包括:窗帘全开、窗帘全关。As another example, the sunshade subsystem includes various devices that can achieve sunshade. The intentions that the sunshade subsystem can achieve include: fully opening the curtains and fully closing the curtains.
由上述描述可知,每个意图可由一个或多个设备实现,或者说,每个意图对应一个或多个设备。每个设备可实现一个或多个意图。比如,调节光线这一意图可由灯和/ 或窗帘实现。对于窗帘来说,其既可实现调节光线意图,又可实现遮阳、防晒意图。It can be seen from the above description that each intention can be implemented by one or more devices, or that each intention corresponds to one or more devices. Each device can implement one or more intents. For example, the intention to adjust the light can be represented by lamps and/or Or curtain implementation. For curtains, they can not only adjust light, but also achieve sunshade and sun protection.
那么,第一电子设备100在确定用户的意图以及确定用户需要控制的第二电子设备200后,就可以指示第二电子设备200执行用户的意图。Then, after determining the user's intention and determining the second electronic device 200 that the user needs to control, the first electronic device 100 can instruct the second electronic device 200 to execute the user's intention.
本申请实施例中,能够让一个或多个子系统中的多个设备自由组合,融合成一个超级终端。每个设备都能成为互相的功能模块,实现能力互助,资源共享。In the embodiment of the present application, multiple devices in one or more subsystems can be freely combined and integrated into a hyper terminal. Each device can become a functional module for each other, realizing mutual assistance and resource sharing.
可选的,该系统还可包括中枢设备300。中枢设备300,也称为中枢、中央控制系统或主机等。在一些示例中,中枢设备300,可以用于将全屋的设备划分为多个子系统,按照子系统粒度对子系统中设备的能力进行抽象,形成子系统的原子能力,原子能力可适配不同类型设备。Optionally, the system may also include a central device 300. The central device 300 is also called a hub, a central control system, a host, etc. In some examples, the central device 300 can be used to divide the equipment in the whole house into multiple subsystems, abstract the capabilities of the devices in the subsystems according to the subsystem granularity, and form the atomic capabilities of the subsystems. The atomic capabilities can adapt to different type device.
中枢设备300还可以根据子系统的原子能力生成子系统的配置文件。示例性的,如图3A示出了全屋包括的子系统,包括但不限于如下子系统:安防、照明、网络、冷暖新风、影音娱乐、家具家私、用水、能耗、家电、遮阳。The hub device 300 can also generate a configuration file of the subsystem according to the atomic capabilities of the subsystem. For example, Figure 3A shows the subsystems included in the whole house, including but not limited to the following subsystems: security, lighting, network, heating and cooling fresh air, audio and video entertainment, furniture, water use, energy consumption, home appliances, and sunshade.
作为一种可能的实现方式,不同场景下,需要调用不同的子系统的原子能力,以便满足用户的设备控制需求。以离家场景为例,示例性的,如图3B所示,在一些示例中,离家场景中需要调用安防子系统、照明子系统以及冷暖新风子系统。以照明子系统为例,中枢设备300对照明子系统中各设备(包括但不限于图3B所示客厅灯、落地灯、窗帘)的能力进行抽象,形成照明子系统的一个或多个原子能力(比如照明模式、开关控制、精准调光等)。如下表1示出了照明子系统的配置文件的一种可能示例。由表1,照明子系统可被抽象为照明模式、开关控制、精准调光等原子能力。可选的,子系统的配置文件还包括该子系统包括的设备的标识。As a possible implementation method, in different scenarios, the atomic capabilities of different subsystems need to be called to meet the user's device control needs. Taking the leaving home scenario as an example, as shown in Figure 3B , in some examples, the security subsystem, lighting subsystem, and heating and cooling fresh air subsystem need to be called in the leaving home scenario. Taking the lighting subsystem as an example, the central device 300 abstracts the capabilities of each device in the lighting subsystem (including but not limited to the living room lamp, floor lamp, and curtain shown in Figure 3B) to form one or more atomic capabilities of the lighting subsystem (such as lighting mode, switch control, precise dimming, etc.). Table 1 below shows a possible example of a configuration file for a lighting subsystem. From Table 1, the lighting subsystem can be abstracted into atomic capabilities such as lighting mode, switch control, and precise dimming. Optionally, the subsystem configuration file also includes the identification of the devices included in the subsystem.
表1
Table 1
需要说明的是,子系统的原子能力可以是对该子系统中部分设备的能力进行抽象得到的,或者,可以是对该子系统中全部设备的能力进行抽象得到的。子系统的一个原子能力对应该子系统中的一个或多个设备。比如,氛围光这一原子能力可以由多个智能灯实现,即可利用多个智能灯共同打造具有特定氛围的光影效果。再比如,调节亮度这一原子能力可由多个智能灯实现,其中,智能灯A的亮度调整至亮度A、智能灯B的亮度调整至亮度B、智能灯C的亮度调整至亮度C,智能灯A、C、B共同打造亮度为目标亮度的光影场景。It should be noted that the atomic capabilities of a subsystem may be obtained by abstracting the capabilities of some devices in the subsystem, or may be obtained by abstracting the capabilities of all devices in the subsystem. An atomic capability of a subsystem corresponds to one or more devices in the subsystem. For example, the atomic capability of ambient light can be realized by multiple smart lights, that is, multiple smart lights can be used to jointly create light and shadow effects with a specific atmosphere. For another example, the atomic ability of adjusting brightness can be realized by multiple smart lamps. Among them, the brightness of smart lamp A is adjusted to brightness A, the brightness of smart lamp B is adjusted to brightness B, the brightness of smart lamp C is adjusted to brightness C, and the brightness of smart lamp C is adjusted to brightness C. A, C, and B jointly create a light and shadow scene whose brightness is the target brightness.
本申请实施例中,一个意图可以对应一个或多个原子能力,一个原子能力也可以对应一个或多个意图,本申请实施例不限制意图与原子能力的具体对应关系。例如意图可以包括:开/关灯、音乐播放、恒温、恒湿、净化关闭、窗帘全开、窗帘全关等。示例性的,开灯意图可以对应表1所示的睡眠光、阅读光、氛围光、分区照明、灯全 开、主灯等原子能力。In the embodiments of this application, one intention can correspond to one or more atomic capabilities, and one atomic capability can also correspond to one or more intentions. The embodiments of this application do not limit the specific correspondence between intentions and atomic capabilities. For example, intentions can include: turning on/off lights, music playing, constant temperature, constant humidity, purification off, curtains fully open, curtains fully closed, etc. For example, the intention to turn on the light may correspond to the sleep light, reading light, ambient light, partition lighting, and full light shown in Table 1. Atomic abilities such as on, main light, etc.
在得到智能家居系统中各子系统的原子能力以及原子能力对应的意图之后,第一电子设备100可以以子系统可执行的意图为场景编排或编辑的粒度,而不再以设备为场景编排粒度。一种设计中,一个意图可由一个多个智能家居设备执行,因此,在某些情况下,用户进行一次基于意图粒度的场景编排,即相当于进行了多次基于设备粒度的场景编排,极大简化了用户的场景编排操作,提升了场景编排效率。或者,在另一些设计中,用户可以在待创建场景中添加多个意图,每个意图可由一个或多个智能家居设备执行。After obtaining the atomic capabilities of each subsystem in the smart home system and the intentions corresponding to the atomic capabilities, the first electronic device 100 can use the executable intentions of the subsystems as the granularity of scene arrangement or editing, instead of using the device as the granularity of scene arrangement. . In one design, an intention can be executed by multiple smart home devices. Therefore, in some cases, the user performs one scene orchestration based on intent granularity, which is equivalent to performing multiple scene orchestrations based on device granularity, which greatly It simplifies the user's scene arrangement operations and improves the efficiency of scene arrangement. Or, in other designs, users can add multiple intents to the scene to be created, each of which can be executed by one or more smart home devices.
在一些示例中,可以按照周期或预设条件更新子系统的原子能力。示例性的,照明子系统中包括阅读灯、墙门灯带、天花灯带等。之后,阅读灯损坏,在检测到阅读灯长时间不在线时,可以从照明子系统中移除阅读灯的相关原子能力,并更新照明子系统的配置文件。In some examples, the atomic capabilities of a subsystem can be updated on a periodic or preset basis. For example, the lighting subsystem includes reading lights, wall and door light strips, ceiling light strips, etc. Later, if the reading light is damaged and it is detected that the reading light is not online for a long time, the relevant atomic capabilities of the reading light can be removed from the lighting subsystem and the configuration file of the lighting subsystem can be updated.
可选地,各房间或各区域的中枢设备、全屋的中枢设备均可以单独存在,也可以与第二电子设备或第一电子设备集成为一个设备,或者是其他形态的设备。本申请对此不做限定。Optionally, the central device of each room or each area or the central device of the whole house can exist alone, or can be integrated with the second electronic device or the first electronic device into one device, or it can be a device in other forms. This application does not limit this.
可选的,在一种示例中,该系统还可包括服务器。服务器可以用于维护子系统配置文件。Optionally, in an example, the system may also include a server. The server can be used to maintain subsystem configuration files.
可选的,在一种示例中,该系统还包括路由设备(比如路由器)。路由设备用于连接局域网或因特网,使用特定协议选择和设定发送信号的路径。第二电子设备200接入路由器,通过路由器建立的Wi-Fi通道与局域网内的设备或互联网内的设备进行数据传输。在一种实施方式中,中枢设备300可以与路由设备集成为一个设备。比如,中枢设备300与路由设备集成为路由设备,即路由设备具有中枢设备300的功能。该路由设备可以为子母路由设备中的一个或多个路由设备,也可以为独立的路由设备。Optionally, in an example, the system also includes a routing device (such as a router). Routing equipment is used to connect to a local area network or the Internet, using a specific protocol to select and set the path for sending signals. The second electronic device 200 is connected to the router and transmits data with devices in the local area network or devices in the Internet through the Wi-Fi channel established by the router. In one implementation, the hub device 300 can be integrated with the routing device into one device. For example, the hub device 300 and the routing device are integrated into the routing device, that is, the routing device has the function of the hub device 300 . The routing device can be one or more routing devices among the sub-master routing devices, or it can be an independent routing device.
上述内容,仅是对设备控制方法所适用的系统的一个举例,系统中还可以包括更多、更少的设备,或不同的设备布局位置等。The above content is only an example of a system to which the device control method is applicable. The system may also include more or less devices, or different device layout locations, etc.
可选的,本申请实施例中的第一电子设备100、第二电子设备200、服务器、中枢设备300可以通过不同的设备实现。例如,本申请实施例中的服务器、中枢设备可通过图4中的设备来实现。图4所示为本申请实施例提供的设备的硬件结构示意图。该设备包括至少一个处理器501,通信线路502,存储器503以及至少一个通信接口504。其中,存储器503还可以包括于处理器501中。Optionally, the first electronic device 100, the second electronic device 200, the server, and the central device 300 in the embodiment of the present application can be implemented by different devices. For example, the server and central device in the embodiment of the present application can be implemented by the device in Figure 4. Figure 4 shows a schematic diagram of the hardware structure of the device provided by the embodiment of the present application. The device includes at least one processor 501, communication line 502, memory 503 and at least one communication interface 504. Among them, the memory 503 may also be included in the processor 501.
可以理解的是,本申请实施例示意的结构并不构成对电子设备的具体限定。在本申请另一些实施例中,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。It can be understood that the structures illustrated in the embodiments of the present application do not constitute specific limitations on the electronic equipment. In other embodiments of the present application, the electronic device may include more or less components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.
处理器501可以是一个通用中央处理器(central processing unit,CPU),微处理器,特定应用集成电路(application-specific integrated circuit,ASIC),或一个或多个用于控制本申请方案程序执行的集成电路。The processor 501 can be a general central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more processors used to control the execution of the program of the present application. integrated circuit.
通信线路502可包括一通路,在上述组件之间传送信息。Communication line 502 may include a path that carries information between the above-mentioned components.
通信接口504,用于与其他设备通信。在本申请实施例中,通信接口可以是模块、 电路、总线、接口、收发器或者其它能实现通信功能的装置,用于与其他设备通信。可选的,当通信接口是收发器时,该收发器可以为独立设置的发送器,该发送器可用于向其他设备发送信息,该收发器也可以为独立设置的接收器,用于从其他设备接收信息。该收发器也可以是将发送、接收信息功能集成在一起的部件,本申请实施例对收发器的具体实现不做限制。Communication interface 504, used to communicate with other devices. In the embodiment of this application, the communication interface may be a module, Circuits, buses, interfaces, transceivers, or other devices that enable communication functions and are used to communicate with other devices. Optionally, when the communication interface is a transceiver, the transceiver can be an independently configured transmitter, which can be used to send information to other devices. The transceiver can also be an independently configured receiver, which can be used to receive information from other devices. The device receives the information. The transceiver may also be a component that integrates the functions of sending and receiving information. The embodiments of this application do not limit the specific implementation of the transceiver.
存储器503可以是只读存储器(read-only memory,ROM)或可存储静态信息和指令的其他类型的静态存储设备,随机存取存储器(random access memory,RAM)或者可存储信息和指令的其他类型的动态存储设备,也可以是电可擦可编程只读存储器(electrically erasable programmable read-only memory,EEPROM)、只读光盘(compact disc read-only memory,CD-ROM)或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,但不限于此。存储器可以是独立存在,通过通信线路502与处理器相连接。存储器也可以和处理器集成在一起。The memory 503 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (random access memory (RAM)) or other type that can store information and instructions. A dynamic storage device can also be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be used by a computer Any other medium for access, but not limited to this. The memory may exist independently and be connected to the processor through the communication line 502 . Memory can also be integrated with the processor.
其中,存储器503用于存储用于实现本申请方案的计算机执行指令,并由处理器501来控制执行。处理器501用于执行存储器503中存储的计算机执行指令,从而实现本申请下述实施例提供的方法。Among them, the memory 503 is used to store computer execution instructions for implementing the solution of the present application, and is controlled by the processor 501 for execution. The processor 501 is used to execute computer execution instructions stored in the memory 503, thereby implementing the methods provided by the following embodiments of the application.
可选的,本申请实施例中的计算机执行指令也可以称之为应用程序代码、指令、计算机程序或者其它名称,本申请实施例对此不作具体限定。Optionally, the computer execution instructions in the embodiments of the present application may also be called application codes, instructions, computer programs or other names, which are not specifically limited in the embodiments of the present application.
在具体实现中,作为一种实施例,处理器501可以包括一个或多个CPU,例如图4中的CPU0和CPU1。In specific implementation, as an embodiment, the processor 501 may include one or more CPUs, such as CPU0 and CPU1 in FIG. 4 .
在具体实现中,作为一种实施例,电子设备可以包括多个处理器,例如图4中的处理器501和处理器507。这些处理器中的每一个可以是一个单核(single-CPU)处理器,也可以是一个多核(multi-CPU)处理器。这里的处理器可以指一个或多个设备、电路、和/或用于处理数据(例如计算机程序指令)的处理核。In specific implementation, as an embodiment, the electronic device may include multiple processors, such as the processor 501 and the processor 507 in FIG. 4 . Each of these processors may be a single-CPU processor or a multi-CPU processor. A processor here may refer to one or more devices, circuits, and/or processing cores for processing data (eg, computer program instructions).
可以理解的是,图4示意的结构并不构成对电子设备的具体限定。在本申请另一些实施例中,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。It can be understood that the structure illustrated in Figure 4 does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or less components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.
图4所示设备可以是一个通用设备或者是一个专用设备,本申请实施例不限定设备的类型。比如,设备为智能面板,为用于控制智能家居设备的专用设备。又比如,设备为手机,为可以控制智能家居设备的通用设备。The device shown in Figure 4 may be a general device or a special device, and the embodiment of this application does not limit the type of device. For example, the device is a smart panel, which is a dedicated device used to control smart home devices. For another example, the device is a mobile phone, which is a general device that can control smart home devices.
可选的,电子设备(比如第一电子设备,第二电子设备,服务器或中枢设备)的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本发明实施例以分层架构的系统为例,示例性说明电子设备的软件结构。Optionally, the software system of the electronic device (such as the first electronic device, the second electronic device, the server or the central device) may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present invention uses a layered architecture The system is taken as an example to illustrate the software structure of the electronic device.
以第一电子设备为例,图5是本发明实施例的第一电子设备100的软件结构框图。Taking the first electronic device as an example, FIG. 5 is a software structure block diagram of the first electronic device 100 according to an embodiment of the present invention.
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,以及内核层。 The layered architecture divides the software into several layers, and each layer has clear roles and division of labor. The layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime (Android runtime) and system libraries, and kernel layer.
应用程序层可以包括一系列应用程序。The application layer can include a series of applications.
如图5所示,应用程序可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。As shown in Figure 5, applications can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
本申请实施例中,应用程序还包括智能家居管理应用以及基础服务。其中,基础服务将智能设备的管理能力开放给系统。智能家居管理应用可以调用基础服务查询待控制的智能家居设备,和/或调用基础服务控制该智能家居设备。In the embodiment of this application, the application program also includes smart home management applications and basic services. Among them, basic services open the management capabilities of smart devices to the system. The smart home management application can call the basic service to query the smart home device to be controlled, and/or call the basic service to control the smart home device.
示例性的,智能家居管理应用可以为智慧生活应用。智能家居应用还可以为其他具有类似功能的应用。智能家居管理应用可以是系统原装应用,也可以是第三方应用,本申请实施例对智能家居管理应用的类别不做限制。下述实施例中主要以智慧生活应用为例进行举例。By way of example, the smart home management application can be a smart life application. Smart home applications can also be other applications with similar functions. The smart home management application may be an original system application or a third-party application. The embodiments of this application do not limit the types of smart home management applications. In the following embodiments, smart life applications are mainly used as examples.
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
如图5所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。As shown in Figure 5, the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。电话管理器用于提供第一电子设备100的通信功能。例如通话状态的管理(包括接通,挂断等)。资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,终端振动,指示灯闪烁等。A window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, capture the screen, etc. Content providers are used to store and retrieve data and make this data accessible to applications. Said data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls that display text, controls that display pictures, etc. A view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide communication functions of the first electronic device 100 . For example, call status management (including connected, hung up, etc.). The resource manager provides various resources to applications, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager allows applications to display notification information in the status bar, which can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be notifications that appear in the status bar at the top of the system in the form of charts or scroll bar text, such as notifications for applications running in the background, or notifications that appear on the screen in the form of conversation windows. For example, text information is prompted in the status bar, a prompt sound is emitted, the terminal vibrates, and the indicator light flashes, etc.
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system. The core library contains two parts: one is the functional functions that need to be called by the Java language, and the other is the core library of Android. The application layer and application framework layer run in virtual machines. The virtual machine executes the java files of the application layer and application framework layer into binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。 2D图形引擎是2D绘图的绘图引擎。System libraries can include multiple functional modules. For example: surface manager (surface manager), media libraries (Media Libraries), 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing. 2D Graphics Engine is a drawing engine for 2D drawing.
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
需要说明的是,图5所示软件架构仅是电子设备所适用的一种软件架构,本申请实施例对电子设备的软件架构不做限制。可选的,某些功能模块可以位于不同于图5所示的层级中。比如,基础服务还可以设置在框架层中,本申请实施例不局限于此。It should be noted that the software architecture shown in Figure 5 is only a software architecture applicable to electronic devices, and embodiments of the present application do not limit the software architecture of electronic devices. Optionally, some functional modules may be located at a different level than shown in Figure 5. For example, the basic service can also be provided in the framework layer, and the embodiments of the present application are not limited to this.
图6示出了图2所示系统中各设备的功能模块划分方式,以及设备之间的交互流程。其中,第一电子设备100包括智慧生活应用以及智慧生活基础服务(比如HiLinkSVC)。智慧生活应用提供全屋智能的用户界面(user interface,UI)。作为一种可能的实现方式,智慧生活应用通过软件工具开发包(比如HiLink Kit SDK(software development kit))提供的接口,调用智慧生活基础服务,以便通过智慧生活应用呈现各种UI。可选的,UI包括意图管理的UI或场景管理的UI等。Figure 6 shows the functional module division of each device in the system shown in Figure 2, as well as the interaction process between the devices. Among them, the first electronic device 100 includes smart life applications and smart life basic services (such as HiLinkSVC). Smart life applications provide a smart user interface (UI) for the whole house. As a possible implementation method, smart life applications call basic smart life services through the interface provided by software tool development kits (such as HiLink Kit SDK (software development kit)), so that various UIs can be presented through smart life applications. Optionally, the UI includes a UI for intent management or a UI for scene management, etc.
可选的,UI可以包括卡片形式的界面。示例性的,智慧生活应用可以提供如图7所示的界面402等。用户可以通过智慧生活应用提供的界面对智能家居设备进行控制。Optionally, the UI may include an interface in the form of a card. For example, the smart life application can provide interface 402 as shown in Figure 7 and so on. Users can control smart home devices through the interface provided by the smart life application.
作为一种可能的实现方式,智慧生活基础服务可以存储有各子系统的配置文件。作为一种可能的实现方式,子系统的配置文件可以从第一服务器获取。As a possible implementation method, the smart life basic service can store the configuration files of each subsystem. As a possible implementation, the configuration file of the subsystem can be obtained from the first server.
智慧生活基础服务可以包括如下模块:Smart life basic services can include the following modules:
意图管理模块,用于根据子系统的配置文件,对子系统的意图进行管理。示例性的,用户可以组合某些意图,形成新的意图。比如,用户可以将开光灯、窗帘、新风设备等意图进行组合,新生成“舒适环境”意图。再示例性的,可以对意图对应的设备控制参数进行调整。再示例性的,可以删除或增加意图。再示例性的,可以生成生日聚会、温馨回家、全屋除湿、全屋透风等新的意图。The intent management module is used to manage the intent of the subsystem according to the configuration file of the subsystem. For example, the user can combine certain intentions to form a new intention. For example, users can combine lights, curtains, fresh air equipment and other intentions to generate a new "comfortable environment" intention. As another example, the device control parameters corresponding to the intention can be adjusted. As another example, intents may be deleted or added. As another example, new intentions such as birthday party, warm homecoming, whole-house dehumidification, and whole-house ventilation can be generated.
场景管理模块,用于对场景进行管理。场景管理包括场景创建、场景的修改等。Scene management module, used to manage scenes. Scene management includes scene creation, scene modification, etc.
中枢设备300包括设备列表管理模块、黑名单管理模块、微调数据管理模块以及批量管理模块。The hub device 300 includes a device list management module, a blacklist management module, a fine-tuning data management module, and a batch management module.
设备列表管理模块,用于获取如下任一项或多项信息:家庭(Home)/空间(Region)/房间(Room)下的子系统列表,各子系统的配置文件,各子系统中实例化设备的列表,各子系统可实现意图的列表。The device list management module is used to obtain any one or more of the following information: the subsystem list under Home/Region/Room, the configuration file of each subsystem, and the instantiation in each subsystem A list of devices and a list of intentions that each subsystem can implement.
黑名单管理模块,用于增加/删除/修改/查询各子系统中的黑名单设备。The blacklist management module is used to add/delete/modify/query blacklist devices in each subsystem.
微调数据管理模块,用于增加/删除/修改/查询意图的微调参数。示例性的,假设意图为打开组合灯,组合灯的色温参数为2000K,用户可以修改该意图对应的设备控制参数,比如将组合灯的色温修改为3000K。第一电子设备的微调数据管理模块可以将打开组合灯这一意图的微调参数(即色温)由2000K修改为3000K。Fine-tuning data management module, used to add/delete/modify/query intent fine-tuning parameters. For example, assuming that the intention is to turn on the combination light, and the color temperature parameter of the combination light is 2000K, the user can modify the device control parameters corresponding to the intention, for example, change the color temperature of the combination light to 3000K. The fine-tuning data management module of the first electronic device can modify the fine-tuning parameter (ie, color temperature) of the intention to turn on the combination light from 2000K to 3000K.
其中,组合灯可以是一个或多个灯。Among them, the combination light can be one or more lights.
批量管理模块,用于对全屋的设备划分为多个子系统,并对子系统的能力进行抽象,得到子系统可实现的一个或多个原子能力。The batch management module is used to divide the equipment in the whole house into multiple subsystems and abstract the capabilities of the subsystems to obtain one or more atomic capabilities that the subsystems can implement.
作为一种可能的实现方式,中枢设备300中存储所有设备的列表、黑名单设备的列表以及意图的微调参数。或者,中枢设备300可以从服务器获取设备列表、黑名单设备的列表以及意图的微调参数。 As a possible implementation, the hub device 300 stores a list of all devices, a list of blacklisted devices, and intended fine-tuning parameters. Alternatively, the hub device 300 may obtain the device list, the list of blacklisted devices, and the intended fine-tuning parameters from the server.
可以理解的是,图6示意的结构并不构成对各电子设备的具体限定。在本申请另一些实施例中,各电子设备可以包括比图示更多或更少的模块,或者组合某些模块,或者拆分某些模块,或者不同的模块布局。图示的模块可以以硬件,软件或软件和硬件的组合实现。It can be understood that the structure illustrated in FIG. 6 does not constitute a specific limitation on each electronic device. In other embodiments of the present application, each electronic device may include more or fewer modules than shown in the figure, or combine certain modules, or split certain modules, or have different module layouts. The illustrated modules may be implemented in hardware, software, or a combination of software and hardware.
以下主要以第一电子设备100为智能设备控制面板(可简称为智能面板),以管理智能家居设备的应用为智慧生活应用为例,对本申请实施例提供的智能设备控制方法进行说明。The following mainly describes the smart device control method provided by the embodiment of the present application, taking the first electronic device 100 as a smart device control panel (which may be referred to as a smart panel) and taking the application for managing smart home devices as a smart life application as an example.
在一些实施例中,电子设备接入局域网后,能够发现接入同一个局域网和/或登录同一个账户的其他电子设备。比如,用户注册智慧生活应用,获得账户的用户名和密码。后续用户在新的电子设备配网过程中,可以通过其他已配网过的电子设备(如手机)登录该账户,协助新的电子设备进行配网。那么,服务器将同一账户下的电子设备划分至同一个home,实现以home为单位的电子设备管理。可选的,服务器管理一个或多个home,home中包括一个或多个子系统。每个子系统包括一个或多个电子设备。In some embodiments, after the electronic device is connected to the local area network, it can discover other electronic devices that are connected to the same local area network and/or logged in to the same account. For example, a user registers for a smart life application and obtains the username and password of the account. During the subsequent network configuration process of new electronic equipment, users can log in to the account through other electronic devices that have been configured to the network (such as mobile phones) to assist in the network configuration of the new electronic equipment. Then, the server divides the electronic devices under the same account into the same home to implement home-based electronic device management. Optionally, the server manages one or more homes, which include one or more subsystems. Each subsystem includes one or more electronic devices.
具体的,以智能面板为例,智能面板在智慧生活应用中登录后,检测到用户添加电子设备的操作后,向服务器发送新添加的电子设备的设备信息,服务器确定电子设备ID,并将电子设备划分到智能面板当前登录账号对应的home中,完成该电子设备的配网。或者,智能面板响应于用户操作,向服务器发送新添加的电子设备的设备信息,服务器确定电子设备ID,并将电子设备划分到智能面板对应的home中。Specifically, take the smart panel as an example. After logging in to the smart life application, the smart panel detects the user's operation of adding an electronic device and sends the device information of the newly added electronic device to the server. The server determines the electronic device ID and sends the electronic device to the server. The device is divided into the home corresponding to the current login account of the smart panel to complete the network configuration of the electronic device. Or, in response to the user operation, the smart panel sends the device information of the newly added electronic device to the server, and the server determines the electronic device ID and divides the electronic device into the home corresponding to the smart panel.
在添加电子设备之后,用户可以通过电子设备编辑场景。示例性的,如图7的(a)所示,第一电子设备显示界面401,界面401包括场景选项401a。检测到用户点击选项401a的操作后,电子设备可跳转到如图7的(b)所示界面402。界面402包括全屋对应的卡片以及全屋中各个空间对应的卡片(比如客厅对应的卡片402a)。各个空间对应的卡片上还包括用于设置相应空间场景的控件。以客厅对应的卡片402a为例,卡片402a上设置有用于设置客厅场景的控件402b。After adding the electronic device, the user can edit the scene through the electronic device. Exemplarily, as shown in (a) of FIG. 7 , the first electronic device displays an interface 401, and the interface 401 includes scene options 401a. After detecting the user's operation of clicking option 401a, the electronic device can jump to interface 402 as shown in (b) of Figure 7 . The interface 402 includes cards corresponding to the whole house and cards corresponding to each space in the whole house (such as the card 402a corresponding to the living room). The card corresponding to each space also includes controls for setting the corresponding space scene. Taking the card 402a corresponding to the living room as an example, the card 402a is provided with a control 402b for setting the living room scene.
需要说明的是,对于同一意图,可能对应不同的呈现形式,比如,在界面中以不同形式的意图卡片显示。以开灯意图为例,作为一种可能的实现方式,对于开灯意图,某些情况下(比如一些精细照明场景或氛围照明场景中)或某些空间中,用户向目标场景添加开灯意图,可能是期望在目标场景中开启某个空间中的全部灯,则界智能面板以“灯全开”意图卡片显示开灯这一意图。在另一些情况下,用户向目标场景中添加开灯意图,可能是期望在目标场景中开启某个空间中的某个或某些灯,则界智能面板可以显示全屋空间中具体灯的意图卡片,比如,可以显示墙门灯带、天花灯带等具体的意图卡片。It should be noted that the same intention may correspond to different presentation forms, for example, it may be displayed in different forms of intention cards in the interface. Taking the intention to turn on the light as an example, as a possible implementation method, for the intention to turn on the light, in some situations (such as some fine lighting scenes or ambient lighting scenes) or in certain spaces, the user adds the intention to turn on the light to the target scene. , it may be that you want to turn on all the lights in a certain space in the target scene, then the smart panel displays the intention to turn on the lights with the "all lights on" intention card. In other cases, the user adds the intention to turn on lights in the target scene, perhaps expecting to turn on one or some lights in a certain space in the target scene, then the smart panel can display the intention of specific lights in the whole house space. Cards, for example, can display specific intention cards such as wall and door light strips, ceiling light strips, etc.
比如,如图7的(b),考虑到用户在餐厅进行餐食,可能需要餐食氛围,智能面板以“灯全开”意图卡片的形式显示餐厅中的开灯意图。用户可以将“灯全开”这一意图添加到餐食场景。如此,后续,满足餐食场景的触发条件时,智能面板可以控制餐厅中的灯全开,以满足用户在餐食场景中的照明需求。For example, as shown in (b) of Figure 7, considering that the user may need a meal atmosphere when dining in a restaurant, the smart panel displays the intention to turn on the lights in the restaurant in the form of a "lights fully on" intention card. Users can add the "lights on" intent to the meal scene. In this way, later, when the trigger conditions of the meal scene are met, the smart panel can control the lights in the restaurant to be fully turned on to meet the user's lighting needs in the meal scene.
再比如,仍如图7的(b),在客厅对应的卡片402a上,智能面板显示“天花灯带”意图卡片。智能面板还可以显示客厅中其他灯的意图卡片。用户可以将客厅中多个灯的意图卡片添加到目标场景中。后续,满足目标场景的触发条件时,智能面板可 以控制客厅中多个灯开启。For another example, still as shown in (b) of Figure 7, on the card 402a corresponding to the living room, the smart panel displays the "ceiling light strip" intention card. The smart panel can also display intent cards for other lights in the living room. Users can add intent cards for multiple lights in the living room to the target scene. Subsequently, when the trigger conditions of the target scene are met, the smart panel can To control multiple lights in the living room to turn on.
在一些示例中,在检测到用户点击如图7的(b)所示控件402b的操作后,电子设备可跳转到如图7的(c)所示界面403。In some examples, after detecting the operation of the user clicking the control 402b shown in (b) of Figure 7, the electronic device can jump to the interface 403 shown in (c) of Figure 7.
其中,界面403包括客厅对应的一个或多个场景。比如,进入客厅场景、离开客厅场景、阅读场景、派对模式场景。在一些示例中,界面403还包括场景创建控件403a。在检测到用户点击控件403a的操作后,电子设备可提供界面,用户可以通过该界面输入待创建场景的名称、待创建的触发条件等信息。在检测到用户执行完输入待创建场景的名称、触发条件等操作之后,电子设备可跳转到如图7的(d)所示界面404,用户可通过界面404编辑该待创建场景。示例性的,如界面404中的404i标记所示,待创建的观影模式场景的触发条件是:用户点击卡片。Among them, the interface 403 includes one or more scenes corresponding to the living room. For example, entering the living room scene, leaving the living room scene, reading scene, party mode scene. In some examples, interface 403 also includes scene creation controls 403a. After detecting the user's operation of clicking the control 403a, the electronic device may provide an interface through which the user can input information such as the name of the scene to be created, the trigger condition to be created, and so on. After detecting that the user has completed operations such as inputting the name and trigger conditions of the scene to be created, the electronic device can jump to interface 404 as shown in (d) of Figure 7 , and the user can edit the scene to be created through interface 404. For example, as shown by the 404i mark in the interface 404, the trigger condition for the movie viewing mode scene to be created is: the user clicks on the card.
考虑到一些场景中,用户并不清楚达成待创建场景需求的最佳设备,因此,本申请实施例中,在为用户提供场景编辑功能时,可以以意图为粒度向用户提供场景编辑功能,用户不再需要一一选择待创建场景中所需控制的设备,而是可以选择意图,由系统精准计算完成意图的一个或多个最佳设备。Considering that in some scenarios, users do not know the best equipment to meet the needs of the scene to be created. Therefore, in the embodiment of the present application, when providing the scene editing function to the user, the scene editing function can be provided to the user at the granularity of intention. The user It is no longer necessary to select the devices that need to be controlled in the scene to be created one by one. Instead, you can select the intention, and the system will accurately calculate the best device or devices to complete the intention.
其中,界面404包括区域404a和区域404b。区域404b可称为场景编辑区域。区域404a可称为意图展示区域,区域404a包括多个子系统对应的一个或多个意图的标识。每个意图可由一个或多个设备实现。可选的,意图的标识可以通过卡片形式呈现,用于表示意图的卡片可称为意图卡片。可选的,智能面板可以查询各个子系统的配置文件,并根据配置文件确定各个子系统的原子能力以及各原子能力对应的意图。例如,智能面板可以查询表1所示的照明子系统的配置文件,并根据该配置文件,确定照明子系统的原子能力以及各原子能力对应的意图,并可以显示照明子系统对应的意图。Among them, the interface 404 includes an area 404a and an area 404b. Area 404b may be called a scene editing area. Area 404a may be called an intention display area, and area 404a includes identification of one or more intentions corresponding to multiple subsystems. Each intent can be implemented by one or more devices. Optionally, the identifier of the intention can be presented in the form of a card, and the card used to express the intention can be called an intention card. Optionally, the smart panel can query the configuration files of each subsystem and determine the atomic capabilities of each subsystem and the corresponding intentions of each atomic capability based on the configuration files. For example, the smart panel can query the configuration file of the lighting subsystem shown in Table 1, and based on the configuration file, determine the atomic capabilities of the lighting subsystem and the intentions corresponding to each atomic capability, and can display the corresponding intentions of the lighting subsystem.
比如,如图7的(d),界面404的区域404a中呈现如下意图卡片:照明子系统对应的灯全开、灯全关、组合灯开启(亮度参数为60%);冷暖新风子系统对应的恒温、恒湿、净化关闭;遮阳子系统对应的窗帘全开、窗帘全关。For example, as shown in (d) of Figure 7 , the following intention cards are presented in the area 404a of the interface 404: the lights corresponding to the lighting subsystem are fully on, the lights are fully off, and the combination light is on (brightness parameter is 60%); the heating and cooling fresh air subsystem corresponds to The constant temperature, constant humidity and purification are turned off; the curtains corresponding to the sunshade subsystem are fully open and the curtains are fully closed.
响应于用户对区域404a所呈现的意图卡片的选择操作,电子设备可以将用户选择的意图卡片添加到待创建场景中。比如,如图7的(d),响应于用户将温度调节卡片404d由区域404a拖动到区域404b的操作,电子设备将温度调节卡片添加到待创建场景中,即将温度调节的意图添加到待创建场景中。可选的,用户将温度调节卡片404d由区域404a拖动到区域404b的操作也可以为用户对温度调节卡片404d的点击操作,本申请对此不做限定。再比如,响应于用户将组合灯(亮度60%)卡片、窗帘全关卡片由区域404a拖动到区域404b的操作,电子设备将组合灯意图(亮度60%)以及窗帘全关意图添加到待创建场景中。如图7的(d)所示,创建的观影模式场景中包括组合灯开启意图(亮度参数为60%)、温度调节意图(调节温度至恒温24度)以及窗帘全关意图。In response to the user's selection operation on the intention card presented in area 404a, the electronic device may add the intention card selected by the user to the scene to be created. For example, as shown in (d) of Figure 7, in response to the user's operation of dragging the temperature adjustment card 404d from the area 404a to the area 404b, the electronic device adds the temperature adjustment card to the scene to be created, that is, the intention of temperature adjustment is added to the scene to be created. Create a scene. Optionally, the user's operation of dragging the temperature adjustment card 404d from the area 404a to the area 404b can also be the user's click operation on the temperature adjustment card 404d, which is not limited in this application. For another example, in response to the user's operation of dragging the combined light (brightness 60%) card and the curtain full closing card from area 404a to area 404b, the electronic device adds the combined light intention (brightness 60%) and the curtain full closing intention to the waiting area. Create a scene. As shown in (d) of Figure 7 , the created viewing mode scene includes the intention to turn on the combination light (brightness parameter is 60%), the intention to adjust the temperature (adjust the temperature to a constant temperature of 24 degrees), and the intention to fully close the curtains.
类似的,用户可以拖动其他意图卡片,电子设备可以根据用户的拖动操作,将相应意图添加到待创建场景中。Similarly, the user can drag other intention cards, and the electronic device can add the corresponding intention to the scene to be created based on the user's drag operation.
可选的,界面404还包括用于显示相应子系统中被隐藏的意图卡片的控件。比如,如图7的(d),界面404包括控件404f,响应于用户对控件404f的操作(比如点击操作),电子设备可以显示如图7的(e)所示界面405,界面405的区域404a中包 括照明子系统中其他的意图卡片,比如组合灯(色温5500开尔文(K))开启的意图卡片。在一些示例中,用户可以将组合灯(色温5500K)开启的意图卡片等由区域404a拖动到区域404b,从而将组合灯(色温6500K)开启的意图添加到待创建的观影模式场景中。Optionally, the interface 404 also includes a control for displaying hidden intention cards in the corresponding subsystem. For example, as shown in Figure 7 (d), the interface 404 includes a control 404f. In response to the user's operation (such as a click operation) on the control 404f, the electronic device can display the interface 405 as shown in Figure 7 (e), and the area of the interface 405 404a medium package Including other intention cards in the lighting subsystem, such as the intention card to turn on the combination light (color temperature 5500 Kelvin (K)). In some examples, the user can drag the intention card that turns on the combination light (color temperature 5500K) from area 404a to area 404b, thereby adding the intention to turn on the combination light (color temperature 6500K) to the viewing mode scene to be created.
或者,第一电子设备可以基于用户的其他操作,显示相应子系统中被隐藏的意图卡片。比如,如图8的(a)所示,第一电子设备检测到用户在界面404的照明子系统的标签404g附近执行左滑操作,则如图8的(b)所示,电子设备可以显示照明子系统中被隐藏的阅读灯关闭的意图卡片404h和墙门灯带关闭的意图卡片404i。用户可以将阅读灯关闭的意图卡片404h以及墙门灯带关闭的意图404i由区域404a拖动到区域404b,从而将阅读灯关闭的意图以及墙门灯带关闭的意图添加到待创建场景中。可以看出,该方案中,用户通过在当前界面上进行简单的选择(比如拖拽意图卡片到场景编辑区域404b)操作,即可创建目标场景,避免了如图1所示方案中用户需反复切换多个界面进行场景编辑,场景编辑效率低的问题。Alternatively, the first electronic device may display the hidden intention card in the corresponding subsystem based on other operations of the user. For example, as shown in (a) of Figure 8, if the first electronic device detects that the user performs a left sliding operation near the label 404g of the lighting subsystem of the interface 404, then as shown in (b) of Figure 8, the electronic device may display The intention card 404h for turning off the hidden reading light in the lighting subsystem and the intention card 404i for turning off the wall door light strip are hidden. The user can drag the intention card 404h to turn off the reading light and the intention to turn off the wall door light strip 404i from the area 404a to the area 404b, thereby adding the intention to turn off the reading light and the intention to turn off the wall door light strip to the scene to be created. It can be seen that in this solution, the user can create the target scene by making a simple selection on the current interface (such as dragging the intention card to the scene editing area 404b), which avoids the need for the user to repeat the operation as shown in Figure 1 Switching multiple interfaces for scene editing leads to low scene editing efficiency.
其中,在创建场景时,用户可以对多个意图进行组合,生成能够满足设备控制需求的场景,例如把开启暖光灯、窗帘、新风设备这几个意图进行组合,生成“舒适环境”场景。Among them, when creating a scene, the user can combine multiple intentions to generate a scene that can meet the device control needs. For example, combining the intentions of turning on warm lights, curtains, and fresh air equipment to generate a "comfortable environment" scene.
在一些实施例中,在场景创建或编辑的过程中,第一电子设备可以接收用户对意图的修改操作,对意图进行修改。示例性的,如图9的(a),响应于用户将意图展示区域404a中的意图卡片(比如阅读灯关闭的意图卡片404h、开启并调整组合灯亮度的意图卡片404k)拖动到场景编辑区域404b的操作,智能面板将这些意图添加到观影模式场景中。如图9的(b),检测到用户长按意图卡片404k的操作后,电子设备可在意图卡片404k上显示亮度调节条404m。用户可以拖动亮度调节条404m来调节组合灯的亮度(比如将组合灯的亮度调节为30%)。类似的,电子设备可以接收用户对其他意图卡片的操作,对可实现相应意图的电子设备的控制参数进行调整。In some embodiments, during the process of scene creation or editing, the first electronic device may receive the user's modification operation on the intention and modify the intention. Exemplarily, as shown in (a) of Figure 9, in response to the user dragging the intention card in the intention display area 404a (such as the intention card 404h to turn off the reading light, the intention card 404k to turn on and adjust the brightness of the combination light) to the scene editor For the operation of area 404b, the smart panel adds these intentions to the viewing mode scene. As shown in (b) of FIG. 9 , after detecting the user's operation of long-pressing the intention card 404k, the electronic device can display the brightness adjustment bar 404m on the intention card 404k. The user can drag the brightness adjustment bar 404m to adjust the brightness of the combination light (for example, adjust the brightness of the combination light to 30%). Similarly, the electronic device can receive the user's operations on other intention cards and adjust the control parameters of the electronic device that can achieve the corresponding intention.
图10示出了场景与设备或子系统的关系。由图10的(a)可以看出,用户创建的一个场景通常关联多个设备(比如平均每个场景关联7个设备)。因此,在以设备为粒度的场景编辑方案中,用户需分别切换至多个设备的界面(比如图1所示空调的界面以及其他设备的界面),并将相应设备添加到待创建的一个场景中。比如,若用户编辑场景时,需要对客厅中多个灯的亮度进行调节,则采用相关技术的场景编辑方法,用户需要针对该多个灯一一进行编排。与之相比,本申请实施例中,如图10的(b),将全屋的设备划分为多个子系统,平均每个场景关联1.2个子系统(或关联其他数目的子系统),每个子系统包括一个或多个设备,并以子系统的意图为粒度进行场景编辑。其中,一个意图通常可由一个多个设备执行,因此,在某些情况下,用户进行一次基于意图粒度的场景编辑,即相当于进行了多次基于设备粒度的场景编辑。如此一来,能够实现跨多个空间的设备的统一控制,无需通过多个界面针对每个设备单独进行编排。比如,用户编辑场景时,仅需通过当前界面,将照明子系统的组合灯意图(亮度参数60%)标识拖动至场景编辑区域,即可完成场景编辑。如此,简化了用户进行场景编排时的操作,能够提升场景编排的效率。Figure 10 shows the relationship between scenarios and devices or subsystems. As can be seen from Figure 10 (a), a scene created by a user is usually associated with multiple devices (for example, each scene is associated with an average of 7 devices). Therefore, in the scenario editing scheme with device granularity, the user needs to switch to the interfaces of multiple devices (such as the interface of the air conditioner and the interfaces of other devices shown in Figure 1), and add the corresponding devices to a scene to be created. . For example, if the user needs to adjust the brightness of multiple lights in the living room when editing a scene, then using the scene editing method of related technologies, the user needs to arrange the multiple lights one by one. In contrast, in the embodiment of the present application, as shown in (b) of Figure 10, the equipment in the whole house is divided into multiple subsystems. On average, each scene is associated with 1.2 subsystems (or other number of subsystems). Each subsystem The system consists of one or more devices, and scene editing is performed at the granularity of the subsystem's intent. Among them, an intention can usually be executed by multiple devices. Therefore, in some cases, a user's scene editing based on intent granularity is equivalent to multiple scene editing based on device granularity. This enables unified control of devices across multiple spaces without having to orchestrate each device individually through multiple interfaces. For example, when editing a scene, the user only needs to drag the combination light intention (brightness parameter 60%) logo of the lighting subsystem to the scene editing area through the current interface to complete the scene editing. In this way, the user's operations when arranging scenes are simplified, and the efficiency of scene arranging can be improved.
可选的,如图7的(d)所示,检测到用户点击“保存”按钮404e的操作后,第 一电子设备可以保存此次创建的观影模式场景。如图11的(a),电子设备显示界面501,界面501包括通过上述过程创建的观影模式场景的卡片501a。可选的,卡片501a上可设置用于修改观影模式场景的控件501b。Optionally, as shown in (d) of Figure 7, after detecting that the user clicks the "Save" button 404e, the An electronic device can save the movie viewing mode scene created this time. As shown in (a) of Figure 11 , the electronic device displays an interface 501. The interface 501 includes a card 501a of the viewing mode scene created through the above process. Optionally, a control 501b for modifying the scene in the viewing mode can be set on the card 501a.
在一些示例中,第一电子设备创建场景后,可以在满足触发条件时执行该场景。比如,如图11的(a)所示,若检测到用户点击卡片501a的操作,则电子设备可执行上述创建的观影模式场景所对应的各个意图,即电子设备指示可实现亮度参数60%的一个或多个灯开启;电子设备指示阅读灯、墙门灯带、天花灯带关闭;电子设备指示客厅的所有窗帘关闭;电子设备指示可实现温度调节意图的设备(比如客厅的空调A)调整温度至24度。In some examples, after the first electronic device creates the scene, the scene can be executed when the trigger condition is met. For example, as shown in (a) of Figure 11, if the user's operation of clicking card 501a is detected, the electronic device can execute each intention corresponding to the above-created viewing mode scene, that is, the electronic device indicates that the brightness parameter 60% can be achieved One or more lights in the living room are turned on; the electronic device indicates that the reading lights, wall door light strips, and ceiling light strips are turned off; the electronic device indicates that all curtains in the living room are closed; the electronic device indicates equipment that can achieve temperature adjustment purposes (such as air conditioner A in the living room) Adjust the temperature to 24 degrees.
在一些示例中,第一电子设备创建场景后,还可以对已创建的场景进行修改。示例性的,如图11的(a),检测到用户点击卡片501a上的控件501b的操作后,电子设备可弹出如图11的(b)所示的弹窗502。弹窗502包括观影模式场景所包括各个意图卡片。示例性的,检测到用户长按组合灯开启意图卡片502a的操作后,电子设备可在标识502a上显示亮度调节条502b。用户可以拖动亮度调节条502b来调节组合灯的亮度(比如将组合灯的亮度调节为30%)。类似的,电子设备可以接收用户对其他意图卡片的操作,对可实现相应意图的电子设备的控制参数进行调整。In some examples, after the first electronic device creates a scene, it can also modify the created scene. For example, as shown in Figure 11 (a), after detecting the user's click on the control 501b on the card 501a, the electronic device can pop up a pop-up window 502 as shown in Figure 11 (b). The pop-up window 502 includes each intention card included in the movie viewing mode scene. For example, after detecting the user's operation of long-pressing the combination light to turn on the intention card 502a, the electronic device may display the brightness adjustment bar 502b on the logo 502a. The user can drag the brightness adjustment bar 502b to adjust the brightness of the combination light (for example, adjust the brightness of the combination light to 30%). Similarly, the electronic device can receive the user's operations on other intention cards and adjust the control parameters of the electronic device that can achieve the corresponding intention.
在一些实施例中,用户还可以为已创建的场景增加或删除意图。示例性的,如图11的(b)所示,弹窗502还包括客厅关联的子系统的意图展示区域502d。用户可以在意图展示区域502d进行滑动操作,以便展示各子系统的意图卡片。如图11的(b)所示,意图展示区域502中显示照明子系统的意图卡片(开启组合灯、阅读灯、墙门灯带)。如图11的(c)所示,响应于用户在意图展示区域502d中执行上滑操作,智能面板在意图展示区域502d中显示冷暖新风子系统的意图卡片(温度、湿度、净化)。In some embodiments, users can also add or delete intents to created scenarios. For example, as shown in (b) of FIG. 11 , the pop-up window 502 also includes an intention display area 502d of the living room-related subsystem. The user can perform a sliding operation in the intention display area 502d to display the intention cards of each subsystem. As shown in (b) of FIG. 11 , the intention display area 502 displays the intention card of the lighting subsystem (turning on combination lights, reading lights, and wall door light strips). As shown in (c) of Figure 11 , in response to the user performing a swipe-up operation in the intention display area 502d, the smart panel displays the intention cards (temperature, humidity, purification) of the heating and cooling fresh air subsystem in the intention display area 502d.
应理解,如图11的(c),在检测到用户点击“保存”按钮502c的操作后,电子设备保存此次对观影模式场景的编辑信息。It should be understood that, as shown in (c) of Figure 11, after detecting the user's operation of clicking the "Save" button 502c, the electronic device saves the editing information of the viewing mode scene this time.
本申请实施例还提供场景编辑界面的其他实现方案。可选的,如图12A的(a),场景编辑界面404可以包括空间标识栏1104。空间标识栏1104包括全屋的多个空间的标识。比如,全屋、客厅、餐厅等空间标识。The embodiments of this application also provide other implementation solutions of the scene editing interface. Optionally, as shown in (a) of Figure 12A, the scene editing interface 404 may include a space identification bar 1104. The space identification column 1104 includes identification of multiple spaces throughout the house. For example, space signs for the whole house, living room, dining room, etc.
在一些示例中,空间标识栏1104可以是智能面板打开场景编辑界面404时就显示的。或者,在另一些示例中,智能面板显示场景编辑界面404后,响应于用户的特定操作,显示空间标识栏1104。比如,智能面板显示场景编辑界面404之后,响应于用户在屏幕左边缘开始的右滑操作,智能面板在场景编辑界面404上显示空间标识栏1104。In some examples, the space identification bar 1104 may be displayed when the smart panel opens the scene editing interface 404 . Or, in other examples, after the smart panel displays the scene editing interface 404, the space identification bar 1104 is displayed in response to a specific operation by the user. For example, after the smart panel displays the scene editing interface 404, in response to the user's right sliding operation from the left edge of the screen, the smart panel displays the space identification bar 1104 on the scene editing interface 404.
在一些实施例中,在对当前空间的场景(比如图12A的(a)所示客厅的场景)进行编辑之后,响应于用户的切换至目标空间的操作,第一电子设备可以切换到目标空间的场景编辑界面。示例性的,如图12A的(a)所示,智能面板显示客厅的场景编辑界面404。之后,如图12A的(b)所示,检测到用户点击餐厅空间标签1102的操作之后,智能面板显示餐厅的场景编辑界面1101。可以看出,用户通过操作当前界面中设置的空间标签,即可控制智能面板进行空间之间的切换,从而可简单快速的进入其他空间的场景编辑界面,场景编辑效率较高。 In some embodiments, after editing the scene of the current space (such as the scene of the living room shown in (a) of Figure 12A), in response to the user's operation of switching to the target space, the first electronic device may switch to the target space. scene editing interface. For example, as shown in (a) of Figure 12A, the smart panel displays the scene editing interface 404 of the living room. Afterwards, as shown in (b) of FIG. 12A , after detecting the user's operation of clicking on the restaurant space label 1102, the smart panel displays the scene editing interface 1101 of the restaurant. It can be seen that by operating the space tag set in the current interface, the user can control the smart panel to switch between spaces, so that the user can easily and quickly enter the scene editing interface of other spaces, and the scene editing efficiency is high.
可选的,如图12A的(a)所示,空间侧边栏1104中还可以包括控件1103。控件1103用于添加空间标签(比如书房、卫生间等空间标签)。Optionally, as shown in (a) of Figure 12A, the space sidebar 1104 may also include a control 1103. Control 1103 is used to add space labels (such as study room, bathroom, etc. space labels).
图12A主要以一个界面呈现某个空间对应的意图标识为例进行说明,在另一些实施例中,可以在一个界面呈现多个空间对应的意图标识。比如,如图12B,智能面板显示界面1203,界面1203包括多个空间的标签(比如餐厅的标签1203a、客厅的标签1203b)。响应于用户选择标签1203a和标签1203b的操作,智能面板在意图展示区域404b显示餐厅对应的意图卡片以及客厅对应的意图卡片。FIG. 12A mainly takes an example of an interface presenting an intention identifier corresponding to a certain space. In other embodiments, an interface may present an intention identifier corresponding to multiple spaces. For example, as shown in Figure 12B, the smart panel displays an interface 1203. The interface 1203 includes labels for multiple spaces (such as a restaurant label 1203a and a living room label 1203b). In response to the user's operation of selecting tag 1203a and tag 1203b, the smart panel displays the intention card corresponding to the restaurant and the intention card corresponding to the living room in the intention display area 404b.
可选的,餐厅对应的意图卡片的UI效果与客厅对应的意图卡片的UI效果可以不同,以便用户对不同空间的意图卡片进行区分。Optionally, the UI effect of the intention card corresponding to the restaurant can be different from the UI effect of the intention card corresponding to the living room, so that the user can distinguish the intention cards of different spaces.
示例性的,餐厅对应的意图卡片的UI效果与餐厅的空间标签1203a的UI效果相近(比如,餐厅对应的空间标签1203a的背景色是红色的,则餐厅对应的意图卡片的背景色也设置为红色),客厅对应的意图卡片的UI效果与客厅的空间标签1203b的UI效果相近。For example, the UI effect of the intent card corresponding to the restaurant is similar to the UI effect of the space label 1203a of the restaurant (for example, if the background color of the space label 1203a corresponding to the restaurant is red, then the background color of the intent card corresponding to the restaurant is also set to red), the UI effect of the intention card corresponding to the living room is similar to the UI effect of the space label 1203b of the living room.
再示例性的,如图12C的(a),智能面板显示界面1201,界面1201包括空间标识栏1204。该空间标识栏1204与图12A的(a)所示空间标识栏1104中各空间标识的UI效果可以不同。比如,图12A的(a)中,客厅等空间标识的形状为圆形,图12C的(a)中,客厅的空间标识的形状为矩形。在一些示例中,空间标识可以是在显示界面1201时一并显示的。或者,可以是在显示界面1201后,智能面板响应于用户的特定操作(比如在屏幕左侧边缘的右滑操作),在界面1201上显示空间标识栏1204。As another example, as shown in (a) of FIG. 12C , the smart panel displays an interface 1201 , and the interface 1201 includes a space identification bar 1204 . The UI effect of each space identifier in the space identifier bar 1204 and the space identifier bar 1104 shown in (a) of FIG. 12A may be different. For example, in (a) of FIG. 12A , the shape of the space sign such as the living room is circular, and in (a) of FIG. 12C , the shape of the space sign of the living room is a rectangle. In some examples, the space identifier may be displayed together with the interface 1201. Alternatively, after the interface 1201 is displayed, the smart panel may display the space identification bar 1204 on the interface 1201 in response to the user's specific operation (such as a right swipe operation on the left edge of the screen).
其中,空间标识栏包括控件1201a。响应于用户点击控件1201a的操作,智能面板可弹出弹窗1201b。在检测到用户点击“餐厅”选项的操作之后,如图12C的(b),智能面板可在界面1201中显示餐厅的空间标签1201c。在一些示例中,当餐厅标识1201c和客厅标识被同时选中的情况下,智能面板可以在界面1201中显示餐厅对应的意图卡片(比如卡片1201d)以及客厅对应的意图卡片。Among them, the space identification bar includes control 1201a. In response to the user clicking on the control 1201a, the smart panel may pop up a pop-up window 1201b. After detecting the user's operation of clicking the "Restaurant" option, as shown in (b) of FIG. 12C , the smart panel may display the space label 1201c of the restaurant in the interface 1201 . In some examples, when the restaurant logo 1201c and the living room logo are selected at the same time, the smart panel can display the intention card corresponding to the restaurant (such as card 1201d) and the intention card corresponding to the living room in the interface 1201.
可选的,场景编辑界面中,不同空间对应的意图标识的UI效果可不同,以便用户能辨别出相应意图所属空间。比如,图12C的(b)所示界面1201中,客厅对应的意图卡片的边框正常显示,餐厅对应的意图卡片的边框加粗显示。Optionally, in the scene editing interface, the UI effects of the intention identifiers corresponding to different spaces can be different, so that the user can identify the space to which the corresponding intention belongs. For example, in the interface 1201 shown in (b) of FIG. 12C , the frame of the intention card corresponding to the living room is displayed normally, and the frame of the intention card corresponding to the restaurant is displayed in bold.
在一些示例中,在创建图12C的(b)所示观影模式场景之后,用户可以对观影模式场景的参数进行调整。示例性的,接收到用户用于调整场景参数的操作之后,智能面板可弹出如图12C的(c)所示弹窗1202,用户可通过弹窗1202对场景参数(比如组合灯的亮度)进行调整。In some examples, after creating the viewing mode scene shown in (b) of FIG. 12C , the user can adjust parameters of the viewing mode scene. For example, after receiving the user's operation to adjust the scene parameters, the smart panel can pop up a pop-up window 1202 as shown in (c) of Figure 12C. The user can adjust the scene parameters (such as the brightness of the combination light) through the pop-up window 1202. Adjustment.
应理解,在第一电子设备创建目标场景之后,第一电子设备检测是否满足执行目标场景的触发条件,在满足触发条件时,第一电子设备执行该目标场景。示例性的,以执行观影模式场景的触发条件为点击观影模式场景对应的卡片为例,当智能面板检测到用户点击如图11的(a)所示卡片501a时,智能面板可以指示观影模式场景关联的一个或多个空间的设备执行相应操作。It should be understood that after the first electronic device creates the target scene, the first electronic device detects whether a trigger condition for executing the target scene is met, and when the trigger condition is met, the first electronic device executes the target scene. For example, taking the trigger condition for executing the viewing mode scene as clicking on the card corresponding to the viewing mode scene, when the smart panel detects that the user clicks on the card 501a as shown in (a) of Figure 11, the smart panel may instruct the viewer to Perform corresponding operations on the devices in one or more spaces associated with the shadow mode scene.
具体的,智能面板获取观影模式场景对应的意图,假设如图7的(d)所示,用户在创建观影模式场景时,将组合灯亮度60%、阅读灯关闭、墙门灯带关闭、天花灯带关闭、温度24度、窗帘全关的卡片由意图展示区域404a拖动到场景编辑区域404b, 则智能面板确定观影模式场景对应的意图为:开启客厅的组合灯并将组合灯的亮度调整至60%、关闭客厅的阅读灯、关闭客厅的墙门灯带、关闭客厅的天花灯带、调整客厅的温度至24度(目标温度)、将客厅的全部窗帘关闭。那么,智能面板可以根据观影模式场景对应的一个或多个目标意图,确定可实现该一个或多个目标意图的目标设备,并指示目标设备执行相应操作。Specifically, the smart panel obtains the intention corresponding to the viewing mode scene. Assume that as shown in (d) of Figure 7, when the user creates a viewing mode scene, the brightness of the combination light is 60%, the reading light is turned off, and the wall door light strip is turned off. , the ceiling light strip is turned off, the temperature is 24 degrees, and the curtains are fully closed, the cards are dragged from the intention display area 404a to the scene editing area 404b. Then the smart panel determines that the corresponding intention of the viewing mode scene is: turn on the combination light in the living room and adjust the brightness of the combination light to 60%, turn off the reading light in the living room, turn off the wall door light strip in the living room, turn off the ceiling light strip in the living room, Adjust the temperature in the living room to 24 degrees (target temperature) and close all curtains in the living room. Then, the smart panel can determine the target device that can realize the one or more target intentions based on one or more target intentions corresponding to the movie viewing mode scene, and instruct the target device to perform corresponding operations.
作为一种可能的实现方式,智能面板可以获取客厅中多个灯的参数,并根据多个灯的参数确定可实现60%亮度的一个或多个目标灯。可选的,目标灯可以是可实现60%亮度的,且节能效果最好的一个或多个灯。或者,目标灯可以是可实现60%亮度的,且色温最适合观影的一个或多个灯。目标灯还可以是其他类型的灯。示例性的,如图13所示,智能面板确定观影模式场景所需控制的目标灯为灯1-灯3。As a possible implementation, the smart panel can obtain the parameters of multiple lights in the living room and determine one or more target lights that can achieve 60% brightness based on the parameters of the multiple lights. Optionally, the target lamp may be one or more lamps that can achieve 60% brightness and have the best energy-saving effect. Alternatively, the target light can be one or more lights that can achieve 60% brightness and have a color temperature that is optimal for movie viewing. The target light can also be other types of lights. For example, as shown in Figure 13, the smart panel determines that the target lights that need to be controlled in the viewing mode scene are Lamp 1 - Lamp 3.
再示例性的,用户还可以对多个意图进行组合,以便创建生日聚会、温馨回家、全屋除湿、全屋透风等新的场景。As another example, users can also combine multiple intentions to create new scenarios such as birthday parties, warm home, whole-house dehumidification, and whole-house ventilation.
示例性的,智能面板可以获取客厅中可实现温控功能的设备(可简称为温控设备)的参数,并从多个温控设备中确定用于调整客厅温度至目标温度的目标温控设备。可选的,目标温控设备可以是电暖气或空调或其他温控设备。For example, the smart panel can obtain the parameters of a device in the living room that can implement temperature control functions (which can be referred to as a temperature control device for short), and determine the target temperature control device for adjusting the temperature of the living room to the target temperature from multiple temperature control devices. . Optionally, the target temperature control device can be an electric heater or air conditioner or other temperature control device.
类似的,智能面板还可以确定用于实现目标意图的其他目标设备。上述仅列举了确定目标设备的示例性方法,应理解,第一电子设备(比如智能面板)还可以采用其他方式确定可实现目标意图的目标设备。Similarly, smart panels can also identify other target devices to use to achieve the target intent. The above only lists exemplary methods for determining the target device. It should be understood that the first electronic device (such as a smart panel) can also use other methods to determine the target device that can achieve the target intention.
图14示出了本申请实施例提供的场景编辑界面的另一种示例。可选的,用户可以通过空间标签切换到相应空间的场景编辑界面。如图14的(a)所示,智能面板显示全屋的场景编辑界面1401。场景编辑界面1401包括各场景的标签1401a(可简称场景标签)。如图14的(a),场景标签包括但不限于离家场景的标签、回家场景的标签、睡眠场景的标签、阅读场景的标签等。用户可以选中某个场景的标签,以便对该场景进行编辑。可选的,当某个场景标签被选中时,智能面板可以在显示屏中心附近显示该意图,此时,被显示在显示屏中心附近的意图可称为中心意图。比如,界面1401中,离家场景的标签被选中,智能面板在显示屏中心附近显示中心意图(离家),用户可以通过界面1401编辑离家场景。Figure 14 shows another example of the scene editing interface provided by the embodiment of the present application. Optionally, users can switch to the scene editing interface of the corresponding space through the space label. As shown in (a) of Figure 14 , the smart panel displays a scene editing interface 1401 for the whole house. The scene editing interface 1401 includes labels 1401a for each scene (which may be referred to as scene labels). As shown in (a) of Figure 14 , scene tags include but are not limited to tags for leaving home scenes, tags for returning home scenes, tags for sleeping scenes, tags for reading scenes, etc. Users can select the label of a scene to edit the scene. Optionally, when a scene tag is selected, the smart panel can display the intent near the center of the display screen. At this time, the intent displayed near the center of the display screen can be called a central intent. For example, in the interface 1401, the label of the leaving home scene is selected, the smart panel displays the central intention (leaving home) near the center of the display screen, and the user can edit the leaving home scene through the interface 1401.
可选的,界面1401还包括控件1401b,该控件1401b用于添加场景标签。Optionally, the interface 1401 also includes a control 1401b, which is used to add scene tags.
在一些实施例中,界面1401还包括全屋的各子系统的标识。比如包括安防子系统的标识1401c。再比如,还包括影音子系统的标识、照明子系统的标识、冷暖新风子系统的标识。用户可以从各子系统的标识中选择目标子系统的标识,智能面板可以将目标子系统可实现的意图添加到离家场景中。示例性的,如图14的(a),用户向中心意图(离家)的方向拖动安防子系统的标识1401c,如图14的(b),当检测到安防子系统的标识1401c与中心意图(离家)碰撞(称为碰撞操作)或接近(例如距离小于预设阈值)之后,智能面板确定用户想要向离家场景添加安防子系统可实现的意图。In some embodiments, interface 1401 also includes identification of various subsystems of the whole house. For example, it includes the identification of the security subsystem 1401c. For another example, it also includes the logo of the audio and video subsystem, the logo of the lighting subsystem, and the logo of the heating and cooling fresh air subsystem. The user can select the identity of the target subsystem from the identities of each subsystem, and the smart panel can add the achievable intentions of the target subsystem to the away-from-home scenario. For example, as shown in (a) of Figure 14, the user drags the logo 1401c of the security subsystem in the direction of the central intention (leaving home). As shown in (b) of Figure 14, when it is detected that the logo 1401c of the security subsystem is in contact with the center. After an intent (leaving home) collision (called a collision operation) or proximity (for example, the distance is less than a preset threshold), the smart panel determines that the user wants to add a security subsystem-achievable intent to the leaving home scene.
在一些示例中,智能面板将安防子系统默认可实现的意图添加到离家场景。In some examples, smart panels add intents achievable by default to security subsystems to away-from-home scenarios.
在另一些示例中,智能面板可以提供界面,用户可以通过界面调整安防子系统可实现的意图。示例性的,在检测到如图14的(a)所示的标识1401c与中心意图(离 家)碰撞之后,如图14的(c),智能面板弹出弹窗1401d。弹窗1401d包括安防子系统可实现的一个或多个意图的卡片(比如智能门锁关闭的卡片、红外窗帘全开的卡片)。In other examples, smart panels can provide an interface through which users can adjust the intent that the security subsystem can achieve. Illustratively, when detecting the identification 1401c shown in Figure 14 (a) and the central intention (off After the collision (home), as shown in (c) of Figure 14, the smart panel pops up a pop-up window 1401d. The pop-up window 1401d includes cards with one or more intentions that can be realized by the security subsystem (such as smart door lock closing cards, infrared curtain fully opening cards).
一种实现方式中,用户可以通过选择一个或多个意图的卡片,将对应的意图添加到目标场景中。In one implementation, the user can add the corresponding intent to the target scene by selecting one or more intent cards.
另一种实现方式中,一个或多个意图的卡片默认是激活状态的,即在用户没有对意图进行移除的情况下,该意图默认被添加到目标场景中。可选的,用户可以删除部分意图,或者,用户可以通过某些操作使得某些意图在离家场景中无效。In another implementation, one or more intent cards are activated by default, that is, if the user does not remove the intent, the intent is added to the target scene by default. Optionally, the user can delete some intentions, or the user can make certain intentions invalid in the away-from-home scenario through certain operations.
示例性的,如图14的(c)所示,若智能面板检测到用户长按(或双击或其他操作)意图1401e的操作,则去激活该意图1401e,即不在离家场景中添加意图1401e,但可以在弹窗1401d中保留意图1401e的卡片。可选的,去激活的意图的UI效果与激活状态的意图的UI效果不同。比如,如图14的(c),去激活状态的意图1401e以边框加粗的UI效果显示,或者,去激活状态的意图呈灰色显示(图中未示出)。For example, as shown in (c) of Figure 14, if the smart panel detects the operation of the user's long press (or double-click or other operation) intention 1401e, the intention 1401e will be deactivated, that is, the intention 1401e will not be added in the leaving-home scene. , but the card with intention 1401e can be retained in the pop-up window 1401d. Optionally, the UI effect of the deactivated intention is different from the UI effect of the activated intention. For example, as shown in (c) of Figure 14, the intention 1401e of the deactivation state is displayed with a UI effect with a bold border, or the intention of the deactivation state is displayed in gray (not shown in the figure).
再示例性的,如图14的(d)所示,在智能面板检测到用户长按(或双击或其他操作)意图1401f的操作之后,智能面板显示提示框1401g,用于提示用户是否移除选中的意图。在检测到用户点击“是”选项,智能面板从弹窗1401d上移除意图1401f,即不再在弹窗1401d上显示意图1401f。As another example, as shown in (d) of Figure 14, after the smart panel detects the user's long press (or double-click or other operation) intention 1401f, the smart panel displays a prompt box 1401g to prompt the user whether to remove Selected intent. After detecting that the user clicks the "Yes" option, the smart panel removes the intent 1401f from the pop-up window 1401d, that is, it no longer displays the intent 1401f on the pop-up window 1401d.
在一些示例中,如图14的(d)所示,弹窗1401d还包括控件1401h,控件1401h用于向目标场景(比如离家场景)中添加意图。与前面实施例的方案类似,图14对应的方案中,也可以对意图的参数进行调整。具体调整意图参数的方法,可参考前面实施例的相关描述,这里不再赘述。In some examples, as shown in (d) of Figure 14, the pop-up window 1401d also includes a control 1401h, which is used to add intent to the target scene (such as leaving home scene). Similar to the solution in the previous embodiment, in the solution corresponding to Figure 14, the intended parameters can also be adjusted. For the specific method of adjusting the intention parameters, please refer to the relevant descriptions of the previous embodiments, and will not be described again here.
上述主要以在离家场景中添加安防子系统的相关意图为例进行说明,在另一些实施例中,还可以在离家场景中添加多个子系统,比如,如图14的(b),用户可以将照明子系统的标识1401i、冷暖新风子系统的标识1401j拖动到与离家场景的标识1401k碰撞或接近,则智能面板确定用户想要在离家场景中添加照明子系统对应的意图和冷暖新风子系统对应的意图。The above is mainly explained by taking the related intention of adding a security subsystem in the away-from-home scenario as an example. In other embodiments, multiple subsystems can also be added in the away-from-home scenario. For example, as shown in (b) of Figure 14, the user The logo 1401i of the lighting subsystem and the logo 1401j of the heating and cooling fresh air subsystem can be dragged to collide with or be close to the logo 1401k of the leaving-home scene. Then the smart panel determines the intention and corresponding intention of the user to add the lighting subsystem in the leaving-home scene. The corresponding intention of the heating and cooling fresh air subsystem.
在一些实施例中,智能面板可以针对每个场景,向用户推荐待添加到场景中的意图。以用户创建观影模式场景为例,示例性的,智能面板可以基于大数据分析,或采用其他方法,确定观影模式场景中包含的常用意图,并根据观影模式场景中的常用意图,在如图15所示的场景编辑界面406的区域404a中显示常用意图的卡片,比如,在观影模式场景中常用意图的卡片包括:组合灯(亮度60%)的意图卡片、温度的意图卡片、窗帘全关的意图卡片。如此,通过向用户推荐相应场景中的常用意图的卡片,可以有效指导用户在该场景中添加常用意图,以便高效的创建场景。In some embodiments, the smart panel can recommend to the user intents to be added to the scene for each scene. Taking the movie-watching mode scene created by the user as an example, the smart panel can determine the common intentions contained in the movie-watching mode scene based on big data analysis or other methods, and based on the common intentions in the movie-watching mode scene, As shown in Figure 15, cards with commonly used intentions are displayed in area 404a of the scene editing interface 406. For example, cards with commonly used intentions in the movie viewing mode scene include: intention cards for combination lights (brightness 60%), intention cards for temperature, Intention card to close the curtains completely. In this way, by recommending cards with common intentions in the corresponding scene to the user, the user can be effectively guided to add common intentions in the scene so that the scene can be created efficiently.
可选的,场景编辑界面406还可以包括控件404f,响应于用户点击控件404f的操作,智能面板可以显示照明子系统对应的其他意图卡片。用户可以从其他意图卡片中选择部分意图卡片,并将选择的意图卡片添加到待创建的场景中。Optionally, the scene editing interface 406 may also include a control 404f. In response to the user clicking the control 404f, the smart panel may display other intention cards corresponding to the lighting subsystem. Users can select some intent cards from other intent cards and add the selected intent cards to the scene to be created.
本申请实施例还提供一种智能设备控制方法,第一电子设备可以根据用户信息和用户意图,确定用户期望控制的第二电子设备的群组(可称为目标电子设备群组),并可以显示目标电子设备群组的标识以及目标电子设备群组中可实现目标意图(比如 开灯意图)的各电子设备的标识。例如,目标电子设备群组可以为客厅的电子设备群组、主卧的电子设备群组等。目标电子设备群组的标识可以为客厅、主卧等。Embodiments of the present application also provide a smart device control method. The first electronic device can determine a group of second electronic devices that the user desires to control (which can be called a target electronic device group) based on user information and user intentions, and can Display the identification of the target electronic device group and the target intent that can be achieved in the target electronic device group (such as Identification of each electronic device indicating the intention to turn on the light. For example, the target electronic device group may be an electronic device group in the living room, an electronic device group in the master bedroom, etc. The identification of the target electronic device group can be living room, master bedroom, etc.
示例性的,假设用户位于主卧,如图7的(a),智能面板显示界面401,界面401包括全屋控制选项401b。接收到用户点击全屋控制选项401b的操作之后,智能面板可跳转到图16A的(a)所示界面1602。如图16A中的(a),界面1602中显示意图标识栏161,意图标识栏161用于显示意图的意图标识。当意图标识栏中的开灯意图标识162显示为选中状态时,表示智能面板当前显示的界面1602为开灯意图标识162对应的开灯意图的控制界面。界面1602包括主卧中可实现开灯意图的电子设备的标识(比如显示如图16A的(a)所示界面1602中的顶灯、射灯、台灯、地灯的标识)。用户可以对主卧中电子设备的标识进行操作,以控制相应电子设备。示例性的,用户将射灯的标识移动至与中心意图(开灯)的标识碰撞,响应于用户的该操作,智能面板控制射灯开启。再示例性的,用户将射灯的标识以及地灯的标识均移向中心意图,响应于用户的该操作,智能面板控制射灯以及地灯开启。For example, assuming that the user is located in the master bedroom, as shown in (a) of Figure 7 , the smart panel displays an interface 401, and the interface 401 includes a whole-house control option 401b. After receiving the user's operation of clicking on the whole house control option 401b, the smart panel can jump to the interface 1602 shown in (a) of Figure 16A. As shown in (a) of FIG. 16A , the intention identification column 161 is displayed in the interface 1602 , and the intention identification column 161 is used to display the intention identification of the intention. When the light-on intention indicator 162 in the intention identification column is displayed in a selected state, it indicates that the interface 1602 currently displayed on the smart panel is the control interface for the light-on intention corresponding to the light-on intention indicator 162 . The interface 1602 includes the identification of the electronic devices in the master bedroom that can realize the intention of turning on the lights (for example, the identification of the ceiling lamp, spotlight, table lamp, and floor lamp in the interface 1602 as shown in (a) of FIG. 16A ). Users can operate the signs of electronic devices in the master bedroom to control the corresponding electronic devices. For example, the user moves the sign of the spotlight to collide with the sign of the central intention (turning on the light). In response to the user's operation, the smart panel controls the spotlight to turn on. As another example, the user moves the logo of the spotlight and the logo of the floor lamp toward the center intention. In response to the user's operation, the smart panel controls the spotlight and the floor lamp to turn on.
再示例性的,用户将主卧的标识移动至与中心意图(开灯)的标识碰撞,响应于用户的该操作,智能面板确定用户想要控制的主卧中的目标电子设备,并控制目标电子设备执行开灯意图。比如,响应于用户将主卧的标识移动至与中心意图的标识碰撞,智能面板默认用户想要控制主卧中可实现开灯意图的全部设备,则智能面板控制主卧中可实现开灯意图的全部设备(比如顶灯、射灯、台灯、地灯)执行开灯意图。再比如,响应于用户将主卧的标识移动至与中心意图的标识碰撞,智能面板根据用户信息,确定目前时间段为晚上8:00(通常为下班回家时间),则智能面板确定用户想要控制主卧中的顶灯开启。As another example, the user moves the logo of the master bedroom to collide with the logo of the central intention (turning on the lights). In response to the user's operation, the smart panel determines the target electronic device in the master bedroom that the user wants to control, and controls the target. The electronic device executes the intention to turn on the light. For example, in response to the user moving the logo of the master bedroom to collide with the logo of the central intention, the smart panel assumes that the user wants to control all the devices in the master bedroom that can achieve the intention of turning on the lights, then the smart panel controls the master bedroom to achieve the intention of turning on the lights. All equipment (such as ceiling lights, spotlights, table lamps, floor lamps) execute the intention of turning on the lights. For another example, in response to the user moving the master bedroom logo to collide with the central intention logo, the smart panel determines that the current time period is 8:00 pm (usually the time to go home from get off work) based on the user information, and the smart panel determines that the user wants to To control the turning on of the ceiling light in the master bedroom.
可选的,界面1602还可以包括可实现开灯意图的其他电子设备群组的标识(比如客厅、次卧、书房的标识)。可选的,假设可实现开灯意图的其他电子设备群组的标识与中心意图之间的距离为第一距离,用户想要控制的电子设备群组(可以称为目标电子设备群组)的标识与中心意图之间的距离为第二距离,第一距离大于第二距离。也就是说,目标电子设备群组的标识距离中心意图更近,以便于用户将目标电子设备群组中目标电子设备的标识拖动至与中心意图碰撞,方便用户对目标电子设备进行控制。示例性的,如图16A的(a),与次卧等群组的标识相比,主卧的标识与中心意图(开灯意图)之间的距离更近,这样能够缩短用户执行碰撞操作的拖动距离,降低设备控制的用时,提升设备控制的效率。Optionally, the interface 1602 may also include identification of other electronic device groups that can realize the intention of turning on the lights (such as identification of the living room, second bedroom, and study room). Optionally, assuming that the distance between the identification of other electronic device groups that can realize the intention of turning on the lights and the central intention is the first distance, the electronic device group that the user wants to control (which can be called the target electronic device group) The distance between the logo and the central intention is the second distance, and the first distance is greater than the second distance. That is to say, the logo of the target electronic device group is closer to the central intention, so that the user can drag the logo of the target electronic device in the target electronic device group until it collides with the central intention, thereby facilitating the user to control the target electronic device. For example, as shown in (a) of Figure 16A, compared with the logos of groups such as the second bedroom, the distance between the logo of the master bedroom and the central intention (the intention to turn on the lights) is closer, which can shorten the time for the user to perform the collision operation. Drag distance to reduce device control time and improve device control efficiency.
再例如,如图16A的(b),用户位于客厅,则用户打开开灯意图对应的控制界面时,智能面板可以根据用户所在的位置确定用户想要控制客厅中的电子设备,则智能面板显示界面1603,界面1603包括客厅中可实现开灯意图的电子设备的标识,比如显示如图16A的(b)所示界面1603中的顶灯、射灯、台灯、地灯的标识。For another example, as shown in (b) of Figure 16A, the user is in the living room, and when the user opens the control interface corresponding to the intention to turn on the lights, the smart panel can determine based on the user's location that the user wants to control the electronic equipment in the living room, and the smart panel displays Interface 1603 includes identification of electronic devices in the living room that can realize the intention of turning on lights, such as identification of ceiling lights, spotlights, desk lamps, and floor lamps in interface 1603 as shown in (b) of Figure 16A .
又例如,当前时间段为用户通常的午休时间段,则用户打开窗帘关闭意图对应的控制界面时,智能面板可以根据当前时间确定用户想要控制主卧中的电子设备,则在控制界面上显示主卧中可实现窗帘关闭意图的各窗帘的标识,用户可以通过操作主卧中窗帘的标识,方便地控制关闭主卧中的窗帘。可选的,智能面板还可以在控制界面上显示可实现窗帘关闭意图的其他设备群组的标识。 For another example, if the current time period is the user's usual lunch break time period, when the user opens the curtains and closes the control interface corresponding to his intention, the smart panel can determine based on the current time that the user wants to control the electronic equipment in the master bedroom, and then display it on the control interface. The logos of each curtain in the master bedroom can be used to realize the curtain closing intention. The user can conveniently control and close the curtains in the master bedroom by operating the logos of the curtains in the master bedroom. Optionally, the smart panel can also display on the control interface the identification of other device groups that can realize the curtain closing intention.
在一些实施例中,用户可以切换意图。比如,如图16A的(b),智能面板显示开灯意图162对应的界面1603。后续,如图16B所示,检测到用户点击意图标识栏1607中音乐播放意图的标识之后,智能面板显示音乐播放意图对应的界面1607。In some embodiments, the user can switch intents. For example, as shown in (b) of Figure 16A, the smart panel displays an interface 1603 corresponding to the intention to turn on the lights 162. Subsequently, as shown in FIG. 16B, after detecting that the user clicks on the mark of the music playback intention in the intention mark bar 1607, the smart panel displays the interface 1607 corresponding to the music playback intention.
考虑到某些情况下,除了智能面板根据用户信息自行确定的目标电子设备群组之外,用户还想要控制其他电子设备群组中的设备,本申请实施例,智能面板可以根据用户的操作确定用户想要控制的其他电子设备。作为一种可能的实现方式,响应于用户对电子设备群组的标识的操作,智能面板可以显示电子设备群组中的电子设备的标识,用户可以通过电子设备的标识对电子设备进行控制。示例性的,如图16A的(a),若用户想要控制主卧中的顶灯等设备,则用户可以将主卧中相应电子设备的标识(比如顶灯、射灯的标识)拖动至与中心意图(开灯)碰撞,或者将主卧中相应电子设备的标识拖动至与中心意图的距离小于一定阈值的位置,以触发智能面板控制相应电子设备执行开灯意图。Considering that in some cases, in addition to the target electronic device group determined by the smart panel based on user information, the user also wants to control devices in other electronic device groups. In the embodiment of the present application, the smart panel can control the target electronic device group according to the user's operation. Identify other electronic devices the user wants to control. As a possible implementation, in response to the user's operation on the identification of the electronic device group, the smart panel can display the identification of the electronic device in the electronic device group, and the user can control the electronic device through the identification of the electronic device. For example, as shown in (a) of Figure 16A, if the user wants to control the ceiling light and other equipment in the master bedroom, the user can drag the logo of the corresponding electronic device in the master bedroom (such as the logo of the ceiling light and spotlight) to the Collision with the central intention (turn on the lights), or drag the logo of the corresponding electronic device in the master bedroom to a position where the distance from the central intention is less than a certain threshold, to trigger the smart panel to control the corresponding electronic device to execute the intention to turn on the lights.
若用户还想要控制次卧中的电子设备,用户还可以长按次卧标识169,响应于用户对次卧标识169的诸如长按操作,智能面板可以显示图17所示的弹窗170,弹窗170包括次卧中可实现开灯意图的各电子设备的标识(比如台灯、顶灯的标识)。响应于用户对次卧中电子设备的标识的操作,智能面板控制相应电子设备执行开灯意图。比如,响应于用户点击次卧中台灯、顶灯标识的操作,智能面板控制次卧中的台灯、顶灯开启。If the user also wants to control the electronic equipment in the secondary bedroom, the user can also long press the secondary bedroom logo 169. In response to the user's long press operation on the secondary bedroom logo 169, the smart panel can display the pop-up window 170 shown in Figure 17, The pop-up window 170 includes the identification of each electronic device in the second bedroom that can realize the intention of turning on the light (such as the identification of a desk lamp and a ceiling light). In response to the user's operation on the logo of the electronic device in the secondary bedroom, the smart panel controls the corresponding electronic device to execute the intention of turning on the light. For example, in response to the user clicking on the logo of the desk lamp and ceiling light in the second bedroom, the smart panel controls the desk lamp and ceiling light in the second bedroom to turn on.
上述主要以智能面板确定目标电子设备群组后,在设备控制界面上向用户展示目标电子设备群组的标识以及目标电子设备群组中的各电子设备的标识为例进行说明。在一些实施例中,智能面板在确定目标电子设备群组后,可以显示目标电子设备群组的标识,但不显示目标电子设备群组中的各电子设备的标识。The above is mainly explained by taking the smart panel as an example to display the identification of the target electronic device group and the identification of each electronic device in the target electronic device group to the user on the device control interface after determining the target electronic device group. In some embodiments, after determining the target electronic device group, the smart panel may display the identity of the target electronic device group, but does not display the identity of each electronic device in the target electronic device group.
示例性的,如图18的(a),用户位于主卧,则用户打开开灯意图对应的控制界面时,智能面板可以根据用户所在的位置确定用户想要控制主卧中的电子设备,则智能面板显示界面1605,界面1605包括主卧的标识164。For example, as shown in (a) of Figure 18, the user is located in the master bedroom. When the user opens the control interface corresponding to the intention to turn on the lights, the smart panel can determine based on the user's location that the user wants to control the electronic equipment in the master bedroom, then The smart panel displays an interface 1605. The interface 1605 includes a logo 164 of the master bedroom.
可选的,界面1605还可以包括:可实现开灯意图的其他电子设备群组的标识,比如客厅、次卧、书房的标识。可选的,主卧标识与中心意图之间的距离小于其他群组标识与中心意图之间的距离。如此,方便用户将主卧标识拖动至与中心意图碰撞。Optionally, the interface 1605 may also include: identification of other electronic device groups that can realize the intention of turning on the lights, such as identification of the living room, second bedroom, and study room. Optionally, the distance between the master bedroom logo and the central intention is smaller than the distance between the other group logos and the central intention. In this way, it is convenient for the user to drag the master bedroom logo to collide with the central intention.
可选的,响应于用户将主卧标识移动至与中心意图碰撞的操作,智能面板自行确定用户想要控制的主卧中可实现开灯意图的目标电子设备。比如,智能面板确定用户想要控制主卧中可实现开灯意图的全部设备。再比如,智能面板根据用户信息,确定用户想要控制的主卧中可实现开灯意图的设备为射灯。Optionally, in response to the user's operation of moving the master bedroom logo to collide with the central intention, the smart panel determines on its own the target electronic device in the master bedroom that the user wants to control that can achieve the intention of turning on the lights. For example, the smart panel determines that the user wants to control all the devices in the master bedroom that can turn on the lights. For another example, based on user information, the smart panel determines that the device in the master bedroom that the user wants to control that can achieve the intention of turning on the lights is a spotlight.
或者,响应于用户将主卧标识移动至与中心意图标识进行碰撞的操作,智能面板弹出弹窗,弹窗中包括主卧中可实现开灯意图的设备。响应于用户从主卧中可实现开灯意图的设备中选择目标电子设备的操作,智能面板确定用户想要控制的目标电子设备。或者,智能面板可以采用其他方法确定用户想要控制的目标电子设备。Or, in response to the user's operation of moving the master bedroom logo to collide with the central intention logo, the smart panel pops up a pop-up window that includes devices in the master bedroom that can realize the intention of turning on the lights. In response to the user's operation of selecting the target electronic device from the devices in the master bedroom that can realize the intention of turning on the lights, the smart panel determines the target electronic device that the user wants to control. Alternatively, the smart panel may employ other methods to determine the target electronic device that the user wants to control.
再示例性的,如图18的(b),用户位于客厅,则用户打开开灯意图对应的控制界面时,智能面板可以根据用户所在的位置确定用户想要控制客厅中的电子设备,则智能面板显示界面1606,界面1606包括客厅的标识172。可选的,客厅标识与中心意 图之间的距离小于其他群组标识与中心意图之间的距离。如此,方便用户将客厅标识拖动至与中心意图碰撞。For another example, as shown in (b) of Figure 18, the user is located in the living room, and when the user opens the control interface corresponding to the intention to turn on the lights, the smart panel can determine based on the user's location that the user wants to control the electronic equipment in the living room, then the smart panel The panel displays an interface 1606, and the interface 1606 includes a logo 172 of the living room. Optional, living room logo and central idea The distance between graphs is smaller than the distance between other group identities and the central intent. In this way, it is convenient for users to drag the living room logo to collide with the central intention.
在一些实施例中,智能面板可以确定电子设备群组中目标电子设备的控制参数。In some embodiments, a smart panel can determine control parameters of a target electronic device in a group of electronic devices.
示例性的,如图19的(a)所示,智能面板显示界面401,界面401包括全屋控制选项401b。接收到用户点击全屋控制选项401b的操作之后,智能面板可跳转到图19的(b)所示界面1601,界面1601上显示有意图标识栏161,意图标识栏161用于显示意图的意图标识。Exemplarily, as shown in (a) of Figure 19, the smart panel displays an interface 401, and the interface 401 includes a whole-house control option 401b. After receiving the operation of the user clicking on the whole house control option 401b, the smart panel can jump to the interface 1601 shown in (b) of Figure 19. The interface 1601 displays an intention identification bar 161, and the intention identification bar 161 is used to display the intention of the intention. logo.
如图19的(b)所示,意图标识栏161中显示的开灯意图标识162突出显示,用于表示智能面板当前显示的界面1601为开灯意图标识162对应的开灯意图的控制界面。如附图标记163所示,智能面板当前显示的中心意图为开灯意图。示例性的,用户可以点击开灯意图的标识162,响应于用户的操作,智能面板可以将开灯意图显示在屏幕中心附近(称为中心意图163)。As shown in (b) of FIG. 19 , the light-on intention indicator 162 displayed in the intention indicator column 161 is highlighted to indicate that the interface 1601 currently displayed on the smart panel is the control interface for the light-on intention corresponding to the light-on intention indicator 162 . As shown in reference numeral 163, the central intention currently displayed by the smart panel is the intention to turn on the light. For example, the user can click the sign 162 of the intention to turn on the lights, and in response to the user's operation, the smart panel can display the intention to turn on the lights near the center of the screen (called the center intention 163).
作为一种可能的实现方式,智能面板可以在中心意图(开灯意图)周围显示可实现开灯意图的电子设备的群组。如附图标记164所示,主卧内包含可实现开灯意图的电子设备,因此,智能面板显示主卧群组的标识(如界面1601上显示的附图标记164指示的圆圈)。智能面板还可以在界面1601上显示其他可实现开灯意图的电子设备的群组(比如客厅、次卧、书房中电子设备的群组)。As a possible implementation, the smart panel can display a group of electronic devices that can realize the intention to turn on the lights around the central intention (the intention to turn on the lights). As shown by reference numeral 164, the master bedroom contains electronic devices that can realize the intention of turning on the lights. Therefore, the smart panel displays the identification of the master bedroom group (such as the circle indicated by reference numeral 164 displayed on the interface 1601). The smart panel can also display on the interface 1601 a group of other electronic devices that can realize the intention of turning on the lights (such as a group of electronic devices in the living room, second bedroom, and study room).
作为一种可能的实现方式,智能面板可以获取可授权获得的用户信息,并根据用户信息确定相应群组中设备的控制参数,并可以向用户提示相应控制参数。可选的,用户信息包括但不限于如下一项或多项信息:用户位置、时间、用户行为。As a possible implementation method, the smart panel can obtain authorized user information, determine the control parameters of the devices in the corresponding group based on the user information, and prompt the user with the corresponding control parameters. Optional, user information includes but is not limited to one or more of the following information: user location, time, user behavior.
再示例性的,智能面板根据历史上获取的用户信息,获知用户在晚上8:30-10:00通常会在书房进行阅读或学习。那么,若当前时间为晚上9:00,则用户打开界面1601时,智能面板可以在界面1601上显示各相应群组内设备的建议控制参数,该建议控制参数适用于阅读或学习场景。比如,如图19的(b)智能面板在界面1601上显示如附图标记165所示的书房标记,如附图标记166所示的阅读建议亮度30%,以及如附图标记167所示的阅读建议色温5000K。As another example, the smart panel learns that users usually read or study in the study room from 8:30 to 10:00 pm based on the user information obtained historically. Then, if the current time is 9:00 pm, when the user opens the interface 1601, the smart panel can display the recommended control parameters of the devices in each corresponding group on the interface 1601. The recommended control parameters are suitable for reading or learning scenarios. For example, the smart panel in (b) of Figure 19 displays a study mark as shown in reference numeral 165 on the interface 1601, a reading suggestion brightness of 30% as shown in reference numeral 166, and a reading suggestion as shown in reference numeral 167. Reading recommended color temperature is 5000K.
可选的,用户可以对智能面板显示的建议控制参数进行调整。示例性的,如图19的(c)所示,用户可以长按标记167所示的建议色温的卡片,调整为新的色温5500K。之后,如图19的(d)所示,用户可以将书房的标识165向中心意图(开灯)的方向进行拖动。当检测到书房的标识165与中心意图碰撞之后,智能面板可以向书房中可实现开灯意图(亮度为30%,色温为5500K)的目标设备发送控制指令,目标设备执行开灯意图。其中,目标设备可以是一个或多个。示例性的,目标设备为灯1和灯2,灯1和灯2的组合亮度是30%,组合色温是5500K。或者,目标设备为灯3,灯3的亮度为建议亮度30%,色温为建议色温5500K。该方案中,智能面板可以根据用户信息,向用户推荐适合当前场景(比如阅读或学习场景)的可实现目标意图的设备控制参数。比如可以向用户推荐适合阅读场景,且可实现开灯意图的设备的亮度参数以及色温参数。可见,智能面板能够针对用户提供个性化的设备控制相关的指导意见,以便有效的指导用户进行智能设备的控制。Optionally, users can adjust the recommended control parameters displayed on the smart panel. For example, as shown in (c) of FIG. 19 , the user can long press the recommended color temperature card shown as mark 167 to adjust to the new color temperature of 5500K. After that, as shown in (d) of FIG. 19 , the user can drag the study room logo 165 in the direction of the central intention (turning on the lights). After detecting that the study room logo 165 collides with the central intention, the smart panel can send a control instruction to a target device in the study room that can realize the lighting intention (brightness is 30%, color temperature is 5500K), and the target device executes the lighting intention. There can be one or more target devices. For example, the target devices are lamp 1 and lamp 2, the combined brightness of lamp 1 and lamp 2 is 30%, and the combined color temperature is 5500K. Or, the target device is lamp 3, the brightness of lamp 3 is the recommended brightness of 30%, and the color temperature is the recommended color temperature of 5500K. In this solution, the smart panel can recommend to the user device control parameters that are suitable for the current scene (such as reading or learning scenes) and can achieve the target intention based on user information. For example, it can recommend to users the brightness parameters and color temperature parameters of devices that are suitable for reading scenes and can achieve the intention of turning on the lights. It can be seen that the smart panel can provide users with personalized guidance related to device control, so as to effectively guide users to control smart devices.
再示例性的,如图20的(a),智能面板显示界面1604,界面1604包括主卧中 可实现开灯意图的电子设备(比如射灯、顶灯等)以及开灯意图对应的建议亮度(30%)和建议色温(5500K)。如图20的(b),响应于用户向中心意图拖动射灯标识的操作,智能面板控制主卧中的射灯开启,射灯的亮度为30%,色温为5500K。As another example, as shown in (a) of Figure 20, the smart panel displays an interface 1604. The interface 1604 includes the Electronic devices that can realize the intention to turn on the light (such as spotlights, ceiling lights, etc.) and the recommended brightness (30%) and recommended color temperature (5500K) corresponding to the intention to turn on the light. As shown in (b) of Figure 20, in response to the user's operation of dragging the spotlight logo toward the center, the smart panel controls the spotlight in the master bedroom to turn on. The brightness of the spotlight is 30% and the color temperature is 5500K.
可选的,不同电子设备群组对应的建议控制参数可以呈现为不同的UI效果。示例性的,如图21,书房中可实现开灯意图的电子设备(比如落地灯、阅读灯)的建议亮度的卡片166,建议色温的卡片167以第一UI效果(比如右上至左下的斜杠)呈现,客厅中可实现开灯意图的电子设备(比如落地灯)的建议亮度的卡片,建议色温的卡片以第二UI效果(比如左上至右下的斜杠)呈现。例如,用户可以将书房的标识向中心意图(开灯)的方向进行拖动。当检测到书房的标识与中心意图碰撞之后,智能面板可以向书房中可实现开灯意图(亮度为30%,色温为5000K)的目标设备发送控制指令,目标设备执行开灯意图。又例如,用户可以将客厅的标识向中心意图(开灯)的方向进行拖动。当检测到客厅的标识与中心意图碰撞之后,智能面板可以向客厅中可实现开灯意图(亮度为35%,色温为5500K)的目标设备发送控制指令,目标设备执行开灯意图。Optionally, the recommended control parameters corresponding to different electronic device groups can be presented as different UI effects. For example, as shown in Figure 21, a card 166 with recommended brightness and a card 167 with recommended color temperature for electronic devices in the study that can turn on lights (such as floor lamps, reading lamps) is displayed with the first UI effect (such as a slash from upper right to lower left). ) presents a card with recommended brightness for electronic devices in the living room (such as a floor lamp) that can turn on lights, and a card with recommended color temperature as a second UI effect (such as a slash from upper left to lower right). For example, the user can drag the sign of the study room in the direction of the central intention (turn on the lights). After detecting that the study room logo collides with the central intention, the smart panel can send control instructions to the target device in the study room that can achieve the intention to turn on the lights (brightness is 30%, color temperature is 5000K), and the target device executes the intention to turn on the lights. For another example, the user can drag the logo of the living room in the direction of the central intention (turning on the lights). After detecting that the logo of the living room collides with the central intention, the smart panel can send control instructions to the target device in the living room that can achieve the intention to turn on the lights (brightness is 35%, color temperature is 5500K), and the target device executes the intention to turn on the lights.
上述以智能面板根据用户信息确定相应电子设备的建议控制参数为例,在另一些实施例中,智能面板还可以根据其他信息确定相应电子设备的建议控制参数。The above example uses the smart panel to determine the recommended control parameters of the corresponding electronic device based on user information. In other embodiments, the smart panel can also determine the recommended control parameters of the corresponding electronic device based on other information.
在一些实施例中,用户还可以选择多个意图,智能面板可以对多个意图进行组合。示例性的,如图22所示,检测到用户从意图标识栏161选择开灯意图162和音乐播放意图的操作,智能面板在屏幕的中心附近显示中心意图(开灯、音乐播放)。响应于用户将主卧标识拖动至与中心意图碰撞,或者用户将主卧标识拖动至与中心意图的距离小于一定距离,智能面板可以控制主卧内的灯开启,控制主卧内的音箱等设备执行音乐播放。In some embodiments, the user can also select multiple intentions, and the smart panel can combine multiple intentions. For example, as shown in FIG. 22 , after detecting the user's operation of selecting the intention to turn on the lights 162 and the intention to play music from the intention identification bar 161 , the smart panel displays the central intention (turning on the lights, playing music) near the center of the screen. In response to the user dragging the master bedroom logo to collide with the central intention, or the user dragging the master bedroom logo to be less than a certain distance from the central intention, the smart panel can control the lights in the master bedroom to turn on and control the speakers in the master bedroom. Wait for the device to perform music playback.
可选的,智能面板还可以根据用户信息确定开灯意图、音乐播放意图对应的设备控制参数。比如,若当前时间为晚上10:00,则智能面板确定音乐播放意图对应的建议音量为xx分贝(dB),并显示如标记168所示的建议音量的卡片。如此,能够有效的对用户控制音乐播放意图的相关设备进行指导,以免播放音乐过程中打扰到附近的邻居。Optionally, the smart panel can also determine the device control parameters corresponding to the intention to turn on lights and the intention to play music based on user information. For example, if the current time is 10:00 pm, the smart panel determines that the recommended volume corresponding to the music playback intention is xx decibels (dB), and displays a card with the recommended volume as marked 168. In this way, it is possible to effectively guide the user to control related devices with music playback intentions, so as to avoid disturbing nearby neighbors during music playback.
上述一个或多个界面均是示例性的,还可以有其他的界面设计方式,本申请对界面的具体设计方式,界面之间的切换方式不做限制。The above one or more interfaces are examples, and other interface design methods are possible. This application does not limit the specific design method of the interface or the switching method between interfaces.
示例性的,场景编辑界面的布局,还可以是在场景编辑界面的右边栏展示场景的触发条件,在场景编辑界面的下方区域展示子系统的意图卡片等。For example, the layout of the scene editing interface can also be to display the trigger conditions of the scene in the right column of the scene editing interface, and to display the intention cards of the subsystems in the lower area of the scene editing interface.
并且,对界面中控件的操作仅是示例的,用户可以通过对界面中的目标控件进行某个操作,触发第一电子设备执行目标操作。还可以定义其他操作,当检测到用户对目标控件进行该其他操作时,第一电子设备执行目标操作。Moreover, the operations on the controls in the interface are only examples. The user can trigger the first electronic device to perform the target operation by performing a certain operation on the target control in the interface. Other operations may also be defined, and when it is detected that the user performs the other operations on the target control, the first electronic device performs the target operation.
上述主要以按照空间划分群组为例进行说明,在另一些实施例中,还可以按照其他划分标准划分群组。比如,可以按照设备与用户之间的距离划分群组,与用户距离小于第一阈值的设备,可以被划分至第一群组。智能面板可以显示第一群组中各设备的标识,以便用户对距离较近的设备进行控制。The above description mainly takes the example of dividing groups according to space. In other embodiments, groups may also be divided according to other dividing standards. For example, groups can be divided according to the distance between the device and the user. Devices whose distance from the user is less than a first threshold can be divided into the first group. The smart panel can display the identification of each device in the first group, so that the user can control the nearby devices.
需要说明的是,上述各方法实施例的流程中的一些操作任选地被组合,并且/或者 一些操作的顺序任选地被改变。并且,各流程的步骤之间的执行顺序仅是示例性的,并不构成对步骤之间执行顺序的限制,各步骤之间还可以是其他执行顺序。并非旨在表明所述执行次序是可以执行这些操作的唯一次序。本领域的普通技术人员会想到多种方式来对本文所述的操作进行重新排序。另外,应当指出的是,本文某个实施例涉及的过程细节同样以类似的方式适用于其他实施例,或者,不同实施例之间可以组合使用。It should be noted that some operations in the processes of the above method embodiments are optionally combined, and/or The order of some operations is optionally changed. Moreover, the execution order between the steps of each process is only exemplary and does not constitute a limitation on the execution order between the steps. Other execution orders are possible between the steps. It is not intended that the order of execution described is the only order in which these operations may be performed. One of ordinary skill in the art will recognize various ways to reorder the operations described herein. In addition, it should be noted that the process details involved in a certain embodiment herein are also applicable to other embodiments in a similar manner, or different embodiments can be used in combination.
此外,方法实施例中的某些步骤可等效替换成其他可能的步骤。或者,方法实施例中的某些步骤可以是可选的,在某些使用场景中可以删除。或者,可以在方法实施例中增加其他可能的步骤。In addition, certain steps in the method embodiments may be equivalently replaced by other possible steps. Alternatively, certain steps in method embodiments may be optional and may be deleted in certain usage scenarios. Alternatively, other possible steps may be added to the method embodiments.
并且,上述各方法实施例之间可以单独实施,或结合起来实施。Moreover, the above method embodiments can be implemented individually or in combination.
示例性的,智能面板可以根据用户信息确定用户想要控制的电子设备群组,并可以根据用户信息确定电子设备群组中目标电子设备的建议控制参数。For example, the smart panel can determine the electronic device group that the user wants to control based on the user information, and can determine recommended control parameters for the target electronic device in the electronic device group based on the user information.
可以理解的是,本申请实施例中的设备为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。结合本申请中所公开的实施例描述的各示例的单元及算法步骤,本申请实施例能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。本领域技术人员可以对每个特定的应用来使用不同的方法来实现所描述的功能,但是这种实现不应认为超出本申请实施例的技术方案的范围。It can be understood that, in order to implement the above functions, the devices in the embodiments of the present application include hardware structures and/or software modules corresponding to each function. In conjunction with the units and algorithm steps of each example described in the embodiments disclosed in this application, the embodiments of this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the technical solutions of the embodiments of the present application.
本申请实施例可以根据上述方法示例对电子设备进行功能单元的划分,例如,可以对应各个功能划分各个功能单元,也可以将两个或两个以上的功能集成在一个处理单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。需要说明的是,本申请实施例中对单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。Embodiments of the present application can divide the electronic device into functional units according to the above method examples. For example, each functional unit can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above integrated units can be implemented in the form of hardware or software functional units. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods.
图23示出了本申请实施例中提供的第一电子设备的一种示意性框图,该信息传输装置可以为上述的接收设备或发送设备。该第一电子设备3300可以以软件的形式存在,还可以为可用于设备的芯片。第一电子设备3300包括:处理单元3303、收发单元3302和显示单元3301。可选的,收发单元3302还可以划分为发送单元(并未在图23中示出)和接收单元(并未在图23中示出)。其中,发送单元,用于支持第一电子设备3300向其他设备发送信息。接收单元,用于支持第一电子设备3300从其他设备接收信息。显示单元3301,用于支持显示内容。Figure 23 shows a schematic block diagram of the first electronic device provided in the embodiment of the present application. The information transmission device may be the above-mentioned receiving device or sending device. The first electronic device 3300 may exist in the form of software, or may be a chip that can be used in the device. The first electronic device 3300 includes: a processing unit 3303, a transceiver unit 3302, and a display unit 3301. Optionally, the transceiver unit 3302 can also be divided into a sending unit (not shown in Figure 23) and a receiving unit (not shown in Figure 23). The sending unit is used to support the first electronic device 3300 in sending information to other devices. The receiving unit is used to support the first electronic device 3300 to receive information from other devices. Display unit 3301 is used to support display content.
可选的,第一电子设备3300还可以包括存储单元1701(未在图中示出),用于存储第一电子设备3300的程序代码和数据,数据可以包括不限于原始数据或者中间数据等。Optionally, the first electronic device 3300 may also include a storage unit 1701 (not shown in the figure) for storing program codes and data of the first electronic device 3300. The data may include but is not limited to original data or intermediate data.
一种可能的方式中,处理单元3303可以是控制器或图4所示的处理器501和/或处理器507,例如可以是中央处理器(Central Processing Unit,CPU),通用处理器,数字信号处理(Digital Signal Processing,DSP),应用专用集成电路(Application Specific Integrated Circuit,ASIC),现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。 处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等等。In one possible way, the processing unit 3303 may be a controller or the processor 501 and/or the processor 507 shown in FIG. 4 , for example, it may be a central processing unit (Central Processing Unit, CPU), a general-purpose processor, a digital signal Processing (Digital Signal Processing, DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various illustrative logical blocks, modules, and circuits described in connection with this disclosure. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of DSP and microprocessors, and so on.
一种可能的方式中,收发单元3302可以是图4所示的通信接口504、还可以是收发电路、收发器、射频器件等。In one possible way, the transceiver unit 3302 may be the communication interface 504 shown in Figure 4, or may be a transceiver circuit, transceiver, radio frequency device, etc.
一种可能的方式中,存储单元1701可以是图4所示的存储器503。In one possible way, the storage unit 1701 may be the memory 503 shown in FIG. 4 .
一种可能的方式中,显示单元3301可以包括显示屏。In one possible way, the display unit 3301 may include a display screen.
本申请实施例还提供一种电子设备,包括一个或多个处理器以及一个或多个存储器。该一个或多个存储器与一个或多个处理器耦合,一个或多个存储器用于存储计算机程序代码,计算机程序代码包括计算机指令,当一个或多个处理器执行计算机指令时,使得电子设备执行上述相关方法步骤实现上述实施例中的信息传输方法。An embodiment of the present application also provides an electronic device, including one or more processors and one or more memories. The one or more memories are coupled to one or more processors. The one or more memories are used to store computer program codes. The computer program codes include computer instructions. When the one or more processors execute the computer instructions, the electronic device causes the electronic device to execute The above related method steps implement the information transmission method in the above embodiment.
本申请实施例还提供一种芯片系统,包括:处理器,所述处理器与存储器耦合,所述存储器用于存储程序或指令,当所述程序或指令被所述处理器执行时,使得该芯片系统实现上述任一方法实施例中的方法。An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, and the memory is used to store programs or instructions. When the program or instructions are executed by the processor, the The chip system implements the method in any of the above method embodiments.
可选地,该芯片系统中的处理器可以为一个或多个。该处理器可以通过硬件实现也可以通过软件实现。当通过硬件实现时,该处理器可以是逻辑电路、集成电路等。当通过软件实现时,该处理器可以是一个通用处理器,通过读取存储器中存储的软件代码来实现。Optionally, there may be one or more processors in the chip system. The processor can be implemented in hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, or the like. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in memory.
可选地,该芯片系统中的存储器也可以为一个或多个。该存储器可以与处理器集成在一起,也可以和处理器分离设置,本申请并不限定。示例性的,存储器可以是非瞬时性处理器,例如只读存储器ROM,其可以与处理器集成在同一块芯片上,也可以分别设置在不同的芯片上,本申请对存储器的类型,以及存储器与处理器的设置方式不作具体限定。Optionally, there may be one or more memories in the chip system. The memory may be integrated with the processor or may be provided separately from the processor, which is not limited by this application. For example, the memory can be a non-transient processor, such as a read-only memory ROM, which can be integrated on the same chip as the processor, or can be separately provided on different chips. This application describes the type of memory, and the relationship between the memory and the processor. There is no specific limitation on how the processor is configured.
示例性的,该芯片系统可以是现场可编程门阵列(field programmable gatearray,FPGA),可以是专用集成芯片(application specific integrated circuit,ASIC),还可以是系统芯片(system on chip,SoC),还可以是中央处理器(central processorunit,CPU),还可以是网络处理器(network processor,NP),还可以是数字信号处理电路(digital signal processor,DSP),还可以是微控制器(micro controller unit,MCU),还可以是可编程控制器(programmable logic device,PLD)或其他集成芯片。For example, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or a system on chip (SoC), or It can be a central processing unit (CPU), a network processor (NP), a digital signal processing circuit (DSP), or a microcontroller unit , MCU), it can also be a programmable logic device (PLD) or other integrated chip.
应理解,上述方法实施例中的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。结合本申请实施例所公开的方法步骤可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。It should be understood that each step in the above method embodiment can be completed by an integrated logic circuit of hardware in the processor or instructions in the form of software. The method steps disclosed in conjunction with the embodiments of this application can be directly implemented by a hardware processor, or executed by a combination of hardware and software modules in the processor.
本申请实施例还提供一种计算机可读存储介质,该计算机可读存储介质中存储有计算机指令,当该计算机指令在电子设备上运行时,使得电子设备执行上述相关方法步骤实现上述实施例中的信息传输方法。Embodiments of the present application also provide a computer-readable storage medium. Computer instructions are stored in the computer-readable storage medium. When the computer instructions are run on an electronic device, the electronic device causes the electronic device to execute the above related method steps to implement the above embodiments. information transmission method.
本申请实施例还提供一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行上述相关步骤,以实现上述实施例中的信息传输方法。An embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, it causes the computer to perform the above related steps to implement the information transmission method in the above embodiment.
另外,本申请的实施例还提供一种装置,该装置具体可以是组件或模块,该装置可包括相连的处理器和存储器;其中,存储器用于存储计算机执行指令,当装置运行 时,处理器可执行存储器存储的计算机执行指令,以使装置执行上述各方法实施例中的信息传输方法。In addition, embodiments of the present application also provide a device. The device may be a component or module. The device may include a connected processor and a memory. The memory is used to store computer execution instructions. When the device runs When the processor executes the computer execution instructions stored in the memory, the device executes the information transmission method in each of the above method embodiments.
其中,本申请实施例提供的电子设备、计算机可读存储介质、计算机程序产品或芯片均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。Among them, the electronic devices, computer-readable storage media, computer program products or chips provided by the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the above provided The beneficial effects of the corresponding methods will not be described again here.
可以理解的是,为了实现上述功能,电子设备包含了执行各个功能相应的硬件和/或软件模块。结合本文中所公开的实施例描述的各示例的算法步骤,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。本领域技术人员可以结合实施例对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。It can be understood that, in order to realize the above functions, the electronic device includes corresponding hardware and/or software modules that perform each function. In conjunction with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions in conjunction with the embodiments for each specific application, but such implementations should not be considered to be beyond the scope of this application.
本实施例可以根据上述方法示例对电子设备进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块可以采用硬件的形式实现。需要说明的是,本实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。This embodiment can divide the electronic device into functional modules according to the above method examples. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. In actual implementation, there may be other division methods.
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Through the above description of the embodiments, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be allocated as needed. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working processes of the systems, devices and units described above, reference can be made to the corresponding processes in the foregoing method embodiments, which will not be described again here.
在本申请所提供的几个实施例中,应该理解到,所揭露的方法,可以通过其它的方式实现。例如,以上所描述的终端设备实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,模块或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed method can be implemented in other ways. For example, the terminal device embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components. can be combined or can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, indirect coupling or communication connection of modules or units, which may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or software functional units.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:快闪存储器、移动硬 盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序指令的介质。If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in various embodiments of the application. The aforementioned storage media include: flash memory, mobile hard drive Various media that can store program instructions, such as disk, read-only memory, random access memory, magnetic disk or optical disk.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。 The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be covered by the protection scope of the present application. . Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (21)

  1. 一种智能设备控制方法,其特征在于,应用于第一电子设备,所述方法包括:An intelligent device control method, characterized in that it is applied to a first electronic device, and the method includes:
    显示第一界面,所述第一界面包括一个或多个意图的标识;所述一个或多个意图中至少一个意图对应多个电子设备;Display a first interface, the first interface including identification of one or more intentions; at least one intention among the one or more intentions corresponds to multiple electronic devices;
    响应于用户从所述一个或多个意图中选择目标意图的操作,将所述目标意图添加到目标场景中;In response to a user operation of selecting a target intent from the one or more intentions, adding the target intent to the target scene;
    在满足所述目标场景的触发条件时,控制一个或多个目标电子设备执行所述目标意图;其中,所述一个或多个目标电子设备为所述目标意图对应的电子设备。When the triggering conditions of the target scene are met, one or more target electronic devices are controlled to execute the target intention; wherein the one or more target electronic devices are electronic devices corresponding to the target intention.
  2. 根据权利要求1所述的方法,其特征在于,所述目标电子设备包括第二电子设备和第三电子设备,所述控制一个或多个目标电子设备执行所述目标意图,包括:The method of claim 1, wherein the target electronic device includes a second electronic device and a third electronic device, and controlling one or more target electronic devices to execute the target intention includes:
    向所述第二电子设备发送第一控制指令,向所述第三电子设备发送第二控制指令,使得所述第二电子设备和所述第三电子设备共同执行所述目标意图。Send a first control instruction to the second electronic device, and send a second control instruction to the third electronic device, so that the second electronic device and the third electronic device jointly execute the target intention.
  3. 根据权利要求1所述的方法,其特征在于,所述目标意图包括第一目标意图和第二目标意图;所述目标电子设备包括第二电子设备和第三电子设备;The method of claim 1, wherein the target intention includes a first target intention and a second target intention; the target electronic device includes a second electronic device and a third electronic device;
    所述控制一个或多个目标电子设备执行所述目标意图,包括:The controlling one or more target electronic devices to execute the target intention includes:
    向所述第二电子设备发送第一控制指令,所述第一控制指令用于控制所述第二电子设备执行所述第一目标意图;Send a first control instruction to the second electronic device, the first control instruction being used to control the second electronic device to execute the first target intention;
    向所述第三电子设备发送第二控制指令,所述第二控制指令用于控制所述第三电子设备执行所述第二目标意图。Send a second control instruction to the third electronic device, where the second control instruction is used to control the third electronic device to execute the second target intention.
  4. 根据权利要求1-3中任一项所述的方法,其特征在于,所述第一界面还包括全屋的多个空间的标识;所述多个空间第一空间和第二空间;所述第一空间的标识被选中;所述一个或多个意图包括所述第一空间中电子设备可执行的意图。The method according to any one of claims 1 to 3, characterized in that the first interface further includes identification of multiple spaces in the whole house; the first space and the second space of the multiple spaces; The identity of the first space is selected; the one or more intentions include intentions that are executable by the electronic device in the first space.
  5. 根据权利要求4所述的方法,其特征在于,所述方法还包括:The method of claim 4, further comprising:
    接收所述用户对所述第二空间的标识的操作,显示第二界面,所述第二界面包括所述第二空间中电子设备可执行的意图的标识。Receive the user's operation on the identification of the second space and display a second interface, where the second interface includes an identification of an intention executable by the electronic device in the second space.
  6. 根据权利要求4所述的方法,其特征在于,所述第二空间的标识被选中;所述一个或多个意图为多个意图,所述多个意图还包括所述第二空间中电子设备可执行的意图。The method according to claim 4, characterized in that the identification of the second space is selected; the one or more intentions are multiple intentions, and the multiple intentions further include electronic devices in the second space Enforceable intent.
  7. 根据权利要求6所述的方法,其特征在于,所述第一空间中电子设备可执行的意图的标识与所述第二空间中电子设备可执行的意图的标识具有不同用户界面UI效果。The method according to claim 6, characterized in that the identification of the intention executable by the electronic device in the first space and the identification of the intention executable by the electronic device in the second space have different user interface UI effects.
  8. 根据权利要求1-7中任一项所述的方法,其特征在于,所述目标意图对应的控制参数为第一控制参数;所述方法还包括:The method according to any one of claims 1-7, characterized in that the control parameter corresponding to the target intention is a first control parameter; the method further includes:
    接收用户输入的第二操作;A second operation that receives user input;
    响应于所述第二操作,显示第一控件,所述第一控件用于输入所述目标意图对应的第二控制参数;In response to the second operation, display a first control, the first control being used to input a second control parameter corresponding to the target intention;
    接收所述用户通过所述第一控件输入的第二控制参数,使得所述目标意图对应的控制参数调整为所述第二控制参数。The second control parameter input by the user through the first control is received, so that the control parameter corresponding to the target intention is adjusted to the second control parameter.
  9. 根据权利要求1-8中任一项所述的方法,其特征在于,所述一个或多个意图属 于一个或多个子系统。The method according to any one of claims 1-8, characterized in that said one or more intentions belong to to one or more subsystems.
  10. 一种智能设备控制系统,其特征在于,包括:An intelligent equipment control system, which is characterized by including:
    第一电子设备,用于显示第一界面,所述第一界面包括一个或多个意图的标识;所述一个或多个意图中至少一个意图对应多个电子设备;A first electronic device configured to display a first interface, where the first interface includes identification of one or more intentions; at least one of the one or more intentions corresponds to multiple electronic devices;
    所述第一电子设备,还用于响应于用户从所述一个或多个意图中选择目标意图的操作,将所述目标意图添加到目标场景中;The first electronic device is further configured to add the target intention to the target scene in response to the user's operation of selecting a target intention from the one or more intentions;
    所述第一电子设备,还用于在满足所述目标场景的触发条件时,向一个或多个目标电子设备发送控制指令;其中,所述一个或多个目标电子设备为所述目标意图对应的电子设备;The first electronic device is further configured to send control instructions to one or more target electronic devices when the trigger conditions of the target scene are met; wherein the one or more target electronic devices correspond to the target intention. electronic equipment;
    所述目标电子设备,用于从所述第一电子设备接收所述控制指令,并根据所述控制指令执行所述目标意图。The target electronic device is configured to receive the control instruction from the first electronic device and execute the target intention according to the control instruction.
  11. 根据权利要求10所述的系统,其特征在于,所述目标电子设备包括第二电子设备和第三电子设备;The system according to claim 10, wherein the target electronic device includes a second electronic device and a third electronic device;
    所述第一电子设备,用于向一个或多个目标电子设备发送控制指令,包括:向所述第二电子设备发送第一控制指令,向所述第三电子设备发送第二控制指令;The first electronic device is used to send control instructions to one or more target electronic devices, including: sending a first control instruction to the second electronic device, and sending a second control instruction to the third electronic device;
    所述目标电子设备,用于从所述第一电子设备接收所述控制指令,并根据所述控制指令执行所述目标意图,包括:所述第二电子设备,用于从所述第一电子设备接收所述第一控制指令,并根据所述第一控制指令执行所述目标意图;所述第三电子设备,用于从所述第一电子设备接收所述第二控制指令,并根据所述第二控制指令执行所述目标意图。The target electronic device is configured to receive the control instruction from the first electronic device and execute the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device. The device receives the first control instruction and executes the target intention according to the first control instruction; the third electronic device is used to receive the second control instruction from the first electronic device and execute the target intention according to the first control instruction. The second control instruction executes the target intention.
  12. 根据权利要求10所述的系统,其特征在于,所述目标意图包括第一目标意图和第二目标意图;所述目标电子设备包括第二电子设备和第三电子设备;The system according to claim 10, wherein the target intention includes a first target intention and a second target intention; the target electronic device includes a second electronic device and a third electronic device;
    所述第一电子设备,用于向一个或多个目标电子设备发送控制指令,包括:The first electronic device is used to send control instructions to one or more target electronic devices, including:
    向所述第二电子设备发送第一控制指令,所述第一控制指令用于控制所述第二电子设备执行所述第一目标意图;Send a first control instruction to the second electronic device, the first control instruction being used to control the second electronic device to execute the first target intention;
    向所述第三电子设备发送第二控制指令,所述第二控制指令用于控制所述第三电子设备执行所述第二目标意图;Send a second control instruction to the third electronic device, the second control instruction being used to control the third electronic device to execute the second target intention;
    所述目标电子设备,用于从所述第一电子设备接收所述控制指令,并根据所述控制指令执行所述目标意图,包括:所述第二电子设备,用于从所述第一电子设备接收所述第一控制指令,并根据所述第一控制指令指示所述第一目标意图;所述第三电子设备,用于从所述第一电子设备接收所述第二控制指令,并根据所述第二控制指令执行所述第二目标意图。The target electronic device is configured to receive the control instruction from the first electronic device and execute the target intention according to the control instruction, including: the second electronic device is configured to receive the control instruction from the first electronic device. The device receives the first control instruction and indicates the first target intention according to the first control instruction; the third electronic device is used to receive the second control instruction from the first electronic device, and The second target intention is executed according to the second control instruction.
  13. 根据权利要求10-12中任一项所述的系统,其特征在于,所述第一界面还包括全屋的多个空间的标识;所述多个空间第一空间和第二空间;所述第一空间的标识被选中;所述一个或多个意图包括所述第一空间中电子设备可执行的意图。The system according to any one of claims 10 to 12, characterized in that the first interface also includes identification of multiple spaces in the whole house; the first space and the second space of the multiple spaces; The identity of the first space is selected; the one or more intentions include intentions that are executable by the electronic device in the first space.
  14. 根据权利要求13所述的系统,其特征在于,所述第一电子设备,还用于:The system according to claim 13, characterized in that the first electronic device is also used for:
    接收所述用户对所述第二空间的标识的操作,显示第二界面,所述第二界面包括所述第二空间中电子设备可执行的意图的标识。Receive the user's operation on the identification of the second space and display a second interface, where the second interface includes an identification of an intention executable by the electronic device in the second space.
  15. 根据权利要求13所述的系统,其特征在于,所述第二空间的标识被选中;所 述一个或多个意图为多个意图,所述多个意图还包括所述第二空间中电子设备可执行的意图。The system according to claim 13, characterized in that the identifier of the second space is selected; The one or more intentions are multiple intentions, and the multiple intentions also include intentions that are executable by the electronic device in the second space.
  16. 根据权利要求15所述的系统,其特征在于,所述第一空间中电子设备可执行的意图的标识与所述第二空间中电子设备可执行的意图的标识具有不同用户界面UI效果。The system of claim 15, wherein the identification of intentions executable by the electronic device in the first space and the identification of intentions executable by the electronic device in the second space have different user interface UI effects.
  17. 根据权利要求10-16中任一项所述的系统,其特征在于,所述目标意图对应的控制参数为第一控制参数;The system according to any one of claims 10-16, characterized in that the control parameter corresponding to the target intention is a first control parameter;
    所述第一电子设备,还用于执行如下操作:The first electronic device is also used to perform the following operations:
    接收用户输入的第二操作;A second operation that receives user input;
    响应于所述第二操作,显示第一控件,所述第一控件用于输入所述目标意图对应的第二控制参数;In response to the second operation, display a first control, the first control being used to input a second control parameter corresponding to the target intention;
    接收所述用户通过所述第一控件输入的第二控制参数,使得所述目标意图对应的控制参数调整为所述第二控制参数。The second control parameter input by the user through the first control is received, so that the control parameter corresponding to the target intention is adjusted to the second control parameter.
  18. 根据权利要求10-17中任一项所述的系统,其特征在于,所述一个或多个意图属于一个或多个子系统。The system according to any one of claims 10-17, characterized in that said one or more intentions belong to one or more subsystems.
  19. 一种电子设备,其特征在于,包括:处理器、存储器和显示屏,所述存储器和所述显示屏与所述处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,当所述处理器从所述存储器中读取所述计算机指令,使得所述电子设备执行如权利要求1-9中任意一项所述的方法。An electronic device, characterized in that it includes: a processor, a memory and a display screen, the memory and the display screen are coupled to the processor, the memory is used to store computer program code, the computer program code includes Computer instructions, when the processor reads the computer instructions from the memory, cause the electronic device to execute the method according to any one of claims 1-9.
  20. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质包括计算机程序,当所述计算机程序在电子设备上运行时,使得所述电子设备执行如权利要求1-9中任意一项所述的方法。A computer-readable storage medium, characterized in that the computer-readable storage medium includes a computer program. When the computer program is run on an electronic device, the electronic device causes the electronic device to execute any one of claims 1-9. method described in the item.
  21. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-9中任意一项所述的方法。 A computer program product, characterized in that, when the computer program product is run on a computer, it causes the computer to execute the method according to any one of claims 1-9.
PCT/CN2023/094602 2022-05-19 2023-05-16 Intelligent device control method and electronic device WO2023221995A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210546887.9 2022-05-19
CN202210546887.9A CN117130284A (en) 2022-05-19 2022-05-19 Intelligent device control method and electronic device

Publications (1)

Publication Number Publication Date
WO2023221995A1 true WO2023221995A1 (en) 2023-11-23

Family

ID=88834670

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/094602 WO2023221995A1 (en) 2022-05-19 2023-05-16 Intelligent device control method and electronic device

Country Status (2)

Country Link
CN (1) CN117130284A (en)
WO (1) WO2023221995A1 (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104460328A (en) * 2014-10-29 2015-03-25 小米科技有限责任公司 Intelligent device control method and device based on set scenario mode
CN105652671A (en) * 2015-12-25 2016-06-08 小米科技有限责任公司 Intelligent equipment operating mode setting method and device
CN106873551A (en) * 2016-11-30 2017-06-20 芜湖美智空调设备有限公司 Interlock method and system between a kind of different household electrical appliances
WO2017141219A1 (en) * 2016-02-18 2017-08-24 Tekoia Ltd. Architecture for remote control of iot (internet of things) devices
CN111176133A (en) * 2020-02-11 2020-05-19 青岛海信智慧家居系统股份有限公司 Method and device for determining smart home scene
CN111176517A (en) * 2019-12-31 2020-05-19 青岛海尔科技有限公司 Method and device for setting scene and mobile phone
CN112180754A (en) * 2020-10-20 2021-01-05 珠海格力电器股份有限公司 Setting method of intelligent control scene and equipment control system
CN113114779A (en) * 2021-04-23 2021-07-13 杭州萤石软件有限公司 Configuration method, terminal and system for linkage of Internet of things equipment
CN113412457A (en) * 2019-05-16 2021-09-17 深圳市欢太科技有限公司 Scene pushing method, device and system, electronic equipment and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104460328A (en) * 2014-10-29 2015-03-25 小米科技有限责任公司 Intelligent device control method and device based on set scenario mode
CN105652671A (en) * 2015-12-25 2016-06-08 小米科技有限责任公司 Intelligent equipment operating mode setting method and device
WO2017141219A1 (en) * 2016-02-18 2017-08-24 Tekoia Ltd. Architecture for remote control of iot (internet of things) devices
CN106873551A (en) * 2016-11-30 2017-06-20 芜湖美智空调设备有限公司 Interlock method and system between a kind of different household electrical appliances
CN113412457A (en) * 2019-05-16 2021-09-17 深圳市欢太科技有限公司 Scene pushing method, device and system, electronic equipment and storage medium
CN111176517A (en) * 2019-12-31 2020-05-19 青岛海尔科技有限公司 Method and device for setting scene and mobile phone
CN111176133A (en) * 2020-02-11 2020-05-19 青岛海信智慧家居系统股份有限公司 Method and device for determining smart home scene
CN112180754A (en) * 2020-10-20 2021-01-05 珠海格力电器股份有限公司 Setting method of intelligent control scene and equipment control system
CN113114779A (en) * 2021-04-23 2021-07-13 杭州萤石软件有限公司 Configuration method, terminal and system for linkage of Internet of things equipment

Also Published As

Publication number Publication date
CN117130284A (en) 2023-11-28

Similar Documents

Publication Publication Date Title
JP7254894B2 (en) Connected lighting system
JP7351890B2 (en) Design of a compact home assistant combining acoustic waveguide and heat sink
US11438939B2 (en) Discovery of connected devices to determine control capabilities and meta-information
CN108111948B (en) Server-provided visual output at a voice interface device
US10158536B2 (en) Systems and methods for interaction with an IoT device
CN107533422B (en) Server and method for controlling group behavior of server
US9306763B2 (en) Providing a user interface for devices of a home automation system
CN108431765B (en) Generation of device applications
US20150128050A1 (en) User interface for internet of everything environment
CN107948231B (en) Scene-based service providing method, system and operating system
EP2744152A2 (en) User terminal apparatus, network apparatus, and control method thereof
US20040260427A1 (en) Home automation contextual user interface
JP2022547319A (en) User interface based on 3D virtual room for home automation system
KR102628856B1 (en) System for sharing contents between electronic devices and method for sharing contents in an electronic device
WO2020228041A1 (en) Scenario operating method and apparatus, electronic device, and computer readable medium
JP2013539329A (en) Conference control hosted by mobile phone
US20180198872A1 (en) Method, system and device for providing service
CN109240098B (en) Equipment configuration method and device, terminal equipment and storage medium
JP7312162B2 (en) Small-screen virtual room-based user interface
TWI738832B (en) Scene-based application operation method, device, terminal equipment and operating system
WO2016123847A1 (en) Application control method and device
WO2024045985A1 (en) Screen control method, screen control apparatus, electronic device, program, and medium
WO2023221995A1 (en) Intelligent device control method and electronic device
US20230041609A1 (en) A network controller for granting access rights to a set of devices
CN114967485A (en) Device control method, device, electronic device and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23806946

Country of ref document: EP

Kind code of ref document: A1