WO2023088061A1 - 智能设备控制方法及电子设备 - Google Patents

智能设备控制方法及电子设备 Download PDF

Info

Publication number
WO2023088061A1
WO2023088061A1 PCT/CN2022/127999 CN2022127999W WO2023088061A1 WO 2023088061 A1 WO2023088061 A1 WO 2023088061A1 CN 2022127999 W CN2022127999 W CN 2022127999W WO 2023088061 A1 WO2023088061 A1 WO 2023088061A1
Authority
WO
WIPO (PCT)
Prior art keywords
intention
electronic device
group
intent
user
Prior art date
Application number
PCT/CN2022/127999
Other languages
English (en)
French (fr)
Inventor
王棕薇
葛鹏
李强
王思佳
韩梦
凌张炎
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023088061A1 publication Critical patent/WO2023088061A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the embodiments of the present application relate to the technical field of terminals, and in particular, to a method for controlling a smart device and an electronic device.
  • the embodiments of the present application provide a smart device control method and an electronic device.
  • the technical solutions provided by the embodiments of the present application can divide devices according to groups, realize group control of devices, simplify device control procedures, and improve user experience.
  • a smart device control method is provided, which is applied to a first electronic device.
  • the method includes: displaying a first interface, the first interface includes a first intent identifier and a first group identifier corresponding to the first group, and the first group includes X number of executable first intent identifiers corresponding to the first intent identifier Electronic equipment, X is a positive integer.
  • a first user operation on the first group identifier is received.
  • the first group identifier is controlled to move to the first intent identifier, and X electronic devices are instructed to execute the first intent.
  • the first intention corresponds to a function that can be realized by the electronic device, such as including an intention to turn on a light, an intention to keep a temperature, and the like.
  • the intention mark is a function mark, which can be used to indicate the corresponding achievable function, for example, the light-on intention mark indicates the corresponding light-on function, and the constant temperature mark represents the corresponding constant temperature function.
  • the first group includes multiple electronic devices with the same category attribute and/or location attribute, and these electronic devices can realize the corresponding intent.
  • the category attributes and/or location attributes of X electronic devices are the same.
  • the first electronic device displays the first intent identifier and the first group identifier, which can enable the user to intuitively determine the group and control the execution intent of the electronic devices in the group.
  • group control of electronic devices can be realized without having to control each electronic device one by one, which simplifies user operations and improves user experience.
  • the method before displaying the first interface, further includes: displaying a second interface, where the second interface includes a plurality of electronic device identifiers respectively corresponding to the plurality of electronic devices.
  • a second operation of selecting X electronic device identities from the plurality of electronic device identities is received.
  • a first group including X electronic devices is established.
  • the first electronic device may establish one or more groups including multiple electronic devices according to user operations. If a plurality of electronic equipment identifications are displayed, according to the second operation of the user selecting the equipment identification, the electronic equipment for establishing the group is determined.
  • the second operation may be an operation of clicking to select an electronic device identifier, or an operation of sliding to circle multiple electronic device identifiers.
  • the first electronic device may display electronic devices capable of group connection, receive user operations during the display process, and determine the grouping result of the electronic devices according to the user operations.
  • the first electronic device may determine the electronic device capable of group connection by means of device search, or may obtain the device list corresponding to the home maintained in the server through interaction with the server, and determine the electronic device capable of group connection .
  • the equipment list includes information such as equipment rooms and equipment categories.
  • the first electronic device can be any electronic device with a display screen and group processing capabilities.
  • the first electronic device has a clear category attribute and/or location attribute, and can automatically confirm that nearby users have the same category attribute and/or location attributes, prompting the user to create a group.
  • the category attribute is used to represent the category of the electronic equipment.
  • the location attribute is used to represent the space where the electronic device is located, such as dividing the space where the electronic device is located at a granularity of a room.
  • the user can also use the near-field connection function (such as the NFC function) of the first electronic device to establish a group of electronic devices through a touch operation.
  • the near-field connection function such as the NFC function
  • the first electronic device detects the user's touch operation, such as touching the NFC tag of device A, obtains the device information of device A, and can broadcast the information to search for devices with the same category attributes as device A within a preset distance. electronic equipment. Then, the electronic device identifiers of the searched electronic devices can be displayed, and according to the user operation, it is determined to establish a group including all or part of the electronic devices.
  • the first electronic device can obtain the electronic device information of the corresponding multiple electronic devices, and display the electronic device information of the multiple electronic devices.
  • Equipment Identity Afterwards, according to the user operation, it is determined to establish a group including all or part of the electronic devices.
  • the method further includes: aggregately displaying electronic device identifiers corresponding to electronic devices with the same category attribute and/or location attribute among the multiple electronic devices.
  • the first electronic device may classify electronic devices according to their category attributes and/or location attributes. For example, according to category attributes, electronic equipment is divided into kitchen appliances, audio-visual equipment, lighting equipment, etc.; for example, electronic equipment is divided into electronic equipment in the master bedroom, electronic equipment in the kitchen, and electronic equipment in the living room according to the location attribute wait.
  • the first electronic device can aggregate and display the electronic device identifiers, so that the user can quickly select the electronic devices classified into one group.
  • the first electronic device aggregates and displays the electronic device identifiers of lighting devices, so that the user can directly circle the grouped and displayed electronic device identifiers to determine the group corresponding to the intention to turn on the lights.
  • the first electronic device aggregates and displays the electronic device identifiers, which facilitates user operations and further improves the efficiency of group establishment.
  • the first intent identifier is displayed in the first area of the first interface, and the first group The logo is displayed in an area other than the first area; the first operation includes: moving the first group logo to the first area.
  • the user only needs to move the group mark close to the first area or move into the first area, and the first electronic device can determine that the user needs to indicate that the electronic devices in the group mark Execute the intent corresponding to the current first area.
  • the method further includes: receiving a third user operation on the first group identifier.
  • X electronic device identifiers respectively corresponding to the X electronic devices are displayed on the first interface.
  • the third operation may be an operation of clicking the first group logo.
  • the first electronic device may highlight the first group identifier that includes the first intention that has been executed, so that the user can determine the execution status of the electronic device according to the highlighted display of the group identifier. Afterwards, if the first electronic device detects that the user clicks on the first group logo, it may display the electronic device logos of the electronic devices in the first group corresponding to the first group logo that have executed the first intention.
  • the first electronic device displays the device identification of the electronic device that executes the first intention among the X electronic devices. For example, among the X electronic devices, M electronic devices execute the first intention successfully, and N electronic devices If the device fails to execute the first intention, the first electronic device may display the electronic device identifiers of the M electronic devices. That is, the electronic device identifiers of the electronic devices that have not executed or failed to execute the first intention may not be displayed, or may not be highlighted. In this way, the user can determine which electronic devices have executed the first intent and which electronic devices have not executed the first intent.
  • the method further includes: receiving the user's identification of the X electronic device identifications The fourth operation of the electronic device identifier corresponding to the second electronic device. In response to the fourth operation, the electronic device identifier corresponding to the second electronic device is controlled to move out of the first area, and the second electronic device is instructed to cancel the execution of the first intention.
  • the fourth operation may be an operation of dragging the electronic device identifier of the second electronic device out of the first area.
  • canceling the execution intention includes instructing the electronic device to execute a command contrary to the intention, for example, canceling the execution intention of turning on the light is instructing the electronic device to execute turning off the light.
  • the command to cancel the execution intention includes no longer executing the intention, for example, the intention is a constant temperature intention, and canceling the constant temperature intention is to instruct the electronic device to no longer execute the constant temperature intention.
  • the first electronic device detects the fourth operation of the user moving the electronic device identifier of the second electronic device in a direction away from the first intention identifier, and may instruct the second electronic device to cancel the execution of the first intention.
  • the first electronic device can also implement individual control of the devices in the group to meet user needs.
  • the category attributes and/or location attributes of the X electronic devices are the same.
  • the method further includes: displaying prompt information on the first interface, and the prompt information is used to feed back the execution of the first intention by the X electronic devices.
  • the first electronic device instructs X electronic devices to execute the first intent, and the X electronic devices will send a feedback signal after executing the first intent. Then the first electronic device can determine whether the first intention is executed according to the received feedback signal. Optionally, the first electronic device may display prompt information according to the received feedback signal, such as displaying the execution status of the command in the group identifier.
  • the user can intuitively determine the execution status of the command according to the display of the group identifier, thereby improving user experience.
  • the first interface further displays the second intent mark
  • the method further includes: receiving a fifth operation of moving the second intent mark to the first area by the user.
  • the fifth operation instruct Y electronic devices in the first group to execute the second intent corresponding to the second intent identifier, where Y is a positive integer.
  • the first electronic device determines the fusion intent according to the user operation, and the fusion intent may include at least two intents. In this way, if the user needs to perform two or more intents in a group, he does not need to operate the two intent identifiers one by one, but can pre-establish a fusion intent that includes the required two or more intents, and then directly indicate the intents in the group.
  • Electronic devices implement fusion intent and simplify user operations.
  • the first electronic device may first determine the electronic devices in the first group that can execute the second intention, and then send an indication signal to these electronic devices, indicating to execute the second intention.
  • the first electronic device may directly send an indication signal to the electronic devices in the first group, and then the first electronic device determines the execution status according to the feedback signal.
  • the first electronic device displays the second intention mark, detects the fifth operation of the user moving the second intention mark to the first area, and can generate the first intention and the second intention mark. Fusion intent of intent. Also, it is determined whether there are electronic devices capable of executing the second intent in the first group corresponding to the first intent, and if so, these electronic devices capable of executing the second intent may be instructed to execute the second intent.
  • the electronic device executing the second intent may be an electronic device that has executed the first intent, may also be an electronic device that has not executed the first intent, or may be partially an electronic device that has executed the first intent.
  • the method further includes: receiving a sixth operation performed by the user on the second group logo displayed on the first interface, the second group
  • the group identifier corresponds to a second group including Z electronic devices capable of executing the first intention and the second intention, where Z is a positive integer.
  • the first electronic device may display the group identifiers of multiple groups corresponding to the intent, and the user may select some or all of the groups according to requirements, and determine to instruct the electronic device among them to execute the intent.
  • the method further includes: receiving a seventh user operation on the first area. In response to the seventh operation, control the first group identifier and the second group identifier to move out of the first area, and instruct Y electronic devices and Z electronic devices to cancel the execution of the first intention and the second intention.
  • the seventh operation is an operation of long pressing any position in the first area.
  • the first electronic device determines that all electronic devices that have executed the first intention and the second intention cancel the execution of the first intention and the second intention.
  • the first electronic device when the first electronic device detects that the user has long pressed any position in the first area, it may also instruct the electronic devices in all currently displayed group identifiers to execute the intent corresponding to the current first area.
  • the user can indicate more groups to execute or cancel the execution intention, further reducing the difficulty of the user's operation.
  • the method further includes: receiving an eighth operation performed by the user on the second area, where the second area corresponds to the second intention.
  • the eighth operation control the second intention mark to move out of the first area, and instruct Y electronic devices to cancel the execution of the second intention.
  • the first area includes the second area, and the second area corresponds to the second intent.
  • the first electronic device may evenly divide the first area into hot zones corresponding to the M intents, and each hot zone corresponds to one intent.
  • the first electronic device determines the user's operation on a certain hot zone, removes the intent corresponding to the hot zone from the fusion intent, and instructs the electronic device currently executing the fusion intent to cancel the removal intent.
  • the second area may be an area located on the left side of the first area, or may be an area located on the right side of the first area.
  • the first electronic device can create the fusion intent according to the user's requirement, and can also split the fusion intent according to the user's requirement, so as to further improve the user experience.
  • the third operation is a click operation.
  • the fourth operation, the fifth operation, the sixth operation, and the eighth operation are drag operations.
  • the seventh operation is a long press operation.
  • an electronic device in a second aspect, includes: a processor, a memory and a display screen, the memory is coupled to the processor, the memory is used to store computer program codes, the computer program codes include computer instructions, when the processor reads from the The computer instructions are read from the memory, so that the electronic device performs the following operations: display a first interface, the first interface includes a first intent identifier, and a first group identifier corresponding to the first group, and the first group includes X electronic devices corresponding to the first intention can be identified by the first intention, where X is a positive integer.
  • a first user operation on the first group identifier is received.
  • the first group identifier is controlled to move to the first intent identifier, and X electronic devices are instructed to execute the first intent.
  • the processor when the processor reads the computer instruction from the memory, it also causes the electronic device to perform the following operation: display a second interface, the second interface includes multiple An electronic device identifier. A second operation of selecting X electronic device identities from the plurality of electronic device identities is received. In response to the second operation, a first group including X electronic devices is established.
  • the processor when the processor reads the computer instruction from the memory, it also causes the electronic device to perform the following operation: Electronic device identifiers corresponding to electronic devices with the same category attribute and/or location attribute are aggregated and displayed.
  • the first intent identifier is displayed in the first area of the first interface, and the first group The logo is displayed in an area other than the first area; the first operation includes: moving the first group logo to the first area.
  • the processor when the processor reads the computer instruction from the memory, it also causes the electronic device to perform the following operations: receive the user's request for the first group The third operation for group identification. In response to the third operation, X electronic device identifiers respectively corresponding to the X electronic devices are displayed on the first interface.
  • the processor when the processor reads the computer instruction from the memory, it also causes the electronic device to perform the following operations: receive the user's request for X electronic A fourth operation of the electronic device identification corresponding to the second electronic device in the device identification. In response to the fourth operation, the electronic device identifier corresponding to the second electronic device is controlled to move out of the first area, and the second electronic device is instructed to cancel the execution of the first intention.
  • the category attributes and/or location attributes of the X electronic devices are the same.
  • the processor when the processor reads the computer instruction from the memory, it also causes the electronic device to perform the following operation: display a prompt on the first interface information, and the prompt information is used to feed back the situation that the X electronic devices execute the first intention.
  • the first interface further displays a second intention mark, and when the processor reads the computer instruction from the memory, the electronic The device performs the following operations: receiving a fifth operation of moving the second intention identifier to the first area by the user. In response to the fifth operation, Y electronic devices in the first group are instructed to execute the second intent corresponding to the second intent identifier, where Y is a positive integer.
  • the processor when the processor reads the computer instructions from the memory, it also causes the electronic device to perform the following operations: receive user input to the first interface
  • the sixth operation of the second group identifier displayed in the second group identifier corresponds to a second group including Z electronic devices capable of executing the first intention and the second intention, and Z is a positive integer.
  • move the second group identifier to the first area and instruct Z electronic devices to execute the first intention and the second intention.
  • the processor when the processor reads the computer instructions from the memory, it also causes the electronic device to perform the following operations: The seventh operation. In response to the seventh operation, control the first group identifier and the second group identifier to move out of the first area, and instruct Y electronic devices and Z electronic devices to cancel the execution of the first intention and the second intention.
  • the processor when the processor reads the computer instruction from the memory, it also causes the electronic device to perform the following operation: receive the user’s request for the second area The eighth operation, the second area corresponds to the second intention. In response to the eighth operation, control the second intention mark to move out of the first area, and instruct Y electronic devices to cancel the execution of the second intention.
  • the third operation is a click operation.
  • the fourth operation, the fifth operation, the sixth operation, and the eighth operation are drag operations.
  • the seventh operation is a long press operation.
  • an embodiment of the present application provides an electronic device, which has a function of implementing the method for controlling a smart device as described in the first aspect and any possible implementation manner thereof.
  • This function can be realized by hardware, and can also be realized by executing corresponding software by hardware.
  • the hardware or software includes one or more modules corresponding to the above functions.
  • a computer-readable storage medium stores a computer program (also referred to as an instruction or code), and when the computer program is executed by the electronic device, the electronic device executes the first aspect or the method in any one of the implementation manners of the first aspect.
  • a computer program also referred to as an instruction or code
  • the embodiments of the present application provide a computer program product, which, when the computer program product runs on an electronic device, causes the electronic device to execute the method in the first aspect or any one of the implementation manners in the first aspect.
  • the embodiments of the present application provide a circuit system, the circuit system includes a processing circuit configured to execute the method in the first aspect or any one of the implementation manners in the first aspect.
  • the embodiment of the present application provides a chip system, including at least one processor and at least one interface circuit, at least one interface circuit is used to perform the function of sending and receiving, and send instructions to at least one processor, when at least one processor When executing the instructions, at least one processor executes the first aspect or the method in any one implementation manner of the first aspect.
  • FIG. 1 is a schematic diagram of a family scene provided by an embodiment of the present application.
  • Fig. 2 is a schematic interface diagram 1 provided by the embodiment of the present application.
  • Fig. 3 is the interface schematic diagram 2 provided by the embodiment of the present application.
  • FIG. 4A is a first schematic diagram of the system architecture provided by the embodiment of the present application.
  • FIG. 4B is a second schematic diagram of the system architecture provided by the embodiment of the present application.
  • FIG. 5A is a schematic diagram of the hardware structure of the first electronic device provided by the embodiment of the present application.
  • FIG. 5B is a schematic diagram of a hardware structure of a communication device provided in an embodiment of the present application.
  • Figure 6 is a schematic diagram of the third interface provided by the embodiment of the present application.
  • FIG. 7 is a schematic diagram of the fourth interface provided by the embodiment of this application.
  • Figure 8 is a schematic diagram of the fifth interface provided by the embodiment of the present application.
  • FIG. 9 is a schematic diagram of the sixth interface provided by the embodiment of this application.
  • FIG. 10 is a schematic diagram of interface VII provided by the embodiment of this application.
  • FIG 11 is the eighth schematic diagram of the interface provided by the embodiment of the present application.
  • Figure 12 is a schematic diagram of the ninth interface provided by the embodiment of this application.
  • FIG. 13A is a first schematic diagram of a group division scenario provided by an embodiment of the present application.
  • Fig. 13B is a tenth schematic diagram of the interface provided by the embodiment of the present application.
  • FIG. 14A is a second schematic diagram of the group division scenario provided by the embodiment of the present application.
  • FIG. 14B is a schematic diagram of a third group division scenario provided by the embodiment of the present application.
  • FIG. 14C is a schematic diagram of a fourth group division scenario provided by the embodiment of the present application.
  • Figure 15 is the eleventh schematic diagram of the interface provided by the embodiment of this application.
  • Figure 16 is a schematic interface diagram twelve provided by the embodiment of this application.
  • Figure 17 is a schematic diagram of the interface provided by the embodiment of the present application thirteen;
  • Figure 18 is a fourteenth schematic diagram of the interface provided by the embodiment of this application.
  • Figure 19 is a schematic diagram of the fifteenth interface provided by the embodiment of this application.
  • Figure 20A is a sixteenth schematic diagram of the interface provided by the embodiment of the present application.
  • Fig. 20B is a schematic diagram of the seventeenth interface provided by the embodiment of the present application.
  • Figure 21 is a schematic interface diagram eighteenth provided by the embodiment of this application.
  • Figure 22 is the nineteenth schematic diagram of the interface provided by the embodiment of this application.
  • Fig. 23 is a schematic interface diagram 20 provided by the embodiment of the present application.
  • Figure 24 is the interface schematic diagram 21 provided by the embodiment of the present application.
  • Figure 25 is the twenty-two schematic diagram of the interface provided by the embodiment of this application.
  • Figure 26 is the twenty-three schematic diagram of the interface provided by the embodiment of this application.
  • Figure 27 is a schematic diagram of interface twenty-four provided by the embodiment of this application.
  • Figure 28A is the twenty-fifth interface schematic diagram provided by the embodiment of this application.
  • Fig. 28B is a schematic diagram of interface twenty-six provided by the embodiment of this application.
  • Figure 29 is the twenty-seventh schematic diagram of the interface provided by the embodiment of this application.
  • Figure 30 is a schematic diagram of interface twenty-eight provided by the embodiment of this application.
  • Figure 31 is a schematic diagram of interface twenty-nine provided by the embodiment of this application.
  • Fig. 32 is a flow chart of the smart device control method provided by the embodiment of the present application.
  • FIG. 33 is a schematic structural diagram of a first electronic device provided by an embodiment of the present application.
  • references to "one embodiment” or “some embodiments” or the like in this specification means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application.
  • appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically stated otherwise.
  • the terms “including”, “comprising”, “having” and variations thereof mean “including but not limited to”, unless specifically stated otherwise.
  • the term “connected” includes both direct and indirect connections, unless otherwise stated. "First” and “second” are used for descriptive purposes only, and should not be understood as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features.
  • Smart home devices are smart devices, such as audio and video equipment (such as large-screen equipment, Bluetooth speakers, etc.), lighting equipment (such as ceiling lights, desk lamps, spotlights, etc.), environmental control equipment (such as air conditioners, air purifiers, etc.), anti-theft Alarm equipment (such as human body sensors, cameras, etc.), etc.
  • the air conditioner is connected to a mobile phone as a smart home device, and the air conditioner can receive control commands sent by the user through the mobile phone.
  • the air conditioner can automatically start after receiving the "turn on” command input by the user through the mobile phone.
  • the air conditioner can automatically adjust the temperature to 26°C after receiving the command "adjust the temperature to 26°C" input by the user through the mobile phone.
  • a smart home application (such as a smart life application) is installed in an electronic device (such as a mobile phone), and the smart home application is paired with the smart home device to manage and control the smart home device.
  • the electronic equipment needs to establish a connection with the smart home equipment in advance, and configure the smart home equipment.
  • the mobile phone starts the smart life application, and displays the scene interface 201 as shown in (a) of FIG. 2 .
  • the mobile phone detects that the user clicks the operation of adding the control 21, an interface 202 as shown in (b) in FIG. operation.
  • an interface 203 as shown in (c) in FIG. 2 is displayed.
  • the mobile phone detects that the user clicks on the smart device control 23, it determines that the user needs to add a task to control the smart device, and can display controllable smart devices for the user to choose.
  • the mobile phone can display the execution tasks corresponding to the air conditioner selected by the user.
  • the trigger condition for currently controlling the air conditioner defaults to "when the scene card is clicked".
  • the trigger condition for controlling the air conditioner can be modified according to the user operation; or, as shown in Figure 2 (b) interface 202, the mobile phone detects that the user clicks the add condition control 26 After the operation, the trigger condition input by the user can also be received. Afterwards, on the interface 204 shown in (d) of FIG.
  • the mobile phone detects that the user clicks the confirmation control 27 and confirms that the creation of the user's current scene is completed. Afterwards, the mobile phone displays an interface 205 as shown in (e) in FIG. 2 , for example, the scene card 28 prompts the user that the scene is created successfully.
  • the electronic device is configured with a hyper terminal function
  • the hyper terminal function is used to implement linkage and control between devices.
  • electronic devices can establish connections with other nearby electronic devices (such as smart devices such as mobile phones, tablets, and speakers) through the hyperterminal function to realize data transmission and send display content to other electronic devices for display.
  • the function of the hyperterminal can only realize the linkage between the electronic device that starts the hyperterminal and other electronic equipment, but cannot realize the linkage between any electronic equipment.
  • the mobile phone is configured with a hyperterminal function.
  • the mobile phone displays a pull-down menu, and after detecting the user's operation of clicking the connection control 31 , it is determined that the user instructs the mobile phone to establish a connection with a nearby electronic device.
  • the mobile phone displays an interface 302 as shown in (b) in FIG. 3 , and the electronic devices that can be connected near the mobile phone are displayed on the interface 302 .
  • the mobile phone detects that the user drags the icon 33 to the mobile phone icon 32, it determines that the Huawei smart screen corresponding to the icon 33 needs to be connected to the mobile phone.
  • the mobile phone prompts the user that the Huawei smart screen is establishing a connection with the mobile phone through the icon shown by reference numeral 34 .
  • the mobile phone can respond to user operations and send the currently playing video to the Huawei Smart Screen for playback. Afterwards, if the user needs to add other electronic devices to establish a connection with the mobile phone, the above operations need to be repeated.
  • the mobile phone detects that the user drags the icon 35 to the mobile phone icon 32 , it determines that the Huawei smart screen corresponding to the icon 35 needs to be connected to the mobile phone.
  • the mobile phone prompts the user that the Huawei smart screen is establishing a connection with the mobile phone through the icon shown by reference numeral 36 .
  • the electronic device equipped with the HyperTerminal function is the central device, and each electronic device can only establish a connection with the central electronic device for linkage, and each electronic device cannot directly establish a connection.
  • the mobile phone needs to establish connections with multiple electronic devices, the user needs to drag the multiple electronic devices one by one, which is cumbersome to operate.
  • the linkage process between the mobile phone and other electronic devices still needs to be configured one by one by the user, which is difficult for the user to operate and affects the user experience.
  • the embodiment of the present application provides a smart device control method, which can divide electronic devices into groups. According to the group division results, realize group connection and control, effectively reduce the difficulty of user operation, and improve user experience.
  • FIG. 4A is a schematic diagram of a system architecture provided by an embodiment of the present application. As shown in FIG. 4A , the system architecture includes a first electronic device 100 , a server 200 and a control device 300 .
  • the first electronic device 100 can be, for example, a speaker 101, a large-screen device 102, a desk lamp 103, an electric light 104, a camera 105, an air purifier 106, a mobile phone, a tablet computer, a personal computer (personal computer, PC), a personal digital Terminal equipment such as assistant (personal digital assistant, PDA), netbook, wearable electronic equipment, artificial intelligence (artificial intelligence) terminal, etc., this application does not specifically limit the specific form of the electronic equipment.
  • the operating system installed on the first electronic device 100 includes but is not limited to or other operating systems.
  • the first electronic device 100 may also not be installed with an operating system.
  • the first electronic device 100 may be a fixed device or a portable device.
  • the present application does not limit the specific type of the first electronic device 100 , whether the operating system is installed or not, and the operating system installed if the operating system is installed.
  • the first electronic device 100 may be a smart home device, and a connection may be established between each first electronic device 100 to form a smart home system.
  • the first electronic device 100 can establish a connection with the server 200 , and the server 200 manages each first electronic device 100 .
  • the server 200 manages one or more first electronic devices 100 included in one or more homes based on a family (home).
  • the server 200 will The first electronic device 100 joins the corresponding home.
  • the server 200 may be a device with a computing function or a network device such as a cloud server or a network server.
  • the server 200 may be a server, or a server cluster composed of multiple servers, or a cloud computing service center.
  • the server 200 can also be described as a smart home cloud platform, which is used to manage smart home devices included in the smart home system.
  • the system architecture may further include a control device 300 .
  • the control device 300 can be connected with one or more first electronic devices 100 for managing and controlling the first electronic devices 100 .
  • control device 300 may be a dedicated device for controlling smart home devices, or a device including the function of controlling smart home devices.
  • the control device 300 may be a smart home control panel 302, or a terminal device such as a mobile phone 301, a tablet, a smart stereo, and a smart watch.
  • the smart home control panel 302 is a dedicated device for controlling smart home devices in the smart home system.
  • the control device 300 may be a fixed device or a portable device. The present application makes no special limitation on the specific form of the control device 300 .
  • control device 300 is connected to one or more first electronic devices 100 to obtain device information of the first electronic devices 100 .
  • the control device 300 provides a human-computer interaction interface, displays the device information of the first electronic device 100 for the user through the human-computer interaction interface, and receives a user's control command on the first electronic device 100 .
  • the first application is installed in the control device 300 .
  • the first application is a smart home application that can be connected with a smart home device to edit and manage the smart home device.
  • the control device 300 is connected to one or more first electronic devices 100 through a first application.
  • the first application is a smart life application.
  • the control device 300 detects the user's operation of adding a device, searches for nearby first electronic devices 100 , and configures the network for the found first electronic devices 100 .
  • the control device 300 sends the network information of the local area network (such as network name and password) to the first electronic device 100, assisting the first electronic device 100 to join the same local area network as the control device 300, the first electronic device 100 A wireless communication connection can be established with the control device 300 .
  • the control device 300 sends the device information of the first electronic device 100 to the server 200, so that the server 200 adds the first electronic device 100 to a corresponding home, and assigns a device identity (identity document, ID). Then, the subsequent server 200 can uniformly manage the first electronic devices 100 included in the home.
  • control device 300 receives a command input by the user to start a certain first electronic device, and forwards the command to the server 200 for processing.
  • the server 200 analyzes the command, determines the target first electronic device, and sends the command to the target first electronic device to start the target first electronic device.
  • the above example takes the control device 300 triggering the first electronic device 100 to join the home as an example during the process of starting the first application, and describes the process of adding the first electronic device 100 to the corresponding home.
  • the method for triggering the first electronic device 100 to join the home may also include other methods. For example, if the control device 300 has not started the first application after being turned on, it can also automatically search for nearby first electronic devices 100 that are not connected to the local area network and/or have not joined the home. Part or all of the devices 100 access the local area network and join the corresponding home. This embodiment of the present application does not specifically limit it.
  • the above system architecture may not include the control device 300 .
  • the first electronic device 100 joins the home managed by the server 200, and the server 200 can directly obtain the information of all the first electronic devices 100 in the home.
  • any electronic device with processing capability among the first electronic devices 100 may send a request to the server 200 to obtain information of other first electronic devices 100 as required.
  • the electronic device acts as a master device and can be used to control other first electronic devices 100 .
  • the first electronic device 100 includes a range hood, and the range hood can search for nearby devices of the same category according to user operations.
  • a device search request can be sent to the server 200 to obtain all device information included in the home where the range hood is located, and then determine the information of the same category of devices included therein; or, the range hood is located within a preset range according to the searched range hood
  • the device information obtained from the server 200 and the device information obtained from the server 200 determine devices of the same category among the searched devices within the preset range. Further, the range hood determines to establish a group with these devices of the same category (for example, the established group is group A), and reports the group information to the server 200 .
  • the user can control other devices in group A through any device in group A, such as starting all devices in group A at the same time; or, the user can also control other groups through any device in home For example, through device A in group A (such as range hood) to obtain information about other devices in the home, and then through device A to control device B to start (device B is a device in group B), or through device A All devices in control group B start.
  • a category in the equipment category is used to represent a consumer demand, for example, including kitchen appliances, audio-visual equipment, lighting equipment, and the like.
  • FIG. 5A shows a schematic structural diagram of the first electronic device 100 .
  • the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, Antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (subscriber identification module, SIM) card interface 195 etc.
  • a processor 110 an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, Antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (subscriber identification module, SIM) card interface 195 etc.
  • SIM subscriber identification module
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the first electronic device 100 .
  • the first electronic device 100 may include more or fewer components than shown in the illustration, or combine some components, or separate some components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is a cache memory.
  • the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
  • processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter
  • MIPI mobile industry processor interface
  • GPIO general-purpose input and output
  • subscriber identity module subscriber identity module
  • SIM subscriber identity module
  • USB universal serial bus
  • the I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL).
  • processor 110 may include multiple sets of I2C buses.
  • the processor 110 can be respectively coupled to a touch sensor, a charger, a flashlight, a camera 193 and the like through different I2C bus interfaces.
  • the processor 110 may be coupled to the touch sensor through an I2C interface, so that the processor 110 communicates with the touch sensor through the I2C bus interface to realize the touch function of the first electronic device 100 .
  • the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 .
  • MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc.
  • the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the first electronic device 100 .
  • the processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the first electronic device 100 .
  • the USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 130 can be used to connect a charger to charge the first electronic device 100 , and can also be used to transmit data between the first electronic device 100 and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.
  • the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the first electronic device 100 .
  • the first electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • the charging management module 140 is configured to receive a charging input from a charger.
  • the charger may be a wireless charger or a wired charger.
  • the charging management module 140 can receive charging input from the wired charger through the USB interface 130 .
  • the charging management module 140 may receive wireless charging input through the wireless charging coil of the first electronic device 100 . While the charging management module 140 is charging the battery 142 , it can also supply power to the electronic device through the power management module 141 .
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the display screen 194 , the camera 193 , and the wireless communication module 160 .
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 141 may also be disposed in the processor 110 .
  • the power management module 141 and the charging management module 140 may also be set in the same device.
  • the wireless communication function of the first electronic device 100 can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the first electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the first electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves and radiate them through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
  • a modem processor may include a modulator and a demodulator.
  • the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the low-frequency baseband signal is passed to the application processor after being processed by the baseband processor.
  • the application processor outputs sound signals through audio equipment, or displays images or videos through the display screen 194 .
  • the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the first electronic device 100 including wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR).
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the first electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the first electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc.
  • GSM global system for mobile communications
  • GPRS general packet radio service
  • code division multiple access code division multiple access
  • CDMA broadband Code division multiple access
  • WCDMA wideband code division multiple access
  • time division code division multiple access time-division code division multiple access
  • TD-SCDMA time-division code division multiple access
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • Beidou navigation satellite system beidou navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the first electronic device 100 communicates with the server 200, the control device 300 or other first electronic devices 100 through the mobile communication module 150 or the wireless communication module 160, so as to realize the unified control of the first electronic devices 100 in the group .
  • any device among device 1 , device 2 and device 3 can control the three devices at the same time by interacting with the server 200 .
  • the control device 300 may implement simultaneous control of the device 1 , the device 2 and the device 3 through interaction with the server 200 .
  • the first electronic device 100 implements a display function through a GPU, a display screen 194 , and an application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos and the like.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), such as an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode).
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • active-matrix organic light emitting diode active-matrix organic light emitting diode.
  • AMOLED organic light emitting diode
  • flexible light emitting diode flexible light emitting diode (flex light-emitting diode, FLED), Mini-led, Micro-led, Micro-oled, quantum dot light emitting diode (quantum dot light emitting diodes, QLED), etc.
  • the first electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
  • the first electronic device 100 can obtain the information of the whole house equipment from the server 200, and display it on the display screen 194, so that the user can have an overview of the situation of the whole house equipment. Moreover, the user can uniformly control the devices in the group on the display screen 194 in units of groups according to the conditions of the devices in the whole house.
  • Camera 193 is used to capture still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the first electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the first electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 121 may be used to store computer-executable program codes including instructions.
  • the internal memory 121 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data created during the use of the first electronic device 100 (such as audio data, phonebook, etc.) and the like.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
  • the processor 110 executes various functional applications and data processing of the first electronic device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
  • the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 170 may also be used to encode and decode audio signals.
  • the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
  • the first electronic device 100 can use the audio module 170, for example, to play music, record and so on.
  • the audio module 170 may include a speaker, a receiver, a microphone, an earphone interface, and an application processor to implement audio functions.
  • the sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
  • the pressure sensor is used to sense the pressure signal and convert the pressure signal into an electrical signal.
  • a pressure sensor may be located on the display screen 194 .
  • pressure sensors such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors.
  • a capacitive pressure sensor may be comprised of at least two parallel plates with conductive material. When a force is applied to the pressure sensor, the capacitance between the electrodes changes.
  • the first electronic device 100 determines the intensity of pressure according to the change in capacitance.
  • the first electronic device 100 detects the intensity of the touch operation according to the pressure sensor.
  • the first electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor.
  • touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view short messages is executed. When a touch operation whose intensity is greater than or equal to the first pressure threshold acts on the icon of the short message application, the instruction of creating a new short message is executed.
  • Touch sensor also known as "touch device”.
  • the touch sensor can be arranged on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, also called “touch screen”.
  • the touch sensor is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to the touch operation can be provided through the display screen 194 .
  • the touch sensor may also be disposed on the surface of the first electronic device 100 , which is different from the position of the display screen 194 .
  • the keys 190 include a power key, a volume key and the like.
  • the key 190 may be a mechanical key. It can also be a touch button.
  • the first electronic device 100 may receive key input and generate key signal input related to user settings and function control of the first electronic device 100 .
  • the motor 191 can generate a vibrating reminder.
  • the motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • touch operations applied to different applications may correspond to different vibration feedback effects.
  • the motor 191 may also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194 .
  • Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
  • the SIM card interface 195 is used for connecting a SIM card.
  • the SIM card can be connected and separated from the first electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 .
  • the first electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the server 200 and the control device 300 in this embodiment of the present application may be implemented by different devices.
  • the server 200 and the control device 300 in the embodiment of the present application may be realized by the communication device in FIG. 5B .
  • FIG. 5B is a schematic diagram of a hardware structure of a communication device provided by an embodiment of the present application.
  • the communication device includes at least one processor 501 , a communication line 502 , a memory 503 and at least one communication interface 504 .
  • the memory 503 may also be included in the processor 501 .
  • the structure shown in the embodiment of the present application does not constitute a specific limitation on the communication device.
  • the communication device may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the control device 300 may also be configured with modules such as a SIM card interface, a camera, and an audio module.
  • the processor 501 can be a general-purpose central processing unit (central processing unit, CPU), a microprocessor, a specific application integrated circuit (application-specific integrated circuit, ASIC), or one or more for controlling the execution of the application program program integrated circuit.
  • CPU central processing unit
  • ASIC application-specific integrated circuit
  • Communication line 502 may include a path for passing information between the above-described components.
  • the communication interface 504 is used for communicating with other devices.
  • the communication interface may be a module, a circuit, a bus, an interface, a transceiver or other devices capable of implementing a communication function, and is used for communicating with other devices.
  • the transceiver can be an independently set transmitter, which can be used to send information to other devices, and the transceiver can also be an independently set receiver, used to receive information from other The device receives the information.
  • the transceiver may also be a component that integrates functions of sending and receiving information, and this embodiment of the present application does not limit the specific implementation of the transceiver.
  • the memory 503 may be a read-only memory (read-only memory, ROM) or other types of static storage devices that can store static information and instructions, a random access memory (random access memory, RAM) or other types that can store information and instructions It can also be an electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be programmed by a computer Any other medium accessed, but not limited to.
  • the memory may exist independently and be connected to the processor through the communication line 502 . Memory can also be integrated with the processor.
  • the memory 503 is used to store computer-executed instructions for implementing the solution of the present application, and the execution is controlled by the processor 501 .
  • the processor 501 is configured to execute computer-executed instructions stored in the memory 503, so as to implement the carrier wave sending method provided in the following embodiments of the present application.
  • the computer-executed instructions in the embodiments of the present application may also be called application program codes, instructions, computer programs or other names, which are not specifically limited in the embodiments of the present application.
  • the processor 501 may include one or more CPUs, for example, CPU0 and CPU1 in FIG. 5B .
  • the communications device may include multiple processors, for example, processor 501 and processor 507 in FIG. 5B .
  • processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor.
  • a processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (eg, computer program instructions).
  • the communication device may further include an output device 505 and an input device 506 .
  • Output device 505 is in communication with processor 501 and can display information in a variety of ways.
  • the output device 505 may be a liquid crystal display (liquid crystal display, LCD), a light emitting diode (light emitting diode, LED) display device, a cathode ray tube (cathode ray tube, CRT) display device, or a projector (projector) wait.
  • the input device 506 communicates with the processor 501 and can receive user input in various ways.
  • the input device 506 may be a mouse, a keyboard, a touch screen device, or a sensing device, among others.
  • the above-mentioned communication device may be a general-purpose device or a special-purpose device, and the embodiment of the present application does not limit the type of the communication device.
  • the communication device is a smart home control panel, which is a dedicated device for controlling smart home devices.
  • the communication device is a mobile phone, which is a general-purpose device that can control smart home devices.
  • control device 300 as a mobile phone or a smart device control panel, and taking an application for managing smart home devices as a smart life application as an example, the smart device control method provided in the embodiment of the application will be described below.
  • the electronic device after the electronic device is connected to the local area network, it can discover other electronic devices connected to the same local area network and/or log in to the same account, and group these electronic devices. Then, in the follow-up, the divided groups can be used as a unit to realize group control according to user needs.
  • the account is used to represent the account of the smart home device management system logged in by the electronic device during the server registration process.
  • a user registers a smart life application and obtains a user name and password of the account. Subsequent users log in to the account through other electronic devices (such as mobile phones) that have already been configured in the network distribution process of the new electronic device to assist the new electronic device in the network distribution. Then, the server divides the electronic devices under the same account into the same home, so as to realize the electronic device management based on the home.
  • the server manages one or more homes, and the homes include one or more groups.
  • a home is a large group, including all electronic devices added by users.
  • the mobile phone After the mobile phone logs in to the smart life application and detects the operation of adding an electronic device by the user, it sends the device information of the newly added electronic device to the server.
  • the server determines the ID of the electronic device and divides the electronic device into Go to the home corresponding to the current login account of the mobile phone to complete the network distribution of the electronic device.
  • the smart home control panel sends the device information of the newly added electronic device to the server in response to the user operation, and the server determines the electronic device ID and divides the electronic device into the home corresponding to the smart home control panel.
  • the smart home control panel can also log in to multiple accounts, then the same server divides the home according to the accounts.
  • the mobile phone can manage the connection of the electronic device through the function of the hyper terminal.
  • the mobile phone displays a drop-down menu, and a hyperterminal card 61 is displayed in the drop-down menu.
  • the mobile phone detects that the user clicks the operation of the connection control 62 displayed on the hyperterminal card 61, it determines that the user needs to perform connection management on nearby devices, and displays an interface 602 as shown in (b) in FIG. 6 .
  • icons of electronic devices capable of group connection found by the mobile phone are displayed.
  • the central icon displayed on the interface 602 is a mobile phone icon 63, and icons of nearby electronic devices are displayed around the mobile phone icon according to the positional relationship between the electronic device and the mobile phone, such as a dishwasher icon 64, a steam box icon 65, an oven icon 66, etc. .
  • the mobile phone can manage the connection of the electronic device through the smart life application.
  • the mobile phone displays smart life applications.
  • an interface 702 as shown in (b) in FIG. 7 is displayed.
  • an interface 703 as shown in (c) in FIG. 7 is displayed.
  • the electronic devices near the mobile phone that can perform group connection are displayed.
  • the specific implementation method of establishing a group connection includes, for example, in the process of controlling the device 300 to display the first electronic device 100 capable of group connection, and establishing a group connection with the first electronic device 100 selected by the user according to a user operation.
  • a group connection is established according to the category attribute and/or location attribute of the first electronic device 100 .
  • the NFC function of the first electronic device 100 is used to establish a group connection of multiple first electronic devices 100 through a user's touch operation.
  • the mobile phone receives user operations during the process of displaying the electronic devices that can be connected in groups, and determines the grouping result of the electronic devices according to the user operations.
  • the mobile phone can determine the electronic devices capable of group connection through device search, or can obtain the device list corresponding to the home maintained in the server through interaction with the server, and determine the electronic devices capable of group connection.
  • the equipment list includes information such as equipment rooms and equipment categories.
  • the mobile phone displays icons of electronic devices located in the same local area network and/or logged into the same account, and the user can divide some or all of the devices into a group, and divide one or more groups.
  • the user will divide the electronic devices located in a certain area into a group, or divide the electronic devices of the same category into a group, so as to perform group control. For example, if the electronic devices in the same room are divided into a group, then the user can start all the electronic devices in the room at the same time, such as turning on all the lights in the bedroom.
  • the user can activate all the electronic devices of the same category at the same time, such as turning on all the lighting devices in the home.
  • icons of electronic devices clustered according to geographic location are displayed near the mobile phone icon 81 .
  • projectors, speakers, and TVs are all located in the living room, and corresponding icons can be aggregated and displayed.
  • dishwashers, steamers, and ovens are all located in the kitchen, and corresponding icons can be aggregated and displayed.
  • the icons of the electronic devices gathered according to the device categories are displayed near the mobile phone icon 81.
  • projectors, speakers, and TVs are all audio-visual electronic devices, and corresponding icons can be aggregated and displayed; dishwashers, steamers, and ovens are all kitchen appliances, and corresponding icons can be aggregated and displayed; smart door locks belong to security For electronic devices, the corresponding icons are displayed separately.
  • the mobile phone detects the user's selection operation on the display screen, and divides the electronic devices selected by the user into a group. For example, as shown in interface 802, the mobile phone detects the user's operation of sliding multiple electronic devices in a circle on the display screen; or, the mobile phone detects the user's operation of continuously clicking multiple electronic devices.
  • the mobile phone displays an interface 803 as shown in (c) in FIG. 8.
  • the mobile phone highlights the icon of the electronic device selected by the user to prompt the user to confirm whether the selected electronic device is correct.
  • the mobile phone detects that the user has long pressed a certain highlighted icon (such as an icon of a dishwasher, a steamer, and an oven), the selection of the icon can be canceled.
  • the mobile phone displays a prompt message, prompting the user to confirm whether the device selection result is correct.
  • the mobile phone displays an interface 804 as shown in (d) in Figure 8, and as shown in the reference numeral 83, the selected electronic device icon is close to the mobile phone icon 81, which is used to prompt the user that the group is being established, and the established group can be Group information is synchronized to the server.
  • the way of highlighting the icon includes, for example, deepening the color, changing the color, blinking, etc., which is not specifically limited in this embodiment of the present application.
  • the mobile phone establishes a group including a dishwasher, a steamer, and an oven through the process shown in FIG. 8 , and the mobile phone can obtain device information from the server, such as obtaining the location information of the three devices as the kitchen. Then, on the interface 901 shown in FIG. 9 , the mobile phone starts the smart life application in response to the user operation, and displays the space managed by the smart life application. As shown by reference numeral 91, the three devices added by the user are displayed in the kitchen card.
  • the user can also establish a group of electronic devices through the smart home control panel.
  • the smart home control panel determines that the user needs to connect a new device after detecting that the user clicks the operation of connecting to a new device control 101 .
  • the smart home control panel can also search for nearby electronic devices, or obtain a list of devices corresponding to the home from the server.
  • the smart home control panel displays an interface 1101 as shown in FIG. 11 , and the user's grouping operation is received on the interface 1101 .
  • the central icon displayed on the interface 1101 is the smart home control panel icon 111 , that is, the smart home control panel is used as the central device.
  • the smart home control panel may also determine the electronic device selected by the user as the central device according to user operations.
  • the user can also establish a group of electronic devices through any electronic device with display screen and group processing capability.
  • the electronic device used to establish the group is used as the master device. If the master device has clear category attributes and/or location attributes, it can automatically confirm nearby electronic devices with the same category attributes and/or location attributes. Prompt the user to create a group.
  • the category attribute is used to represent the category of the electronic equipment.
  • the location attribute is used to represent the space where the electronic device is located, such as dividing the space where the electronic device is located at a granularity of a room.
  • the main control device is a range hood.
  • the cooker hood detects the user's operation of creating a group on the display screen, and starts the group connection function. Afterwards, the cooker hood displays an interface 1201 as shown in (a) in FIG. Range hoods Icons for electronic devices with category attributes and/or location attributes are highlighted. For example, the range hood can obtain the device information list from the server, determine the category attribute and/or location attribute of the electronic device, and then highlight icons of electronic devices with the same category attribute and/or location attribute.
  • the range hood determines itself as a kitchen appliance, and can determine to highlight the icon 122 of the steamer, the icon 123 of the oven, and the icon 124 of the dishwasher, which are also kitchen appliances. Or, as shown in the interface 1201, the range hood determines that it is located in the kitchen, and may determine to highlight icons of electronic equipment also located in the kitchen, such as the icon 122 of the steamer, the icon 123 of the oven, and the icon 124 of the dishwasher.
  • the range hood detects the user's operation of dragging the icon to the central icon, and determines to establish a group relationship between the electronic device corresponding to the icon and the range hood. For example, in the interface 1202 shown in (b) in FIG. After the user clicks to confirm the operation of the control 125, it is determined that the user has created a group including range hoods, steamers, ovens and dishwashers.
  • the range hood automatically gathers and displays icons of all electronic devices that share category attributes and/or location attributes with the range hood around the range hood icon, and detects that the user moves the electronic device icon away from the range hood icon In the dragging operation, it is determined that the user does not need to add the corresponding electronic device to the group, thereby reducing the user's dragging operation.
  • the main control device (such as a range hood) can send group information to the server. Then, after the mobile phone starts the smart life application in response to the user's operation, it can obtain the latest device information from the server, display the latest group division result, and realize the user's group control of the electronic device.
  • the user can also establish a group of electronic devices through a touch operation through a near-field connection function (such as an NFC function) of the mobile phone.
  • a near-field connection function such as an NFC function
  • the group connection card 131 is displayed on the interface 1301 .
  • the group connection card 131 displays icons of electronic devices that meet the requirements detected by the mobile phone.
  • display the title of these electronic equipments and the title of group if mobile phone searches for equipment B and equipment C, display the title of equipment A, equipment B and equipment C on group connection card 131 , and the corresponding group name is office equipment (for example, the group is automatically named after the equipment category).
  • the mobile phone can receive the user's operations on the group connection card 131, such as operations of deleting icons of some electronic devices, operations of modifying group names, and the like.
  • the mobile phone determines that the user does not add the corresponding electronic devices to the group including device A. Afterwards, the mobile phone determines to establish a group including device A, device B and device C after detecting that the user clicks the group connection control 133 displayed on the group connection card 131 .
  • the mobile phone after the mobile phone establishes the group, it can send the group information to the server. Then, later, when the smart life application is activated in response to user operations, the smart life application can obtain the latest device information from the server, display the latest group division results, and realize the user's group control of electronic devices.
  • the mobile phone detects that the user touches the NFC tag of device A through the NFC function, determines that the user needs to create a group including device A, and displays an interface 1401 .
  • a group connection card 141 of device A is displayed, and an icon of device A is displayed on the group connection card 141 .
  • the mobile phone detects that the user touches the NFC tag of device B through the NFC function, and determines that the user needs to add device B to the group including device A , an interface 1402 is displayed. As indicated by reference numeral 142, the icon of device A and the icon of newly added device B are displayed on the group connection card 141 of device A, prompting the user that device B has been added.
  • the mobile phone detects that the user touches the NFC tag of device C through the NFC function, and determines that the user needs to add device C to the included In the group of device A and device B, an interface 1403 is displayed.
  • the icon of device A, the icon of device B, and the icon of newly added device C are displayed on the group connection card 141 of device A, prompting the user that device C has been added.
  • the mobile phone detects that the user has clicked the operation of the group connection control 144 displayed on the group connection card 141, it determines that the user has completed the addition of devices in the group, and can add the devices A and B that have been confirmed to be added. , and device C is established as a group. Or, the mobile phone does not detect the user's operation of adding a new device within the preset time (such as not detecting the user's operation of touching the device's NFC tag through the NFC function), and automatically sets the added device as a group.
  • the mobile phone after the mobile phone establishes the group, it can send the group information to the server. Then, later, when the smart life application is activated in response to user operations, the smart life application can obtain the latest device information from the server, display the latest group division results, and realize the user's group control of electronic devices.
  • the process of establishing a group is described by taking the realization of connection through the touch operation of the NFC function as an example. It can be understood that the establishment of the group can also be realized through other functions, such as through the shake function of the mobile phone, or by adding the device serial number of the electronic device to be established on the mobile phone and other methods to realize the establishment of the group.
  • the intention is used to express user expectations, for example, it may include: turning on/off lights, playing music, purifying air, controlling curtains, controlling temperature, and so on.
  • group control method will be described below by taking a room as a group unit as an example.
  • smart home devices are divided into devices in the master bedroom, devices in the second bedroom, devices in the living room, devices in the study, and devices in the children's room.
  • groups of other granularity can also be established according to user operations, such as groups of office equipment, etc.
  • control methods of other groups you can also refer to the following group control methods , which will not be repeated here.
  • the subsystems are divided based on the functions of the smart home devices, such as lighting subsystems, environmental subsystems, and security subsystems.
  • Each subsystem corresponds to one or more intents.
  • the intents corresponding to the lighting subsystem include: the intent to turn on/off lights, etc.
  • the intents corresponding to the environment subsystem include: constant temperature intent, constant humidity intent, constant net intent, etc.
  • the control device 300 can determine the first electronic device 100 in the group that can realize the intention, and instruct the first electronic device 100 to implement the user's intention.
  • a subsystem configuration file and an intent configuration file are configured in the server.
  • the subsystem configuration file is used to configure the subsystem, as shown in Table 1 below, the subsystem configuration file includes the subsystem name, device type, device ID, and intent identification.
  • the subsystem configuration file of the lighting subsystem includes the device ID of the electronic device capable of realizing lighting and the corresponding intent identifier.
  • the intent identifier is used to represent the corresponding control command when the electronic device executes the intent, and the server can determine the corresponding operation that needs to be performed by the electronic device according to the control command, and then issue corresponding instructions to the electronic device.
  • the subsystem configuration file is saved in the control device 300, then, after the control device 300 determines the user's intention, it can determine the device ID of the electronic device that can realize the user's intention according to the subsystem configuration file, and then recommend for the user including The group of electronic devices intended by the user is convenient for the user to control the group of electronic devices.
  • the intent configuration file is used to configure the execution conditions and execution actions corresponding to the intent, as shown in Table 2 below, the intent configuration file includes device ID, intent identifier, execution conditions and execution actions.
  • the intent configuration file includes device ID, intent identifier, execution conditions and execution actions.
  • one subsystem configuration file corresponds to one or more intent configuration files, and the execution condition is used to indicate the execution condition of the execution action.
  • the execution of some intents may not include the execution condition, that is, the execution condition may not be configured in the intent configuration file.
  • the intent configuration file corresponding to the lighting subsystem includes the device ID of the electronic device that can realize lighting (assumed to be the device ID of device A), the intent identifier, and the corresponding execution action . Then, if the intent configuration file of all intents is saved in the server, as shown in Table 2 below, the server determines that it is necessary to instruct device A to start (such as turn on the light) according to the intent configuration file, and sends an indication signal to device A for instructing device A start up.
  • the intent configuration file includes the execution conditions for realizing the execution actions of the multiple electronic devices.
  • the electronic devices corresponding to the security subsystem include cameras, human body sensors, alarms, etc., and the corresponding execution actions can only be executed after the content detected by these electronic devices meets the execution conditions. Therefore, corresponding execution conditions need to be configured in the intent configuration file corresponding to the security subsystem.
  • an electronic device needs to execute a corresponding intent under certain conditions such as temperature and time, then it is necessary to configure the corresponding execution condition in the intent configuration file.
  • the group control process will be described below by taking the control device 300 as a smart home control panel as an example.
  • the smart home control panel detects that the user clicks the operation of the whole house control control 151, and determines that the user needs to operate the smart home device, and the smart home control panel enters the whole house control system, as shown in Figure 16 Interface 1601 is shown.
  • an intention identification column 161 is displayed, and the intention identification column 161 is used for displaying an intention identification showing all intentions, or an intention identification showing partial intentions.
  • all intents are used to represent all intents defined by developers or users.
  • the partial intentions may include intentions achievable by electronic devices currently in the house and/or intentions selected by the user from all intentions.
  • intentions may include intentions achievable by electronic devices in the current house.
  • the first electronic device 100 in the current house includes lights and speakers
  • the corresponding achievable intentions include the intention to turn on the light and the intention to play music
  • the smart home control panel can display the intention to turn on the light and the intention to play music in the intention identification column logo.
  • the partial intentions include intentions achievable by electronic devices in the current house and intentions selected by the user from all intentions.
  • the corresponding achievable intentions include the intention to turn on the lights and the intention to play music
  • the smart home control panel determines that the intention selected by the user is the intention to purify the air (assuming that the intention is currently Intentions that cannot be fulfilled by electronic equipment in the house). Then the smart home control panel can display the intent logo of turning on the light, the intent logo of music playing and the intent logo of purifying air in the intent logo column. For another example, the smart home control panel only displays the intention logo of the intention selected by the user in the intention logo column according to the user's operation, such as the intention logo of purifying air.
  • the intention selected by the user may be an intention that is achievable in the current room, or an intention that is not achievable in the current room.
  • the smart home control panel displays the intent identifiers of some of the intents that can be realized by the electronic devices in the current house in the intent identifier column.
  • the intention identifiers displayed in the intent identifier column include intent identifiers corresponding to intentions that cannot be realized by the current indoor electronic equipment
  • the intention identifiers corresponding to the intentions that cannot be realized by the current indoor electronic equipment may be displayed in a gray inoperable state.
  • the achievable intention of the new electronic device is the intention corresponding to the currently displayed inoperable state intent identifier, and the inoperable state intent identifier can be converted into an operable state intent identifier.
  • the order of displaying the intention identifications in the intention identification column 161 may be a default order; or, an order determined according to user operations, such as adjusting the display order of intention identifications according to user operations; or, an order according to user operations.
  • the order in which the operation frequency is determined such as displaying the intention identification of the intention frequently operated by the user at a display position with a higher priority (such as a display position that is convenient for user operation, or a previous display position), is convenient for user operation; or;
  • the sign bar 161 is divided into an adjustable area and an unadjustable area.
  • the adjustable area can adjust the display of intention signs according to user operations, and the non-adjustable area displays default intention signs according to a preset number and a preset display order.
  • the light-on intention mark 162 displayed in the intention mark column 161 is highlighted, which is used to indicate that the interface 1601 currently displayed on the smart home control panel is the control interface corresponding to the light-on intention corresponding to the light-on intention mark 162 .
  • the displayed central intention is the intention to turn on the light, and the circles displayed around the central intention are used to indicate a group including electronic devices that can realize the intention to turn on the light.
  • the living room contains electronic devices capable of turning on the lights, therefore, the smart home control panel displays the identification of the living room group (such as the circle indicated by reference numeral 164 displayed on the interface 1601).
  • the circles displayed around the central intention may also be used to represent electronic devices that can realize the intention to turn on the light.
  • the smart home control panel can be directly displayed around the central intention Identification of this part of the electronic device. That is to say, the identifiers displayed around the central intent identifier include group identifiers and/or device identifiers.
  • the smart home control panel detects that the user clicks on the light-on intention sign 162, according to the subsystem configuration file shown in Table 1 above, it determines the electronic devices that can realize the light-on intention, and then determines the group where these electronic devices are located. Group. Afterwards, the center intention logo and the logo of the determined group are displayed on the interface 1601, so that the user can realize group control according to the intention.
  • the subsystem configuration file is stored in the smart home control panel; or, after the smart home control panel determines the intention of the user, it sends a request to the server, and the server determines the device ID of the corresponding electronic device; or, requests the server to send Subsystem configuration files.
  • the group logo displayed around the center intent logo also displays the electronic equipment corresponding to the center intent, such as the children's room, second bedroom, living room, master bedroom, and study corresponding to the intention to turn on the light None of the electronic devices are switched on. Users can view the whole house situation through the smart home control panel, without having to confirm the device status one by one through complicated operations, which improves the user experience.
  • the smart home control panel detects the user's preset operation on the group identifier, and determines that the user instructs the electronic devices in the group corresponding to the group identifier to perform preset conditions and preset actions corresponding to the central intention.
  • the preset operation includes, for example, an operation in which the user operates the group identification to identify the collision center, or the user operates the operation center to identify the collision group identification.
  • the central intention displayed on the smart home control panel is the light-on intention.
  • the smart home control panel detects that the user drags the master bedroom logo 172 to move toward the light-on intention logo 171 along the direction shown by the arrow 173.
  • the electronic device corresponding to the intention of turning on the light in the bedroom activates the function of turning on the light.
  • the smart home control panel determines the device ID of the electronic device corresponding to the intention to turn on the light in the master bedroom group and the intention identification corresponding to the intention to turn on the light (the intention identification also corresponds to the activation status displayed on the smart home control panel.
  • Light intention identification 171) send the device ID and the intention identification to the server.
  • the server determines the execution actions and execution conditions that need to be performed by the electronic device corresponding to the device ID.
  • the server generates a signal instruction and sends it to the electronic device corresponding to the device ID, so that the electronic device performs a corresponding action, such as turning on the light.
  • the server generates a signal instruction, sends it to the smart home control panel, and the smart home control panel forwards the signal instruction to the electronic device corresponding to the device ID, so that the electronic device performs a corresponding action, such as turning on the light.
  • the electronic equipment in the master bedroom will send a feedback signal after turning on the light according to the signal indication, and the smart home control panel will determine whether the signal indication is activated according to the received feedback signal forwarded by the server or the received feedback signal sent by the electronic equipment. implement.
  • the smart home control panel displays the execution of the command in the group logo of the master bedroom according to the received feedback signal, such as 4 lamps in the master bedroom The lights are on.
  • the user can intuitively determine the execution status of the command according to the display of the group ID, thereby improving the user experience.
  • the user can realize the group control of the electronic devices through a simple drag operation, which reduces the difficulty of the user's device operation and satisfies the user's multi-device control requirements.
  • the smart home control panel can also display the electronic device in the group that has specifically executed the execution action, so that the user can understand the execution status of the electronic device.
  • the interface 1801 shown in FIG. 18 after the smart home control panel determines that the electronic device in the master bedroom activates the function of turning on the light, it sequentially flashes the buttons for starting the function of turning on the light in the group logo.
  • the indicator of the electric light is displayed in the master bedroom. For example, assuming that there should be 6 lighting devices in the master bedroom, but only 4 lighting devices are activated in the scene shown in Figure 17, then the user can intuitively determine which electronic devices have executed the corresponding intent based on the electronic device identification shown in Figure 18. Execute actions, and those that do not perform actions corresponding to the intent. Thereby, the user's confirmation operation is simplified.
  • the smart home control panel when the smart home control panel detects the user's preset operation on the group identifier corresponding to the electronic device that has executed the central intent, it expands and displays the identifiers of all electronic devices that execute the central intent corresponding to the group identifier.
  • the smart home control panel detects that the user clicks on the master bedroom logo 191 , and displays the interface shown in (b) in FIG. 19 1902. As shown in the interface 1902, the smart home control panel displays the signs of electronic devices (such as ceiling lights, spotlights, floor lamps, and table lamps) that have activated the light-on function in the master bedroom around the light-on intention sign.
  • electronic devices such as ceiling lights, spotlights, floor lamps, and table lamps
  • the smart home control panel cancels the execution action corresponding to the intention performed by the electronic device corresponding to the device identification and execution conditions.
  • the interface 2001 shown in (a) in FIG. The operation of dragging the desk lamp sign 202 in the direction away from the lamp intention sign 201 determines that the user needs to cancel turning on the desk lamp (that is, the user instructs to turn off the desk lamp).
  • the smart home control panel sends the device ID of the desk lamp and the command to cancel the execution intention to the server, and the server sends an instruction signal to turn off the lamp according to the device ID.
  • the smart home control panel directly sends an indication signal to the desk lamp to instruct the desk lamp to turn off the light. Then, after receiving the indication signal, the desk lamp executes the command to turn off the light and sends a feedback signal.
  • the smart home control panel displays an interface 2002 as shown in (b) in FIG. 20A according to the feedback signal forwarded by the server or received from the desk lamp.
  • the desk lamp logo 202 is no longer highlighted, which is used to remind the user that the desk lamp is turned off.
  • the command to cancel the execution intention includes instructing the electronic device to execute a command contrary to the intention, for example, the command to cancel the execution intention of turning on the light is to instruct the electronic device to turn off the light.
  • the command to cancel the execution intention includes a command to no longer execute the intention, for example, the intention is a constant temperature intention, and the command to cancel the constant temperature intention is to instruct the electronic device to no longer execute the constant temperature intention.
  • the user can also continue to turn off other lighting devices in the master bedroom on the interface 2002, such as dome lights and spotlights.
  • the smart home control panel detects the user's operation of clicking the close control 203, it determines that the user has completed the control of the electronic devices in the current group, and can display an interface 2003 as shown in (c) in Figure 20A.
  • the execution of the command displayed in the master bedroom logo is changed from the master bedroom shown in (a) in Figure 19 (a) turning on 4 lights to the master bedroom shown in reference number 204 turning on 3 lights , that is, a lamp in the master bedroom is turned off.
  • the smart home control panel determines the modification operation of the group parameters by the user, and then performs group control according to the modified group parameters during subsequent user control of the electronic devices in the group.
  • the operation of modifying the group parameters includes the operation of changing the number of devices included in the group, the operation of changing the parameters of the devices in the group, and the like.
  • modification of group parameters can be implemented through a blacklist. If the device ID of the electronic device deleted by the user is added to the blacklist, then the smart home control panel can exclude some electronic devices corresponding to the intention according to the blacklist in the process of determining the subsystem configuration file.
  • the modification of the group parameter may directly modify the subsystem configuration file and the intent configuration file.
  • the smart home control panel sends the user's modification of the device parameters to the server, and the server modifies the corresponding parameters in the intent configuration file. Then, when determining the execution conditions and actions, it can instruct the electronic device to execute according to the modified device parameters. intention.
  • the blacklist determined by the server, the modified subsystem configuration file, and the intent configuration file can be synchronized to the smart home control panel.
  • the smart home control panel in response to the user operation, deletes the desk lamp in the master bedroom. So, assume the user has turned off all lighting in the master bedroom. For example, as shown in (c) in FIG. 20A , the user drags the master bedroom sign shown by reference numeral 204 to move away from the light intention sign, and the smart home control panel determines that the three lights that have been turned on are turned off. Subsequently, as shown in (a) interface 2004 in FIG.
  • the smart home control panel detects that the user clicks the operation of turning on the light-on intention logo 205 displayed in the intention logo column
  • the displayed central intention logo is the light-on intention logo 206
  • the light-on intention logo 206 is displayed.
  • An unhighlighted master bedroom logo is displayed around intent logo 206 .
  • the smart home control panel detects that the user drags the master bedroom sign 207 to move to the light-on intention sign 206 and collides with it, and determines that it needs to control the lighting equipment in the master bedroom to execute Turn on the lights intent.
  • the smart home control panel can determine that the current master bedroom includes 3 lighting devices according to the subsystem configuration file and the blacklist, and determine the corresponding device ID and intent identification, so as to realize the control of these 3 lighting devices to execute the intention of turning on the lights. Afterwards, the smart home control panel displays an interface 2006 as shown in (c) in FIG. 20B. As shown by reference numeral 208, the command execution status displayed in the master bedroom control logo is 3 lights on, and no longer includes response to user operations. Added lamps to the blacklist. Furthermore, if the user turns on the desk lamp again this time, the smart home control panel can delete the desk lamp from the blacklist and synchronize it to the server. Then, in the follow-up, the smart home control panel determines that the lighting equipment in the master bedroom implements the intention of turning on the lights, and can instruct the desk lamp to implement the intention of turning on the lights.
  • the execution action in the intention profile of the intention to turn on the light includes a brightness parameter of the light, for example, 350 candela/square meter (cd/m).
  • the server instructs the lighting equipment in the master bedroom to start with a brightness of 350cd/m.
  • the smart home control panel detects the user's operation of adjusting the brightness of the desk lamp in the lighting equipment in the master bedroom, and determines that the user has adjusted the brightness of the desk lamp to 300cd/m. Then, the smart home control panel sends the adjusted parameters to the server, and the server modifies and synchronizes the intent configuration file.
  • the smart home control panel detects that the user instructed to start the lighting equipment in the master bedroom, it instructs the table lamp in the master bedroom to start with a brightness of 300cd/m, and the rest of the lighting equipment to start with a brightness of 350cd/m.
  • the smart home control panel can adaptively adjust the subsystem configuration file and the intent configuration file according to the user operation, so that the group control meets the user's needs, and further improves the user experience.
  • the smart home control panel limited by the display area of the display screen of the smart home control panel, only a limited number of intention signs can be displayed in the intention representation column. Therefore, in the case that some intent identifiers are not displayed on the current page of the intent identifier bar, the user can view more intent identifiers through operations such as sliding in the intent identifier bar. That is, in response to the user's operation such as sliding on the intention identification bar, the smart home control panel slides to display the intention identification.
  • the smart home control panel displays in the intention identification column 211 the intention identification of turning on the lights, the intention of playing music, the intention of purifying the air and the intention of curtains. It is assumed that none of the currently displayed intent identifiers is the intent identifier of the intent that the user wants to control. Then, as shown in the interface 2101 , after the smart home control panel detects the user's sliding operation in the direction indicated by the arrow 212 on the intention identification bar 211 , the intention identification displayed in the intention identification bar 211 is slid to be displayed. For example, in response to the user's sliding operation, the smart home control panel displays an interface 2102 as shown in (b) in FIG.
  • the user can view more intents through a simple sliding operation, thereby satisfying more intent requirements of the user.
  • the smart home control panel detects that the user clicks on the curtain intention logo 221 during the process of displaying the interface of the intention to turn on the lights, and determines that the user needs to view the curtain intention corresponding interface.
  • the smart home control panel obtains the group corresponding to the curtain intent, and the execution of the curtain intent by the electronic devices in the group, and displays an interface 2202 as shown in (b) in FIG. 22 .
  • the displayed center intent logo is the curtain intent logo 222
  • group logos including groups of electronic devices capable of realizing the curtain intent logo are displayed around the curtain intent logo.
  • the second bedroom logo 223 is highlighted, and the execution of the intention is displayed on the second bedroom logo 223, such as the second bedroom curtain is opened.
  • the user can switch to view different intent interfaces through the intent identification bar, so as to determine the status of the electronic devices in the whole house.
  • electronic devices corresponding to different intentions can be controlled by switching the intention interface.
  • the smart home control panel detects the user's deletion operation in the intention identification column, and can delete the unnecessary intention identification of the user.
  • the smart home control panel detects that the user has long pressed the music playback intention mark 231 , and can display the delete bar 232 . Afterwards, after detecting that the user drags the music playback intention logo 231 to the deletion bar 232 along the direction shown by the arrow 233, the music playback logo can be deleted, and an interface 2302 as shown in (b) in FIG. 23 is displayed. As shown in the interface 2302 , the deleted music playing logo is no longer displayed in the intent logo column 234 .
  • the central intent identifiers displayed around the central intent identifier when all the groups corresponding to the group identifiers displayed around the central intent identifier do not execute the central intent, it is detected that the user presses the central intent identifier for a long time, and all groups corresponding to the central intent The corresponding electronic device sends an intent-to-execute command. In this way, the user can quickly operate all the electronic devices corresponding to the intention, without having to operate in groups one by one, thereby further reducing the difficulty of user operation, improving the control efficiency of electronic devices, and improving the user experience.
  • the central intention is to turn on the light.
  • the smart home control panel detects that the user has long pressed the light-on intention sign 241, and determines that all the groups corresponding to the light-on intention have not executed the light-on intention, and determines all lighting devices corresponding to the light-on intention according to the subsystem configuration file. ID and intent identification.
  • the smart home control panel sends the device IDs and intent identifiers of all lighting devices corresponding to the intention to turn on the lights to the server. In this way, all lighting devices in these groups can be activated.
  • the smart home control panel displays an interface 2402 as shown in (b) in FIG. display, which is used to prompt the user that the lighting device corresponding to the intention to turn on all lights has been activated.
  • an operation of long-pressing the central intent by the user is detected, and an intent cancellation command may be sent to corresponding electronic devices in all groups corresponding to the central intent. Therefore, the user can quickly operate all the electronic devices corresponding to the intention, without having to operate in groups one by one, further reducing the user's operation difficulty, improving the control efficiency of the electronic device, and improving the user experience.
  • the central intention is to turn on the lights, and all groups corresponding to the intention to turn on the lights have executed the intention to turn on the lights (as shown in the interface 2501, all the intentions to turn on the lights 251 around Group IDs shown are highlighted).
  • the smart home control panel detects that the user presses and holds the light-on intention sign 251 , and determines the device IDs and intention signs of all lighting devices corresponding to the light-on intention according to the subsystem configuration file.
  • the smart home control panel sends the device IDs and intent identifiers of all lighting devices corresponding to the intention to turn on the lights to the server. In this way, all the lighting devices can be turned off.
  • the smart home control panel displays an interface 2502 as shown in (b) in FIG. 25 , and all group logos are no longer highlighted, which is used to remind the user that all lighting devices corresponding to the intention to turn on the lights have been turned off.
  • the electronic devices in some groups have executed the execution conditions and execution actions corresponding to the central intention, and the electronic devices in some groups have not executed the execution conditions and execution actions corresponding to the central intention.
  • the smart home control panel detects that the user has long pressed the operation of the center intent logo, it determines to control all groups to execute the execution conditions and execution actions corresponding to the center intent according to the preset rules.
  • the central intention is the intention to turn on the light
  • the lighting equipment in the group including the lighting equipment that does not execute the intention to turn on the light will be controlled. Execute the intent to turn on the lights.
  • the central intention is the intention to turn on the light.
  • the smart home control panel detects that the user has long pressed the operation of the intention to turn on the light, it will control the lighting equipment in the group including the lighting equipment that has executed the intention to turn on the light according to the preset rules. are closed.
  • the preset rule may be a rule preset in the smart home control panel by the developer, or may be a user-defined rule.
  • the smart home control panel detects the user's fusion intention operation, and can fuse two or more intentions to generate a fusion intention. Therefore, the user can directly control the electronic devices corresponding to the multiple intents included in the fusion intent through the fusion intent, further simplifying user operations.
  • the smart home control panel is displaying an interface for turning on lights.
  • the smart home control panel detects that the user drags the constant temperature intention logo 261 displayed in the intention logo column to move toward the central intention (such as the intention to turn on the light) along the direction shown by the arrow 262, as shown in reference numeral 264, the constant temperature intention logo After moving to the preset range around the central intention, it will be highlighted to remind the user that the intention fusion mode is currently activated, which can fuse the constant temperature intention with the central intention. If the smart home control panel detects that the user continues to drag the constant temperature intention logo to move to the light-on intention logo 263, the interface 2602 shown in (b) in FIG.
  • a schematic diagram of logo fusion will be displayed, prompting the user that the two intents have begun to merge.
  • the smart home control panel determines that the intent to be fused is the intent to turn on the light and the intent to keep the temperature, and can generate a fusion intent identifier.
  • a fused intent identifier 266 is displayed in the intent identifier column.
  • the switching center intention is a fusion intention, and a fusion intention interface is displayed.
  • the central intention is identified as the fusion intention identification 267 of the intention to turn on the light and the intention to keep the temperature.
  • the fusion intention is displayed on the fusion intention mark 267, prompting the user to control the electronic device capable of turning on the light and keeping the temperature through the fusion intention.
  • the smart home control panel After the smart home control panel generates a new fusion intent, it will bounce off all the highlighted group logos around the original central intent logo and no longer highlight them.
  • the master bedroom logo In the interface 2602 shown in (b) of Figure 26, the master bedroom logo is prominently displayed around the sign of the intention to turn on the lights, and then in the interface 2603 shown in Figure 26 (c), after the smart home control panel determines the fusion intention, the fusion intention The group logo is no longer highlighted around the logo 267.
  • the group logo that was originally highlighted on the intent interface is no longer highlighted when the fusion intent interface is displayed, it does not mean that the execution of the intent of the electronic devices in the group is directly cancelled.
  • the master bedroom logo is no longer highlighted in the fusion intent interface shown in (c) in FIG. 26 .
  • these 4 lights remain on.
  • the turn-on intention logo 268 in the intention logo column if after detecting that the user clicks the turn-on intention logo 268, switch and display the turn-on intention interface, in the turn-on intention
  • the master bedroom logo is highlighted on the interface.
  • the smart home control panel detects that the user clicks the operation of the fusion logo 271 displayed in the intention logo column, and determines that the intention corresponding to the fusion logo 271 includes the intention to turn on the light and constant temperature intent.
  • the smart home control panel acquires the subsystem configuration file of the intention to turn on the lights and the subsystem configuration file of the thermostat intention, and after determining the electronic devices included in the two subsystem configuration files, it is determined that the electronic devices that can perform the intention of turning on the lights and
  • the group of electronic devices that can execute the intent of constant temperature send the device ID and the corresponding intent identifier of the electronic devices that can execute the intent of turning on the light and/or the intent of constant temperature in this part of the group to the server, so as to realize that the corresponding electronic device is instructed to execute Intention execution conditions and execution actions.
  • the smart home control panel determines the device ID of the lighting device in the master bedroom and the corresponding intent identifier, as well as the device ID and the corresponding intent identifier of the constant temperature device, and realizes instructing these lighting devices and constant temperature devices to perform corresponding execution conditions and execution actions .
  • the smart home control panel determines that the electronic devices in the master bedroom group have executed the corresponding execution conditions and actions, it displays an interface 2702 as shown in (b) in FIG.
  • the execution status of the command is displayed on the sign of the master bedroom, for example, 4 lights in the master bedroom are turned on and the temperature is 26°C.
  • the user can quickly activate the lighting and thermostat in the master bedroom.
  • the user can also quickly cancel the execution of the electronic device's intention by merging the intention.
  • operations intended to be canceled reference may be made to the related content shown in FIG. 20A or FIG. 25 above, and details are not repeated here.
  • the smart home control panel determines that in the currently displayed intent interface, the group corresponding to the highlighted group identifier includes electronic devices that can execute the intent to be merged. Then, the smart home control panel can keep highlighting the group logo on the fusion intent interface after the fusion intent, but the command execution status displayed in the group logo changes to the corresponding command execution status after the fusion intent is executed.
  • the smart home control panel determines that in the currently displayed intent interface, the group corresponding to the highlighted group identifier does not include electronic devices that can execute the intent to be fused. Then, the intent logo will no longer be highlighted on the fusion intent interface. That is to say, during the intention fusion process, the smart home control panel needs to determine the central intention of the electronic device corresponding to the group identifier highlighted on the current interface and the execution status of the intention to be integrated.
  • the master bedroom includes a constant temperature device that can perform a constant temperature intention, as shown in the interface 2801 shown in FIG. 28A .
  • the interface 2601 shown in (a) of Figure 26 when the central intention mark is the light-on intention mark 263, the master bedroom mark is highlighted on the interface 2601, and four lights in the master bedroom are determined to be turned on. Then, after the smart home control panel detects the fusion intention operation on the interface 2601 and determines the fusion intention, it can directly display the interface 2802 as shown in FIG. 28B .
  • the central intent mark is the fusion intent mark 283 of the light-on intent and the constant temperature intent, and the master bedroom mark is highlighted as shown by reference number 284, and the command execution status of the fusion intent is displayed on the master bedroom mark, as shown in FIG. 4 lights on and temperature 26°C.
  • the fused intent operation may also include other implementations.
  • the smart home control panel detects that the user drags an intention identifier displayed in the intent identifier column to another intent identifier displayed in the intent identifier column, and may determine the intent corresponding to the fusion of the two intent identifiers.
  • the two intent identifiers may be intent identifiers of separate intents; or, the two intent identifiers may also be intent identifiers of fused intents; or, the two intent identifiers may also be single intent identifiers , another intent ID is the intent ID of the fused intent.
  • the smart home control panel detects that the user presses and holds the intent identifier displayed in the intent identifier column, the intent identifier can be selected. Afterwards, the smart home control panel detects that the user continuously selects multiple intent identifiers, and the smart home control panel fuses the intents corresponding to the multiple intent identifiers continuously selected by the user to obtain the fusion intent.
  • the smart home control panel may split the corresponding fusion intent in response to the user's operation of splitting the fusion intent identification. Thereby, the user's demand for controlling electronic equipment is further satisfied.
  • the central intent identification displayed in the interface 2901 is the fusion intention identification corresponding to the integration of the light-on intention and the constant temperature intention
  • the fusion intention identification includes the intention corresponding to the fusion intention
  • it includes the hot zone 291 for turning on the light and the hot zone 292 for the constant temperature purpose, and the user can intuitively determine the position of each hot zone by fusing the content displayed on the intention mark.
  • the smart home control panel detects that the user presses and holds the constant temperature hot zone 292 and moves away from the fusion intention mark, and determines that the user needs to separate the constant temperature intention from the fusion intention.
  • the smart home control panel displays the constant temperature intent logo in the process of peeling off the fusion intent, which is used to prompt the user to continue dragging to complete the peeling of the constant temperature intent. If the smart home control panel detects that the user keeps dragging the constant temperature hot zone to move away from the fusion intention mark, it can display an interface 2903 as shown in (c) in FIG. 29 . On the interface 2903 , in the intention identification column 295 , the fusion intention identification corresponding to the intention of constant temperature and the intention of turning on the light that has been stripped and fused is no longer displayed.
  • the smart home control panel may instruct the electronic devices in the group that have executed the original fusion intent to cancel the execution of the stripped intent.
  • the smart home control panel responds to the user operation and strips the constant temperature intention from the fusion intention.
  • the smart home control panel may then instruct the thermostat in the master bedroom that has executed the fusion intent to cancel the thermostat intent.
  • the central intent identifier is changed to the intent identifier corresponding to the remaining intent after stripping, and the corresponding intent identifier including the execution intention corresponding to the intent identifier is highlighted.
  • the group ID of the group of electronic equipment such as the master bedroom ID.
  • the smart home control panel can generate and display fusion intention signs of the remaining intentions.
  • the method for determining whether to highlight the corresponding group identifier in the newly generated fused intent identifier can refer to the above-mentioned methods shown in FIG. 26 or FIG. 28A and FIG. 28B , which will not be repeated here.
  • the group control process is described by taking the central intention mark as a bubble-shaped (circular) mark as an example. It can be understood that, the central intent mark may also be displayed in other shapes or sizes, which is not limited in this embodiment of the present application.
  • the central intent identification can also be implemented as an area display, and after the smart home control panel detects the user's operation on the central intention identification area corresponding to the central intent, corresponding group control can also be realized. It can be understood that, the embodiment of the present application also does not limit the shape and size displayed in the central intent identification area.
  • the smart home control panel displays the center intention to turn on the light, such as the light on intention identification area 301 corresponding to the light on intention.
  • a group identification such as a master bedroom identification, a study identification, etc.
  • the smart home control panel detects that the user drags the master bedroom sign 302 to the light-on intention sign area 301 along the direction indicated by the arrow 303, and determines that the user needs to control the electronic device corresponding to the turn-on intention in the master bedroom to activate the light-on function.
  • the smart home control panel can also send the determined device ID and intent identifier to the server in the scenario shown in Figure 30, so as to realize the control of the activation of the electronic device corresponding to the intention to turn on the light in the master bedroom. Turn on the light function.
  • the master bedroom will be displayed in the light-on intention identification area 301. logo, and display the execution status of the command in the logo of the master bedroom, such as turning on 4 lights in the master bedroom.
  • the functions that can be realized by the smart home control panel can also be realized when the central intention is displayed as the central intention identification area.
  • the logos of the electronic devices that activate the light-on function flash sequentially in the master bedroom logo.
  • the smart home control panel determines that the corresponding electronic device in the master bedroom activates the lighting function, it can also sequentially flash the master bedroom logo in the master bedroom logo displayed in the light-on intention logo area 301 .
  • the identification of the electronic device that initiates the function of turning on the light is not limited to the number of electronic devices that initiates the function of turning on the light.
  • the logos of electronic devices that have activated the light-on function in the master bedroom are displayed around the logo of the master bedroom.
  • the smart home control panel may also display the identification of the electronic device in the master bedroom that has activated the light-on function around the master bedroom logo displayed in the light-on intention identification area 301 .
  • the size of the central intent identification area can be adaptively changed according to the display content.
  • the light-on intention mark area 301 displays a preset initial size.
  • the smart home control panel After determining that the sign of the electronic device that has activated the light-on function in the master bedroom needs to be displayed around the mark of the master bedroom, the smart home control panel determines the current The area of the displayed light-on intention logo area 301 is not enough to display the logo to be displayed, and the size of the light-on intention logo area 301 can be automatically enlarged to realize the display of the master bedroom logo and the corresponding start-up lights in the light-on intention logo area 301 Functional electronic device identification.
  • the smart home control panel detects that the user drags out the electronic device logo displayed around the group logo. After the operation of the center intent identification area, it may be determined to cancel the execution center intent of the electronic device corresponding to the electronic device identification.
  • the smart home control panel does not display any logo (such as After a long press operation on the position of the group logo or device logo), the group corresponding to the group logo displayed around the full selection can be determined, and the electronic device in it can be controlled to execute the central intention. Alternatively, it may be determined not to select all the groups corresponding to the group identifiers displayed around, and control the electronic devices therein to cancel the intention of the execution center.
  • the interface 3101 shown in (a) of FIG. 31 after the smart home control panel detects that the user drags the constant temperature logo 311 displayed in the intention logo bar to the operation in the light-on intention logo area 312 , it determines that it is necessary to fuse the thermostat
  • the constant temperature intention corresponding to the identification 311 and the intention to turn on the light correspond to the intention to turn on the light indicated in the region 312 .
  • the interface 3102 shown in (b) in FIG. 31 displays the fusion intention identification area 313 of "turn on the light + constant temperature", and displays in the fusion intention identification area 313 the information of the electronic device including the executable light-on intention and constant temperature intention.
  • the fused intent identification area includes the hotspots corresponding to each fused intent, so that the fused intent can be separated.
  • the fusion intention identification area 313 shown in (b) of FIG. 31 the left half is the hot zone corresponding to the intention of turning on the light, and the right half is the hot zone corresponding to the intention of constant temperature.
  • the smart home control panel displays the central intention identification area, so that the user can determine the execution of the central intention of the group according to the group identification displayed in the central intention identification area, which facilitates the user's group control and improves the user's experience.
  • FIG. 32 is a schematic flowchart of a method for controlling a smart device provided in an embodiment of the present application.
  • This method is applied to a first electronic device, and the first electronic device may be the above-mentioned control device 300 (such as a smart home control panel, a mobile phone), or may be the above-mentioned first electronic device 100 .
  • the method includes the following steps.
  • the first group includes X electronic devices capable of executing the first intent corresponding to the first intent identification, where X is a positive integer.
  • the category attributes and/or location attributes of the X electronic devices are the same.
  • the first intention corresponds to the functions achievable by the electronic device, such as including an intention to turn on a light, an intention to keep a temperature, and the like.
  • the intention mark is a function mark, which can be used to indicate the corresponding achievable function, for example, the light-on intention mark indicates the corresponding light-on function, and the constant temperature mark represents the corresponding constant temperature function.
  • the first intent identifier is displayed in a first area of the first interface, and the first group identifier is displayed in other areas than the first area.
  • the light is intended to identify all or part of area 301 .
  • the first operation includes: moving the first group identifier to the first area.
  • the first electronic device detects that the user drags the master bedroom logo 302 along the direction shown by the arrow 303 to the light-on intention logo area 301 (that is, the first operation of the first area).
  • control the first group identifier to move to the first intent identifier, and instruct X electronic devices to execute the first intent.
  • the first electronic device can determine the device IDs of X electronic devices in the first group that can execute the first intent according to the subsystem configuration file. Then, the first electronic device may control the first group identifier to move to the first intent identifier, and send the device ID and the intent identifier corresponding to the displayed first intent identifier to the server.
  • the server determines the execution actions and execution conditions that need to be performed by the X electronic devices corresponding to the device IDs according to the device ID, the intent identifier, and the intent configuration file.
  • the server generates a signal instruction and sends it to the X electronic devices corresponding to the device ID, so as to instruct the X electronic devices to perform corresponding execution actions, such as turning on a light.
  • the server generates a signal instruction, sends it to the first electronic device, and the first electronic device forwards the signal instruction to the X electronic devices corresponding to the device ID, so as to instruct the X electronic devices to perform corresponding actions, such as turning on the light.
  • the first electronic device such as a smart home control panel
  • the first electronic device detects the user's first operation on the master bedroom logo 172, it determines that the user needs to control the intention of turning on the lights in the master bedroom.
  • the corresponding electronic device activates the function of turning on the light.
  • the first electronic device displays the moving process of the master bedroom logo 172 to the light-on intention logo area 301, and instructs the X electronic devices determined in the master bedroom to execute the light-on intention.
  • the user can realize the group control of the electronic devices through a simple drag operation, which reduces the difficulty of the user's device operation and satisfies the user's multi-device control requirements.
  • the first electronic device may also display prompt information on the first interface, and the prompt information is used to feed back the execution of the first intention by the X electronic devices.
  • the electronic device in the master bedroom will send a feedback signal after turning on the light according to the signal instruction, and the first electronic device will send a feedback signal according to the received feedback signal forwarded by the server or received by the electronic device.
  • the feedback signal to determine whether the signal indication is executed.
  • the first electronic device displays prompt information according to the received feedback signal, such as displaying the execution status of the command in the group logo of the master bedroom, For example, 4 lights in the master bedroom are turned on. The user can intuitively determine the execution status of the command according to the display of the group ID, thereby improving the user experience.
  • the first electronic device receives the user's third operation on the first group identifier, and in response to the third operation, X electronic device identifiers corresponding to the X electronic devices are displayed on the first interface.
  • the third operation may be an operation of clicking the first group logo.
  • the first electronic device detects that the user clicks on the master bedroom logo 191 , and may display an interface 1902 as shown in (b) in FIG. 19 .
  • the first electronic device displays on the interface 1902 the electronic device identification of the electronic device that has executed the intention of turning on the light (ie, the first intention), such as the identification of a table lamp, an identification of a ceiling light, an identification of a spotlight, and an identification of a floor lamp.
  • the first electronic device displays the device identification of the electronic device that executes the first intention among the X electronic devices. For example, among the X electronic devices, M electronic devices execute the first intention successfully, and N If a number of electronic devices fail to execute the first intention, the first electronic device may display the electronic device identifiers of the M electronic devices. That is to say, electronic device identifiers of electronic devices that have not executed or failed to execute the first intention may not be displayed, or may not be highlighted. In this way, the user can determine which electronic devices have executed the first intent and which electronic devices have not executed the first intent.
  • the first electronic device receives a fourth user operation on the electronic device identifier corresponding to the second electronic device among the X electronic device identifiers.
  • the electronic device identification corresponding to the second electronic device is controlled to move out of the first area, and the second electronic device is instructed to cancel the execution of the first intention.
  • the fourth operation may be an operation of dragging the electronic device identifier of the second electronic device out of the first area.
  • canceling the execution intention includes instructing the electronic device to execute a command contrary to the intention, for example, canceling the execution intention of turning on the light is instructing the electronic device to execute turning off the light.
  • the command to cancel the execution intention includes no longer executing the intention, for example, the intention is a constant temperature intention, and canceling the constant temperature intention is to instruct the electronic device to no longer execute the constant temperature intention.
  • the first electronic device detects that the user moves the electronic device identification (for example, the fourth operation of the desk lamp logo 202) can instruct the desk lamp to cancel the intention to turn on the light. While group control is realized in this way, individual control of devices in the group can also be realized to meet user needs.
  • the first interface further displays a second intent mark
  • the first electronic device receives a fifth operation of moving the second intent mark to the first area by the user.
  • Y electronic devices in the first group are instructed to execute the second intent corresponding to the second intent identifier, where Y is a positive integer.
  • the Y electronic devices are identical, different or partially identical to the X electronic devices.
  • the fifth operation may be an operation of dragging the second intent identifier to the first area.
  • the first electronic device such as a smart home control panel
  • displays a second intention mark such as a constant temperature mark
  • detects that the user moves the constant temperature mark 311 to the first area such as The fifth operation of the light-on intention identification area 312
  • the first electronic device can generate a fusion intention of the light-on intention and the constant temperature intention.
  • the electronic device that executes the intent of constant temperature may be an electronic device that has originally executed the intent to turn on the light, or may be an electronic device that has not executed the intent to turn on the light, or may be part of the electronic device that has originally executed the intent to turn on the light.
  • the first electronic device receives the user's sixth operation on the second group identification displayed on the first interface, and the second group identification corresponds to Z electronic devices that can execute the first intention and the second intention.
  • the second group of devices, Z is a positive integer.
  • move the second group identifier to the first area and instruct Z electronic devices to execute the first intention and the second intention.
  • the fourth operation may be an operation of dragging the second group logo to the first area.
  • the first area is used to represent the corresponding area.
  • the first electronic device detects the fourth operation of moving the second intent identifier to the first area, and may determine to instruct Z electronic devices in the second group to execute the fusion intent, that is, to execute the first intent and the second intent. For example, some of the electronic devices in the second group execute the first intent, and some of the electronic devices execute the second intent.
  • the electronic devices that execute the first intent and the electronic devices that execute the second intent may be the same, different, or partially identical. Together they constitute Z electronic devices.
  • the first electronic device receives a seventh user operation on the first area.
  • control the first group identifier and the second group identifier to move out of the first area, and instruct Y electronic devices and Z electronic devices to cancel the execution of the first intention and the second intention.
  • the seventh operation is an operation of long pressing any position in the first area.
  • the first electronic device determines that all electronic devices that have executed the first intention and the second intention cancel the execution of the first intention and the second intention.
  • the first electronic device receives an eighth operation of the user on the second area, and the second area corresponds to the second intention.
  • control the second intention mark to move out of the first area and instruct Y electronic devices to cancel the execution of the second intention.
  • the first area includes a second area, and the second area corresponds to the second intent.
  • the fusion intention identification area 313 is used to indicate the first area, corresponding to the intention of turning on the light and the intention of constant temperature, then the first electronic device is based on the number of intentions included in the fusion intention, such as 2 , divide the first region evenly into hotspots corresponding to the two intents.
  • the area on the left is the hot zone corresponding to the intention of turning on the light (the first intention)
  • the area on the right is the hot zone corresponding to the intention of constant temperature (the second intention).
  • a step of establishing a first group may also be included before the above step S3201.
  • the first electronic device displays a second interface
  • the second interface includes a plurality of electronic device identifiers respectively corresponding to the plurality of electronic devices.
  • a second operation of selecting X electronic device identities from the plurality of electronic device identities is received.
  • a first group including X electronic devices is established.
  • electronic device identifiers corresponding to electronic devices with the same category attribute and/or location attribute among the multiple electronic devices are aggregated and displayed.
  • the first electronic device (such as a mobile phone) displays an interface 802, and multiple electronic device identifiers are displayed on the interface 1101, and the IDs of the electronic devices of the same category attribute among the multiple electronic devices Aggregated display of electronic device identification. It is detected that the user selects the operation of the dishwasher, the steamer and the oven, and these three electronic devices may be divided into a group.
  • the smart device control method provided by the embodiment of the present application has been described in detail above with reference to FIGS. 6-32 .
  • the smart device control device provided by the embodiment of the present application will be described in detail below with reference to FIG. 33 .
  • FIG. 33 is a schematic structural diagram of a first electronic device provided in an embodiment of the present application.
  • the first electronic device 3300 may include: a display unit 3301 , a transceiver unit 3302 and a processing unit 3303 .
  • the first electronic device 3300 as the smart device control device, can be used to implement the functions of the first electronic device 100 or the control device 300 involved in the above method embodiments.
  • the display unit 3301 is configured to support the first electronic device 3300 to display interface content; and/or, support the first electronic device 3300 to execute S3201 and S3203 in FIG. 32 .
  • the transceiving unit 3302 is configured to support the first electronic device 3300 to execute S3202 in FIG. 32 .
  • the processing unit 3303 is configured to support the first electronic device 3300 to execute S3203 in FIG. 32 .
  • the transceiving unit may include a receiving unit and a transmitting unit, may be implemented by a transceiver or a transceiver-related circuit component, and may be a transceiver or a transceiver module.
  • the operations and/or functions of each unit in the first electronic device 3300 are to realize the corresponding flow of the smart device control method described in the above method embodiment, and all the relevant content of each step involved in the above method embodiment can be cited from For the sake of brevity, the description of the functions of the corresponding functional units will not be repeated here.
  • the first electronic device 3300 shown in FIG. 33 may further include a storage unit (not shown in FIG. 33 ), where programs or instructions are stored.
  • a storage unit not shown in FIG. 33
  • programs or instructions are stored.
  • the display unit 3301, the transceiver unit 3302, and the processing unit 3303 execute the program or instruction
  • the first electronic device 3300 shown in FIG. 33 can execute the smart device control method described in the above method embodiments.
  • the technical solution provided in this application may also be a functional unit or chip in the first electronic device, or a device used in conjunction with the first electronic device.
  • the embodiment of the present application also provides a chip system, including: a processor, the processor is coupled with a memory, and the memory is used to store programs or instructions, and when the programs or instructions are executed by the processor, the The system on chip implements the method in any one of the foregoing method embodiments.
  • processors in the chip system there may be one or more processors in the chip system.
  • the processor can be realized by hardware or by software.
  • the processor may be a logic circuit, an integrated circuit, or the like.
  • the processor may be a general-purpose processor implemented by reading software codes stored in a memory.
  • the memory may be integrated with the processor, or may be configured separately from the processor, which is not limited in this embodiment of the present application.
  • the memory can be a non-transitory processor, such as a read-only memory ROM, which can be integrated with the processor on the same chip, or can be respectively arranged on different chips.
  • the arrangement manner of the memory and the processor is not specifically limited.
  • the chip system may be a field programmable gate array (field programmable gate array, FPGA), an application specific integrated chip (AP device application specific integrated circuit, ASIC), or a system on chip (system on chip, SoC ), it can also be a central processing unit (central processor unit, CPU), it can also be a network processor (network processor, NP), it can also be a digital signal processing circuit (digital signal processor, DSP), it can also be a microcontroller (micro controller unit, MCU), can also be a programmable controller (programmable logic device, PLD) or other integrated chips.
  • FPGA field programmable gate array
  • ASIC application specific integrated circuit
  • SoC system on chip
  • CPU central processing unit
  • CPU central processor unit, NP
  • DSP digital signal processing circuit
  • microcontroller micro controller unit, MCU
  • PLD programmable logic device
  • each step in the foregoing method embodiments may be implemented by an integrated logic circuit of hardware in a processor or instructions in the form of software.
  • the method steps disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.
  • the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is run on the computer, the computer is made to perform the above-mentioned related steps, so as to realize the above-mentioned embodiment. Intelligent device control method.
  • An embodiment of the present application further provides a computer program product, which, when running on a computer, causes the computer to execute the above-mentioned related steps, so as to implement the smart device control method in the above-mentioned embodiment.
  • the embodiment of the present application further provides a device.
  • the apparatus may specifically be a component or a module, and the apparatus may include one or more processors and memory associated therewith. Among them, the memory is used to store computer programs. When the computer program is executed by one or more processors, the device is made to execute the smart device control method in the above method embodiments.
  • the apparatus, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding method provided above. Therefore, the beneficial effects that it can achieve can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
  • the steps of the methods or algorithms described in connection with the disclosure of the embodiments of the present application may be implemented in the form of hardware, or may be implemented in the form of a processor executing software instructions.
  • the software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (random access memory, RAM), flash memory, read only memory (read only memory, ROM), erasable programmable read-only memory (erasable programmable ROM, EPROM), electrically erasable programmable read-only memory (electrically EPROM, EEPROM), registers, hard disk, removable hard disk, CD-ROM, or any other form of storage medium known in the art.
  • An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium.
  • the storage medium may also be a component of the processor.
  • the processor and the storage medium may be located in an application specific integrated circuit (AP device application specific integrated circuit, ASIC).
  • the disclosed method may be implemented in other ways.
  • the device embodiments described above are illustrative only.
  • the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored, or not.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of modules or units may be in electrical, mechanical or other forms.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • Computer-readable storage media include but are not limited to any of the following: U disk, mobile hard disk, read-only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk, etc.
  • ROM read-only memory
  • RAM random access memory
  • magnetic disk or optical disk etc.
  • Various media that can store program code include but are not limited to any of the following: U disk, mobile hard disk, read-only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk, etc.
  • Various media that can store program code include but are not limited to any of the following: U disk, mobile hard disk, read-only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种智能设备控制方法及电子设备,该方法包括:显示包括第一意图标识、以及第一群组对应的第一群组标识的第一界面,该第一群组包括可执行第一意图标识对应的第一意图的X个电子设备(S3201);之后接收用户对第一群组标识的第一操作(S3202);控制第一群组标识移向第一意图标识,并指示该X个电子设备执行第一意图(S3203)。该方法能够将设备按照群组进行划分,实现设备的群组控制,简化设备控制流程,提升用户使用体验。

Description

智能设备控制方法及电子设备
本申请要求于2021年11月16日提交国家知识产权局、申请号为202111355520.0、发明名称为“智能设备控制方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及终端技术领域,尤其涉及一种智能设备控制方法及电子设备。
背景技术
随着终端技术的发展,用户拥有的电子设备越来越多。如图1所示的家庭场景,通过物联网技术将家中的各种设备(如音视频设备11、照明系统设备12、环境控制设备13、安防系统设备14等)连接到一起形成智能家居系统,实现设备的集中控制,为用户提供家电控制、照明控制、防盗报警等多种功能。
但是,由于设备数量众多,用户需要一个个进行连接、编排、分组后才能够实现设备控制。并且,用户如需操作多个设备,需要在智能家居系统中反复切换多个界面,分别对多个设备进行操作,用户操作繁琐,耗费时间,且无法一览全屋设备状态。
发明内容
为了解决上述的技术问题,本申请实施例提供了一种智能设备控制方法及电子设备。本申请实施例提供的技术方案,能够将设备按照群组进行划分,实现设备的群组控制,简化设备控制流程,提升用户使用体验。
为了实现上述的技术目的,本申请实施例提供了如下技术方案:
第一方面,提供一种智能设备控制方法,应用于第一电子设备。该方法包括:显示第一界面,第一界面包括第一意图标识、以及第一群组对应的第一群组标识,第一群组包括可执行第一意图标识对应的第一意图的X个电子设备,X为正整数。接收用户对第一群组标识的第一操作。响应于第一操作,控制第一群组标识移向第一意图标识,并指示X个电子设备执行第一意图。
在一些实施例中,第一意图对应于电子设备可实现的功能,如包括开灯意图、恒温意图等。意图标识为功能标识,可用于表示对应的可实现的功能,如开灯意图标识表示对应的开灯功能,恒温意图标识表示对应的恒温功能。
在一些实施例中,第一群组中包括品类属性和/或位置属性相同的多个电子设备,这些电子设备可实现对应的意图。比如,X个电子设备的品类属性和/或位置属性相同。
如此,第一电子设备显示第一意图标识和第一群组标识,可以使用户直观的确定群组以及可控制群组中的电子设备执行的意图。并可通过简单的操作,实现电子设备的群组控制,而不必再一一控制各个电子设备,简化用户操作,提升用户使用体验。
根据第一方面,在显示第一界面之前,方法还包括:显示第二界面,第二界面包括与多个电子设备分别对应的多个电子设备标识。接收从多个电子设备标识中选择X个电子设备标识的第二操作。响应于第二操作,建立包括X个电子设备的第一群组。
在一些实施例中,在实现群组控制之前,第一电子设备可根据用户操作,建立包括多个电子设备的一个或多个群组。如显示多个电子设备标识,根据用户选择设备标 识的第二操作,确定建立群组的电子设备。可选的,第二操作可以为点击选择电子设备标识的操作,也可以为滑动圈出多个电子设备标识的操作。
一些实施例中,第一电子设备可显示可进行群组连接的电子设备,在显示的过程中,接收用户操作,根据用户操作,确定电子设备的分组结果。其中,第一电子设备可以通过设备搜索的方式确定可进行群组连接的电子设备,或者可以通过与服务器的交互,获取服务器中维护的home对应的设备列表,确定可进行群组连接的电子设备。其中,在设备列表中包括设备房间、设备品类等信息。
另一些实施例中,第一电子设备可以为任一具有显示屏以及群组处理能力的电子设备,如第一电子设备具有明确的品类属性和/或位置属性,可自动确认附近具有相同品类属性和/或位置属性的电子设备,提示用户建立群组。其中,品类属性用于表示电子设备的品类。位置属性用于表示电子设备所在的空间,如以房间为粒度划分电子设备所在的空间。
又一些实施例中,用户也可以通过第一电子设备的近场连接功能(如NFC功能),通过碰一碰操作,实现建立电子设备的群组。
比如,第一电子设备检测到用户的碰一碰操作,如碰一碰设备A的NFC标签,获取设备A的设备信息,可广播信息,用于搜索预设距离内与设备A具有相同品类属性的电子设备。那么可显示搜索到的各个电子设备的电子设备标识,根据用户操作,确定建立包括其中全部或部分电子设备的群组。
又比如,在预设时间内用户通过第一电子设备对多个电子设备执行碰一碰操作,第一电子设备可获得对应的多个电子设备的电子设备信息,显示该多个电子设备的电子设备标识。之后,根据用户操作,确定建立包括其中全部或部分电子设备的群组。
如此,用户可以通过简单的操作,实现批量添加设备,建立电子设备群组,降低用户操作难度,提升用户使用体验。
根据第一方面,或者以上第一方面的任意一种实现方式,方法还包括:将多个电子设备中相同品类属性和/或位置属性的电子设备对应的电子设备标识聚集显示。
示例性的,第一电子设备可根据电子设备的品类属性和/或位置属性划分电子设备。如根据品类属性将电子设备划分为厨电类设备、影音类设备、照明类设备等;如根据位置属性将电子设备划分为主卧中的电子设备、厨房中的电子设备、客厅中的电子设备等。这样,第一电子设备可将电子设备标识聚集显示,便于用户快速选择划分为一个群组的电子设备。如第一电子设备将照明类设备的电子设备标识聚集显示,这样用户可直接圈中这部分聚集显示的电子设备标识,确定建立对应的开灯意图对应的群组。
如此,第一电子设备通过聚集显示电子设备标识,便于用户操作,进一步提升群组的建立效率。
根据第一方面,或者以上第一方面的任意一种实现方式,在接收用户对第一群组标识的第一操作之前,第一意图标识显示在第一界面的第一区域,第一群组标识显示在第一区域以外的其他区域;第一操作包括:将第一群组标识移至第一区域。
如此,通过划分意图标识所在区域,便于用户控制操作,用户只需将群组标识靠近第一区域或者移动到第一区域中,第一电子设备可确定用户需要指示该群组标识中的电子设备执行当前第一区域对应的意图。
根据第一方面,或者以上第一方面的任意一种实现方式,方法还包括:接收用户对第一群组标识的第三操作。响应于第三操作,在第一界面显示与X个电子设备分别对应的X个电子设备标识。
可选的,该第三操作可以为点击第一群组标识的操作。
在一些实施例中,第一电子设备可突出显示包括已执行第一意图的第一群组标识,这样用户能够根据群组标识的突出显示,确定电子设备的执行情况。之后,如第一电子设备检测到用户点击第一群组标识的操作,可显示第一群组标识对应的第一群组中已执行第一意图的电子设备的电子设备标识。
比如,第一电子设备响应于第三操作,显示X个电子设备中执行第一意图的电子设备的设备标识,如X个电子设备中,M个电子设备执行第一意图执行成功,N个电子设备执行第一意图执行失败,第一电子设备可显示M个电子设备的电子设备标识。即未执行或执行第一意图失败的电子设备的电子设备标识可不显示,或不突出显示。这样用户可以确定哪些电子设备执行了第一意图,哪些电子设备未执行第一意图。
根据第一方面,或者以上第一方面的任意一种实现方式,在第一界面显示与X个电子设备分别对应的X个电子设备标识后,方法还包括:接收用户对X个电子设备标识中的第二电子设备对应的电子设备标识的第四操作。响应于第四操作,控制第二电子设备对应的电子设备标识移出第一区域,并指示第二电子设备取消执行第一意图。
可选的,该第四操作可以为将第二电子设备的电子设备标识拖动出第一区域的操作。
其中,取消执行意图包括指示电子设备执行与意图相反的命令,比如,取消执行开灯意图为指示电子设备执行关灯。取消执行意图的命令包括不再执行意图,比如,意图为恒温意图,取消恒温意图为指示电子设备不再执行恒温意图。
示例性的,第一电子设备检测到用户向远离第一意图标识的方向移动第二电子设备的电子设备标识的第四操作,可指示第二电子设备取消执行第一意图。
如此,第一电子设备在实现群组控制的同时,也可实现群组中设备的单独控制,满足用户需求。
根据第一方面,或者以上第一方面的任意一种实现方式,X个电子设备的品类属性和/或位置属性相同。
根据第一方面,或者以上第一方面的任意一种实现方式,方法还包括:在第一界面显示提示信息,提示信息用于反馈X个电子设备执行第一意图的情况。
示例性的,第一电子设备指示X个电子设备执行第一意图,X个电子设备在执行第一意图后,会发送反馈信号。那么第一电子设备根据接收到的反馈信号,可确定第一意图是否被执行。可选的,第一电子设备可根据接收到的反馈信号,显示提示信息,如在群组标识中显示命令的执行情况。
如此,用户能够根据群组标识的显示,直观的确定命令的执行情况,提升用户使用体验。
根据第一方面,或者以上第一方面的任意一种实现方式,第一界面还显示有第二意图标识,方法还包括:接收用户将第二意图标识移至第一区域的第五操作。响应于第五操作,指示第一群组中的Y个电子设备执行第二意图标识对应的第二意图,Y为 正整数。
在一些实施例中,第一电子设备和根据用户操作,确定融合意图,该融合意图中可包括至少两个意图。这样,用户如需群组执行两个以上意图时,就不必再一一操作两个意图标识,而是可预先建立包括所需的两个以上意图的融合意图,就可以直接指示群组中的电子设备执行融合意图,简化用户操作。
可选的,第一电子设备在检测到第五操作后,可先确定第一群组中可执行第二意图的电子设备,之后再向这些电子设备发送指示信号,指示执行第二意图。或者,第一电子设备在检测到第五操作后,可直接向第一群组中的电子设备发送指示信号,之后第一电子设备再根据反馈信号确定执行情况。
示例性的,如图31中(a)所示,第一电子设备显示第二意图标识,检测到用户将第二意图标识移至第一区域的第五操作,可生成第一意图和第二意图的融合意图。并且,确定第一意图对应的第一群组中是否存在可执行第二意图的电子设备,如存在,可指示这些可执行第二意图的电子设备执行第二意图。其中,执行第二意图的电子设备可以为原已执行第一意图的电子设备,也可以为未执行过第一意图的电子设备,也可以部分为原已执行第一意图的电子设备。
根据第一方面,或者以上第一方面的任意一种实现方式,在接收第五操作之后,方法还包括:接收用户对第一界面中显示的第二群组标识的第六操作,第二群组标识对应于包括可执行第一意图和第二意图的Z个电子设备的第二群组,Z为正整数。响应于第六操作,将第二群组标识移至第一区域,并指示Z个电子设备执行第一意图和第二意图。
在一些实施例中,第一电子设备可显示意图对应的多个群组的群组标识,用户可根据需求选择其中的部分或全部群组,确定指示其中的电子设备执行该意图。
如此,用户通过简单的操作,即可确定可执行意图的群组,便于用户实现电子设备的群组控制。
根据第一方面,或者以上第一方面的任意一种实现方式,方法还包括:接收用户对第一区域的第七操作。响应于第七操作,控制第一群组标识和第二群组标识移出第一区域,并指示Y个电子设备和Z个电子设备取消执行第一意图和第二意图。
示例性的,第七操作为长按第一区域中任意位置的操作。第一电子设备检测到用户的第七操作后,确定指示已执行第一意图和第二意图的全部电子设备取消执行第一意图和第二意图。
又示例性的,第一电子设备检测到用户长按第一区域中任意位置的操作,也可指示当前显示的全部群组标识中的电子设备执行当前第一区域对应的意图。
如此,用户通过简单的操作,可实现指示更多群组执行意图或取消执行意图,进一步降低用户操作难度。
根据第一方面,或者以上第一方面的任意一种实现方式,方法还包括:接收用户对第二区域的第八操作,第二区域对应于第二意图。响应于第八操作,控制第二意图标识移出第一区域,并指示Y个电子设备取消执行第二意图。
示例性的,第一区域包括第二区域,第二区域对应于第二意图。比如,融合意图包括M个意图,那么第一电子设备可将第一区域平均划分为对应于M个意图的热区, 每一热区对应于一个意图。第一电子设备确定用户在某一热区上的八操作,可将该热区对应的意图从融合意图中移除,并指示当前执行融合意图的电子设备取消执行该移除的意图。
比如,将第一意图和第二意图这两个意图融合,那么第二区域可为位于第一区域中左侧的区域,或者可为位于第一区域中位于右侧的区域。
如此,第一电子设备可根据用户的需求创建融合意图,也可根据用户需求拆分融合意图,进一步提升用户的使用体验。
根据第一方面,或者以上第一方面的任意一种实现方式,第三操作为点击操作。第四操作、第五操作、第六操作、第八操作为拖动操作。第七操作为长按操作。
第二方面,提供一种电子设备。该电子设备包括:处理器、存储器和显示屏,所述存储器与所述处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,当所述处理器从所述存储器中读取所述计算机指令,使得所述电子设备执行如下操作:显示第一界面,第一界面包括第一意图标识、以及第一群组对应的第一群组标识,第一群组包括可执行第一意图标识对应的第一意图的X个电子设备,X为正整数。接收用户对第一群组标识的第一操作。响应于第一操作,控制第一群组标识移向第一意图标识,并指示X个电子设备执行第一意图。
根据第二方面,当所述处理器从所述存储器中读取所述计算机指令,还使得所述电子设备执行如下操作:显示第二界面,第二界面包括与多个电子设备分别对应的多个电子设备标识。接收从多个电子设备标识中选择X个电子设备标识的第二操作。响应于第二操作,建立包括X个电子设备的第一群组。
根据第二方面,或者以上第二方面的任意一种实现方式,当所述处理器从所述存储器中读取所述计算机指令,还使得所述电子设备执行如下操作:将多个电子设备中相同品类属性和/或位置属性的电子设备对应的电子设备标识聚集显示。
根据第二方面,或者以上第二方面的任意一种实现方式,在接收用户对第一群组标识的第一操作之前,第一意图标识显示在第一界面的第一区域,第一群组标识显示在第一区域以外的其他区域;第一操作包括:将第一群组标识移至第一区域。
根据第二方面,或者以上第二方面的任意一种实现方式,当所述处理器从所述存储器中读取所述计算机指令,还使得所述电子设备执行如下操作:接收用户对第一群组标识的第三操作。响应于第三操作,在第一界面显示与X个电子设备分别对应的X个电子设备标识。
根据第二方面,或者以上第二方面的任意一种实现方式,当所述处理器从所述存储器中读取所述计算机指令,还使得所述电子设备执行如下操作:接收用户对X个电子设备标识中的第二电子设备对应的电子设备标识的第四操作。响应于第四操作,控制第二电子设备对应的电子设备标识移出第一区域,并指示第二电子设备取消执行第一意图。
根据第二方面,或者以上第二方面的任意一种实现方式,X个电子设备的品类属性和/或位置属性相同。
根据第二方面,或者以上第二方面的任意一种实现方式,当所述处理器从所述存储器中读取所述计算机指令,还使得所述电子设备执行如下操作:在第一界面显示提 示信息,提示信息用于反馈X个电子设备执行第一意图的情况。
根据第二方面,或者以上第二方面的任意一种实现方式,第一界面还显示有第二意图标识,当所述处理器从所述存储器中读取所述计算机指令,还使得所述电子设备执行如下操作:接收用户将第二意图标识移至第一区域的第五操作。响应于第五操作,指示第一群组中的Y个电子设备执行第二意图标识对应的第二意图,Y为正整数。
根据第二方面,或者以上第二方面的任意一种实现方式,当所述处理器从所述存储器中读取所述计算机指令,还使得所述电子设备执行如下操作:接收用户对第一界面中显示的第二群组标识的第六操作,第二群组标识对应于包括可执行第一意图和第二意图的Z个电子设备的第二群组,Z为正整数。响应于第六操作,将第二群组标识移至第一区域,并指示Z个电子设备执行第一意图和第二意图。
根据第二方面,或者以上第二方面的任意一种实现方式,当所述处理器从所述存储器中读取所述计算机指令,还使得所述电子设备执行如下操作:接收用户对第一区域的第七操作。响应于第七操作,控制第一群组标识和第二群组标识移出第一区域,并指示Y个电子设备和Z个电子设备取消执行第一意图和第二意图。
根据第二方面,或者以上第二方面的任意一种实现方式,当所述处理器从所述存储器中读取所述计算机指令,还使得所述电子设备执行如下操作:接收用户对第二区域的第八操作,第二区域对应于第二意图。响应于第八操作,控制第二意图标识移出第一区域,并指示Y个电子设备取消执行第二意图。
根据第二方面,或者以上第二方面的任意一种实现方式,第三操作为点击操作。第四操作、第五操作、第六操作、第八操作为拖动操作。第七操作为长按操作。
第二方面以及第二方面中任意一种实现方式所对应的技术效果,可参见上述第一方面及第一方面中任意一种实现方式所对应的技术效果,此处不再赘述。
第三方面,本申请实施例提供一种电子设备,该电子设备具有实现如上述第一方面及其中任一种可能的实现方式中所述的智能设备控制方法的功能。该功能可以通过硬件实现,也可以通过硬件执行相应地软件实现。该硬件或软件包括一个或多个与上述功能相对应的模块。
第三方面以及第三方面中任意一种实现方式所对应的技术效果,可参见上述第一方面及第一方面中任意一种实现方式所对应的技术效果,此处不再赘述。
第四方面,提供一种计算机可读存储介质。计算机可读存储介质存储有计算机程序(也可称为指令或代码),当该计算机程序被电子设备执行时,使得电子设备执行第一方面或第一方面中任意一种实施方式的方法。
第四方面以及第四方面中任意一种实现方式所对应的技术效果,可参见上述第一方面及第一方面中任意一种实现方式所对应的技术效果,此处不再赘述。
第五方面,本申请实施例提供一种计算机程序产品,当计算机程序产品在电子设备上运行时,使得电子设备执行第一方面或第一方面中任意一种实施方式的方法。
第五方面以及第五方面中任意一种实现方式所对应的技术效果,可参见上述第一方面及第一方面中任意一种实现方式所对应的技术效果,此处不再赘述。
第六方面,本申请实施例提供一种电路系统,电路系统包括处理电路,处理电路被配置为执行第一方面或第一方面中任意一种实施方式的方法。
第六方面以及第六方面中任意一种实现方式所对应的技术效果,可参见上述第一方面及第一方面中任意一种实现方式所对应的技术效果,此处不再赘述。
第七方面,本申请实施例提供一种芯片系统,包括至少一个处理器和至少一个接口电路,至少一个接口电路用于执行收发功能,并将指令发送给至少一个处理器,当至少一个处理器执行指令时,至少一个处理器执行第一方面或第一方面中任意一种实施方式的方法。
第七方面以及第七方面中任意一种实现方式所对应的技术效果,可参见上述第一方面及第一方面中任意一种实现方式所对应的技术效果,此处不再赘述。
附图说明
图1为本申请实施例提供的家庭场景示意图;
图2为本申请实施例提供的界面示意图一;
图3为本申请实施例提供的界面示意图二;
图4A为本申请实施例提供的系统架构示意图一;
图4B为本申请实施例提供的系统架构示意图二;
图5A为本申请实施例提供的第一电子设备的硬件结构示意图;
图5B为本申请实施例提供的通信设备的硬件结构示意图;
图6为本申请实施例提供的界面示意图三;
图7为本申请实施例提供的界面示意图四;
图8为本申请实施例提供的界面示意图五;
图9为本申请实施例提供的界面示意图六;
图10为本申请实施例提供的界面示意图七;
图11为本申请实施例提供的界面示意图八;
图12为本申请实施例提供的界面示意图九;
图13A为本申请实施例提供的群组划分场景示意图一;
图13B为本申请实施例提供的界面示意图十;
图14A为本申请实施例提供的群组划分场景示意图二;
图14B为本申请实施例提供的群组划分场景示意图三;
图14C为本申请实施例提供的群组划分场景示意图四;
图15为本申请实施例提供的界面示意图十一;
图16为本申请实施例提供的界面示意图十二;
图17为本申请实施例提供的界面示意图十三;
图18为本申请实施例提供的界面示意图十四;
图19为本申请实施例提供的界面示意图十五;
图20A为本申请实施例提供的界面示意图十六;
图20B为本申请实施例提供的界面示意图十七;
图21为本申请实施例提供的界面示意图十八;
图22为本申请实施例提供的界面示意图十九;
图23为本申请实施例提供的界面示意图二十;
图24为本申请实施例提供的界面示意图二十一;
图25为本申请实施例提供的界面示意图二十二;
图26为本申请实施例提供的界面示意图二十三;
图27为本申请实施例提供的界面示意图二十四;
图28A为本申请实施例提供的界面示意图二十五;
图28B为本申请实施例提供的界面示意图二十六;
图29为本申请实施例提供的界面示意图二十七;
图30为本申请实施例提供的界面示意图二十八;
图31为本申请实施例提供的界面示意图二十九;
图32为本申请实施例提供的智能设备控制方法流程图;
图33为本申请实施例提供的第一电子设备的结构示意图。
具体实施方式
下面结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。其中,在本申请实施例的描述中,以下实施例中所使用的术语只是为了描述特定实施例的目的,而并非旨在作为对本申请的限制。如在本申请的说明书和所附权利要求书中所使用的那样,单数表达形式“一个”、“一种”、“所述”、“上述”、“该”和“这一”旨在包括例如“一个或多个”这种表达形式,除非其上下文中明确地有相反指示。还应当理解,在本申请以下各实施例中,“至少一个”、“一个或多个”是指一个或两个以上(包含两个)。
在本说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此,在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例,而是意味着“一个或多个但不是所有的实施例”,除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”,除非是以其他方式另外特别强调。术语“连接”包括直接连接和间接连接,除非另外说明。“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。
在本申请实施例中,“示例性地”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性地”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。确切而言,使用“示例性地”或者“例如”等词旨在以具体方式呈现相关概念。
在一些场景中,各种各样的电子设备已经进入人们的生活,针对电子设备家庭使用场景提出智能家居系统的概念,以住宅为平台,利用物联网、自动控制等技术,智能家居系统实现将与家居生活有关的各个电子设备、应用子系统有机的结合在一起。其中,智能家居系统中的电子设备例如为智能家居设备。智能家居设备为智能设备,如包括音视频设备(如大屏设备、蓝牙音箱等)、照明设备(如顶灯、台灯、射灯等)、环境控制设备(如空调、空气净化器等)、防盗报警设备(如人体传感器、摄像头等)等。
示例性的,假设空调作为智能家居设备,与手机连接,空调可以接收用户通过手机发送的控制命令。例如,空调接收用户通过手机输入的“打开”的命令,可自动启动。又例如,空调接收用户通过手机输入的“调节温度至26℃”的命令,可自动调节 温度至26℃。可选的,电子设备(如手机)中安装有智能家居应用(如智慧生活应用),通过智能家居应用与智能家居设备配对,管理和控制智能家居设备。
但是,如需实现上述智能家居设备的控制,电子设备需要预先与智能家居设备建立连接,并对智能家居设备进行配置。
示例性的,假设手机中安装有智慧生活应用,手机启动智慧生活应用,显示如图2中(a)所示的场景界面201。手机检测到用户点击添加控件21的操作后,显示如图2中(b)所示界面202,接收用户创建场景的操作,如接收用户添加控制智能家居设备的条件和需要智能家居设备执行的任务的操作。手机检测到用户点击添加任务控件22的操作后,显示如图2中(c)所示界面203。在界面203上,手机检测到用户点击智能设备控件23的操作后,确定用户需要添加控制智能设备的任务,可显示可控制的智能设备供用户选择。假设用户选择的智能设备为空调,则如图2中(d)所示界面204中附图标记24所示,手机可以显示用户选择的空调对应的执行任务。如附图标记25所示,当前控制空调的触发条件默认为“点击场景卡片时”。手机检测到用户点击附图标记25所示控件的操作后,可根据用户操作修改控制空调的触发条件;或者,如图2中(b)所示界面202,手机检测到用户点击添加条件控件26的操作后,也可以接收用户输入的触发条件。之后,如图2中(d)所示界面204,手机检测到用户点击确认控件27的操作后,确认用户当前场景创建完成。之后,手机显示如图2中(e)所示界面205,如通过场景卡片28提示用户场景创建成功。
可以看出,如需实现对智能设备的控制需要预先对各个智能设备进行编排。但是,如图2所述的场景编辑过程,场景编辑过程复杂,用户操作难度较大。并且,如用户需要添加或删除场景中的部分设备时,同样需要复杂的编辑过程,影响用户使用体验。
在另一些实施例中,电子设备配置有超级终端功能,超级终端功能用于实现设备间的联动和控制。比如,电子设备通过超级终端功能,可以与附近的其他电子设备(如手机、平板、音箱等智能设备)建立连接,实现数据的传输,将显示内容发送到其他电子设备显示。但是,超级终端功能只能实现启动超级终端的电子设备与其他电子设备的联动,而不能实现任意电子设备间的联动。
示例性的,假设手机配置有超级终端功能。如图3中(a)所示界面301,手机显示下拉菜单,检测到用户点击连接控件31的操作后,确定用户指示手机与附近的电子设备建立连接。手机显示如图3中(b)所示界面302,在界面302上显示手机附近可连接的电子设备。手机检测到用户向手机图标32拖拽图标33的操作后,确定需要将图标33对应的华为智慧屏与手机建立连接。如图3中(c)所示界面303,手机通过附图标记34所示图标提示用户华为智慧屏正在与手机建立连接。在连接建立成功后,手机可以响应于用户操作,将正在播放的视频发送到华为智慧屏播放。之后,用户如需再添加其他电子设备与手机建立连接,需要再重复上述操作。比如,如图3中(c)所示界面303,手机检测到用户向手机图标32拖拽图标35的操作后,确定需要将图标35对应的华为智慧屏与手机建立连接。如图3中(d)所示界面304,手机通过附图标记36所示图标提示用户华为智慧屏正在与手机建立连接。
可以看出,在超级终端场景中,配置有超级终端功能的电子设备为中心设备,各个电子设备只能与该中心电子设备建立连接,进行联动,而各个电子设备之间不能直 接建立连接,限制其他应用场景的实现。并且,如需手机与多个电子设备建立连接,需要用户一一拖动多个电子设备,操作繁琐。那么相应的,手机与其他电子设备的联动过程依旧需要用户一一配置,用户操作难度较大,影响用户使用体验。
由此,本申请实施例提供一种智能设备控制方法,可以将电子设备进行群组划分。根据群组划分结果,实现群组连接和控制,有效降低用户操作难度,提升用户使用体验。
图4A为本申请实施例提供的一种系统架构示意图。如图4A中所示,该系统架构包括第一电子设备100,服务器200和控制设备300。
可选的,第一电子设备100例如可以为音箱101、大屏设备102、台灯103、电灯104、摄像头105、空气净化器106、手机、平板电脑、个人计算机(personal computer,PC)、个人数字助理(personal digital assistant,PDA)、上网本、可穿戴电子设备、人工智能(artificial intelligence)终端等终端设备,本申请对该电子设备的具体形式不做特殊限制。第一电子设备100安装的操作系统包括但不限于
Figure PCTCN2022127999-appb-000001
Figure PCTCN2022127999-appb-000002
或者其它操作系统。第一电子设备100也可以不安装有操作系统。在一些实施例中,第一电子设备100可以为固定式设备,也可以为便携式设备。本申请对第一电子设备100的具体类型、有无安装操作系统、在有安装操作系统下所安装的操作系统均不作限制。
在一些实施例中,第一电子设备100可以为智能家居设备,各个第一电子设备100之间可建立连接,组成智能家居系统。第一电子设备100能够与服务器200建立连接,由服务器200管理各个第一电子设备100。比如,服务器200以家庭(home)为单位,管理一个或多个home包括的一个或多个第一电子设备100,第一电子设备100在请求加入智能家居系统的配网过程中,服务器200将第一电子设备100加入到对应的home。
可选的,服务器200可以是云服务器或者网络服务器等具有计算功能的设备或网络设备。服务器200可以是一台服务器,也可以是由多台服务器组成的服务器集群,或者是一个云计算服务中心。服务器200也可以描述为智能家居云平台,用于管理智能家居系统中包含的智能家居设备等。
可选的,如图4A所示,系统架构中还可以包括控制设备300。控制设备300可与一个或多个第一电子设备100连接,用于管理和控制第一电子设备100。
可选的,控制设备300可以为控制智能家居设备的专用设备,或者为包括控制智能家居设备功能的设备。例如,控制设备300可以为智能家居控制面板302,或者为手机301、平板、智能音响、智能手表等终端设备。其中,智能家居控制面板302为用于控制智能家居系统中的智能家居设备的专用设备。在一些实施例中,控制设备300可以为固定式设备,也可以为便携式设备。本申请对控制设备300的具体形式不做特殊限制。
在一些实施例中,控制设备300与一个或多个第一电子设备100连接,获得第一电子设备100的设备信息。控制设备300提供人机交互界面,通过人机交互界面为用户显示第一电子设备100的设备信息,以及接收用户对第一电子设备100设备的控制命令。
在一些实施例中,控制设备300中安装有第一应用。其中,第一应用为能够与智 能家居设备连接,对智能家居设备进行编辑以及管理的智能家居应用。如图4A所示,控制设备300通过第一应用连接一个或多个第一电子设备100。可选的,第一应用为智慧生活应用。
在一些实施例中,控制设备300在启动第一应用的过程中,检测到用户添加设备的操作,搜索附近的第一电子设备100,对搜索到的第一电子设备100进行配网。在配网流程中,控制设备300将局域网的网络信息(如网络名称和密码)发送至第一电子设备100,协助第一电子设备100加入与控制设备300相同的局域网中,第一电子设备100可与控制设备300建立无线通信连接。并且,控制设备300将第一电子设备100的设备信息发送至服务器200,使得服务器200将第一电子设备100加入到相应的home中,并为第一电子设备100分配设备身份标识(identity document,ID)。那么,后续服务器200能够统一管理home中包括的第一电子设备100。
比如,控制设备300接收用户输入的启动某第一电子设备的命令,将该命令转发至服务器200处理。服务器200分析该命令,确定目标第一电子设备,将命令下发至目标第一电子设备,以启动目标第一电子设备。
需要说明的是,上述示例以控制设备300启动第一应用的过程中,触发第一电子设备100加入home为例,对将第一电子设备100添加到相应的home的过程进行说明。可以理解的是,触发第一电子设备100加入home的方法还可以包括其他方法。比如,若控制设备300在开机启动后,暂未启动第一应用,也可自动搜索附近未接入局域网络和/或未加入home的第一电子设备100,根据用户操作,将这些第一电子设备100中的部分或全部设备接入局域网并加入到对应的home。对此本申请实施例不做具体限制。
在一些实施例中,如图4B所示,上述系统架构中也可以不包括控制设备300。第一电子设备100加入到服务器200管理的home中,服务器200能够直接获取到home中全部的第一电子设备100的信息。那么后续,第一电子设备100中的任一具有处理能力的电子设备可以按需向服务器200发送请求,获取到其他第一电子设备100的信息。之后,该电子设备作为主设备,可以用于控制其他第一电子设备100。
比如,第一电子设备100包括油烟机,油烟机可以根据用户操作,搜索附近同品类的设备。可向服务器200发送设备搜索请求,获取该抽油烟机所在的home中包括的全部设备信息,进而确定其中包括的相同品类的设备的信息;或者,抽油烟机根据搜索到的位于预设范围内的设备的信息,以及从服务器200获取到的设备信息,在搜索到的位于预设范围内的设备中确定相同品类的设备。进而抽油烟机确定与这些相同品类的设备建立群组(如建立的群组为群组A),并将群组信息上报到服务器200。之后,用户能够通过群组A中的任一设备控制群组A中的其他设备,如同时启动群组A中的全部设备等;或者,用户还可以通过home中的任一设备控制其他群组中的设备,如通过群组A中的设备A(如油烟机)获取home中其他设备的信息,进而通过设备A控制设备B启动(设备B为群组B中的设备),或通过设备A控制群组B中的全部设备启动。从而用户能够通过群组的方式,配置和控制部分设备,而不必再一一配置、操作各个设备,降低用户操作难度。其中,设备品类中的一个分类即用于表示一种消费者的需求,例如包括厨电类设备、影音类设备、照明类设备等。
示例性的,图5A示出了第一电子设备100的一种结构示意图。
第一电子设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。
可以理解的是,本申请实施例示意的结构并不构成对第一电子设备100的具体限定。在本申请另一些实施例中,第一电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
I2C接口是一种双向同步串行总线,包括一根串行数据线(serial data line,SDA)和一根串行时钟线(derail clock line,SCL)。在一些实施例中,处理器110可以包含多组I2C总线。处理器110可以通过不同的I2C总线接口分别耦合触摸传感器,充电器,闪光灯,摄像头193等。例如:处理器110可以通过I2C接口耦合触摸传感器,使处理器110与触摸传感器通过I2C总线接口通信,实现第一电子设备100的触摸功能。
MIPI接口可以被用于连接处理器110与显示屏194,摄像头193等外围器件。MIPI接口包括摄像头串行接口(camera serial interface,CSI),显示屏串行接口(display serial interface,DSI)等。在一些实施例中,处理器110和摄像头193通过CSI接口通信,实现第一电子设备100的拍摄功能。处理器110和显示屏194通过DSI接口通信,实现第一电子设备100的显示功能。
USB接口130是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口130可以用于连接充电器为第一电子设备100充电,也可以用于第一电子设备100与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如AR设备等。
可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对第一电子设备100的结构限定。在本申请另一些实施例中,第一电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过第一电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
第一电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。第一电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在第一电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在第一电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,第一电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得第一电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
在一些实施例中,第一电子设备100通过移动通信模块150或无线通信模块160和服务器200、控制设备300或其他第一电子设备100通信,实现群组内的第一电子设备100的统一控制。
比如,将设备1、设备2和设备3划分为同一群组,那么设备1、设备2和设备3中的任一设备可以通过与服务器200的交互,实现同时控制这三个设备。或者,控制设备300可以通过与服务器200的交互,实现同时控制设备1、设备2和设备3。
第一电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),例如采用有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Mini-led,Micro-led,Micro-oled,量子点发光二极管(quantum dot light emitting diodes,QLED)等生产制造。在一些实施例中,第一电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。
在一些实施例中,第一电子设备100可以从服务器200获取到全屋设备信息,并在显示屏194上进行显示,使得用户可以一览全屋设备情况。并且,用户可以根据全 屋设备情况,在显示屏194以群组为单位,统一控制群组中的设备。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,第一电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展第一电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储第一电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器110通过运行存储在内部存储器121的指令,和/或存储在设置于处理器中的存储器的指令,执行第一电子设备100的各种功能应用以及数据处理。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。第一电子设备100可以通过音频模块170,例如音乐播放,录音等。音频模块170可以包括扬声器,受话器,麦克风,耳机接口,以及应用处理器等实现音频功能。
传感器模块180可以包括压力传感器,陀螺仪传感器,气压传感器,磁传感器,加速度传感器,距离传感器,接近光传感器,指纹传感器,温度传感器,触摸传感器,环境光传感器,骨传导传感器等。
压力传感器用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器可以设置于显示屏194。压力传感器的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器,电极之间的电容改变。第一电子设备100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏,第一电子设备100根据压力传感器检测所述触摸操作强度。第一电子设备100也可以根据压力传感器的检测信号计算触摸的位置。在一些实施例中,作用于相同触摸位置,但不同触摸操作强度的触摸操作,可以对应不同的操作指令。例如:当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时,执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时,执行新建短消息的指令。
触摸传感器,也称“触控器件”。触摸传感器可以设置于显示屏194,由触摸传感器与显示屏194组成触摸屏,也称“触控屏”。触摸传感器用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器也可以设置于第一电子设备100的表面,与显示屏194所处的位置不同。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。第一电子设备100可以接收按键输入,产生与第一电子设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195,或从SIM卡接口195拔出,实现和第一电子设备100的接触和分离。第一电子设备100可以支持1个或N个SIM卡接口,N为大于1的正整数。
可选的,本申请实施例中的服务器200、控制设备300可以通过不同的设备实现。例如,本申请实施例中的服务器200、控制设备300可通过图5B中的通信设备来实现。图5B所示为本申请实施例提供的通信设备的硬件结构示意图。该通信设备包括至少一个处理器501,通信线路502,存储器503以及至少一个通信接口504。其中,存储器503还可以包括于处理器501中。
可以理解的是,本申请实施例示意的结构并不构成对通信设备的具体限定。在本申请另一些实施例中,通信设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。比如,通信设备为控制设备300,控制设备300为手机,那么控制设备300还可以配置有SIM卡接口、摄像头、音频模块等模块。
处理器501可以是一个通用中央处理器(central processing unit,CPU),微处理器,特定应用集成电路(application-specific integrated circuit,ASIC),或一个或多个用于控制本申请方案程序执行的集成电路。
通信线路502可包括一通路,在上述组件之间传送信息。
通信接口504,用于与其他设备通信。在本申请实施例中,通信接口可以是模块、电路、总线、接口、收发器或者其它能实现通信功能的装置,用于与其他设备通信。可选的,当通信接口是收发器时,该收发器可以为独立设置的发送器,该发送器可用于向其他设备发送信息,该收发器也可以为独立设置的接收器,用于从其他设备接收信息。该收发器也可以是将发送、接收信息功能集成在一起的部件,本申请实施例对收发器的具体实现不做限制。
存储器503可以是只读存储器(read-only memory,ROM)或可存储静态信息和指令的其他类型的静态存储设备,随机存取存储器(random access memory,RAM)或者可存储信息和指令的其他类型的动态存储设备,也可以是电可擦可编程只读存储器(electrically erasable programmable read-only memory,EEPROM)、只读光盘(compact disc read-only memory,CD-ROM)或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,但不限于此。存储器可以是独立存在,通过通信线路502与处理器相连接。存储器也可以和处理器集成在一起。
其中,存储器503用于存储用于实现本申请方案的计算机执行指令,并由处理器501来控制执行。处理器501用于执行存储器503中存储的计算机执行指令,从而实现本申请下述实施例提供的载波发送方法。
可选的,本申请实施例中的计算机执行指令也可以称之为应用程序代码、指令、计算机程序或者其它名称,本申请实施例对此不作具体限定。
在具体实现中,作为一种实施例,处理器501可以包括一个或多个CPU,例如图5B中的CPU0和CPU1。
在具体实现中,作为一种实施例,通信设备可以包括多个处理器,例如图5B中的处理器501和处理器507。这些处理器中的每一个可以是一个单核(single-CPU)处理器,也可以是一个多核(multi-CPU)处理器。这里的处理器可以指一个或多个设备、电路、和/或用于处理数据(例如计算机程序指令)的处理核。
在具体实现中,作为一种实施例,通信设备还可以包括输出设备505和输入设备506。输出设备505和处理器501通信,可以以多种方式来显示信息。例如,输出设备505可以是液晶显示器(liquid crystal display,LCD),发光二级管(light emitting diode,LED)显示设备,阴极射线管(cathode ray tube,CRT)显示设备,或投影仪(projector)等。输入设备506和处理器501通信,可以以多种方式接收用户的输入。例如,输入设备506可以是鼠标、键盘、触摸屏设备或传感设备等。
上述的通信设备可以是一个通用设备或者是一个专用设备,本申请实施例不限定通信设备的类型。比如,通信设备为智能家居控制面板,为用于控制智能家居设备的专用设备。又比如,通信设备为手机,为可以控制智能家居设备的通用设备。
以下以控制设备300为手机或智能设备控制面板,以管理智能家居设备的应用为智慧生活应用为例,对申请实施例提供的智能设备控制方法进行说明。
在一些实施例中,电子设备接入局域网后,能够发现接入同一个局域网和/或登录同一个账户的其他电子设备,对这些电子设备进行群组划分。那么后续,可以以划分后的群组为单位,根据用户需求实现群组控制。其中,账户用于表示电子设备在服务器注册过程中登录的智能家居设备管理系统的账户。
比如,用户注册智慧生活应用,获得账户的用户名和密码。后续用户在新的电子设备配网过程中,通过其他已配网过的电子设备(如手机)登录该账户,协助新的电子设备进行配网。那么,服务器将同一账户下的电子设备划分至同一个home,实现以home为单位的电子设备管理。可选的,服务器管理一个或多个home,home中包括一 个或多个群组。一个home为一个大的群组,包括用户添加的全部电子设备。
具体的,以手机为例,手机在智慧生活应用中登录后,检测到用户添加电子设备的操作后,向服务器发送新添加的电子设备的设备信息,服务器确定电子设备ID,并将电子设备划分到手机当前登录账号对应的home中,完成该电子设备的配网。或者,智能家居控制面板响应于用户操作,向服务器发送新添加的电子设备的设备信息,服务器确定电子设备ID,并将电子设备划分到智能家居控制面板对应的home中。可选的,智能家居控制面板也可以登录多个账户,那么同样的服务器根据账户划分home。
示例性的,手机可以通过超级终端功能进行电子设备的连接管理。如图6中(a)所示界面601,手机显示下拉菜单,在下拉菜单中显示有超级终端卡片61。手机检测到用户点击超级终端卡片61上显示的连接控件62的操作后,确定用户需要对附近的设备进行连接管理,显示如图6中(b)所示界面602。在界面602上,显示手机搜索到的可进行群组连接的电子设备的图标。比如,界面602上显示的中心图标为手机图标63,在手机图标周围根据电子设备与手机的位置关系显示附近的电子设备的图标,如洗碗机图标64、蒸箱图标65、烤箱图标66等。
又示例性的,手机可以通过智慧生活应用进行电子设备的连接管理。如图7中(a)所示界面701,手机显示智慧生活应用。手机检测到用户点击添加控件71的操作后,显示如图7中(b)所示界面702。检测到用户点击菜单栏72中显示的添加设备控件73的操作后,确定用户需要添加电子设备至智慧生活应用,显示如图7中(c)所示界面703。在界面703上显示手机附近可进行群组连接的电子设备。
如下介绍建立群组连接的具体实现方法。建立群组连接的方法例如包括控制设备300显示可进行群组连接的第一电子设备100的过程中,根据用户操作,将用户选择的第一电子设备100建立群组连接。或者,根据第一电子设备100的品类属性和/或位置属性,建立群组连接。或者,利用第一电子设备100的NFC功能,通过用户的碰一碰操作,建立多个第一电子设备100的群组连接。如下对各个方法进行详细介绍。
在一些实施例中,手机在显示可进行群组连接的电子设备的过程中,接收用户操作,根据用户操作,确定电子设备的分组结果。其中,手机可以通过设备搜索的方式确定可进行群组连接的电子设备,或者可以通过与服务器的交互,获取服务器中维护的home对应的设备列表,确定可进行群组连接的电子设备。其中,在设备列表中包括设备房间、设备品类等信息。
示例性的,如图8中(a)所示界面801,手机显示位于同一个局域网和/或登录同一个账户的电子设备的图标,用户可以将其中的部分或全部设备划分为一个群组,以及划分一个或多个群组。一般的,用户会将位于一定区域内的电子设备划分为一个群组,或者会将同一品类的电子设备划分为一个群组,以便于进行群组控制。比如,将同一个房间的电子设备划分为一个群组,那么用户可以同时启动该房间内的全部电子设备,如打开卧室的全部电灯。又比如,将同一品类的电子设备划分为一个群组,那么用户可以同时启动相同品类的全部电子设备,如打开家中的全部照明设备。那么,为了便于用户操作,如界面801所示,在手机图标81附近显示按照地理位置关系分区聚集的电子设备的图标。比如,投影仪、音箱、电视都位于客厅,可以聚集显示对应的图标。又比如,洗碗机、蒸箱、烤箱都位于厨房,可以聚集显示对应的图标。又或 者,如界面801所示,在手机图标81附近显示按照设备品类分区聚集的电子设备的图标。比如,投影仪、音箱、电视都属于影音类电子设备,可以聚集显示对应的图标;洗碗机、蒸箱、烤箱都属于厨电类电子设备,可以聚集显示对应的图标;智能门锁属于安全类电子设备,单独显示对应的图标。
之后,如图8中(b)所示界面802,手机检测到用户在显示屏上的选择操作,将用户选中的电子设备划分至一个群组。比如,如界面802所示,手机检测到用户在显示屏上滑动圈中多个电子设备的操作;或者,手机检测到用户连续点击多个电子设备的操作。手机显示如图8中(c)所示界面803,在界面803上,如附图标记82所示,手机将用户选中的电子设备的图标突出显示,以提示用户确认选择的电子设备是否正确。比如,手机检测到用户长按某一突出显示的图标(如洗碗机、蒸箱、烤箱的图标)的操作,可取消该图标的选中。又比如,手机显示提示信息,提示用户确认设备选择结果是否正确。再比如,检测到用户点击空白区域的操作,确定取消全部图标的选中。
之后,手机如图8中(d)所示显示界面804,如附图标记83所示,选中的电子设备图标向手机图标81靠近,用于提示用户正在建立群组,并可将建立的群组信息同步到服务器。其中,图标突出显示的方式如包括颜色加深、变化颜色、闪烁等,对此本申请实施例不做具体限制。
示例性的,手机通过如图8所示的过程建立包括洗碗机、蒸箱、烤箱的群组,并且手机能够从服务器获取到设备的信息,如获得3个设备的位置信息为厨房。那么,如图9所示界面901,手机响应于用户操作启动智慧生活应用,并显示智慧生活应用管理的空间,如附图标记91所示,在厨房卡片中显示用户已添加的3个设备。
如此,用户可以通过简单的操作,实现批量添加设备,降低用户操作难度,提升用户使用体验。
在另一些实施例中,用户也可以通过智能家居控制面板,实现建立电子设备的群组。
示例性的,如图10所示界面1001,智能家居控制面板检测到用户点击连接新设备控件101的操作后,确定用户需要连接新设备。智能家居控制面板同样能够搜索到附近的电子设备,或者从服务器获得home对应的设备列表。之后,智能家居控制面板显示如图11所示界面1101,在界面1101上接收用户的分组操作。其中,在界面1101上显示的中心图标为智能家居控制面板图标111,即以智能家居控制面板作为中心设备。可选的,智能家居控制面板也可以根据用户操作,确定用户选择的电子设备为中心设备。
在另一些实施例中,用户也可以通过任一具有显示屏以及群组处理能力的电子设备,实现建立电子设备的群组。可选的,将用于建立群组的电子设备作为主控设备,如主控设备具有明确的品类属性和/或位置属性,可自动确认附近具有相同品类属性和/或位置属性的电子设备,提示用户建立群组。其中,品类属性用于表示电子设备的品类。位置属性用于表示电子设备所在的空间,如以房间为粒度划分电子设备所在的空间。
示例性的,假设主控设备为抽油烟机。抽油烟机在显示屏上检测到用户建立群组的操作,启动群组连接功能。之后,抽油烟机显示如图12中(a)所示界面1201,显 示的中心图标为抽油烟机图标121,周围显示位于同一个局域网和/或登录同一个账户的电子设备的图标,其中与抽油烟机具有品类属性和/或位置属性的电子设备的图标突出显示。比如,抽油烟机能够从服务器获取到设备信息列表,确定电子设备的品类属性和/或位置属性,进而突出显示相同品类属性和/或位置属性的电子设备的图标。如界面1201所示,抽油烟机确定自身为厨电类设备,可确定突出显示同为厨电类设备的蒸箱的图标122、烤箱的图标123以及洗碗机的图标124。或者,如界面1201所示,抽油烟机确定自身位于厨房,可确定突出显示同样位于厨房的电子设备的图标,如蒸箱的图标122、烤箱的图标123以及洗碗机的图标124。
之后,抽油烟机检测用户拖动图标至中心图标的操作,确定建立图标对应的电子设备与抽油烟机的群组关系。比如,如图12中(b)所示界面1202,抽油烟机检测到用户将蒸箱的图标122、烤箱的图标123以及洗碗机的图标124向抽油烟机图标121拖动的操作,检测到用户点击确认控件125的操作后,确定用户建立一个包括抽油烟机、蒸箱、烤箱以及洗碗机的群组。或者,抽油烟机自动将全部与抽油烟机具有品类属性和/或位置属性的电子设备的图标聚集显示在抽油烟机图标四周,检测到用户将电子设备的图标向远离抽油烟机图标的方向拖动的操作,确定用户不需要将对应的电子设备添加到该群组,从而减少用户的拖动操作。
可选的,主控设备(如抽油烟机)在建立群组后,可将群组信息发送到服务器。那么后续,手机响应于用户操作启动智慧生活应用后,能够从服务器获得最新的设备信息,显示最新的群组划分结果,实现用户对于电子设备的群组控制。
在另一些实施例中,用户也可以通过手机的近场连接功能(如NFC功能),通过碰一碰操作,实现建立电子设备的群组。
示例性的,如图13A所示,假设设备A配置有NFC标签,用户在需要建立包括设备A的群组时,可以通过手机的NFC功能碰一碰设备A的NFC标签,那么手机会发生广播信息,用于寻找预设距离内与设备A具有相同品类属性的电子设备。如图13A所示,假设设备B和设备C位于设备A的预设距离以内,且与设备A的品类相同(如均为办公设备)。
那么,如图13B所示界面1301,在界面1301上显示群组连接卡片131。如界面1301所示,群组连接卡片131上显示手机检测到的符合要求的电子设备的图标。并且,如附图标记132所示,显示这些电子设备的名称以及群组的名称,如手机搜索到设备B和设备C,在群组连接卡片131上显示设备A、设备B和设备C的名称,以及对应的群组名称为办公设备(如自动以设备品类命名群组)。手机可以接收用户在群组连接卡片131上的操作,如删除部分电子设备的图标的操作、修改群组名称的操作等。其中,如手机检测到用户删除部分电子设备的图标的操作,可确定用户不将对应的电子设备加入到包括设备A的群组中。之后,手机检测到用户点击群组连接卡片131上显示的群组连接控件133的操作后,确定建立包括设备A、设备B和设备C的群组。
可选的,手机在建立群组后,可将群组信息发送到服务器。那么后续,响应于用户操作启动智慧生活应用时,智慧生活应用能够从服务器获得最新的设备信息,显示最新的群组划分结果,实现用户对于电子设备的群组控制。
又示例性的,如图14A所示,手机检测到用户通过NFC功能碰一碰设备A的NFC 标签,确定用户需要建立包括设备A的群组,显示界面1401。在界面1401上,显示设备A的群组连接卡片141,在群组连接卡片141显示设备A的图标。
之后,如图14B所示,在预设时间(如20秒)内,手机又检测到用户通过NFC功能碰一碰设备B的NFC标签,确定用户需要将设备B加入到包括设备A的群组中,显示界面1402。如附图标记142所示,在设备A的群组连接卡片141显示设备A的图标和新添加的设备B的图标,提示用户已添加设备B。
之后,如图14C所示,在添加设备B后的预设时间(如20秒)内,手机又检测到用户通过NFC功能碰一碰设备C的NFC标签,确定用户需要将设备C加入到包括设备A和设备B的群组中,显示界面1403。如附图标记143所示,在设备A的群组连接卡片141显示设备A的图标、设备B的图标,以及新添加的设备C的图标,提示用户已添加设备C。
如图14C所示,手机检测到用户点击群组连接卡片141显示的群组连接控件144的操作后,确定用户已完成群组中的设备的添加,可将已确定添加的设备A、设备B,以及设备C建立为一个群组。或者,手机在预设时间内未再检测到用户添加新设备的操作(如未检测到用户通过NFC功能碰一碰设备NFC标签的操作),自动将已添加的设备设置为一个群组。
可选的,手机在建立群组后,可将群组信息发送到服务器。那么后续,响应于用户操作启动智慧生活应用时,智慧生活应用能够从服务器获得最新的设备信息,显示最新的群组划分结果,实现用户对于电子设备的群组控制。
需要说明的是,上述图13A-图14C所述场景以通过NFC功能的碰一碰操作实现连接为例对群组建立过程进行说明。可以理解的是,还可以通过其他功能实现群组的建立,如通过手机的摇一摇功能,或者在手机上添加待建立群组的电子设备的设备序列号等方法实现群组的建立。
如上介绍了如何建立第一电子设备100的群组连接,如下介绍如何根据用户的意图实现对群组的控制。其中,在智能家居应用场景中,意图用于表达用户期望,例如可以包括:开/关灯、音乐播放、净化空气、窗帘控制、温度控制等。
需要说明的是,如下以房间为群组单位为例,对群组控制方法进行说明。比如,将智能家居设备划分为主卧中的设备、次卧中的设备、客厅中的设备、书房中的设备、儿童房中的设备等。可以理解的是,如上述群组连接部分的介绍,还可以根据用户操作建立其他粒度的群组,如办公设备的群组等,对于其他群组的控制方法也可参考下述群组控制方法,对此不再赘述。
在一些实施例中,智能家居设备的种类众多,按照用户的意图,以智能家居设备的功能为基础,划分子系统,如照明子系统、环境子系统、安防子系统等。每个子系统对应于一个多个意图。比如,照明子系统对应的意图包括:开/关灯意图等;环境子系统对应的意图包括:恒温意图、恒湿意图、恒净意图等。那么,控制设备300在确定用户的意图以及确定用户需要控制的群组后,就可以确定该群组中能够实现意图的第一电子设备100,并指示第一电子设备100执行用户的意图。
在一些实施例中,服务器中配置有子系统配置文件和意图配置文件。其中,子系统配置文件用于配置子系统,如下表1所示,子系统配置文件包括子系统名称、设备 类型、设备ID以及意图标识。以照明子系统为例,照明子系统的子系统配置文件中包括能够实现照明的电子设备的设备ID以及对应的意图标识。其中,意图标识用于表示电子设备执行意图时对应的控制命令,服务器根据控制命令能够确定对应的需要电子设备执行的操作,进而向电子设备下发相应的指令。可选的,控制设备300中保存有子系统配置文件,那么,控制设备300在确定用户意图后,能够根据子系统配置文件确定能够实现用户意图的电子设备的设备ID,进而为用户推荐包括实现用户意图的电子设备的群组,便于用户对于电子设备的群组控制。
表1
Figure PCTCN2022127999-appb-000003
其中,意图配置文件用于配置意图对应的执行条件和执行动作,如下表2所示,意图配置文件包括设备ID、意图标识、执行条件和执行动作。其中,一个子系统配置文件对应于一个或多个意图配置文件,执行条件用于表示执行动作执行的条件,部分意图的执行可以不包括执行条件,即意图配置文件中可以不配置执行条件。
比如,如下表2所示,以照明子系统为例,照明子系统对应的意图配置文件包括能够实现照明的电子设备的设备ID(假设为设备A的设备ID)、意图标识以及对应的执行动作。那么,如服务器中保存有全部意图的意图配置文件,如下表2所示,服务器根据意图配置文件,确定需要指示设备A启动(如开灯),向设备A发送指示信号,用于指示设备A启动。又比如,如需实现安防子系统对应的意图,可能需要多个电子设备的配合,那么意图配置文件包括实现多个电子设备的执行动作的执行条件。如安防子系统对应的电子设备包括摄像头、人体传感器、报警器等,那么需要这些电子设备检测到的内容满足执行条件后,才能够执行相应的执行动作。因此,需要在安防子系统对应的意图配置文件中配置相应的执行条件。又比如,电子设备需要在特定的温度、时间等条件下执行对应的意图,那么就需要在意图配置文件中配置对应的执行条件。
表2
Figure PCTCN2022127999-appb-000004
如下以控制设备300为智能家居控制面板为例,对群组控制过程进行说明。
示例性的,如图15所示界面1501,智能家居控制面板检测到用户点击全屋控制控件151的操作,确定用户需要操作智能家居设备,智能家居控制面板进入全屋控制系统,显示如图16所示界面1601。在界面1601上显示有意图标识栏161,意图标识 栏161用于显示显示全部意图的意图标识,或者用于显示部分意图的意图标识。其中,全部意图用于表示开发者或用户定义的全部意图。部分意图可以包括当前屋内电子设备可实现的意图和/或用户从全部意图中选择的意图。
比如,部分意图,可以包括当前屋内电子设备可实现的意图。如假设当前屋内的第一电子设备100包括电灯和音箱,那么对应的可实现的意图包括开灯意图和音乐播放意图,智能家居控制面板可在意图标识栏中显示开灯意图标识和音乐播放意图标识。又比如,部分意图包括当前屋内电子设备可实现的意图和用户从全部意图中选择的意图。如假设当前屋内的第一电子设备100包括电灯和音箱,对应的可实现的意图包括开灯意图和音乐播放意图,智能家居控制面板又确定用户选择的意图为净化空气意图(假设该意图为当前屋内电子设备不可实现的意图)。那么智能家居控制面板可在意图标识栏中显示开灯意图标识、音乐播放意图标识和净化空气意图标识。再比如,智能家居控制面板根据用户操作,在意图标识栏中只显示用户选择的意图的意图标识,如净化空气意图标识。
需要说明的是,用户选择的意图可以为当前屋内可实现的意图,也可以为当前屋内不可实现的意图。比如,根据用户操作,智能家居控制面板在意图标识栏显示当前屋内电子设备可实现的意图中的部分意图的意图标识。
其中,在意图标识栏显示的意图标识包括当前屋内电子设备不可实现的意图对应的意图标识的情况下,当前屋内电子设备不可实现的意图对应的意图标识可以显示为灰色的不可操作状态。后续如接入新的电子设备,确定新的电子设备可实现的意图为当前显示的不可操作状态的意图标识对应的意图,可将不可操作状态的意图标识转换为可操作状态的意图标识。
可选的,如图16所示,意图标识栏161中显示意图标识的顺序可为默认顺序;或者,为根据用户操作确定的顺序,如根据用户操作调整意图标识显示顺序;或者,为根据用户操作频率确定的顺序,如将用户经常操作的意图的意图标识显示在优先级较高的显示位置(如便于用户操作的显示位置,或在前的显示位置),便于用户操作;或者;将意图标识栏161划分为可调整区域和不可调整区域,可调整区域可根据用户操作调整意图标识的显示,不可调整区域按照预设数量和预设显示顺序显示默认的意图标识。
如图16所示,意图标识栏161中显示的开灯意图标识162突出显示,用于表示智能家居控制面板当前显示的界面1601为开灯意图标识162对应的开灯意图对应的控制界面。如附图标记163所示,显示的中心意图为开灯意图,在中心意图周围显示的圆圈用于表示包含可实现开灯意图的电子设备的群组。如附图标记164所示,客厅内包含可实现开灯意图的电子设备,因此,智能家居控制面板显示客厅群组的标识(如界面1601上显示的附图标记164指示的圆圈)。可选的,在中心意图周围显示的圆圈还可以用于表示可实现开灯意图的电子设备。比如,如部分可实现开灯意图的电子设备未加入到群组中或者某群组中只包括一个电子设备(该电子设备可实现开灯意图),智能家居控制面板可直接在中心意图周围显示这部分电子设备的标识。也就是说,中心意图标识周围显示的标识包括群组标识和/或设备标识。
具体的,智能家居控制面板检测到用户点击开灯意图标识162的操作后,根据如 上表1所示的子系统配置文件,确定可实现开灯意图的电子设备,进而确定这些电子设备所在的群组。之后,在界面1601上显示中心意图标识,以及显示确定的群组的标识,便于用户根据意图实现群组控制。其中,智能家居控制面板中保存有子系统配置文件;或者,智能家居控制面板在确定用户选择的意图后,向服务器发送请求,由服务器确定对应的电子设备的设备ID;或者,请求服务器下发子系统配置文件。
可选的,如图16所示,中心意图标识周围显示的群组标识中还显示有中心意图对应的电子设备的情况,如儿童房、次卧、客厅、主卧以及书房中开灯意图对应的电子设备均未开启。用户能够通过智能家居控制面板一览全屋情况,而不必再通过复杂的操作一一确认设备状态,提升用户使用体验。
在一些实施例中,智能家居控制面板检测到用户对群组标识的预设操作,确定用户指示群组标识对应的群组中的电子设备执行中心意图对应的预设条件和预设动作。可选的,预设操作例如包括用户操作群组标识碰撞中心意图标识的操作,或者用户操作中心意图标识碰撞群组标识的操作。
示例性的,如图17中(a)所示,如界面1701所示的开灯意图标识171,智能家居控制面板显示的中心意图为开灯意图。智能家居控制面板检测到用户拖动主卧标识172沿箭头173所示方向向开灯意图标识171移动的操作,在检测到主卧标识172和开灯意图标识171碰撞后,确定用户需要控制主卧内的开灯意图对应的电子设备启动开灯功能。那么,智能家居控制面板根据子系统配置文件,确定主卧群组中开灯意图对应的电子设备的设备ID以及开灯意图对应的意图标识(该意图标识同样对应于智能家居控制面板显示的开灯意图标识171),将设备ID和意图标识发送至服务器。服务器根据设备ID、意图标识以及意图配置文件,确定需要设备ID对应的电子设备执行的执行动作以及执行条件。服务器生成信号指示,发送到设备ID对应电子设备,使得电子设备执行相应的执行动作,如开灯。或者服务器生成信号指示,发送到智能家居控制面板,由智能家居控制面板转发信号指示至设备ID对应电子设备,使得电子设备执行相应的执行动作,如开灯。之后,主卧中的电子设备在根据信号指示开灯后,会发送反馈信号,智能家居控制面板根据接收到的服务器转发的反馈信号或接收到的电子设备发送的反馈信号,确定信号指示是否被执行。
如图17中(b)所示界面1702,如附图标记174所示,智能家居控制面板根据接收到的反馈信号,在主卧的群组标识中显示命令的执行情况,如主卧4盏灯开。用户能够根据群组标识的显示,直观的确定命令的执行情况,提升用户使用体验。
如此,用户通过简单的拖动操作,即可实现电子设备的群组控制,降低用户的设备操作难度,满足用户的多设备控制需求。
在一些实施例中,在电子设备执行意图对应的执行动作后,智能家居控制面板还可以显示群组中具体执行了执行动作的电子设备,便于用户了解电子设备的执行情况。
示例性的,对应于图17所示场景,如图18所示界面1801,智能家居控制面板在确定主卧内的电子设备启动开灯功能后,在群组标识中依次闪现启动开灯功能的电子设备的标识。如附图标记181所示,在主卧中显示电灯的标识。比如,假设主卧中应该有6盏照明设备,但是如图17所示场景只启动了4盏,那么用户可以根据图18所示的电子设备标识,直观的确定哪些电子设备执行了意图对应的执行动作,哪些没有 执行意图对应的执行动作。从而简化用户的确认操作。
在一些实施例中,智能家居控制面板在检测到用户对已执行中心意图的电子设备对应的群组标识的预设操作,展开显示该群组标识对应的全部执行中心意图的电子设备的标识。
示例性的,对应于图17所示场景,如图19中(a)所示界面1901,智能家居控制面板检测到用户点击主卧标识191的操作,显示如图19中(b)所示界面1902。如界面1902所示,智能家居控制面板在开灯意图标识周围显示主卧中已启动开灯功能的电子设备(如顶灯、射灯、地灯、台灯)的标识。
这样,用户可以根据需求,查看具体群组内电子设备的意图执行情况,快速了解全屋设备状态。降低用户操作难度,提升用户交互性。
在一些实施例中,在展开显示群组中执行意图的电子设备的标识的过程中,响应于用户对设备标识的操作,智能家居控制面板取消设备标识对应的电子设备执行的意图对应的执行动作和执行条件。
示例性的,对应于图19所示场景,如图20A中(a)所示界面2001,智能家居控制面板展开显示主卧中启动开灯功能的电子设备的标识的过程中,检测到用户向远离开灯意图标识201的方向拖动台灯标识202的操作,确定用户需要取消台灯的开灯(即用户指示关闭台灯)。智能家居控制面板向服务器发送台灯的设备ID以及取消执行意图的命令,服务器根据设备ID向台灯发送关灯的指示信号。或者,智能家居控制面板直接向台灯发送指示信号,用于指示台灯关灯。那么,台灯在接收到指示信号后,执行关灯命令,并发送反馈信号。智能家居控制面板根据服务器转发的反馈信号或者根据接收到的台灯发送的反馈信号,显示如图20A中(b)所示界面2002。如界面2002所示,台灯标识202不再突出显示,用于提示用户台灯已关闭。其中,取消执行意图的命令包括指示电子设备执行与意图相反的命令,比如,取消执行开灯意图的命令为指示电子设备执行关灯。取消执行意图的命令包括不再执行意图的命令,比如,意图为恒温意图,取消恒温意图的命令为指示电子设备不再执行恒温意图。
之后,如图20A中(b)所示,用户还可以在界面2002上继续关闭主卧中的其他照明设备,如顶灯、射灯等。智能家居控制面板检测到用户点击关闭控件203的操作后,确定用户已完成当前群组内的电子设备的控制,可显示如图20A中(c)所示界面2003。在界面2003上,主卧标识中显示的命令的执行情况,由图19中(a)所示的主卧打开了4盏灯变换为如附图标记204所示的主卧打开了3盏灯,即已关闭主卧中的一盏台灯。
在一些实施例中,智能家居控制面板确定用户对群组参数的修改操作,在后续用户对群组中的电子设备进行控制的过程中,将按照修改后的群组参数进行群组控制。其中,对群组参数的修改操作包括改变群组中包括的设备数量的操作,改变群组中设备参数的操作等。可选的,群组参数的修改可以通过黑名单的方式实现。如将用户删除的电子设备的设备ID添加到黑名单中,那么智能家居控制面板在确定子系统配置文件的过程中,可根据黑名单,排除部分意图对应的电子设备。或者,群组参数的修改可以为直接对子系统配置文件和意图配置文件的修改。如智能家居控制面板将用户对设备参数的修改发送到服务器,服务器将意图配置文件中对应的参数进行修改,那么 后续在确定执行条件和执行动作时,可以指示电子设备按照修改后的设备参数执行意图。可选的,服务器确定的黑名单、修改后的子系统配置文件、意图配置文件可以同步至智能家居控制面板。
示例性的,在上述图20A所示场景中,响应于用户操作,智能家居控制面板删除主卧中的台灯。那么,假设用户已关闭主卧中的全部照明设备。比如,图20A中(c)所示,用户拖动附图标记204所示的主卧标识向远离开灯意图标识的方向移动,智能家居控制面板确定指示已开启的三盏灯关闭。后续,如图20B中(a)界面2004,智能家居控制面板检测到用户点击意图标识栏中显示的开灯意图标识205的操作后,显示的中心意图标识为开灯意图标识206,在开灯意图标识206周围显示未突出显示的主卧标识。之后,如图20B中(b)所示界面2005,智能家居控制面板检测到用户拖动主卧标识207向开灯意图标识206移动并并碰撞的操作,确定需要控制主卧中的照明设备执行开灯意图。智能家居控制面板可根据子系统配置文件和黑名单,确定当前主卧中包括3台照明设备,并确定对应的设备ID和意图标识,实现控制这3台照明设备执行开灯意图。之后,智能家居控制面板显示如图20B中(c)所示界面2006,如附图标记208所示,在主卧控制标识中显示命令执行情况为3盏灯开,不再包括响应于用户操作添加到黑名单中的台灯。进一步的,如用户此次又开启了台灯,那么智能家居控制面板可将台灯从黑名单中删除,并同步至服务器。那么后续,智能家居控制面板再确定主卧中的照明设备执行开灯意图,可指示台灯执行开灯意图。
又示例性的,假设开灯意图的意图配置文件中的执行动作包括灯的亮度参数,如为350坎德拉/平方米(cd/m)。那么,如上述图17所示场景,服务器指示主卧中的照明设备以350cd/m的亮度启动。假设智能家居控制面板检测到用户调节主卧中的照明设备中的台灯亮度的操作,确定用户将台灯亮度调节为300cd/m。那么,智能家居控制面板将该调节后的参数发送至服务器,由服务器修改并同步意图配置文件。后续,智能家居控制面板再次检测到用户指示启动主卧中的照明设备的操作后,指示主卧中的台灯以300cd/m的亮度启动,其余照明设备以350cd/m的亮度启动。
如此,智能家居控制面板能够根据用户操作,自适应的调节子系统配置文件和意图配置文件,使得群组控制符合用户需求,进一步提升用户的使用体验。
在一些实施例中,受限于智能家居控制面板的显示屏的显示面积,意图表示栏中只能显示有限数量的意图标识。因此,在意图标识栏当前页面未显示某些意图标识的情况下,用户可以通过在意图标识栏内的滑动等操作,查看更多的意图标识。也即,响应于用户在意图标识栏的滑动等操作,智能家居控制面板滑动显示意图标识。
示例性的,如图21中(a)所示界面2101,智能家居控制面板在意图标识栏211显示开灯意图标识、音乐播放意图标识、净化空气意图标识以及窗帘意图标识。假设当前显示的意图标识均不是用户想要控制的意图的意图标识。那么,如界面2101所示,智能家居控制面板检测到用户在意图标识栏211上沿箭头212所示方向的滑动操作后,滑动显示意图标识栏211中显示的意图标识。如响应于用户的滑动操作,智能家居控制面板显示如图21中(b)所示界面2102,在意图标识栏211中显示界面2101中未能显示的恒温意图标识213。
如此,用户能够通过简单的滑动操作,查看更多的意图,从而满足用户更多的意 图需求。
在一些实施例中,检测到用户在意图标识栏点击意图标识的操作,显示意图标识对应的意图界面。
示例性的,如图22中(a)所示界面2201,智能家居控制面板在显示开灯意图的界面的过程中,检测到用户点击窗帘意图标识221的操作,确定用户需要查看窗帘意图对应的界面。智能家居控制面板获取窗帘意图对应的群组,以及群组中的电子设备对窗帘意图的执行情况,显示如图22中(b)所示界面2202。如界面2202所示,显示的中心意图的标识为窗帘意图标识222,在窗帘意图标识周围显示有包括能够实现窗帘意图的电子设备的群组的群组标识。并且,假设次卧中包含已执行窗帘意图的电子设备,那么如界面2202所示,次卧标识223突出显示,并在次卧标识223上中显示意图的执行情况,如次卧布帘打开。
如此,用户可以通过意图标识栏切换查看不同的意图界面,从而确定全屋的电子设备的状态。并且,能够通过切换意图界面,实现控制不同意图对应的电子设备。
在一些实施例中,智能家居控制面板检测到用户在意图标识栏的删除操作,能够删除用户不需要的意图标识。
示例性的,如图23中(a)所示界面2301,智能家居控制面板检测到用户长按音乐播放意图标识231的操作,可显示删除栏232。之后,检测到用户沿箭头233所示方向将音乐播放意图标识231拖动到删除栏232的操作后,可删除音乐播放标识,显示如图23中(b)所示界面2302。如界面2302所示,在意图标识栏234中不再显示已删除的音乐播放标识。
在一些实施例中,在中心意图标识周围显示的群组标识对应的群组全部未执行中心意图的情况下,检测到用户长按中心意图标识的操作,可向中心意图对应的全部群组中对应的电子设备发送意图执行命令。从而用户能够快速操作意图对应的全部电子设备,而不必在一个一个群组的操作,从而进一步降低用户操作难度,提升电子设备的控制效率,提升用户使用体验。
示例性的,如图24中(a)所示界面2401,中心意图为开灯。智能家居控制面板检测到用户长按开灯意图标识241的操作,确定开灯意图对应的全部群组均未执行开灯意图,根据子系统配置文件,确定开灯意图对应的全部照明设备的设备ID和意图标识。智能家居控制面板将开灯意图对应的全部照明设备的设备ID和意图标识发送到服务器。从而实现将这些群组中的照明设备全部启动。之后,智能家居控制面板显示如图24中(b)所示界面2402,如附图标记242所示,开灯意图对应的全部群组的群组标识均已突出并聚集到开灯意图标识周围显示,用于提示用户全部开灯意图对应的照明设备已启动。
在一些实施例中,在中心意图周围的群组全部执行中心意图的情况下,检测到用户长按中心意图的操作,可向中心意图对应的全部群组中对应的电子设备发送意图取消命令。从而用户能够快速操作意图对应的全部电子设备,而不必在一个一个群组的操作,进一步降低用户操作难度,提升电子设备的控制效率,提升用户使用体验。
示例性的,如图25中(a)所示界面2501,中心意图为开灯,开灯意图对应的全部群组均已执行开灯意图(如界面2501所示,全部开灯意图标识251周围显示的群组 标识均已突出显示)。智能家居控制面板检测到用户长按开灯意图标识251的操作,根据子系统配置文件,确定开灯意图对应的全部照明设备的设备ID和意图标识。智能家居控制面板将开灯意图对应的全部照明设备的设备ID和意图标识发送到服务器。从而实现将这些照明设备全部关闭。之后,智能家居控制面板显示如图25中(b)所示界面2502,全部群组标识不再突出显示,用于提示用户全部开灯意图对应的照明设备已关闭。
在另一些实施例中,对应于图24和图25所示场景,如中心意图对应的部分群组标识突出显示,部分群组标识未突出显示。那么,表示当前中心意图对应的群组中,部分群组中的电子设备执行了中心意图对应的执行条件和执行动作,部分群组中的电子设备未执行中心意图对应的执行条件和执行动作。在这种情况下,智能家居控制面板检测到用户长按中心意图标识的操作后,确定按照预设规则控制全部群组执行中心意图对应的执行条件和执行动作。比如,中心意图为开灯意图,智能家居控制面板在检测到用户长按开灯意图标识的操作时,按照预设规则,控制包括未执行开灯意图的照明设备的群组中的照明设备均执行开灯意图。又比如,中心意图为开灯意图,智能家居控制面板在检测到用户长按开灯意图标识的操作时,按照预设规则,控制包括已执行开灯意图的照明设备的群组中的照明设备均关闭。其中,预设规则可以为开发者预置在智能家居控制面板中的规则,也可以为用户自定义的规则。
在一些实施例中,智能家居控制面板检测到用户的融合意图的操作,可以将两个或两个以上的意图融合,生成融合意图。从而用户可以通过融合意图直接实现控制融合意图包括的多个意图对应的电子设备,进一步简化用户操作。
示例性的,如图26中(a)所示界面2601,假设智能家居控制面板正在显示开灯意图界面。智能家居控制面板检测到用户拖动意图标识栏中显示的恒温意图标识261沿箭头262所示方向向中心意图(如开灯意图)标识移动的操作,如附图标记264所示,恒温意图标识在移动至中心意图周围预设范围内后突出显示,以提示用户当前启动意图融合模式,可将恒温意图与中心意图融合。如智能家居控制面板检测到用户继续拖动恒温意图标识向开灯意图标识263移动的操作,如图26中(b)所示界面2602,如附图标记265所示,若智能家居控制面板检测到恒温标识与开灯标识碰撞到一起,如从检测到两个意图标识接触开始,显示标识融合的示意图,提示用户两个意图已开始融合。智能家居控制面板确定需要融合的意图为开灯意图和恒温意图,可生成融合意图标识。如图26中(c)所示界面2603,在意图标识栏中显示融合意图标识266。并且,切换中心意图为融合意图,显示融合意图界面。如中心意图标识为开灯意图和恒温意图的融合意图标识267。在融合意图标识267上显示融合的意图,提示用户可通过该融合意图控制可执行开灯意图和恒温意图的电子设备。
可选的,智能家居控制面板在生成新的融合意图后,会将原中心意图标识周围突出显示的群组标识全部弹开,不再突出显示。如图26中(b)所示界面2602,开灯意图标识周围突出显示有主卧标识,之后如图26中(c)所示界面2603,智能家居控制面板在确定融合意图后,在融合意图标识267周围不再突出显示群组标识。
需要说明的是,原本在意图界面突出显示的群组标识,如在显示融合意图界面时不再突出显示,并不表示直接取消该群组中电子设备的意图执行。比如,上述图26 所示场景,在将开灯意图和恒温意图融合后,显示的如图26中(c)所示的融合意图界面中,主卧标识不再突出显示。但是,如图26中(a)所示,主卧中有4盏灯开。那么,在意图融合后,这4盏灯仍保持打开。并且,如图26中(c)所示,在意图标识栏中仍保持显示开灯意图标识268,如检测到用户单击开灯意图标识268后,切换显示开灯意图界面,在开灯意图界面上突出显示主卧标识。
这样,基于图26所示场景,如用户在进行融合意图之前需要启动开灯意图和恒温意图对应的群组,需要通过上述图17所示方法,分别操作两个意图的意图标识,操作繁琐。而在建立融合意图之后,用户即可直接通过的对融合意图标识的操作,实现控制融合意图对应的群组中的电子设备,简化用户操作。
示例性的,假设在未进行融合意图之前,用户需要启动主卧中的照明设备和恒温设备,需要先在开灯意图界面操作主卧标识启动主卧照明设备,之后再切换恒温意图界面操作主卧标识启动主卧恒温设备。而在融合意图之后,如图27中(a)所示界面2701,智能家居控制面板检测到用户点击意图标识栏中显示的融合标识271的操作,确定该融合标识271对应的意图包括开灯意图和恒温意图。之后,智能家居控制面板获取开灯意图的子系统配置文件和恒温意图的子系统配置文件,确定两个子系统配置文件中包括的电子设备后,确定包括既可执行开灯意图的电子设备,又可执行恒温意图的电子设备的群组,将这部分群组中可执行开灯意图和/或恒温意图的电子设备的设备ID以及对应的意图标识发送到服务器,从而实现指示相应的电子设备执行意图的执行条件和执行动作。比如,假设如界面2701所示,主卧、书房、儿童房、次卧和客厅中均包括可执行开灯意图的照明设备,但只有主卧中包括可执行恒温意图的恒温设备。因此,智能家居控制面板确定主卧中的照明设备的设备ID和对应的意图标识、以及恒温设备的设备ID和对应的意图标识,实现指示这些照明设备和恒温设备执行对应的执行条件和执行动作。之后,智能家居控制面板在确定主卧群组中的电子设备已执行对应的执行条件和执行动作后,显示如图27中(b)所示界面2702,此时突出显示主卧标识274,并在主卧标识上显示命令的执行情况,如主卧4盏灯开,温度26℃。
如此,用户可快速启动主卧中的照明设备和恒温设备。相应的,用户也可以通过融合意图快速取消电子设备的意图执行。意图取消执行的操作可以参考上述图20A或图25所示的相关内容,在此不再赘述。
在另一些实施例中,如在意图融合过程中,智能家居控制面板确定当前显示的意图界面中,突出显示的群组标识对应的群组中包括可执行待融合意图的电子设备。那么,智能家居控制面板可在融合意图后,在融合意图界面保持突出显示该群组标识,但在群组标识中显示的命令执行情况变化为融合意图执行后对应的命令执行情况。当然,如智能家居控制面板确定当前显示的意图界面中,突出显示的群组标识对应的群组中不包括可执行待融合意图的电子设备。那么,在融合意图界面将不再突出显示该意图标识。也就是说,在意图融合过程中,智能家居控制面板需要对当前界面突出显示的群组标识对应的电子设备的中心意图和待融合意图的执行情况进行确定。
示例性的,对应于如图26所示场景,假设主卧中包括可执行恒温意图的恒温设备,如图28A所示界面2801,在中心意图标识为恒温意图标识281的情况下,在界面2801上突出显示主卧标识282,并确定启动主卧中的恒温设备。此外,如图26中(a)所 示界面2601,在中心意图标识为开灯意图标识263的情况下,在界面2601上突出显示主卧标识,并确定主卧中的4盏灯开。那么,在智能家居控制面板检测到如界面2601上的融合意图操作后,确定融合意图后,可直接显示如图28B所示界面2802。在界面2802上,中心意图标识为开灯意图和恒温意图的融合意图标识283,并且如附图标记284所示突出显示主卧标识,并在主卧标识上显示融合意图的命令执行情况,如4盏灯开和温度26℃。
在另一些实施例中,除图26所示的拖动意图标识至中心意图标识的融合意图操作,融合意图操作还可以包括其他实现方式。比如,智能家居控制面板检测到用户拖动意图标识栏中显示的某个意图标识至意图标识栏中显示的另一个意图标识的操作,可确定融合这两个意图标识对应的意图。进一步的,这两个意图标识可以为单独意图的意图标识;或者,这两个意图标识也可以为融合意图的意图标识;或者,这两个意图标识也可以一个意图标识为单独意图的意图标识,另一个意图标识为融合意图的意图标识。又比如,智能家居控制面板检测到用户长按意图标识栏中显示的意图标识的操作,可选中该意图标识。之后智能家居控制面板检测到用户连续选中多个意图标识的操作,智能家居控制面板将用户连续选中的多个意图标识对应的意图进行融合,获得融合意图。
在一些实施例中,智能家居控制面板响应于用户拆分融合意图标识的操作,可以拆分对应的融合意图。从而进一步满足用户控制电子设备的需求。
示例性的,如图29中(a)所示界面2901,界面2901中显示的中心意图标识为开灯意图和恒温意图融合后对应的融合意图标识,融合意图标识包括对应于融合意图包括的意图的热区,如包括开灯意图热区291和恒温意图热区292,用户可以直观的通过融合意图标识上显示的内容确定各个意图热区的位置。智能家居控制面板检测到用户长按恒温热区292并向远离融合意图标识的方向移动的操作,确定用户需要将恒温意图从融合意图中剥离。如图29中(b)所示界面2902,如附图标记293所示,智能家居控制面板显示剥离融合意图过程中的恒温意图标识,用于提示用户继续拖动可完成恒温意图的剥离。如智能家居控制面板检测到用户保持拖动恒温热区向远离融合意图标识方向移动的操作,可显示如图29中(c)所示界面2903。在界面2903上,在意图标识栏295中不再显示已剥离融合的恒温意图和开灯意图对应的融合意图标识。
可选的,融合意图剥离后,智能家居控制面板可指示已执行原融合意图的群组中的电子设备取消执行被剥离的意图。示例性的,如图29所示场景智能家居控制面板响应于用户操作,将融合意图中的恒温意图剥离。那么,智能家居控制面板可指示已执行融合意图的主卧中的恒温设备取消执行恒温意图。
可选的,如图29中(c)所示界面2903,如附图标记294所示,中心意图标识变化为剥离后剩余意图对应的意图标识,且突出显示该意图标识对应的包括执行意图的电子设备的群组的群组标识,如主卧标识。
需要说明的是,如意图剥离后,剩余的意图仍为融合意图,智能家居控制面板可生成并显示剩余意图的融合意图标识。可选的,在新生成的融合意图标识是否突出显示对应的群组标识的确定方法,可参考上述图26或图28A和图28B所示方法,在此不再赘述。
上述实施例以中心意图标识为气泡状(圆形)标识为例,对群组控制过程进行说明。可以理解的是,中心意图标识还可以显示为其他形状或大小,本申请实施例对此不做限制。在一些实施例中,中心意图标识还可以实现为区域显示,在智能家居控制面板检测到用户在中心意图对应的中心意图标识区域上的操作后,同样能够实现对应的群组控制。可以理解的是,本申请实施例同样不限制中心意图标识区域显示的形状和大小。
示例性的,如图30中(a)所示界面3001,智能家居控制面板显示中心意图为开灯意图,如开灯意图对应的开灯意图标识区域301。在开灯意图标识区域301周围显示包括可实现开灯意图的电子设备的群组的群组标识(如主卧标识,书房标识等)。智能家居控制面板检测到用户拖动主卧标识302沿箭头303所示方向至开灯意图标识区域301内的操作,确定用户需要控制主卧内的开灯意图对应的电子设备启动开灯功能。那么,参考上述图17所述相关内容,智能家居控制面板在图30所示场景中,也可向服务器发送确定的设备ID和意图标识,从而实现控制主卧中开灯意图对应的电子设备启动开灯功能。
如图30中(b)所示界面3002,智能家居控制面板确定主卧中相应的电子设备已启动开灯功能后,如附图标记304所示,在开灯意图标识区域301内显示主卧标识,并在主卧标识中显示命令的执行情况,如主卧4盏灯开。
那么相应的,上述图16-图29所述的群组控制过程中,智能家居控制面板可实现的功能,在中心意图显示为中心意图标识区域的情况下,同样可以实现。
比如,如上述图18所示,在主卧标识中依次闪现启动开灯功能的电子设备的标识。那么相应的,在图30所示场景中,智能家居控制面板在确定主卧中相应的电子设备启动照明功能后,也可在开灯意图标识区域301中显示的主卧标识中依次闪现主卧中启动开灯功能的电子设备的标识。
又比如,如上述图19所示,在主卧标识周围显示主卧中已启动开灯功能的电子设备的标识。那么相应的,在图30所示场景中,智能家居控制面板也可在开灯意图标识区域301中显示的主卧标识周围显示主卧中已启动开灯功能的电子设备的标识。可选的,中心意图标识区域的大小可根据显示内容自适应变化。如图30所示场景,开灯意图标识区域301显示预设的初始大小,在确定需要在主卧标识周围显示主卧中已启动开灯功能的电子设备的标识后,智能家居控制面板确定当前显示的开灯意图标识区域301的面积不足以显示待显示的标识,可自动扩大开灯意图标识区域301的大小,以在开灯意图标识区域301内实现显示主卧标识以及对应的启动开灯功能的电子设备标识。
那么对应于上述图20A所示的指示群组中部分已执行中心意图的电子设备取消执行中心意图的过程,智能家居控制面板在检测到用户将在群组标识周围展开显示的电子设备标识拖出中心意图标识区域的操作后,可确定取消该电子设备标识对应的电子设备执行中心意图。
又比如,对应于图24所示的群组全选场景和对应于图25所示的群组全不选场景,智能家居控制面板在检测到用户在中心意图标识区域中任意未显示标识(如群组标识或设备标识)的位置的长按操作后,可确定全选周围显示的群组标识对应的群组,控 制其中的电子设备执行中心意图。或者,可确定全不选周围显示的群组标识对应的群组,控制其中的电子设备取消执行中心意图。
再比如,对应于上述图27、图28A和图28B所示的意图融合场景,在智能家居控制面板显示的中心意图为中心意图标识区域的过程中,检测到用户融合意图的操作后,同样可以实现意图的融合。
示例性的,如图31中(a)所示界面3101,智能家居控制面板检测到用户拖动意图标识栏中显示的恒温标识311至开灯意图标识区域312内的操作后,确定需要融合恒温标识311对应的恒温意图和开灯意图标识区域312对应的开灯意图。之后,如图31中(b)所示界面3102,显示“开灯+恒温”的融合意图标识区域313,并在融合意图标识区域313内显示包括可执行开灯意图和恒温意图的电子设备的主卧的主卧标识。同样的,融合意图标识区域包括各个融合的意图对应的热区,可实现剥离已融合的意图。如图31中(b)所示的融合意图标识区域313中,左半部分为开灯意图对应的热区,右半部分为恒温意图对应的热区。
可选的,其他智能家居控制面板显示中心意图标识区域的实现,可参考上述智能家居控制面板显示中心意图标识的相关内容,在此不再赘述。
如此,智能家居控制面板显示中心意图标识区域,使得用户能够根据中心意图标识区域内显示的群组标识,确定群组的中心意图执行情况,便于用户的群组控制,提升用户的使用体验。
示例性的,图32为本申请实施例提供的智能设备控制方法流程示意图。该方法应用于第一电子设备,该第一电子设备可以为上述控制设备300(如智能家居控制面板、手机),还可以为上述第一电子设备100。如图32所示,该方法包括如下步骤。
S3201、显示第一界面,第一界面包括第一意图标识、以及第一群组对应的第一群组标识。
其中,第一群组包括可执行第一意图标识对应的第一意图的X个电子设备,该X为正整数。可选的,X个电子设备的品类属性和/或位置属性相同。第一意图对应于电子设备可实现的功能,如包括开灯意图、恒温意图等。意图标识为功能标识,可用于表示对应的可实现的功能,如开灯意图标识表示对应的开灯功能,恒温意图标识表示对应的恒温功能。
在一些实施例中,第一意图标识显示在第一界面的第一区域,第一群组标识显示在第一区域以外的其他区域。
示例性的,如图30中(a)所示界面3001,第一区域为开灯意图标识区域301,开灯意图标识可以为显示在该开灯意图标识区域301内的意图标识,可以占据开灯意图标识区域301的全部或部分区域。
S3202、接收用户对第一群组标识的第一操作。
在一些实施例中,第一操作包括:将第一群组标识移至第一区域。
示例性的,如图30中(a)所示界面3001,第一电子设备(如智能家居控制面板)检测到用户拖动主卧标识302沿箭头303所示方向拖动至开灯意图标识区域301(即第一区域)的第一操作。
S3203、响应于第一操作,控制第一群组标识移向第一意图标识,并指示X个电 子设备执行第一意图。
在一些实施例中,第一电子设备检测到第一操作后,能够根据子系统配置文件,确定第一群组中可执行第一意图的X个电子设备的设备ID。那么,第一电子设备可控制第一群组标识移向第一意图标识,并向服务器发送设备ID和显示的第一意图标识对应的意图标识。服务器根据设备ID、意图标识以及意图配置文件,确定需要设备ID对应的X个电子设备执行的执行动作以及执行条件。服务器生成信号指示,发送到设备ID对应X个电子设备,以指示X个电子设备执行相应的执行动作,如开灯。或者服务器生成信号指示,发送到第一电子设备,由第一电子设备转发信号指示至设备ID对应X个电子设备,以指示X个电子设备执行相应的执行动作,如开灯。
示例性的,如图30中(a)所示,第一电子设备(如智能家居控制面板)检测到用户对主卧标识172的第一操作后,确定用户需要控制主卧内的开灯意图对应的电子设备启动开灯功能。那么,第一电子设备响应于用户的第一操作,显示主卧标识172向开灯意图标识区域301的移动过程,并指示主卧中确定的X个电子设备执行开灯意图。
如此,用户通过简单的拖动操作,即可实现电子设备的群组控制,降低用户的设备操作难度,满足用户的多设备控制需求。
在一些实施例中,第一电子设备还可以在第一界面显示提示信息,提示信息用于反馈X个电子设备执行第一意图的情况。
示例性的,如图30所示场景,主卧中的电子设备在根据信号指示开灯后,会发送反馈信号,第一电子设备根据接收到的服务器转发的反馈信号或接收到的电子设备发送的反馈信号,确定信号指示是否被执行。如图30中(b)所示界面3002,如附图标记304所示,第一电子设备根据接收到的反馈信号,显示提示信息,如在主卧的群组标识中显示命令的执行情况,如主卧4盏灯开。用户能够根据群组标识的显示,直观的确定命令的执行情况,提升用户使用体验。
在一些实施例中,第一电子设备接收用户对第一群组标识的第三操作,响应于第三操作,在第一界面显示与X个电子设备分别对应的X个电子设备标识。可选的,该第三操作可以为点击第一群组标识的操作。
示例性的,如图19中(a)所示,第一电子设备(如智能家居控制面板)检测到用户点击主卧标识191的操作,可显示如图19中(b)所示界面1902。第一电子设备在界面1902上显示已执行开灯意图(即第一意图)的电子设备的电子设备标识,如台灯标识、顶灯标识、射灯标识和地灯标识。
可选的,第一电子设备响应于第三操作,显示X个电子设备中执行第一意图的电子设备的设备标识,如X个电子设备中,M个电子设备执行第一意图执行成功,N个电子设备执行第一意图执行失败,第一电子设备可显示M个电子设备的电子设备标识。也就是说,未执行或执行第一意图失败的电子设备的电子设备标识可不显示,或不突出显示。这样用户可以确定哪些电子设备执行了第一意图,哪些电子设备未执行第一意图。
一些实施例中,第一电子设备接收用户对X个电子设备标识中的第二电子设备对应的电子设备标识的第四操作。响应于第四操作,控制第二电子设备对应的电子设备 标识移出第一区域,并指示第二电子设备取消执行第一意图。可选的,该第四操作可以为将第二电子设备的电子设备标识拖动出第一区域的操作。
其中,取消执行意图包括指示电子设备执行与意图相反的命令,比如,取消执行开灯意图为指示电子设备执行关灯。取消执行意图的命令包括不再执行意图,比如,意图为恒温意图,取消恒温意图为指示电子设备不再执行恒温意图。
示例性的,如图20A中(a)所示,第一电子设备检测到用户向远离第一意图标识(如开灯意图标识)的方向移动第二电子设备(如台灯)的电子设备标识(如台灯标识202)的第四操作,可指示台灯取消执行开灯意图。如此实现群组控制的同时,也可实现群组中设备的单独控制,满足用户需求。
在一些实施例中,第一界面还显示有第二意图标识,第一电子设备接收用户将第二意图标识移至第一区域的第五操作。响应于第五操作,指示第一群组中的Y个电子设备执行第二意图标识对应的第二意图,Y为正整数。可选的,Y个电子设备与X个电子设备相同、不相同或部分相同。可选的,该第五操作可以为将第二意图标识拖动至第一区域的操作。
示例性的,如图31中(a)所示,第一电子设备(如智能家居控制面板)显示第二意图标识(如恒温标识),检测到用户将恒温标识311移至第一区域(如开灯意图标识区域312)的第五操作,可生成开灯意图和恒温意图的融合意图。并且,确定开灯意图对应的第一群组(如主卧群组)中是否存在可执行恒温意图的电子设备,如存在,可指示这些可执行恒温意图的电子设备执行恒温意图。其中,执行恒温意图的电子设备可以为原已执行开灯意图的电子设备,也可以为未执行过开灯意图的电子设备,也可以部分为原已执行开灯意图的电子设备。
在一些实施例中,第一电子设备接收用户对第一界面中显示的第二群组标识的第六操作,第二群组标识对应于包括可执行第一意图和第二意图的Z个电子设备的第二群组,Z为正整数。响应于第六操作,将第二群组标识移至第一区域,并指示Z个电子设备执行第一意图和第二意图。可选的,该第四操作可以为将第二群组标识拖动至第一区域的操作。
示例性的,对应于如图31所示场景,第一意图(如开灯意图)和第二意图(如恒温意图)融合后,生成融合意图,那么第一区域用于表示该融合意图对应的区域。第一电子设备检测到将第二意图标识移动至该第一区域的第四操作,可确定指示第二群组中的Z个电子设备执行融合意图,即执行第一意图和第二意图。比如,第二群组中的部分电子设备执行第一意图,部分电子设备执行第二意图,执行第一意图的电子设备和执行第二意图的电子设备可以相同、可以不相同、可以部分相同,共同构成Z个电子设备。
在一些实施例中,第一电子设备接收用户对第一区域的第七操作。响应于第七操作,控制第一群组标识和第二群组标识移出第一区域,并指示Y个电子设备和Z个电子设备取消执行第一意图和第二意图。
比如,第七操作为长按第一区域中任意位置的操作。第一电子设备检测到用户的第七操作后,确定指示已执行第一意图和第二意图的全部电子设备取消执行第一意图和第二意图。
在一些实施例中,第一电子设备接收用户对第二区域的第八操作,第二区域对应于第二意图。响应于第八操作,控制第二意图标识移出第一区域,并指示Y个电子设备取消执行第二意图。
可选的,第一区域包括第二区域,第二区域对应于第二意图。比如,如图31中(b)所示,融合意图标识区域313用于表示第一区域,对应于开灯意图和恒温意图,那么第一电子设备根据融合意图中包括的意图的数量,如2个,将第一区域平均划分为对应于两个意图的热区。如融合意图标识区域313中位于左侧的区域为开灯意图(第一意图)对应的热区,位于右侧的区域为恒温意图(第二意图)对应的热区。
在一些场景中,在上述步骤S3201之前还可以包括建立第一群组的步骤。
在一些实施例中,第一电子设备显示第二界面,第二界面包括与多个电子设备分别对应的多个电子设备标识。接收从多个电子设备标识中选择X个电子设备标识的第二操作。响应于第二操作,建立包括X个电子设备的第一群组。可选的,将多个电子设备中相同品类属性和/或位置属性的电子设备对应的电子设备标识聚集显示。
示例性的,如图8中(b)所示,第一电子设备(如手机)显示界面802,在界面1101上显示多个电子设备标识,并且多个电子设备中相同品类属性的电子设备的电子设备标识聚集显示。检测到用户选择其中洗碗机、蒸箱和烤箱的操作,可将这三个电子设备划分为一个群组。
可选的,其他建立群组的方法可参考上述图10-图14C所示的相关内容,在此不再赘述。
如此,用户可以通过简单的操作,实现批量添加设备,降低用户操作难度,提升用户使用体验。
以上结合图6-图32详细说明了本申请实施例提供的智能设备控制方法。以下结合图33详细说明本申请实施例提供的智能设备控制装置。
在一种可能的设计中,图33为本申请实施例提供的第一电子设备的结构示意图。如图33所示,第一电子设备3300可以包括:显示单元3301、收发单元3302以及处理单元3303。第一电子设备3300作为智能设备控制装置,可用于实现上述方法实施例中涉及的第一电子设备100或控制设备300的功能。
可选地,显示单元3301,用于支持第一电子设备3300显示界面内容;和/或,支持第一电子设备3300执行图32中的S3201和S3203。
可选地,收发单元3302,用于支持第一电子设备3300执行图32中的S3202。
可选地,处理单元3303,用于支持第一电子设备3300执行图32中的S3203。
其中,收发单元可以包括接收单元和发送单元,可以由收发器或收发器相关电路组件实现,可以为收发器或收发模块。第一电子设备3300中的各个单元的操作和/或功能分别为了实现上述方法实施例中所述的智能设备控制方法的相应流程,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能单元的功能描述,为了简洁,在此不再赘述。
可选地,图33所示的第一电子设备3300还可以包括存储单元(图33中未示出),该存储单元中存储有程序或指令。当显示单元3301、收发单元3302以及处理单元3303执行该程序或指令时,使得图33所示的第一电子设备3300可以执行上述方法实施例 中所述的智能设备控制方法。
图33所示的第一电子设备3300的技术效果可以参考上述方法实施例中所述的智能设备控制方法的技术效果,此处不再赘述。
除了以第一电子设备3300的形式以外,本申请提供的技术方案也可以为第一电子设备中的功能单元或者芯片,或者与第一电子设备匹配使用的装置。
本申请实施例还提供一种芯片系统,包括:处理器,所述处理器与存储器耦合,所述存储器用于存储程序或指令,当所述程序或指令被所述处理器执行时,使得该芯片系统实现上述任一方法实施例中的方法。
可选地,该芯片系统中的处理器可以为一个或多个。该处理器可以通过硬件实现也可以通过软件实现。当通过硬件实现时,该处理器可以是逻辑电路、集成电路等。当通过软件实现时,该处理器可以是一个通用处理器,通过读取存储器中存储的软件代码来实现。
可选地,该芯片系统中的存储器也可以为一个或多个。该存储器可以与处理器集成在一起,也可以和处理器分离设置,本申请实施例并不限定。示例性地,存储器可以是非瞬时性处理器,例如只读存储器ROM,其可以与处理器集成在同一块芯片上,也可以分别设置在不同的芯片上,本申请实施例对存储器的类型,以及存储器与处理器的设置方式不作具体限定。
示例性地,该芯片系统可以是现场可编程门阵列(field programmable gate array,FPGA),可以是专用集成芯片(AP设备plication specific integrated circuit,ASIC),还可以是系统芯片(system on chip,SoC),还可以是中央处理器(central processor unit,CPU),还可以是网络处理器(network processor,NP),还可以是数字信号处理电路(digital signal processor,DSP),还可以是微控制器(micro controller unit,MCU),还可以是可编程控制器(programmable logic device,PLD)或其他集成芯片。
应理解,上述方法实施例中的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。结合本申请实施例所公开的方法步骤可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。
本申请实施例还提供一种计算机可读存储介质,该计算机可读存储介质中存储有计算机程序,当该计算机程序在计算机上上运行时,使得计算机执行上述相关步骤,以实现上述实施例中的智能设备控制方法。
本申请实施例还提供一种计算机程序产品,当该计算机程序产品在计算机上运行时,使得计算机执行上述相关步骤,以实现上述实施例中的智能设备控制方法。
另外,本申请实施例还提供一种装置。该装置具体可以是组件或模块,该装置可包括相连的一个或多个处理器和存储器。其中,存储器用于存储计算机程序。当该计算机程序被一个或多个处理器执行时,使得装置执行上述各方法实施例中的智能设备控制方法。
其中,本申请实施例提供的装置、计算机可读存储介质、计算机程序产品或芯片均用于执行上文所提供的对应的方法。因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。
结合本申请实施例公开内容所描述的方法或者算法的步骤可以硬件的方式来实现, 也可以是由处理器执行软件指令的方式来实现。软件指令可以由相应地软件模块组成,软件模块可以被存放于随机存取存储器(random access memory,RAM)、闪存、只读存储器(read only memory,ROM)、可擦除可编程只读存储器(erasable programmable ROM,EPROM)、电可擦可编程只读存储器(electrically EPROM,EEPROM)、寄存器、硬盘、移动硬盘、只读光盘(CD-ROM)或者本领域熟知的任何其它形式的存储介质中。一种示例性的存储介质耦合至处理器,从而使处理器能够从该存储介质读取信息,且可向该存储介质写入信息。当然,存储介质也可以是处理器的组成部分。处理器和存储介质可以位于专用集成电路(AP设备plication specific integrated circuit,ASIC)中。
通过以上的实施方式的描述,本领域技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明。实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成;即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请所提供的几个实施例中,应该理解到,所揭露的方法,可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的。例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式;例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,模块或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
计算机可读存储介质包括但不限于以下的任意一种:U盘、移动硬盘、只读存储器(read-only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (16)

  1. 一种智能设备控制方法,应用于第一电子设备,其特征在于,所述方法包括:
    显示第一界面,所述第一界面包括第一意图标识、以及第一群组对应的第一群组标识,所述第一群组包括可执行所述第一意图标识对应的第一意图的X个电子设备,所述X为正整数;
    接收用户对所述第一群组标识的第一操作;
    响应于所述第一操作,控制所述第一群组标识移向所述第一意图标识,并指示所述X个电子设备执行所述第一意图。
  2. 根据权利要求1所述的方法,其特征在于,在所述显示第一界面之前,所述方法还包括:
    显示第二界面,所述第二界面包括与多个电子设备分别对应的多个电子设备标识;
    接收从所述多个电子设备标识中选择X个电子设备标识的第二操作;
    响应于所述第二操作,建立包括所述X个电子设备的所述第一群组。
  3. 根据权利要求2所述的方法,其特征在于,所述方法还包括:
    将所述多个电子设备中相同品类属性和/或位置属性的电子设备对应的电子设备标识聚集显示。
  4. 根据权利要求1-3任一项所述的方法,其特征在于,在所述接收用户对所述第一群组标识的第一操作之前,所述第一意图标识显示在所述第一界面的第一区域,所述第一群组标识显示在所述第一区域以外的其他区域;所述第一操作包括:将所述第一群组标识移至所述第一区域。
  5. 根据权利要求4所述的方法,其特征在于,所述方法还包括:
    接收用户对所述第一群组标识的第三操作;
    响应于所述第三操作,在所述第一界面显示与所述X个电子设备分别对应的X个电子设备标识。
  6. 根据权利要求5所述的方法,其特征在于,在所述第一界面显示与所述X个电子设备分别对应的X个电子设备标识后,所述方法还包括:
    接收用户对所述X个电子设备标识中的第二电子设备对应的电子设备标识的第四操作;
    响应于所述第四操作,控制所述第二电子设备对应的电子设备标识移出所述第一区域,并指示所述第二电子设备取消执行所述第一意图。
  7. 根据权利要求1-6任一项所述的方法,其特征在于,所述X个电子设备的品类属性和/或位置属性相同。
  8. 根据权利要求1-7任一项所述的方法,其特征在于,所述方法还包括:
    在所述第一界面显示提示信息,所述提示信息用于反馈所述X个电子设备执行所述第一意图的情况。
  9. 根据权利要求4所述的方法,其特征在于,所述第一界面还显示有第二意图标识,所述方法还包括:
    接收用户将所述第二意图标识移至所述第一区域的第五操作;
    响应于所述第五操作,指示所述第一群组中的Y个电子设备执行所述第二意图标 识对应的第二意图,所述Y为正整数。
  10. 根据权利要求9所述的方法,其特征在于,在接收所述第五操作之后,所述方法还包括:
    接收用户对所述第一界面中显示的第二群组标识的第六操作,所述第二群组标识对应于包括可执行所述第一意图和所述第二意图的Z个电子设备的第二群组,所述Z为正整数;
    响应于所述第六操作,将所述第二群组标识移至所述第一区域,并指示所述Z个电子设备执行所述第一意图和所述第二意图。
  11. 根据权利要求10所述的方法,其特征在于,所述方法还包括:
    接收用户对所述第一区域的第七操作;
    响应于所述第七操作,控制所述第一群组标识和所述第二群组标识移出所述第一区域,并指示所述Y个电子设备和所述Z个电子设备取消执行所述第一意图和所述第二意图。
  12. 根据权利要求9所述的方法,其特征在于,所述方法还包括:
    接收用户对第二区域的第八操作,所述第二区域对应于所述第二意图;
    响应于所述第八操作,控制所述第二意图标识移出所述第一区域,并指示所述Y个电子设备取消执行所述第二意图。
  13. 根据权利要求1-12任一项所述的方法,其特征在于,
    所述第三操作为点击操作;
    所述第四操作、所述第五操作、所述第六操作、所述第八操作为拖动操作;
    所述第七操作为长按操作。
  14. 一种电子设备,其特征在于,包括:处理器、存储器和显示屏,所述存储器和所述显示屏与所述处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,当所述处理器从所述存储器中读取所述计算机指令,使得所述电子设备执行如权利要求1-13中任意一项所述的方法。
  15. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质包括计算机程序,当所述计算机程序在电子设备上运行时,使得所述电子设备执行如权利要求1-13中任意一项所述的方法。
  16. 一种计算机程序产品,其特征在于,当所述计算机程序产品在计算机上运行时,使得所述计算机执行如权利要求1-13中任意一项所述的方法。
PCT/CN2022/127999 2021-11-16 2022-10-27 智能设备控制方法及电子设备 WO2023088061A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111355520.0 2021-11-16
CN202111355520.0A CN116136659A (zh) 2021-11-16 2021-11-16 智能设备控制方法及电子设备

Publications (1)

Publication Number Publication Date
WO2023088061A1 true WO2023088061A1 (zh) 2023-05-25

Family

ID=86332893

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/127999 WO2023088061A1 (zh) 2021-11-16 2022-10-27 智能设备控制方法及电子设备

Country Status (2)

Country Link
CN (1) CN116136659A (zh)
WO (1) WO2023088061A1 (zh)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105376125A (zh) * 2015-12-08 2016-03-02 深圳众乐智府科技有限公司 一种智能家居系统操控方法及装置
CN105611047A (zh) * 2015-12-16 2016-05-25 芜湖美智空调设备有限公司 基于移动终端的快捷控制方法及装置
KR20180052347A (ko) * 2016-11-10 2018-05-18 삼성전자주식회사 음성 인식 장치 및 방법
CN108845503A (zh) * 2018-08-11 2018-11-20 深圳市百创网络科技有限公司 智能家居场景化服务的提供方法及其系统
CN110944236A (zh) * 2019-11-29 2020-03-31 维沃移动通信有限公司 一种群组创建方法及电子设备
CN111752165A (zh) * 2020-07-10 2020-10-09 广州博冠智能科技有限公司 一种智能家居系统的智能设备控制方法及装置
CN111897462A (zh) * 2020-07-17 2020-11-06 深圳市致趣科技有限公司 智能家居app中智能的显示控制方法及装置
CN112799305A (zh) * 2019-11-13 2021-05-14 北京安云世纪科技有限公司 一种智能家居控制方法及系统
CN113055255A (zh) * 2020-12-25 2021-06-29 青岛海尔科技有限公司 智能家电的场景配置方法和装置、存储介质及电子设备

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105376125A (zh) * 2015-12-08 2016-03-02 深圳众乐智府科技有限公司 一种智能家居系统操控方法及装置
CN105611047A (zh) * 2015-12-16 2016-05-25 芜湖美智空调设备有限公司 基于移动终端的快捷控制方法及装置
KR20180052347A (ko) * 2016-11-10 2018-05-18 삼성전자주식회사 음성 인식 장치 및 방법
CN108845503A (zh) * 2018-08-11 2018-11-20 深圳市百创网络科技有限公司 智能家居场景化服务的提供方法及其系统
CN112799305A (zh) * 2019-11-13 2021-05-14 北京安云世纪科技有限公司 一种智能家居控制方法及系统
CN110944236A (zh) * 2019-11-29 2020-03-31 维沃移动通信有限公司 一种群组创建方法及电子设备
CN111752165A (zh) * 2020-07-10 2020-10-09 广州博冠智能科技有限公司 一种智能家居系统的智能设备控制方法及装置
CN111897462A (zh) * 2020-07-17 2020-11-06 深圳市致趣科技有限公司 智能家居app中智能的显示控制方法及装置
CN113055255A (zh) * 2020-12-25 2021-06-29 青岛海尔科技有限公司 智能家电的场景配置方法和装置、存储介质及电子设备

Also Published As

Publication number Publication date
CN116136659A (zh) 2023-05-19

Similar Documents

Publication Publication Date Title
WO2020192714A1 (zh) 显示设备控制页面的方法、相关装置及系统
JP6275268B2 (ja) スマート機器グルーピングシステム、方法および装置
US10091020B2 (en) Electronic device and gateway for network service, and operation method therefor
CN113272745B (zh) 智能家居设备分享系统、方法及电子设备
CN110795179B (zh) 一种显示方法及电子设备
CN111614524A (zh) 一种多智能设备联动控制的方法、设备及系统
CN107948231B (zh) 基于场景的服务提供方法、系统和操作系统
CN111505946B (zh) 设备控制方法和设备
WO2022068483A1 (zh) 应用启动方法、装置和电子设备
JP7234379B2 (ja) スマートホームデバイスによってネットワークにアクセスするための方法および関連するデバイス
WO2022156535A1 (zh) 分布式应用的处理方法和装置
WO2023071454A1 (zh) 场景同步方法、装置、电子设备及可读存储介质
WO2023207761A1 (zh) 外设控制方法、电子设备及系统
US11412555B2 (en) Mobile terminal
WO2022042751A1 (zh) 一种移动轨迹生成方法和装置
KR20180060685A (ko) 전자 장치 및 그의 제어 방법
WO2023088061A1 (zh) 智能设备控制方法及电子设备
WO2023051643A1 (zh) 设备控制方法、相关装置及通信系统
CN114095542A (zh) 显示控制方法及电子设备
WO2023216892A1 (zh) 场景设置方法及电子设备
CN118119901A (zh) 场景设置方法及电子设备
WO2024027713A1 (zh) 场景配置方法、电子设备及系统
WO2023198196A1 (zh) 设备控制方法及电子设备
WO2024067308A1 (zh) 智能设备控制方法、电子设备及系统
WO2023071590A1 (zh) 输入控制方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22894598

Country of ref document: EP

Kind code of ref document: A1