WO2020133495A1 - 一种智能设备管理方法、移动终端及系统 - Google Patents

一种智能设备管理方法、移动终端及系统 Download PDF

Info

Publication number
WO2020133495A1
WO2020133495A1 PCT/CN2018/125815 CN2018125815W WO2020133495A1 WO 2020133495 A1 WO2020133495 A1 WO 2020133495A1 CN 2018125815 W CN2018125815 W CN 2018125815W WO 2020133495 A1 WO2020133495 A1 WO 2020133495A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart device
server
mobile terminal
instruction
file
Prior art date
Application number
PCT/CN2018/125815
Other languages
English (en)
French (fr)
Inventor
黄威
周鼎
劳成彪
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2018/125815 priority Critical patent/WO2020133495A1/zh
Priority to CN201880100359.2A priority patent/CN113273151A/zh
Publication of WO2020133495A1 publication Critical patent/WO2020133495A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/40—Network security protocols

Definitions

  • Embodiments of the present disclosure relate to the field of smart terminals, and more specifically, to a smart device management method, mobile terminal, and system.
  • the QR code printed on the smart device can be scanned through the application for controlling the smart device installed on the mobile terminal, and the relevant credentials can be generated by the QR code and sent to the cloud server to realize the binding of the user account and the smart device Fixed association.
  • This article describes a smart device management method, mobile terminal, and system that can provide a more secure and easy-to-operate binding solution.
  • this application provides a smart device management method.
  • the smart device management method includes: a mobile terminal sends a first request to a server, the first request includes a first identifier of the smart device; the server sends a first instruction to the smart device in response to the first request, and sends a second instruction to the mobile The terminal; the smart device performs at least one operation according to the first instruction; the mobile terminal responds to the second instruction, records the process that the smart device performs the at least one operation described above and generates a recorded first file; the mobile terminal sends the first file to the server The server determines whether at least one operation performed by the smart device matches the above-mentioned first instruction according to the first file; the server responds to the determination that the at least one operation performed by the smart device matches the above-mentioned first instruction, and the first The logo is associated with the user management account established on the server.
  • the main purpose of the binding operation of the smart device and the user account is to confirm that the user holds the smart device and establish the association relationship between the user account and the device.
  • the smart device can dynamically perform the corresponding operation based on the first instruction, and the user needs to record the process of performing the operation of the smart device through the camera or microphone of the mobile terminal. Therefore, this method can confirm that the user does indeed hold the smart device.
  • the first instruction may be randomly generated by the server according to the operation capability of the smart device.
  • the server can generate a variety of combined operation sequences according to the capabilities of the smart device. These operation sequences are valid at a time and can reach a fairly high level of security.
  • the user of the mobile terminal can bind the smart device to the user account only by recording the process of performing at least one operation by the smart device, and the operation is simple. Moreover, the smart device does not need to paste an identification mark (such as a two-dimensional code), and the appearance is more beautiful.
  • the first identification of the smart device may be dynamically allocated by the server instead of being written to the smart device in the generation link, which may improve the security of the binding process.
  • the mobile terminal sends the first information of the smart device to the server; the server obtains the first identification of the smart device according to the first information and sends the first identification to the mobile terminal, where the first information is one of the following parameters Item or any combination: the serial number of the smart device, the media access control address.
  • the first identifier of the smart device is randomly generated by the server according to the first information. Moreover, the first identification is used to uniquely identify the smart device. Using the first identification assigned by the server can improve the uniqueness, integrity and confidentiality of the data.
  • the server may randomly generate the first instruction according to the set of operation capabilities of the smart device.
  • the set of operating capabilities of the smart device represents some of the operating parameters that the smart device can perform, for example, the change parameters of the color and brightness of the indicator light, the change parameters of the timbre, tone, intensity and length of the sound, the vibration parameters of the vibration motor, or Sports mode parameters, etc.
  • the first instruction may include an operation instruction sequence (for example, the operation sequence is on, off, on).
  • the server may sequentially send the instructions in the operation sequence to the smart device for execution at a certain interval (for example, send the instructions to turn on, off, and light on to the smart device for execution at a certain interval).
  • the at least one operation performed by the smart device according to the first instruction includes one or any combination of the following operations: sound operation, light operation, and motion operation.
  • the sound operation includes at least one operation of the timbre, pitch, intensity, or length of the sound.
  • the light operation includes color operation or brightness operation of the light.
  • the motion operation includes a vibration operation or a movement operation.
  • the server recognizes the image information and audio information in the first file to obtain the operation behavior characteristic of the smart device; and determines whether the operation behavior characteristic matches the second instruction.
  • the mobile terminal can control the smart device to perform the operation event.
  • the mobile terminal performs a process of performing at least one operation through at least one recording smart device in the camera or the microphone.
  • an embodiment of the present application provides another method for managing a smart device.
  • the method includes: a mobile terminal sends a first request to a server, where the first request includes a first identification of the smart device; and the smart device receives the first instruction sent by the server ; In response to the first instruction, the smart device performs at least one operation; the mobile terminal receives the second instruction sent by the server; in response to the second instruction, the mobile terminal records the process of the smart device performing at least one operation and generates the recorded first A file; the mobile terminal sends the first file to the server, the first file is used by the server to determine whether at least one operation performed by the smart device matches the second instruction; the mobile terminal receives an association success notification from the server, and the association success notification indicates: After determining that at least one operation performed by the smart device matches the second instruction, the server successfully associates the first identification of the smart device with the user management account established on the server.
  • an embodiment of the present application provides an intelligent device management system.
  • the system includes the mobile terminal, the intelligent device, and the server according to the first aspect.
  • an embodiment of the present application provides another intelligent device management system.
  • the system includes the mobile terminal and the intelligent device according to the second aspect.
  • an embodiment of the present application provides a method for managing a smart device.
  • the method includes: in response to a first touch input, displaying a first user interface, the first user interface includes a first interface element, and the first interface element is used for Add a smart device; receive a second touch input that selects the above-mentioned first interface element; in response to the second touch input, display a second user interface, the second user interface includes a smart device identification; receive a third selection of the smart device identification Touch input; in response to the third touch input, a network configuration interface is displayed, wherein the network configuration interface is used to receive the SSID and/or password input by the user; send the SSID and/or password to the smart device; start the camera and record the smart device to perform at least An operation process and generating a first file; sending the first file to the server; receiving an association success notification sent by the server, the association success notification indicating that the server successfully associated the smart device with the user management account.
  • embodiments of the present application provide a mobile terminal, including: a touch screen; one or more processors; one or more memories; and one or more computer programs, where one or more computer programs are stored in In the one or more memories, the one or more computer programs include instructions that, when executed by the mobile terminal, cause the mobile terminal to execute the mobile terminal in the first aspect, second aspect, or fifth aspect Method steps.
  • an embodiment of the present application provides a computer program product containing instructions that, when the computer program product runs on a mobile terminal, causes the mobile terminal to execute the mobile terminal in the first aspect, the second aspect, or the fifth aspect Method steps performed.
  • an embodiment of the present application provides a computer-readable storage medium that stores instructions, and when the instructions run on a mobile terminal, the mobile terminal executes the first aspect described above Or the method steps performed by the mobile terminal in the second aspect or the fifth aspect.
  • a communication connection has been established between the smart device, the mobile terminal, and the server (such as a cloud server).
  • the cloud server can send instructions to the smart device to cause the smart device to perform operations such as flashing lights, changing colors, or making sounds;
  • the user records the process of the smart device performing the above operations and provides the recording credentials to the server, and finally completes the smart device binding on the cloud server to obtain the complete control authority of the smart device.
  • the user can use the management APP to obtain complete device control rights (such as controlling the switch of the air conditioner, working mode, target temperature, wind speed, etc.).
  • This solution only requires that the smart device has a state change that can be observed by the outside world, such as the blinking of the lamp, the change of the color of the lamp, the change of the icon, the change of the character, the buzzer sound, or the observable movement track, and then the feature can be used to complete the intelligence Device management account binding.
  • This solution does not need to intervene in the production or sales of intelligent hardware, and it is also not limited by the size and installation location of the equipment.
  • FIG. 1 is a schematic diagram of a smart device management system provided by an embodiment of the present application
  • FIG. 2 is a schematic diagram of a smart device registration process provided by an embodiment of the present application.
  • 3A is a signaling interaction diagram of smart device binding provided by an embodiment of the present application.
  • FIG. 3B is another signaling interaction diagram of smart device binding provided by an embodiment of the present application.
  • 4A, 4B, 4C, 4E, 4F, and 4G show user interfaces during the process of adding smart devices to the mobile terminal in the embodiment of the present application
  • FIG. 8 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of a communication device according to an embodiment of the present application.
  • FIG. 1 shows an example of a smart device management system 100 in which one or more of the devices, methods, systems, and/or computer program products described further herein may be applicable.
  • the depicted smart device management system 100 includes one or more smart devices 118.
  • the smart device 118 may receive control instructions of the mobile terminal or the server, and perform corresponding operations according to the above control instructions.
  • the smart device 118 represents various smart devices, such as the light bulb 102, the switch 104, the socket 106, and the sound box 108 in FIG.
  • the smart devices 102, 104, 106, and 108 and other smart home devices are collectively referred to as "smart devices.”
  • the light bulb 102 can control the change of the light, such as the change of the color and brightness of the light.
  • the switch 104 can control the turning on or off of other smart devices, for example, control the turning on and off of the light bulb 102.
  • the switch 104 can also detect ambient lighting conditions to control the power and/or light and dark states of the one or more light bulbs 102.
  • the outlet 106 may control the power supply of one or more outlets (eg, receive a remote control instruction to turn on the power supply or turn off the power supply).
  • the speaker 108 can perform voice interaction with the user, for example, can receive the user's voice control instruction to play the user's favorite song.
  • the speaker 108 may have an integrated voice assistant module that can provide interactive voice conversation or query functions through a "wake word" (e.g., "Hello, Xiaoyi").
  • the smart device management system 100 further includes one or more mobile terminals 110, and the mobile terminal 110 may include a smart phone, a laptop computer, a desktop computer, a tablet computer, a smart watch, a smart bracelet, and the like.
  • the smart device management system 100 also includes a wireless router 112.
  • the smart devices can communicate via the wireless router 112 (for example, the light bulb 102 communicates with the switch 104 through the wireless router 112).
  • the smart devices can also communicate with each other via a connection of a network, such as the network 114.
  • the network 114 the smart device can communicate with the server 116 and the mobile terminal 110.
  • the smart device and the mobile terminal 110 can also directly communicate (for example, through short-range communication technologies such as Wi-Fi, NFC, and Bluetooth).
  • the mobile terminal 110 and the smart device 118 may also use other wireless communication technologies (eg, ZigBee, infrared) to communicate.
  • the mobile terminal 110 and the smart device 118 may be connected to the network 114 through other types of smart home gateways (eg, ZigBee gateways), and then communicate with the server 116.
  • the server 116 can be used as a media platform to implement communication between the home and external control devices to meet the needs of remote control, detection, and information exchange.
  • the server 116 is associated with the manufacturer or service provider of the smart device. For example, the server 116 may automatically send software updates to smart devices or provide cloud services for smart devices.
  • the speaker 108 and the server 116 communicate through the network 114.
  • the user issues an instruction to "inquire air tickets from A to B" to the speaker 108.
  • the voice interaction system of the speaker 108 collects the above-mentioned voice through a voice algorithm processing unit and an audio decoding unit, reduces noise, recognizes wake words, converts the voice signal into a digital signal, and then uploads the processed digital signal to the server 116.
  • the server 116 will perform speech digital coding recognition and semantic understanding, and then call the information in the ticket reservation database and pass it to the speaker 108.
  • the speaker 108 restores the above ticket reservation information to a voice signal through the sound effect unit and plays it out.
  • Examples of the network 114 may include a local area network (LAN) and a wide area network (WAN), such as the Internet.
  • the communication network 114 can be implemented using any known network protocol, including various wired or wireless protocols, such as, for example, Ethernet, Universal Serial Bus (USB), Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE ), code division multiple access (CDMA), time division multiple access (TDMA), long-term evolution (LTE), fifth-generation mobile communication (5G), Bluetooth, wireless fidelity (Wi-Fi) any other suitable communication protocol.
  • USB Universal Serial Bus
  • GSM Global System for Mobile Communications
  • EDGE Enhanced Data GSM Environment
  • CDMA code division multiple access
  • TDMA time division multiple access
  • LTE long-term evolution
  • 5G fifth-generation mobile communication
  • Wi-Fi wireless fidelity
  • the mobile terminal 110 can communicate through the Wi-Fi network provided by the router 112.
  • the mobile terminal 110 can communicate with the server 116 via the network 114 via the router 112.
  • the user may communicate with the server 116 through the network 114 through the mobile terminal 110 to observe the image captured by the smart camera in the home. Before returning home at night, the user can control the air conditioner to adjust to an appropriate temperature in advance through the mobile terminal 110.
  • the smart device may be bound or paired with the user management account registered on the server.
  • the server 116 is responsible for managing the smart device management account of one or more users. The user can perform the binding or pairing operation when the smart device is unpacked for the first time and powered on or after the smart device system is reset.
  • the user management account may be associated with a specific user or a specific group of users (eg, family or group).
  • the user can establish a user account through the account management function of a smart device management application (for example, a smart home APP), apply for a user management account and set a management password, and can also request reasonable management authority as needed.
  • a smart device management application for example, a smart home APP
  • the user management account can be associated with one or more smart devices.
  • the user management account usually includes a collection of data and services necessary for the operation of the smart home device or the ecosystem of the smart home device.
  • user management accounts will be described as related to cloud-based service providers with "cloud servers” (eg, computing devices that utilize cloud computing technology and large-scale distributed storage technology to meet various application needs)
  • the "cloud server” can be accessed by smart devices through the network 114, and can be accessed through the network 114 via mobile terminals (eg, tablet computers, smart phones, wearable devices).
  • a particular user management account is often uniquely identified by the user's email address or mobile phone number, and may also be named using other accounts (eg, social networking site accounts).
  • the purpose of the binding or pairing process is to associate the unique identification of the smart device (eg, the media access control (MAC) address or other unique identifier of the smart device) with the user management account.
  • the user can control the smart device 118 by managing the account. For example, turning on or off the light bulb, adjusting the temperature of the smart air conditioner, opening the door or playing music, or allowing users to stop or start work at the same time according to the rules set by the user (for example, after the smart device management application is away from home mode, all home lights and appliances All are automatically turned off, or after the home mode of the smart device management application is turned on, the lights, air conditioners, water heaters, etc. are adjusted to the appropriate working state).
  • the specific examples of the binding process will be discussed in detail below.
  • the smart device 118 (for example, the smart device 102 (bulb)) shown in FIG. 1 will be used as an example to introduce the smart device management method.
  • the smart device may be connected to the Wi-Fi network created by the router 112 first.
  • the smart home management platform for example, the server 116
  • the smart devices that are connected to the management platform for the first time network need to be registered and authenticated.
  • Figure 2 shows the signaling for registering smart devices Interactive diagram.
  • step 202 the mobile terminal 110 sends the network SSID and password of the Wi-Fi network to the smart device 118.
  • the user can download the management application of the smart device 118 (or the smart home platform application of the cloud service provider of the smart device 118) and install it in the mobile terminal 110.
  • the user sets a user management account through the management application of the smart device 118.
  • the user can add a new smart device and send the network SSID and password of the Wi-Fi network to the smart device 118 at the beginning of the adding or binding process.
  • the user first activates the smart device 118 (eg, connects it to the home power system and turns it on).
  • the user can select an option such as "add new device” in the management application or specifically specify the new device model (eg, light bulb, switch, socket, speaker, etc.) he/she is adding.
  • the network SSID and password of the Wi-Fi network are transmitted to the smart device 118 through various methods.
  • the smart device 118 may establish a temporary Wi-Fi network after being powered on, that is, the smart device 118 is in an access point (AP) mode.
  • the mobile terminal 110 is in a station (STA, station) mode, and the mobile terminal 110 is connected to the temporary Wi-Fi network of the smart device 118 to form a local area network.
  • the mobile terminal 110 sends the SSID and password of the Wi-Fi network to the smart device 118 through the temporary Wi-Fi network.
  • the mobile terminal 110 may establish a temporary Wi-Fi network, that is, the mobile terminal 110 is in an access point (AP) mode.
  • the smart device 118 is in a station (STA, station) mode, and the smart device 118 is connected to the temporary Wi-Fi network of the mobile terminal 110 to form a local area network.
  • the mobile terminal 110 sends the SSID and password of the Wi-Fi network to the smart device 118 through the temporary Wi-Fi network.
  • the smart device 118 listens to all packets in the network after being powered on and started.
  • the mobile terminal 110 encodes the Wi-Fi network SSID and password into a UDP message and sends it through a broadcast packet or a multicast report. After receiving the UDP message, the smart device 118 decodes to obtain the correct Wi-Fi network SSID and password.
  • the mobile terminal 110 can also transfer the SSID and password of the Wi-Fi network to the smart device 118 through other communication protocols (eg, NFC, Bluetooth, and other short-range communication protocols).
  • the mobile terminal 110 may send the SSID and password of the encrypted Wi-Fi network to the smart device 118, thereby improving the security of data transmission.
  • the smart device 118 decrypts using the corresponding key to obtain the SSID and password.
  • step 204 the smart device 118 obtains the network SSID and password of the Wi-Fi network and automatically connects to the router 112 identified by the network SSID of the Wi-Fi network.
  • the mobile terminal 110 requests to register the smart device 118.
  • the mobile terminal 110 may provide the server 116 with the first information of the smart device 118.
  • the first information may be the serial number of the smart device 118, or information such as a media access control (MAC) address (for example, 802.11 MAC address).
  • MAC media access control
  • the smart device 118 may send the above-mentioned first information to the mobile terminal 110 through the temporary Wi-Fi network established by it.
  • the smart device 118 may also send the above-mentioned first information to the mobile terminal 110 through other communication protocols (eg, NFC, Bluetooth, and other short-range communication protocols).
  • step 208 in response to the request, the server 116 provides the mobile terminal 110 with the configuration information of the smart device 118.
  • the configuration information may include the first identification of the smart device 118.
  • the first identification may be used to pair the smart device 118 with the user management account of the server 116.
  • the first identification is generated by the server 116 based on the first information, and may be a serial number or name that can uniquely identify the smart device 118.
  • the first identifier is obtained by the server 116 querying a database, which stores the correspondence between the first information of the smart device and the configuration information.
  • the configuration information may further include a registration code, which is used by the server 116 to subsequently verify the identity of the smart device 118. After completing the first power-on registration of the smart device 118, after each subsequent reconnection to the network, it is necessary to request the login server 116 using the registration code. Since the configuration information (for example, the first identification of the smart device) sent from the server 116 is dynamically allocated, it is more secure than the serial number or MAC address of the smart device 118, and is not easily leaked or forged.
  • a registration code which is used by the server 116 to subsequently verify the identity of the smart device 118. After completing the first power-on registration of the smart device 118, after each subsequent reconnection to the network, it is necessary to request the login server 116 using the registration code. Since the configuration information (for example, the first identification of the smart device) sent from the server 116 is dynamically allocated, it is more secure than the serial number or MAC address of the smart device 118, and is not easily leaked or forged.
  • the mobile terminal 110 sends the above configuration information (e.g., the first identification and/or registration code of the smart device 118) to the smart device 118.
  • the mobile terminal 110 can encrypt and transmit the above configuration information to the smart device 118.
  • the smart device 118 initiates registration with the server 116. After the smart device 118 can establish a communication connection with the server 116, it sends the above configuration information (for example, the first identification and/or registration code of the smart device 118) to the server 116 and negotiates a communication key, which is used to communicate the smart device 118 with the server Future communications between 116 are encrypted.
  • the above configuration information for example, the first identification and/or registration code of the smart device 118
  • the smart device 118 completes the steps of accessing the Wi-Fi network, and establishes a communication connection with the server through the Wi-Fi network, which lays a foundation for subsequent reception of the server's operation instructions.
  • FIG. 3A shows a signaling interaction diagram of smart device binding according to some embodiments of the present application.
  • the mobile terminal 110 sends a first request to the server 116 for requesting to bind the smart device 118.
  • the first request may carry the first identification of the smart device 118.
  • the first identification may be dynamically generated by the server 116, so it is not easy to leak and forge.
  • the mobile terminal 110 may send the first information of the smart device 118 to the server 116.
  • the server 116 obtains the first identification of the smart device 118 according to the first information and sends the first identification to the mobile terminal 110, where the first information includes the serial number or media access control address of the smart device 118.
  • the server 116 sends a second instruction to the mobile terminal 110, and the second instruction instructs the mobile terminal 110 to perform a recording operation (for example, audio or video recording).
  • the server 116 may send a start recording instruction to the mobile terminal 110, and the start recording instruction instructs the mobile terminal to start a camera and/or a microphone to record the operation event of the smart device 118 (for example, recording the light brightness change, color change, sound of the smart device 118) Change or movement change).
  • the mobile terminal 110 starts the recording operation in response to the second instruction.
  • the mobile terminal 110 receives a second instruction from the server 116 (for example, a recording start notification instruction), automatically starts the camera to collect images, and starts the microphone to obtain audio data, and obtains the final recorded data and stores it in the first file .
  • the mobile terminal 110 receives a second instruction from the server 116 (for example, a recording start notification), and displays a prompt to start recording for the smart device 118.
  • the user starts the recording function in the camera or video recorder application according to the recording prompt.
  • Starting the function can be regarded as inputting a recording start command, which is usually input by the user through an input device (physical keyboard, button or touch screen) of the mobile terminal 110 (For example, click the record button displayed on the screen).
  • the server 116 sends a first instruction to the smart device 118.
  • the first instruction may be an operation sequence instructing the smart device to perform at least one operation.
  • the server 116 generates the first instruction according to the operation capability of the smart device 118. For example, for the light bulb 102, it can show changes in light color (red, yellow, green), brightness (brightness level 1, brightness level 2, brightness level 3), etc., and its operation capability can be expressed as ⁇ red, yellow, green, brightness Level 1, brightness level 2, brightness level 3 ⁇ .
  • the operation sequence included in the first instruction may be a sequence of lighting instructions. For example, a variety of operation sequences can be formed in accordance with the arrangement and combination of lighting control operations. For example, operation sequence 1: on, off, on.
  • each of the at least one operation includes one or any combination of the following operations: sound adjustment operation, light adjustment operation, or motion operation.
  • the sound adjustment operation includes one or any combination of the following operations: timbre adjustment, tone adjustment, tone intensity adjustment, or tone length adjustment.
  • Light operation includes color adjustment or light brightness adjustment.
  • Motion operations include vibration or movement.
  • the light bulb 102 performs operations of turning on, turning off, and turning on according to operation sequence 1.
  • step 352 the mobile terminal 110 sends the first file to the server 116.
  • the server 116 determines whether at least one operation performed by the smart device matches the above-mentioned first instruction according to the first file. In some embodiments, the server 116 recognizes the image information and audio information in the first file to obtain the operation behavior characteristic of the smart device 118; and then determines whether the operation behavior characteristic matches the first instruction.
  • step 356 in response to determining that at least one operation performed by the smart device 118 matches the first instruction, the server 116 associates the smart device with the user management account. In some embodiments, the server 116 associates the first identification of the smart device 118 with the user management account established at the server.
  • step 358 the server 116 sends a notification of successful association to the mobile terminal 110.
  • the mobile terminal can control the smart device to perform an operation event (for example, control the smart device to be turned on or off through the smart device management application, adjust the light brightness of the smart device, etc.).
  • FIG. 3B shows a signaling interaction diagram of smart device binding according to some embodiments of the present application.
  • the mobile terminal 110 sends a first request to the server 116 for requesting to bind the smart device 118.
  • the first request may carry the first identification of the smart device 118 (for example, the first identification of the smart device 118 mentioned above).
  • the first identification may be dynamically generated by the server 116, so it is not easy to leak and forge.
  • the mobile terminal 110 may also send the aforementioned serial number or MAC (eg, 802.11 MAC address) address and other information of the smart device to the server 116 in step 302 to bind the smart device 118.
  • MAC eg, 802.11 MAC address
  • step 302 it may further include at least one of the following steps:
  • the mobile terminal 110 displays a first user interface (for example, the user interface 402 shown in FIG. 4A) in response to the first touch input.
  • the first user interface includes a smart sweeper 406 and a smart speaker 408.
  • the first user interface may also include a smart device adding interface element (the plus icon in the upper right corner of FIG. 4A). For example, the user opens the user interface 402 shown in FIG. 4A through the management application of the smart device 118 (or the smart home platform application of the cloud service provider of the smart device 118);
  • a second user interface is displayed, the second user interface includes a smart device list, and the smart device list includes an identifier of the first smart device (For example, the identification of a smart device to be bound nearby is "smart bulb A").
  • the add smart device button 404 the plus icon in the upper right corner of FIG. 4A
  • a second user interface 410 as shown in FIG. 4B is displayed, and the second user interface 410 includes a smart light bulb A412 to be bound.
  • the smart device list displayed in the second user interface may include one or more smart devices.
  • the second user interface further includes a "scanning device” interface element, and the user may select a “scanning device” button to discover surrounding bindable devices.
  • the second interface also includes a "manually add device” interface element, and the user can select the "manually add” button to select and add a smart device.
  • the mobile terminal stores the SSID of the Wi-Fi network, and the user directly selects the user interface to send The network SSID to the smart device 118 can send the corresponding SSID and password to the smart device.
  • the recording interface may include a video recording frame 422, and may also include a prompt 424 for prompting the smart device 118 to record and reminding the user to point the camera at the smart device 118;
  • step 302 Detect whether the camera is aimed at the smart device 118, wherein the mobile terminal 110 can perform image content recognition on the image collected by the camera, and determine whether the currently collected image content matches a certain type of smart device 118 selected by the user. Then step 302 is performed.
  • the mobile terminal 110 can perform image content recognition on the image collected by the camera, and extract image features to describe the visual content of the image, such as color, shape, and texture. If the extracted image features and the mobile terminal 110 pre-stored If the characteristics of the smart device 118 match, step 302 is executed.
  • the mobile terminal 110 may send the image collected by the camera to an image recognition server for image content recognition.
  • the image recognition server extracts image features to describe the visual content of the image, such as color, shape, and texture. If the image feature matches the feature of the smart device 118 pre-stored by the image recognition server, step 302 is executed.
  • step 304 the server 116 determines whether the smart device is not bound. If the smart device is not bound, step 306 is executed. The smart device must have completed registration (for example, the registration process shown in FIG. 2) and has not been bound before it can request binding. If the smart device 118 has been bound to a certain user management account, the mobile terminal 110 is directly notified that the binding has failed.
  • the server 116 sends a second instruction to the mobile terminal 110 to notify the mobile terminal 110 to start the operation process of the recording smart device 118.
  • the server 116 may send a start recording instruction to the mobile terminal 110, and the start recording instruction instructs the mobile terminal to start a camera and/or a microphone to record the operation event of the smart device.
  • the server 116 may also notify the mobile terminal 110 to obtain other operation information of the smart device 118.
  • the mobile terminal 110 acquires Bluetooth broadcast information of the smart device 118 through Bluetooth, or acquires specific information of the smart device 118 through NFC.
  • step 308 the mobile terminal 110 starts the process of recording the smart device 118 to perform at least one operation.
  • the mobile terminal 110 receives the recording start notification from the server 116 in step 306, automatically starts the camera to collect image frames, and starts the microphone to obtain audio data to obtain the final recorded data.
  • step 306 is optional, and the mobile terminal 110 may directly perform the recording process after step 302, that is, it does not need to receive the start recording notification sent by the server 116.
  • the mobile terminal 110 displays a prompt to start recording for the smart device 118. The user starts the recording function in the camera or video recorder application according to the recording prompt. Starting the function can be regarded as inputting a recording start command, which is usually input by the user through an input device (physical keyboard, button or touch screen) of the mobile terminal 110 (For example, click the record button displayed on the screen).
  • step 310 the server 116 generates a first instruction according to the operation capability of the smart device 118, and the first instruction instructs the smart device 118 to perform at least one operation.
  • the server 116 queries the device model of the smart device 118 according to the first identification of the smart device 118.
  • the server 116 acquires the operation capability set of the smart device 118 that matches the device model of the smart device 118, and generates a first instruction according to the operation capability set of the smart device 118.
  • the server 116 stores the first instruction that matches the set of operational capabilities of the smart device 118.
  • the server 116 may query the first instruction matching the set of operating capabilities of the smart device 118 and send the first instruction to the smart device 118.
  • the first instruction may include at least one operation instruction during the binding operation, and each operation instruction corresponds to an operation (for example, a brightness adjustment instruction corresponds to a brightness adjustment operation, a color adjustment instruction corresponds to a color adjustment operation, and a sound adjustment instruction corresponds to a sound adjustment operation ).
  • the first instruction may be an operation sequence indicating that the smart device performs at least one operation.
  • the operational capability set indicates the set of control operations that the smart device 118 can perform.
  • the set of operational capabilities of the smart device 118 includes changes in light color and brightness parameters (for example, the colors that can be displayed by the smart device 118 include three types: red, yellow, and green, and the brightness changes can exhibit three different brightness levels, etc., then
  • the operation capability set of the smart device 118 can be expressed as ⁇ red, yellow, green, brightness level 1, brightness level 2, brightness level 3 ⁇ ); the operation capability set of the smart device 118 is in addition to the change parameters of the color and brightness of the indicator light, It can also include the parameters of the timbre, pitch, intensity and length of the sound, and of course the vibration parameters of the vibration motor of the smart device 118.
  • the set of operational capabilities of the smart device 118 may also only be the motion mode parameters of the device 118.
  • the server may query a specific database to obtain the capability set of the smart device 118, where different smart device 118 models and their corresponding sets of operating capabilities are recorded in the database.
  • the light bulb 102 may emit light
  • the power indicator light of the speaker 108 may emit light
  • the switch 104 or the socket 106 may also have an indicator light.
  • the above operation sequence may be a sequence of lighting instructions.
  • a variety of operation sequences can be formed in accordance with the arrangement and combination of lighting control operations. For example, operation sequence 1: on, off, on; operation sequence 2: on, off, on, off.
  • the light bulb includes a light bulb 502 and a screw-in base 504. In response to the sequence of operations, the light bulb 502 can produce a change in light intensity.
  • the operation sequence may be a color change of a group of lights.
  • the indicator light of the smart device 118 may present four different colors, namely, red, green, blue, and yellow.
  • operation sequence 1 red, green, blue, yellow
  • operation sequence 2 red, green, yellow, blue
  • operation sequence 3 red, yellow, blue, green.
  • operation sequence 4 red (display 2 seconds), yellow (display 1 second), blue (display 3 seconds), green (display 2 seconds) ); operation sequence 5: red (display 1 second), yellow (display 3 seconds), blue (display 3 seconds), green (display 2 seconds); operation sequence 6: red (display 2 seconds), yellow (display 2 Seconds), blue (displayed for 3 seconds), green (displayed for 2 seconds).
  • operation sequence 4 red (display 2 seconds), yellow (display 1 second), blue (display 3 seconds), green (display 2 seconds)
  • operation sequence 5 red (display 1 second), yellow (display 3 seconds), blue (display 3 seconds), green (display 2 seconds)
  • operation sequence 6 red (display 2 seconds), yellow (display 2 Seconds), blue (displayed for 3 seconds), green (displayed for 2 seconds).
  • the light bulb 502 can produce a light color change.
  • the operation sequence may indicate the sound changes of a group of speakers.
  • the speakers of the smart device 118 may emit sounds with different timbre, pitch, intensity and length.
  • Various operation sequences can be formed according to different combinations of timbre, pitch, intensity and length.
  • the operation sequence frequency 1 (10 MHz for 2 seconds), frequency (12 MHz for 3 seconds), frequency (13 MHz for 2 seconds), frequency (15 MHz for 2 seconds).
  • the screw-in base 504 of the light bulb in FIG. 5 may include a speaker, which can perform the sound operation indicated by the above operation sequence, and the user can also hear the sound played by the light bulb.
  • the sequence of operations may indicate a set of motions.
  • the smart device 118 has a vibration motor, which may simulate vibration feedback and cause the smart device 118 to perform vibration motion.
  • the vibration motor can form various operation sequences according to different combinations of vibration frequency and amplitude.
  • the operation sequence frequency 1 (for 2 seconds), frequency 2 (for 3 seconds), frequency 3 (for 2 seconds), frequency 4 (for 2 seconds), where frequency 1, frequency 2, frequency 3, and frequency 4 represent Four different vibration frequencies.
  • the smart device 118 is a smart sweeper with mobile capabilities, which can move freely on the ground.
  • the operation sequence may include a movement trajectory.
  • the operation sequence 1 may be: moving forward 30 cm, moving left 10 cm, moving backward 10 cm.
  • the intelligent sweeper in FIG. 6 may perform the corresponding movement according to the illustrated arrows operating.
  • the operation sequence 2 may be an S-shaped curve movement for ten seconds.
  • FIG. 6 also shows an example of the trajectory of the S-shaped curve movement.
  • This sequence of operations may indicate an image change on the display screen of the smart device 118.
  • the smart device 118 is a speaker with a display screen, which can display characters, pictures, or other patterns.
  • the operation sequence may include displaying at least one pattern, for example: a string of random serial numbers, a picture, a string of text, and so on.
  • the operation sequence may include displaying a combination of at least one pattern and sound.
  • the speaker 700 in FIG. 7 may display a fish pattern as a response to the operation sequence.
  • the smart device 118 may also generate and display a two-dimensional code according to the first instruction received in step 308, and the mobile terminal 110 may scan the two-dimensional code displayed by the smart device 118 to perform the binding operation.
  • the mobile terminal 110 may scan the two-dimensional code displayed by the smart device 118 to perform the binding operation.
  • the operation sequence may be randomly generated by the server 116.
  • the operation sequence may correspond to a sequence of on and off commands for a group of power indicator lights. Taking the command sequence including 16 light-off control operations as an example, the combination of state command sequence changes can reach 65536 (ie, 2 16 , 2 to the 16th power).
  • the operation sequence is valid for a single time, and a relatively high safety level can be achieved.
  • step 312 the server 116 sends the first instruction to the smart device 118.
  • the server 116 sequentially sends instructions to the smart device 118 for execution according to the operation sequence.
  • the smart device 118 executes the above-mentioned first instruction.
  • the smart device 118 can perform a set of operations, such as the operation of changing the brightness of lights, the color shown in FIG. 5 and the operation of playing sounds, the moving operation shown in FIG. 6, and the display operation shown in FIG. 7.
  • step 316 the smart device 118 returns the first instruction execution result to the server 116 to notify the server 116 that the first instruction has been executed.
  • the server 116 sequentially sends instructions to the smart device 118 for execution according to the operation sequence.
  • the smart device returns the execution result of each instruction to the server 116. After the server 116 confirms that the instruction is successfully executed, it sends at the interval T The next instruction.
  • step 318 the server 116 notifies the mobile terminal 110 to submit the recorded file. For example, in response to receiving the first instruction execution result transmitted in step 316, the server 116 sends a transmission media file notification to the mobile terminal 110.
  • step 320 the mobile terminal 110 stops recording.
  • the mobile terminal 110 sends the first file to the server 116.
  • the first file may be a recorded media file, and the first file may include images and/or audio data.
  • the mobile terminal 110 may also send feature information extracted from the recorded media file, for example, image feature information such as color, shape and texture, or sound feature information such as sound frequency and sound intensity.
  • the server 116 may analyze the image and/or audio data contained in the first file to extract operation behavior characteristics, and the operation behavior characteristics can reflect the process of the smart device 118 performing at least one operation indicated by the first instruction.
  • Analyzing the image may include analyzing image features extracted from the image captured by the mobile terminal 110 camera to describe the visual content of the image, such as color, shape, and texture, and each feature has multiple description methods. Each feature describes the visual content of the image computably from different angles.
  • the server 116 performs speech recognition to extract useful features from the audio data.
  • the recognition method includes a template matching method or an artificial intelligence network (ANN) method.
  • ANN artificial intelligence network
  • the server 116 can also use machine learning and deep learning to implement image and/or audio data analysis.
  • the server 116 determines whether the operating behavior characteristic of the smart device 118 matches the first instruction in step 308. For example, the server 116 may analyze the image and compare the image features with standard features that should be present in the image. For example, if the confidence level of the matching of the image sequence and the generated operation mode is lower than the threshold, the mobile terminal 110 may be notified that the binding has failed. If the confidence that the image sequence and the operation instruction sequence match is higher than the threshold, step 328 is executed.
  • the server 116 parses the media file to determine whether the smart device 118 has the light on and off changes indicated in the operation sequence; in some embodiments, in operation When the sequence includes a set of light color control instructions, the server 116 parses the media file to determine whether the light color change indicated in the operation sequence has occurred in the smart device 118; in some embodiments, when the operation sequence includes a set of sound control instructions, The server 116 parses the media file to determine whether the smart device 118 emits the sound indicated in the operation sequence; in some embodiments, when the operation sequence includes a set of motion control instructions, the server 116 parses the media file to determine whether the smart device 118 has made the operation The corresponding motion in the sequence (for example, vibration or movement); in some embodiments, when the operation sequence includes a set of display control instructions, the server 116 parses the media file to determine whether the display device of the smart device 118 displays the corresponding pattern content ( For example, the fish shown in Figure 7
  • the server 116 may associate the first identification of the smart device 118 with the user management account.
  • the user can be allowed to manage the account to access the smart device 118, for example, allowing the user to manage the remote control of the account (for example, remotely turning on the smart device 118 when the company is working), or receiving a message notification from the smart device 118 (for example, when in When the company is working, the outdoor weather perception system of the balcony in the home monitors the outdoor weather in real time. In rain and snow weather, the window pusher can be linked to automatically close the window and send a message notification to the user).
  • Steps 324, 326, and 328 require the processing of the server 116, and the user may need to wait for the processing of the server 116 to be completed.
  • the mobile terminal 110 may display the progress interface 426 shown in FIG. 4E.
  • the progress interface 426 may include the current operation progress 428 (progress 64% in FIG. 4E), and may also include a prompt 430 for prompting the user to ensure that the network condition is good.
  • the server 116 notifies the mobile terminal 110 that the smart device 118 is successfully bound.
  • the mobile terminal 110 may display the connection successful interface 432 shown in FIG. 4F.
  • the connection successful interface 432 may include a success indication 434.
  • the user can also select a location category for the smart device 118 on the successful connection interface 432 (eg, primary bedroom, secondary bedroom, living room, kitchen, bathroom, etc.). Thereafter, the mobile terminal 110 may display the corresponding smart device 118 in the corresponding location category.
  • the mobile terminal 110 displays a user interface as shown in FIG. 4G.
  • the user interface 436 shown in FIG. 4G includes icons of the smart sweeper 438 and the smart speaker 440, and also includes icons 442 of the newly added smart device 118.
  • the user can control the smart device 118 through the management application of the smart device 118 (or the smart home platform application of the cloud service provider of the smart device 118). For example, controlling the turning on or turning off of the light bulb 102, or controlling the speaker 108 to play favorite music through voice commands or querying weather conditions.
  • 3A and 3B describe in detail the flow including the binding operation performed by the mobile terminal 110, the smart device 118, and the server 116.
  • the structures of the mobile terminal 110, the smart device 118, and the server 116 that execute the above-mentioned flow will now continue to be described.
  • FIG. 8 shows a schematic structural diagram of a mobile terminal 110 according to an embodiment of the present application.
  • the mobile terminal 110 includes a radio frequency (RF) circuit 810, a power supply 820, a processor 830, a memory 840, an input unit 850, The display unit 860, the sensor 870, the audio circuit 880, and the wireless-fidelity (Wi-Fi) module 890 and other components.
  • RF radio frequency
  • the display unit 860 the sensor 870, the audio circuit 880, and the wireless-fidelity (Wi-Fi) module 890 and other components.
  • Wi-Fi wireless-fidelity
  • the RF circuit 810 can be used to send and receive information or to receive and send signals during a call.
  • the RF circuit 810 may send the downlink data received from the base station to the processor 830 for processing, and send the uplink data to the base station.
  • the RF circuit includes but is not limited to an RF chip, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, a radio frequency switch, and the like.
  • the RF circuit 810 can also wirelessly communicate with networks and other devices.
  • the wireless communication can use any communication standard or protocol, including but not limited to global mobile communication system (global system of mobile communication (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access (CDMA), wideband code division multiple access (wideband code division multiple access (WCDMA), long term evolution (LTE), email, short message service (SMS), etc.).
  • GSM global system of mobile communication
  • GSM global packet radio service
  • GPRS general packet radio service
  • CDMA code division multiple access
  • WCDMA wideband code division multiple access
  • LTE long term evolution
  • email short message service
  • the memory 840 may be used to store software programs and modules, and the processor 830 executes various functional applications and data processing of the mobile terminal 110 by running the software programs and modules stored in the memory 840.
  • the memory 840 may mainly include a storage program area and a storage data area, where the storage program area may store an operating system, at least one function required application programs (such as a sound playback function, an image playback function, etc.), etc.; the storage data area may store The data created by the use of the mobile terminal 110 (such as audio data, phone book, etc.), etc.
  • the memory 840 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
  • the memory 840 may also store a knowledge base, a tag library, and an algorithm library.
  • the input unit 850 may be used to receive input digital or character information, and generate key signal input related to user settings and function control of the mobile terminal 110.
  • the input unit 850 may include a touch panel 851 and other input devices 852.
  • the touch panel 851 also known as a touch screen, can collect user's touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc. on or near the touch panel 851 Operation), and drive the corresponding connection device according to the preset program.
  • the touch panel 851 may include a touch detection device and a touch controller.
  • the touch detection device detects the user's touch orientation, and detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into contact coordinates, and then sends To the processor 830, and can receive the command sent by the processor 830 and execute it.
  • the touch panel 851 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • the input unit 850 may include other input devices 852.
  • other input devices 852 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), trackball, mouse, joystick, and so on.
  • the display unit 860 may be used to display information input by the user or information provided to the user and various menus of the mobile phone 800.
  • the display unit 860 may include a display panel 861.
  • the display panel 861 may be configured in the form of a liquid crystal display (liquid crystal) (LCD), an electromechanical laser display (organic light-emitting diode, OLED), or the like.
  • the touch panel 851 may cover the display panel 861, and when the touch panel 851 detects a touch operation on or near it, it is transmitted to the processor 830 to determine the type of touch event, and then the processor 830 according to the touch event The type provides corresponding visual output on the display panel 861.
  • the touch panel 851 and the display panel 861 are implemented as two independent components to realize the input and input functions of the mobile phone 800, in some embodiments, the touch panel 851 and the display panel 861 may be integrated And realize the input and output functions of the mobile terminal 110.
  • the mobile terminal 110 may further include at least one sensor 870, such as a light sensor, a motion sensor, and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 861 according to the brightness of the ambient light, and the proximity sensor may close the display panel 861 when the mobile terminal 110 moves to the ear And/or backlight.
  • the accelerometer sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when at rest, and can be used to identify mobile phone gesture applications (such as horizontal and vertical screen switching, related Games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, percussion), etc.
  • the mobile terminal 110 may also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, which will not be repeated here.
  • the audio circuit 880, the speaker 881, and the microphone 882 may provide an audio interface between the user and the mobile terminal 110.
  • the audio circuit 880 can transmit the received electrical data into the speaker 881, and the speaker 881 converts the electrical signal into a sound signal output; on the other hand, the microphone 882 converts the collected sound signal into an electrical signal, which is converted by the audio circuit 880 After receiving, it is converted into audio data, and then the audio data is output to the RF circuit 810 to be sent to another mobile phone, for example, or the audio data is output to the memory 840 for further processing.
  • Wi-Fi belongs to short-distance wireless transmission technology.
  • the mobile terminal 110 can help users send and receive emails, browse web pages, and access streaming media through the Wi-Fi module 890. It provides users with wireless broadband Internet access.
  • FIG. 8 shows the Wi-Fi module 890, it can be understood that it does not belong to the mandatory configuration of the mobile terminal 110, and can be omitted as needed without changing the essence of the invention.
  • the processor 830 is the control center of the mobile terminal 110, uses various interfaces and lines to connect various parts of the entire mobile phone, runs or executes software programs and/or modules stored in the memory 840, and calls data stored in the memory 840 , Perform various functions and process data of the mobile terminal 110, so as to realize various services based on mobile phones.
  • the processor 830 may include one or more processing units; preferably, the processor 830 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, and application programs, etc.
  • the modem processor mainly handles wireless communication. It can be understood that, the foregoing modem processor may not be integrated into the processor 830.
  • the processor 830 may execute the program instructions stored in the memory 840 to implement the method shown in the above embodiment.
  • the method program instructions on the mobile terminal 110 side shown in FIG. 2 or FIGS. 3A and 3B are stored in the memory 840, and when the processor 830 executes the above program instructions, the mobile terminal 110 causes the mobile terminal 110 to execute FIG. 2 and FIG. 3A Or the method steps performed by the mobile terminal 110 in FIG. 3B.
  • steps 202, 206, 208, 210 in FIG. 2 steps 342, 346, 352, 358 shown in FIG. 3A, and steps 302, 308, 320, 322, and 330 shown in FIG. 3B.
  • the camera in the mobile terminal 110 is used to photograph and record the smart device, and the microphone is used to collect sound information of the smart device.
  • the mobile terminal 110 may also encode the captured image through the video encoder, and encode the sound collected by the microphone through the audio encoder.
  • the memory 840 is also used to store recorded audio and video data.
  • the display unit 860 is used to display the user interface shown in FIGS. 4A-4G.
  • the mobile terminal 110 further includes a power supply 820 (such as a battery) that supplies power to various components.
  • a power supply 820 (such as a battery) that supplies power to various components.
  • the power supply can be logically connected to the processor 830 through a power management system, so as to realize functions such as charging, discharging, and power consumption management through the power management system.
  • the mobile terminal 110 may further include a camera, a Bluetooth module, etc., which will not be repeated here.
  • FIG. 9 shows a schematic structural diagram of a communication device.
  • the communication device may be the smart device 118 or the server 116 in FIG. 1.
  • the communication device may include a communication module 910, a processor 920, and a memory 930.
  • the memory 930 may be used to store data, software programs, and software modules, and may be volatile memory (volatile memory), such as random access memory (random-access memory, RAM); or non-volatile memory (non-volatile memory), such as read-only memory (ROM), flash memory (flash memory), hard disk (hard disk drive) or solid-state drive (SSD), or the above types of memory combination.
  • volatile memory such as random access memory (random-access memory, RAM
  • non-volatile memory non-volatile memory
  • ROM read-only memory
  • flash memory flash memory
  • hard disk hard disk drive
  • SSD solid-state drive
  • a program code may be stored in the memory 930, and the program code is used to enable the processor 920 to execute the program code to execute the smart device management method provided by the embodiment of the present application.
  • a program code may be stored in the memory 930, and the program code is used to enable the processor 920 to execute the method steps performed by the smart device 118 side in FIG. 2 or FIG. 3A or FIG. 3B by executing the program code (For example, steps 202, 204, and 212 in FIG. 2, step 350 in FIG. 3A, and step 314 in FIG. 3B).
  • the smart device 118 is mainly responsible for receiving the first instruction sent by the server 116 and performing at least one operation according to the first instruction (for example, the indicator light is turned off, the color of the light is changed, a specific character/icon is displayed, the buzzer sounds, or the human eye can Observed movement, etc.), and send the execution result to the server.
  • a program code may be stored in the memory 930, and the program code is used to enable the processor 920 to execute the method steps executed by the server 116 side in FIG. 2 or FIG. 3A or FIG. 3B (for example, FIG. Step 208 in 2, Steps 344, 348, 354, 356, 358 in FIG. 3A, Steps 304, 306, 310, 312, 318, 324, 326, 328, 330 in FIG. 3B).
  • the server 116 is also used to perform user identity authentication and record the login status of the user account; manage the binding relationship between the user account and the device; and manage device registration information and device capability sets.
  • the memory 930 may include a fast read-write memory for storing programs and data during operation of the communication device and a permanent memory for storing instructions and data required by the instructions and data.
  • the memory 930 may also store data to be transmitted from the communication device or data received by the communication device.
  • the communication module 910 may include a wireless communication module and/or a wired communication module, such as one or more of a Wi-Fi module, a Bluetooth module, an infrared module, a GPRS module, an Ethernet communication module, etc., may be used to send and receive information, and may also The received information is processed by the processor 920; or, the signal generated by the processor 920 is sent out.
  • the communication module 910 may receive a wireless control signal desired for operation, and the control signal may originate from a remote communication device, such as the mobile terminal 110.
  • the processor 920 is coupled to the communication module 910 and the memory 930.
  • the processor 920 may be any processing device, including but not limited to a MIPS (microprocessor without interlocked pipes) stages, microprocessors, digital signal processors, application specific integrated circuit circuits, microcontrollers, state machines, or any type of programmable Logical array.
  • the processor 920 is the control center of the communication device, and uses various interfaces and lines to connect various parts of the entire communication device, by running or executing software programs and/or modules stored in the memory 930, and calling data stored in the memory 930 , Perform various functions of the communication device and process data.
  • FIG. 9 is not intended to limit the structure of the communication device involved in the embodiments of the present application.
  • the communication device may also include other modules, such as sensors, power modules, etc. Repeat.
  • the embodiments of the present application may divide the functional modules of the user equipment according to the foregoing method examples.
  • each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
  • the above integrated modules can be implemented in the form of hardware or software function modules. It should be noted that the division of the modules in the embodiments of the present application is schematic, and is only a division of logical functions. In actual implementation, there may be another division manner.
  • Embodiments of the present application also provide a system for binding a smart device to a user management account established on a server.
  • the system includes a mobile terminal 110, a smart device 118, and a server 116 shown in FIG. 1.
  • the system can implement FIG.
  • the mobile terminal 110 is used to execute the method steps performed on the mobile terminal 110 side shown in FIG. 2 or FIG. 3A or 3B
  • the smart device 118 is used to execute FIG. 2 or FIG.
  • the server 116 performs the method steps performed by the server 116 shown in FIG. 2 or FIG. 3.
  • An embodiment of the present application also provides another system for binding a smart device to a user management account established on a server.
  • the system includes the mobile terminal 110 and the smart device 118 shown in FIG. 1.
  • the system can implement FIGS. 2 and 3A. Or the smart device management method steps shown in FIG. 3B, the mobile terminal 110 is used to execute the method steps performed on the mobile terminal 110 side shown in FIG. 2, FIG. 3A or FIG. 3B, and the smart device 118 is used to execute FIG. 2 and FIG. 3A Or the method steps performed by the smart device 118 shown in FIG. 3B.
  • An embodiment of the present application further provides a computer storage medium, which, when the computer program product runs on the mobile terminal, causes the mobile terminal to execute the relevant method steps in FIG. 2, FIG. 3A, or FIG. 3B.
  • An embodiment of the present application further provides a computer program product, which, when the computer program product runs on a mobile terminal, causes the mobile terminal to execute the relevant method steps in FIG. 2, FIG. 3A or FIG. 3B.
  • the computer program product includes one or more computer instructions.
  • the computer may be a general-purpose computer, a dedicated computer, a computer network, or other programmable devices.
  • the computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be from a website site, computer, server or data center Transmission to another website, computer, server or data center via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.).
  • the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device including a server, a data center, and the like integrated with one or more available media.
  • the available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), or the like.

Abstract

本公开涉及一种智能设备管理方法、移动终端及系统。移动终端发送智能设备绑定请求至服务器；服务器发送启动录制指令至移动终端；服务器发送操作控制指令至智能设备，指示智能设备执行至少一种操作；智能设备根据控制操作指令执行上述至少一种操作；移动终端将智能设备执行上述至少一种操作的过程录制并生成媒体文件发送至服务器；服务器解析该媒体文件并判断其是否与上述控制操作指令匹配，若匹配则将智能设备与用户管理账户关联。其中，操作控制指令可以是服务器随机生成的，而且需要用户实时录制智能设备的操作执行过程，可以提高绑定的安全性。

Description

一种智能设备管理方法、移动终端及系统 技术领域
本公开实施例涉及智能终端领域，并且更具体地，涉及一种智能设备管理方法、移动终端及系统。
背景技术
随着智能硬件的发展，各种各样的智能设备(例如，音箱、智能灯具、智能空调等)逐渐进入人们的生活。要实现对智能设备的管理和操作，首先要建立智能设备与用户账户之间的绑定关联关系。智能设备与用户账户绑定操作的主要目的是为了确认用户持有该智能设备，并且在云服务器侧建立用户账号和智能设备的关联关系。用户账号和智能设备的关联关系一旦建立以后，只有绑定用户才具有访问和控制智能设备的权限，因此在建立用户与智能设备之间的绑定关系的过程中，势必也面临更高的安全性要求。
现有技术中，可以通过移动终端安装的控制智能设备的应用程序扫描智能设备上印制的二维码，通过二维码生成相关的凭证并发送到云服务器以实现用户账号与智能设备的绑定关联。
但是采用这种方案时，如果智能设备体积过小(例如灯泡、开关、按钮等)，可能没有足够的地方印制二维码；或者如果智能设备智能设备的安装位置过高(例如，吸顶灯)，用户很难执行扫描二维码的操作。而且，用于绑定操作的二维码需要在智能设备出厂前预先印制，并需要提前在云端备案，过程繁琐，数据的唯一性、完整性和保密性保障难度大。因此，这类智能设备绑定技术在安全性或者可操作性方面存在较大的缺陷，导致难以推广和应用。
发明内容
本文描述了一种智能设备管理方法、移动终端及系统，可提供一种安全性更高且操作简易的绑定方案。
为达到上述目的，本申请的实施例采用如下技术方案：
第一方面，本申请提供了一种智能设备管理方法。该智能设备管理方法包括：移动终端发送第一请求至服务器，第一请求包括智能设备的第一标识；服务器响应于该第一请求，发送第一指令至智能设备，并发送第二指令至移动终端；智能设备根据该第一指令执行至少一种操作；移动终端响应于第二指令，录制智能设备执行上述至少一种操作的过程并生成录制的第一文件；移动终端发送第一文件至服务器；服务器根据第一文件确定智能设备执行的至少一种操作是否与上述第一指令匹配；服务器响应于确定智能设备执行的至少一种操作与上述第一指令匹配，将所述智能设备的第一标识与在服务器建立的用户管理账户相关联。
要实现智能设备的管理和操作，首先要建立智能设备与用户账户之间的绑定 关联关系。智能设备与用户账户绑定操作的主要目的是为了确认用户持有该智能设备，并且建立用户账户和设备的关联关系。
上述方法中，智能设备可以基于第一指令动态执行对应的操作，用户则需要通过移动终端的摄像头或者麦克风录制智能设备执行操作的过程。因此，该方法可以确认用户确实持有该智能设备。
而且，第一指令可以是服务器根据智能设备的操作能力随机生成的。服务器可以根据智能设备的能力生成多种组合的操作序列，这些操作序列单次有效，可以达到相当高的安全等级。
通过上述方法，移动终端的用户仅通过录制智能设备执行至少一种操作的过程即可将智能设备与用户账户绑定，操作简单。而且，智能设备无需粘贴身份标识(例如二维码)，外观更加美观。
在一些可能的实现方式中，智能设备的第一标识可以是由服务器动态分配的，而非在生成环节中写入智能设备的，这样可以提升绑定过程的安全性。例如，移动终端发送智能设备的第一信息至服务器；服务器根据该第一信息获取智能设备的第一标识并将该第一标识发送至移动终端，其中所述第一信息是以下参数中的一项或者任意组合：所述智能设备的序列号、媒体访问控制地址。
在一些可能的实现方式中，上述智能设备的第一标识是由服务器根据上述第一信息随机生成的。而且，第一标识用于唯一标识该智能设备。采用服务器分配的第一标识可以提高数据的唯一性、完整性和保密性。
在一些可能的实现方式中，服务器可以根据智能设备的操作能力集合，随机生成上述第一指令。智能设备的操作能力集合代表了智能设备所能执行的一些操作参数，例如，指示灯的颜色、亮度的变化参数，声音的音色、音调、音强和音长变化参数，振动马达的振动参数，或运动模式参数等。第一指令可以包括操作指令序列(例如，操作序列为亮、灭、亮)。服务器可以按照一定的间隔时间，依次将操作序列中的指令发给智能设备执行(例如，按照一定的间隔时间依次发送点亮、熄灭、点亮的指令给智能设备执行)。
在一些可能的实现方式中，智能设备根据第一指令执行的至少一种操作包括以下操作中的一种或者任意组合：声音操作、灯光操作、运动操作。
在一些可能的实现方式中，声音操作包括声音的音色、音调、音强或音长中的至少一种操作。
在一些可能的实现方式中，灯光操作包括灯光的颜色操作或亮度操作。
在一些可能的实现方式中，运动操作包括振动操作或移动操作。
在一些可能的实现方式中，服务器识别第一文件中的图像信息和音频信息以获取智能设备的操作行为特征；并确定该操作行为特征是否与所述第二指令匹配。
在一些可能的实现方式中，移动终端可以控制智能设备执行操作事件。
在一些可能的实现方式中，移动终端通过摄像头或麦克风中的至少一个录制智能设备执行至少一种操作的过程。
第二方面，本申请实施例提供另一种智能设备管理方法，该方法包括：移动终端发送第一请求至服务器，第一请求包括智能设备的第一标识；智能设备接收服务器发送的第一指令；响应于该第一指令，智能设备执行至少一种操作；移动终端接收服务器发送的第二指令；响应于该第二指令，移动终端录制智能设备执行至少一种操作的过程并生成录制的第一文件；移动终端发送上述第一文件至服务器，第一文件被服务器用于确定智能设备执行的至少一种操作是否与第二指令匹配；移动终端从服务器接收关联成功通知，关联成功通知指示：服务器在确定智能设备执行的至少一种操作与第二指令匹配后，成功将智能设备的第一标识与在服务器建立的用户管理账户相关联。
第三方面，本申请实施例提供一种智能设备管理系统，系统包括上述第一方面涉及的移动终端、智能设备和服务器。
第四方面，本申请实施例提供另一种智能设备管理系统，系统包括上述第二方面涉及的移动终端和智能设备。
第五方面，本申请实施例提供一种智能设备管理方法，该方法包括：响应于第一触摸输入，显示第一用户界面，该第一用户界面包含第一界面元素，第一界面元素用于添加智能设备；接收选择上述第一界面元素的第二触摸输入；响应于该第二触摸输入，显示第二用户界面，第二用户界面包含智能设备的标识；接收选择上述智能设备标识的第三触摸输入；响应于该第三触摸输入，显示网络配置界面，其中网络配置界面用于接收用户输入的SSID和/或密码；发送SSID和/或密码至智能设备；启动摄像头并录制智能设备执行至少一种操作的过程并生成第一文件；发送第一文件至服务器；接收服务器发送的关联成功通知，该关联成功通知指示服务器成功将智能设备与用户管理账户相关联。
第六方面，本申请的实施例提供一种移动终端，包括：触摸屏；一个或多个处理器；一个或多个存储器；以及一个或多个计算机程序，其中一个或多个计算机程序被存储在上述一个或多个存储器中，上述一个或多个计算机程序包括指令，当所述指令被所述移动终端执行时，使得移动终端执行上述第一方面、第二方面或第五方面中移动终端执行的方法步骤。
第七方面，本申请实施例提供一种包含指令的计算机程序产品，当该计算机程序产品在移动终端上运行时，使得所述移动终端执行上述第一方面、第二方面或第五方面中移动终端执行的方法步骤。
第八方面，本申请实施例提供一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，当所述指令在移动终端上运行时，使得所述移动终端执行上述第一方面或第二方面或第五方面中移动终端执行的方法步骤。
智能设备、移动终端和服务器(例如云服务器)之间已建立通信连接，智能设备在云服务器完成注册后，云服务器可以发送指令至智能设备，使智能设备执行闪灯、变色或发声等操作；用户录制智能设备执行上述操作的过程并提供录制凭证至服务器，最后在云服务器完成智能设备绑定，获取该智能设备的完整控制 权限。绑定操作完成后，用户可以使用管理APP获得完整的设备控制权(例如控制空调的开关、工作模式、目标温度、风速等)。
此方案只需要智能设备有被外界能观察到的状态变化，例如灯的闪烁、灯的颜色变化、图标变化、字符变化、蜂鸣器发声或者可以观测的运动轨迹，即可利用该特征完成智能设备的管理账号绑定。该方案无需介入智能硬件的生产或者销售环节，同时也不受设备的大小、安装位置限制。
另外，第二方面至第八方面中任一种设计方式所带来的技术效果可参见上述第一方面中不同设计方法所带来的技术效果，此处不再赘述。
附图说明
图1是本申请实施例提供的一种智能设备管理系统的示意图；
图2是本申请实施例提供的一种智能设备注册过程的示意图；
图3A是本申请实施例提供的一种智能设备绑定的信令交互图；
图3B是本申请实施例提供的另一种智能设备绑定的信令交互图；
图4A、4B、4C、4E、4F、4G示出了本申请实施例中移动终端添加智能设备过程中的用户界面；
图5、图6、图7是本申请实施例提供的智能设备执行操作的示意图；
图8是本申请实施例提供的一种移动终端的结构示意图；
图9是本申请实施例提供的一种通信设备的结构示意图。
具体实施方式
下面将结合本公开实施例中的附图，对本公开实施例中的技术方案进行描述。
图1示出了本文中进一步描述的装置、方法、系统和/或计算机程序产品中的一个或多个可能适用的智能设备管理系统100的示例。所描绘的智能设备管理系统100包括一个或多个智能设备118。智能设备118可以接收移动终端或者服务器的控制指令，并根据上述控制指令执行对应的操作。智能设备118代表多种智能设备，例如图1中的灯泡102、开关104、插座106、音箱108。下文中，将智能设备102、104、106和108以及其他智能家居设备(诸如、电视、洗衣机、风扇、空调、安全系统等)统称为“智能设备”。其中，灯泡102可以控制灯光的变化，例如灯光颜色及亮度的变化。开关104可以控制其他智能设备的开启或者关闭，例如控制灯泡102的亮灭。在一些实现方式中，开关104还可以检测周围照明条件，进而控制一个或多个灯泡102的功率和/或亮暗状态。插座106可以控制一个或多个插座的电力供应(例如，接收远程控制指令接通电力供应或者断开电力供应)。音箱108可以和用户进行语音交互，例如可以接收用户的语音控制指令播放用户喜爱的歌曲。在一些实现方式中，音箱108可以带有集成的语音 助手模块，可通过一个“唤醒词”(例如，“你好，小艺”)提供交互式语音对话或查询功能。智能设备管理系统100还包括一个或多个移动终端110，移动终端110可以包括智能手机、膝上型计算机、台式计算机、平板计算机、智能手表、智能手环等。
智能设备管理系统100还包括无线路由器112。智能设备之间能够经由无线路由器112进行通信(例如，灯泡102通过无线路由器112与开关104进行通信)。智能设备还能够经由网络(诸如网络114)的连接彼此通信。通过网络114，智能设备能够与服务器116进行通信，以及与移动终端110进行通信。当然，智能设备和移动终端110还可以直接进行通信(例如，通过Wi-Fi、NFC、蓝牙等短距通信技术)。在一些实施例中，移动终端110和智能设备118还可以采用其他无线通信技术(例如ZigBee、红外)进行通信。相应的，移动终端110和智能设备118可以通过其他类型的智能家居网关(例如，ZigBee网关)连接到网络114，进而和服务器116通信。
服务器116能够作为媒介平台实现家庭内部与外部控制设备的通信交流，满足远程控制、检测和信息交换的需求。服务器116与和智能设备的制造商或服务提供商相关联。例如，服务器116可以向智能设备自动地发送软件更新或者为智能设备提供云服务。在一些实施例中，音箱108与服务器116通过网络114进行通信。例如，用户向音箱108发出“查询A到B的机票”的指令。音箱108的语音交互系统通过语音算法处理单元和音频解码单元收集上述语音、降噪、识别唤醒词、将语音信号转为数字信号，之后将处理后的数字信号上传至服务器116。服务器116将进行语音数字编码识别和语义理解，随后调用机票预订数据库中的信息并传递给音箱108。音箱108将上述机票预订信息通过音效单元还原为语音信号并播放出来。
网络114的示例可包括局域网(LAN)和广域网(WAN)，例如互联网。通信网络114可以使用任何已知的网络协议来实现，包括各种有线或无线协议，诸如例如以太网、通用串行总线(USB)、全球移动通信系统(GSM)、增强型数据GSM环境(EDGE)、码分多址(CDMA)、时分多址(TDMA)、长期演进(LTE)、第五代移动通信(5G)、蓝牙、无线保真(Wi-Fi)任何其他合适的通信协议。
移动终端110能够通过路由器112提供的Wi-Fi网络进行通信。移动终端110能够经由路由器112通过网络114与服务器116进行通信。例如，用户可以通过移动终端110通过网络114与服务器116进行通信，以观察家中智能摄像机捕获的图像。晚上回到家前，用户可以通过移动终端110控制空调提前调到适宜的温度。
本申请的实施例中，智能设备可以与服务器上登记的用户管理账户绑定或配对。其中，服务器116负责管理一个或多个用户的智能设备管理账户。用户可以在首次开箱取出智能设备上电时或在智能设备系统重置之后可以执行绑定或者配对操作。
用户管理账户可与特定用户或者一组特定用户(例如，家庭或者小组)相关联。用户可以通过智能设备管理应用(例如，智能家居APP)的账号管理功能建立用户账户，申请用户管理账号并设置管理密码，还可以根据需要请求合理的管理权限。而且，用户管理账户能够与一个或者多个智能设备相关联。用户管理账户通常包括对智能家庭装置的操作或智能家庭装置的生态系统必需的数据和服务的集合。在一些实施例中，用户管理账户将被描述为与具有“云服务器”(例如，利用云计算技术和大规模分布存储技术来满足各种应用需求的计算设备)的基于云的服务提供商相关联，“云服务器”可通过网络114被智能设备访问，并且可经由移动终端(例如，平板计算机、智能电话、可穿戴设备)通过网络114访问。特定用户管理账户常常由该用户的电子邮件地址或者移动电话号码唯一地标识，也可以使用其他账户命名(例如，社交网站账户)。
对于智能设备，绑定或者配对过程的目的是将该智能设备的唯一标识(例如，智能设备的媒体访问控制(MAC)地址或其它唯一标识符)与用户管理账户相关联。绑定或者配对后，用户就可以通过管理账户来控制智能设备118。例如，开关灯泡、调节智能空调温度、开门或是播放音乐，或者按照用户制定规则，让多种设备同时停止或者启动工作(例如，智能设备管理应用离家模式开启后，所有家庭的灯光、电器全部自动关闭，或者智能设备管理应用回家模式开启后，灯光、空调、热水器等调整到合适的工作状态)。下文会详细讨论该绑定过程的具体实例。
下文中将以图1示出的智能设备118(例如，智能设备102(灯泡))为例介绍智能设备的管理方法。为了实现智能设备和用户管理账户的绑定，可以先将智能设备接入路由器112创建的Wi-Fi网络。同时，为了保证所接入智能家居管理平台(例如，服务器116)的智能设备的合法性，对首次联网接入管理平台的智能设备需要进行注册认证，图2示出了注册智能设备的信令交互图。
参见图2，在步骤202，移动终端110向智能设备118发送Wi-Fi网络的网络SSID和密码。
用户可以下载智能设备118的管理应用(或者智能设备118的云服务提供商的智能家居平台应用)并将其安装在移动终端110中。用户通过智能设备118的管理应用设置用户管理账户。在管理应用内，用户可以添加新智能设备，并在添加或者绑定过程的开始阶段将Wi-Fi网络的网络SSID和密码发送至智能设备118。
用户首先启动智能设备118(例如，将其连接到家庭电力系统并开机)。用户能够在管理应用中选择诸如"添加新装置"的选项或者具体地指定他/她正在添加的新设备型号(例如，灯泡、开关、插座、音箱等)。在选中添加智能设备118后通过多种方式传输Wi-Fi网络的网络SSID和密码至智能设备118。
在一些实施例中，智能设备118上电启动后可建立临时Wi-Fi网络，即，智能设备118处于接入点(AP)模式。移动终端110处于工作站(STA，station) 模式，移动终端110连接智能设备118的临时Wi-Fi网络后组成局域网。移动终端110通过该临时Wi-Fi网络发送Wi-Fi网络的SSID及密码至智能设备118。
在一些实施例中，移动终端110可建立临时Wi-Fi网络，即，移动终端110处于接入点(AP)模式。智能设备118处于工作站(STA，station)模式，智能设备118连接移动终端110的临时Wi-Fi网络后组成局域网。移动终端110通过该临时Wi-Fi网络发送Wi-Fi网络的SSID及密码至智能设备118。
在另一些实施例中，智能设备118上电启动后，监听网络中的所有报文。移动终端110将Wi-Fi网络SSID和密码编码到UDP报文中，通过广播包或组播报发送，智能设备118接收到UDP报文后解码得到正确的Wi-Fi网络SSID和密码。当然，移动终端110还可以通过其他通信协议(例如，NFC，蓝牙等近距离通信协议)将Wi-Fi网络的SSID和密码传递给智能设备118。
在一些实施例中，步骤202中移动终端110可以发送加密的Wi-Fi网络的SSID和密码至智能设备118，以此提高数据传输的安全性。智能设备118接收到加密的SSID和密码后使用对应的密钥解密即可获取SSID和密码。
在步骤204，智能设备118获取到Wi-Fi网络的网络SSID和密码后自动连接至Wi-Fi网络的网络SSID标识的路由器112。
在步骤206，移动终端110请求注册智能设备118。步骤206中，移动终端110可以向服务器116提供智能设备118的第一信息。其中，第一信息可以是智能设备118的序列号，或媒体访问控制(MAC)地址(例如，802.11MAC地址)等信息。在一些实施例中，智能设备118可通过其建立的临时Wi-Fi网络将上述第一信息发送至移动终端110。在一些实施例中，智能设备118还可以通过其他通信协议(例如，NFC，蓝牙等近距离通信协议)将上述第一信息发送至移动终端110。
在步骤208，响应于该请求，服务器116向移动终端110提供智能设备118的配置信息。
在一些实施例中，配置信息可以包括智能设备118的第一标识。第一标识可以被用来使智能设备118与服务器116的用户管理账户配对。在一些实现方式中，该第一标识是服务器116基于上述第一信息生成的，可以是能够唯一标识智能设备118的一串序号或者名字。在另一些实现方式中，该第一标识是服务器116查询数据库获取的，该数据库存储了智能设备的第一信息与配置信息的对应关系。
在一些实施例中，配置信息还可以包括注册码，注册码用于服务器116后续验证智能设备118的身份。完成首次上电注册的智能设备118，后续每次重新连接网络后，都需要利用注册码请求登录服务器116。从服务器116发送的配置信息(例如，智能设备的第一标识)由于是动态分配的，因此相较于智能设备118的序列号或MAC地址而言安全性更高，不容易泄露和伪造。
在步骤210，移动终端110向智能设备118发送上述配置信息(例如，智能 设备118的第一标识和/或注册码)。其中，移动终端110可以加密传输上述配置信息至智能设备118。
在步骤212，智能设备118向服务器116发起注册。智能设备118能够与服务器116建立通信连接后，将上述配置信息(例如，智能设备118的第一标识和/或注册码)发送到服务器116并协商通信密钥，用来对智能设备118与服务器116之间的将来通信进行加密。
至此，智能设备118完成了接入Wi-Fi网络的步骤，并且通过Wi-Fi网络与服务器建立起了通信连接，为后续接收服务器的操作指令奠定了基础。
下面介绍具体的智能设备绑定流程。图3A示出了根据本申请一些实施例的智能设备绑定的信令交互图。
参见图3A，在步骤342，移动终端110发送第一请求至服务器116，用于请求绑定智能设备118。其中，第一请求可携带智能设备118的第一标识。第一标识可以是服务器116动态生成的，因此，不容易泄露和伪造。可选地，在步骤342之前，移动终端110可发送智能设备118的第一信息至服务器116。服务器116根据第一信息获取智能设备118的第一标识并将第一标识发送至移动终端110，其中第一信息包括智能设备118的序列号或媒体访问控制地址。
在步骤344，响应于该第一请求，服务器116发送第二指令至移动终端110，第二指令指示移动终端110执行录制操作(例如，音频或者视频的录制)。具体的，服务器116可以向移动终端110发送启动录制指令，启动录制指令指示移动终端启动摄像头和/或麦克风录制智能设备118的操作事件(例如，录制智能设备118的灯光亮度变化、颜色变化、声音变化或者运动变化)。
在步骤346，移动终端110响应于第二指令，启动录制操作。在一些实施例中，移动终端110接收来自服务器116的第二指令(例如，录像启动通知指令)，自动启动摄像头采集图像并启动麦克风获取音频数据，得到最后的录像数据并存储在第一文件中。在一些实施例中，移动终端110接收来自服务器116的第二指令(例如，录像启动通知)，显示启动针对智能设备118的录像提示。用户根据该录像提示启动照相机或录像机应用中的录像功能，启动该功能可视为输入了录像启动指令，上述录像启动指令通常为用户通过移动终端110的输入装置(物理键盘、按钮或触摸屏)输入的(例如，点击屏幕上显示的录像按钮)。
在步骤348，服务器116发送第一指令至智能设备118，第一指令可以是一个操作序列，指示智能设备执行至少一种操作。在一些实施例中，服务器116根据智能设备118的操作能力生成第一指令。例如，对于灯泡102，其可以展现灯光颜色(红、黄、绿)、亮度(亮度等级1、亮度等级2、亮度等级3)等变化，其操作能力可表示为{红、黄、绿，亮度等级1、亮度等级2、亮度等级3}。第一指令包含的操作序列可以是一组灯光的亮灭指令序列。例如，可以按照亮灭控制操作的排列组合形成多种操作序列。例如，操作序列1：亮、灭、亮。
在步骤350，智能设备118根据第一指令执行至少一种操作。在一些实施例 中，至少一种操作中的每一种操作包括以下操作中的一项或任意组合：声音调节操作、灯光调节操作、或运动操作。其中，声音调节操作包括以下操作中的一项或任意组合：音色调节、音调调节、音强调节或音长调节。灯光操作包括灯光的颜色调节或灯光亮度调节。运动操作包括振动或移动。例如，灯泡102根据操作序列1执行点亮、熄灭、点亮的操作。
在步骤352，移动终端110发送第一文件至服务器116。
在步骤354，服务器116根据第一文件确定智能设备执行的至少一种操作是否与上述第一指令匹配。在一些实施例中，服务器116识别第一文件中的图像信息和音频信息以获取智能设备118的操作行为特征；然后确定该操作行为特征是否与所述第一指令匹配。
在步骤356，服务器116响应于确定智能设备118执行的至少一种操作与第一指令匹配，将智能设备与用户管理账户相关联。在一些实施例中，服务器116将智能设备118的第一标识与在服务器建立的用户管理账户相关联。
在步骤358，服务器116发送关联成功通知至移动终端110。之后，移动终端可以控制智能设备执行操作事件(例如，通过智能设备管理应用控制智能设备的开启或者关闭，调节智能设备的灯光亮度等)。
图3B示出了根据本申请一些实施例的智能设备绑定的信令交互图。在步骤302，移动终端110向服务器116发送第一请求，用于请求绑定智能设备118。其中，第一请求可携带智能设备118的第一标识(例如上文提到的智能设备118的第一标识)。第一标识可以是服务器116动态生成的，因此，不容易泄露和伪造。
当然，移动终端110也可以在步骤302中发送上文中提到的智能设备的序列号或MAC(例如，802.11MAC地址)地址等信息至服务器116以绑定智能设备118。
在一些实施例中，步骤302之前还可以包括以下步骤中的至少一项：
(1)移动终端110响应于第一触摸输入，显示第一用户界面(例如，图4A中示出的用户界面402)。第一用户界面包含智能扫地机406和智能音箱408。第一用户界面还可以包含智能设备添加界面元素(图4A中右上角的加号图标)。例如，用户通过智能设备118的管理应用(或者智能设备118云服务提供商的智能家居平台应用)打开如图4A中示出的用户界面402；
(2)接收选择上述智能设备添加界面元素的第二触摸输入；响应于该第二触摸输入，显示第二用户界面，第二用户界面包含智能设备列表，智能设备列表包含第一智能设备的标识(例如，附近待绑定的智能设备的标识“智能灯泡A”)。例如，用户点击添加智能设备按钮404(图4A中右上角的加号图标)后，显示如图4B所示的第二用户界面410，第二用户界面410包含待绑定的智能灯泡A412。其中，第二用户界面显示的智能设备列表可包含一个或多个智能设备。在一些实现方式中，第二用户界面还包括“扫描设备”界面元素，用户可以选择“扫 描设备”按钮发现周围可绑定的设备。在一些实现方式中，第二界面还包括“手动添加设备”界面元素，用户可以选择“手动添加”按钮选择添加智能设备。
(3)接收选择上述第一智能设备的第三触摸输入；响应于该第三触摸输入，显示网络配置界面，其中网络配置界面用于接收用户输入的SSID和/或密码。类似于图2中步骤202描述的传递SSID和密码的方法，用户可以输入/选择他们的Wi-Fi网络的SSID和/或密码，所述SSID和/或密码然后被发送到智能设备118，例如，用户通过图4C中的界面输入他们的Wi-Fi网络的SSID：HomeNetwork 416和密码418；在一些实现方式中，移动终端保存有Wi-Fi网络的SSID，用户直接在用户界面选择想要发送至智能设备118的网络SSID，即可将对应的SSID和密码发送至智能设备。
(4)显示录制界面，例如，图4D示出的录制界面420。录制界面可以包括录像框422，还可以包括提示语424，用于提示对智能设备118进行录像并提醒用户将摄像头对准智能设备118；
(5)检测摄像头是否对准智能设备118，其中，移动终端110可以对摄像头采集的图像进行图像内容识别，确定当前采集的图像内容是否与用户选中的某型号的智能设备118相匹配，若匹配则执行步骤302。在一些实现方式中，移动终端110可以对摄像头采集的图像进行图像内容识别，提取图像特征来描述图像的视觉内容，如颜色、形状和纹理等，如果提取的图像特征和移动终端110预先存储的智能设备118的特征相匹配，则执行步骤302。在另一些实现方式中，移动终端110可以将摄像头采集的图像发送至图像识别服务器进行图像内容识别，图像识别服务器提取图像特征来描述图像的视觉内容，如颜色、形状和纹理等，如果提取的图像特征和图像识别服务器预先存储的智能设备118的特征相匹配，则执行步骤302。
在步骤304，服务器116判断智能设备是否未被绑定。如果智能设备未被绑定，执行步骤306。智能设备必须已经完成注册(例如，图2示出的注册过程)，并且尚未被绑定，才能请求绑定。如果智能设备118已经绑定到某个用户管理账户，则直接通知移动终端110绑定失败。
在步骤306，服务器116发送第二指令至移动终端110，通知移动终端110启动录制智能设备118的操作过程。具体的，服务器116可以向移动终端110发送启动录制指令，启动录制指令指示移动终端启动摄像头和/或麦克风录制所述智能设备的操作事件。
在一些实施例中，步骤304中服务器116还可以通知移动终端110获取智能设备118的其他操作信息。例如，移动终端110通过蓝牙获取智能设备118的蓝牙广播信息，或者通过NFC获取智能设备118的特定信息。
在步骤308，移动终端110开始录制智能设备118执行至少一种操作的过程。
在一些实施例中，移动终端110在步骤306中接收来自服务器116的录像启动通知，自动启动摄像头采集图像帧并启动麦克风获取音频数据，得到最后的 录像数据。在另一些实施例中，步骤306是可选的，移动终端110可以在步骤302之后直接执行录制过程，即不需要接收服务器116发送的启动录制通知。在一些实现方式中，移动终端110在步骤306中接收来自服务器116的录像启动通知后，显示启动针对智能设备118的录像提示。用户根据该录像提示启动照相机或录像机应用中的录像功能，启动该功能可视为输入了录像启动指令，上述录像启动指令通常为用户通过移动终端110的输入装置(物理键盘、按钮或触摸屏)输入的(例如，点击屏幕上显示的录像按钮)。
在步骤310，服务器116根据智能设备118的操作能力生成第一指令，第一指令指示智能设备118执行至少一种操作。
在一些实施例中，服务器116根据智能设备118的第一标识查询智能设备118的设备型号。服务器116获取与智能设备118的设备型号匹配的智能设备118的操作能力集，并根据智能设备118的操作能力集生成第一指令。
在另一些实施例中，服务器116保存有与智能设备118的操作能力集匹配的第一指令。服务器116可以查询与智能设备118的操作能力集匹配的第一指令，并将第一指令发往智能设备118。第一指令可以包括绑定操作过程中的至少一条操作指令，每条操作指令对应于一个操作(例如，亮度调整指令对应亮度调节操作、颜色调整指令对应颜色调节操作、声音调整指令对应声音调节操作)。第一指令可以是一个操作序列，指示智能设备执行至少一种操作。
在一些实施例中，操作能力集指示了智能设备118能够执行的控制操作的集合。例如，智能设备118的操作能力集包括灯光颜色、亮度的变化参数(例如，智能设备118可显示的颜色包括3种：红、黄、绿，亮度变化可以呈现3种不同的亮度等级等，则智能设备118的操作能力集可表示为{红、黄、绿，亮度等级1、亮度等级2、亮度等级3})；智能设备118的操作能力集除了指示灯的颜色、亮度的变化参数外，还可以包括声音的音色，音调，音强和音长变化参数，当然也可以包括智能设备118的振动马达的振动参数。智能设备118的操作能力集还可以只能设备118的运动模式参数。服务器可以查询特定数据库来获取智能设备118的能力集，数据库中记录了不同的智能设备118型号及其对应的操作能力集合。
在一些实施例中，针对具有指示灯或者其他灯光能力的智能设备。例如灯泡102可以发光、音箱108的电源指示灯可以发光，开关104或者插座106也可以具有指示灯。上述操作序列可以是一组灯光的亮灭指令序列。例如，可以按照亮灭控制操作的排列组合形成多种操作序列。例如，操作序列1：亮、灭、亮；操作序列2：亮、灭、亮、灭。还可以将亮灭的展示时长作为参数加入到操作序列当中，例如，操作序列3：亮(1秒)、灭(2秒)、亮(1秒)；操作序列4：亮(1秒)、灭(1秒)、亮(2秒)、亮(1秒)；操作序列5：亮(2秒)、灭(2秒)、亮(1秒)、灭(1秒)。如图5所示，灯泡包括灯泡502和旋入式底座504。作为对操作序列的响应，灯泡502可以产生灯光亮度变化。
在另一些实施例中，对于上述具有指示灯或者其他灯光能力的智能设备。该操作序列可以是一组灯光的颜色变化，例如，智能设备118的指示灯可以呈现四种不同的颜色，即，红色、绿色、蓝色、黄色。那么可以按照灯光颜色的排列组合形成多种操作序列。例如，操作序列1：红色、绿色、蓝色、黄色；操作序列2：红色、绿色、黄色、蓝色；操作序列3：红色、黄色、蓝色、绿色。还可以将每种灯光颜色展示时长作为参数加入到操作序列当中，例如，操作序列4：红色(显示2秒)、黄色(显示1秒)、蓝色(显示3秒)、绿色(显示2秒)；操作序列5：红色(显示1秒)、黄色(显示3秒)、蓝色(显示3秒)、绿色(显示2秒)；操作序列6：红色(显示2秒)、黄色(显示2秒)、蓝色(显示3秒)、绿色(显示2秒)。如图5所示，作为对操作序列的响应，灯泡502可以产生灯光颜色变化。
在一些实施例中，对于具有扬声器的智能设备。该操作序列可以指示一组扬声器的声音变化，例如，智能设备118的扬声器可以发出不同音色，音调，音强和音长的声音。可以按照音色，音调，音强和音长的不同组合形成多种操作序列。例如，操作序列：频率1(10MHz，持续2秒)、频率(12MHz，持续3秒)、频率(13MHz，持续2秒)、频率(15MHz，持续2秒)。在一些实现方式中，图5中灯泡的旋入式底座504可包括扬声器，可以执行上述操作序列指示的声音操作，用户也可以听见灯泡播放的声音。
在一些实施例中，对于具有振动马达或者电机的智能设备。该操作序列可以指示一组运动，例如，智能设备118具有振动马达，可以模拟震动反馈，并使得智能设备118执行振动运动。振动马达可以按照振动频率和幅度的不同组合形成多种操作序列。例如，操作序列：频率1(持续2秒)、频率2(持续3秒)、频率3(持续2秒)、频率4(持续2秒)，其中频率1、频率2、频率3、频率4代表四种不同的振动频率。又如，智能设备118是具有移动能力的智能扫地机，可以在地面上自由移动。操作序列可以包括一种运动轨迹，例如操作序列1可以为：向前移动30厘米、向左移动10厘米、向后移动10厘米，图6中的智能扫地机可以按照图示箭头执行对应的移动操作。操作序列2可以为以S型曲线移动十秒钟，图6中也示出了一种S型曲线移动的轨迹示例。
在一些实施例中，对于具有显示能力的智能设备。该操作序列可以指示智能设备118显示屏的图像变化。例如，智能设备118为具有显示屏幕的音箱，可以显示字符、图片或其他图案。操作序列可以包括显示至少一种图案，例如：一串随机序列号、一幅图片、一串文字等。操作序列可以包括显示至少一种图案和声音的组合。例如，图7中音箱700可以显示鱼的图案作为对操作序列的响应。在一些实现方式中，智能设备118还可以根据308步骤中接收的第一指令生成并显示一个二维码，移动终端110可以扫描智能设备118显示的二维码执行绑定操作。当然，操作序列有多种多样的组合方式，在此不一一列举。
在一些实施例中，操作序列可以是服务器116随机生成的。对于智能插座 设备，该操作序列可以对应一组电源指示灯的亮灭指令序列。以该指令序列包含16个亮灭控制操作为例，状态指令序列变化组合可达65536种(即，2 16，2的16次方)。针对待配对的智能插座，该操作序列单次有效，可以达到相当高的安全等级。
在步骤312，服务器116发送第一指令至智能设备118。在一些实现方式中，服务器116按照操作序列，依次将指令发给智能设备118执行。
在步骤314，智能设备118执行上述第一指令。如上所述，智能设备118可以执行一组操作，例如图5示出的灯光亮度、颜色的变化操作和播放声音的操作、图6示出的移动操作、以及图7示出的显示操作。
在步骤316，智能设备118返回第一指令执行结果到服务器116，以通知服务器116第一指令已经执行完毕。在一些实现方式中，服务器116按照操作序列，依次将指令发给智能设备118执行，智能设备将每条指令的执行结果返回给服务器116，在服务器116确认指令执行成功后，按照间隔时间T发送下一个指令。
在步骤318，服务器116通知移动终端110提交录制的文件。例如，响应于接收到步骤316传送的第一指令执行结果，服务器116向移动终端110发送传输媒体文件通知。
在步骤320，移动终端110停止录制。
在步骤322中，移动终端110发送第一文件至服务器116。在一些实施例中，第一文件可以是录制的媒体文件，第一文件可以包括图像和/或音频数据。在一些实现方式中，移动终端110还可以发送录制的媒体文件中提取的特征信息，例如，颜色、形状和纹理等图像特征信息或者声音频率、声音强度等声音特征信息。
在步骤324，服务器116可以分析第一文件中包含的图像和/或音频数据提取操作行为特征，操作行为特征能反映智能设备118执行第一指令指示的至少一种操作的过程。分析图像可以包括分析由移动终端110相机捕获的图像中提取的图像特征来描述图像的视觉内容，如颜色、形状和纹理等，每种特征都具有多种描述方式。每种特征从不同的角度对图像视觉内容进行可计算性的描述。服务器116执行语音识别从音频数据提取有用的特征，识别方法包括模板匹配法或人工智能网络(ANN)方法等。服务器116还可以用机器学习和深度学习实现图像和/或音频数据分析。
在步骤326，服务器116确定智能设备118的操作行为特征与步骤308中的第一指令是否相匹配。例如，服务器116可以分析图像并将图像特征与应该存在于图像中的标准特征进行比较。例如，如果图像序列和生成的操作模式匹配置信度低于阈值，则可以通知移动终端110绑定失败。如果图像序列和操作指令序列匹配置信度高于阈值，则执行步骤328。
在一些实施例中，在操作序列包括一组灯光的亮灭控制指令时，服务器116解析媒体文件确定智能设备118是否发生了操作序列中指示的灯光亮灭变化；在一些实施例中，在操作序列包括一组灯光的颜色控制指令时，服务器116解析媒 体文件确定智能设备118是否发生了操作序列中指示的的灯光颜色变化；在一些实施例中，当操作序列包括一组声音控制指令时，服务器116解析媒体文件确定智能设备118是否发出了操作序列中指示的声音；在一些实施例中，当操作序列包括一组运动控制指令时，服务器116解析媒体文件确定智能设备118是否做出了操作序列中相应的运动(例如，振动或者移动)；在一些实施例中，当操作序列包括一组显示控制指令时，服务器116解析媒体文件确定智能设备118的显示设备是否显示了对应的图案内容(例如，图7中显示的鱼)。当然，操作序列可以是以上至少一种第一指令的组合，例如灯光颜色和亮度的组合，或者屏幕显示控制指令及声音控制指令的组合等。
在步骤328，服务器116可以将智能设备118的第一标识与用户管理账户相关联。关联成功后，即可允许用户管理账户访问智能设备118，例如允许用户管理账户的远程控制(例如，在公司工作时远程开启智能设备118)，或者从智能设备118接收消息通知(例如，当在公司工作时，家中阳台户外天气感知系统实时监测室外天气情况，雨雪天气可以联动推窗器自动关闭窗户，并向用户发送消息通知)。
步骤324、步骤326和步骤328需要服务器116的处理，用户可能需要等待服务器116处理完成。在一些实施例中，在步骤320之后，移动终端110可显示图4E所示的进度界面426。进度界面426可以包括当前操作进度428(图4E中进度64％)，还可以包括提示语430，用于提示用户确保网络状况良好。
在步骤330，服务器116通知移动终端110成功绑定智能设备118。移动终端110可显示图4F所示的连接成功界面432。连接成功界面432可以包括成功指示434。用户还可以在连接成功界面432为智能设备118选择位置类别(例如，主卧、次卧、客厅、厨房、卫生间等)。之后，移动终端110可以在对应的位置类别显示对应的智能设备118。
步骤330之后，响应于用户查看智能设备列表的操作，移动终端110显示如图4G所示的用户界面。图4G示出的用户界面436包含智能扫地机438和智能音箱440的图标外，还包含新添加的智能设备118的图标442。之后，用户可以通过智能设备118的管理应用(或者智能设备118云服务提供商的智能家居平台应用)控制智能设备118。例如，控制灯泡102的开启或者关闭，或者通过语音指令控制音箱108播放喜爱的音乐或者查询天气状况。
图3A、3B详细描述了包含由移动终端110、智能设备118和服务器116所执行的绑定操作的流程。现在将继续描述执行上述流程的移动终端110、智能设备118和服务器116的结构。
图8示出了本申请实施例涉及的移动终端110的一种结构示意图，该移动终端110包括：射频(radio frequency，RF)电路810、电源820、处理器830、存储器840、输入单元850、显示单元860、传感器870、音频电路880、以及无线保真(wireless-fidelity，Wi-Fi)模块890等部件。本领域技术人员可以理解，图 8中示出的手机结构并不构成对手机的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
下面结合图8对移动终端110的各个构成部件进行具体的介绍：
RF电路810可用于收发信息或在通话过程中进行信号的接收和发送。例如：RF电路810可以将从基站接收的下行数据发送给处理器830处理，并把上行数据发送给基站。
通常，RF电路包括但不限于RF芯片、天线、至少一个放大器、收发信机、耦合器、低噪声放大器(low noise amplifier，LNA)、双工器、射频开关等。此外，RF电路810还可以与网络和其他设备进行无线通信。所述无线通信可以使用任一通信标准或协议，包括但不限于全球移动通讯系统(global system of mobile communication，GSM)、通用分组无线服务(general packet radio service，GPRS)、码分多址(code division multiple access，CDMA)、宽带码分多址(wideband code division multiple access，WCDMA)、长期演进(long term evolution，LTE)、电子邮件、短消息服务(short messaging service，SMS)等。
存储器840可用于存储软件程序以及模块，处理器830通过运行存储在存储器840的软件程序以及模块，从而执行移动终端110的各种功能应用以及数据处理。存储器840可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等；存储数据区可存储根据移动终端110的使用所创建的数据(比如音频数据、电话本等)等。此外，存储器840可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。存储器840还可以存储知识库、标签库和算法库。
输入单元850可用于接收输入的数字或字符信息，以及产生与移动终端110的用户设置以及功能控制有关的键信号输入。具体地，输入单元850可包括触控面板851以及其他输入设备852。触控面板851，也称为触摸屏，可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板851上或在触控面板851附近的操作)，并根据预先设定的程式驱动相应的连接装置。可选的，触控面板851可包括触摸检测装置和触摸控制器两个部分。其中，触摸检测装置检测用户的触摸方位，并检测触摸操作带来的信号，将信号传送给触摸控制器；触摸控制器从触摸检测装置上接收触摸信息，并将它转换成触点坐标，再送给处理器830，并能接收处理器830发来的命令并加以执行。此外，可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板851。除了触控面板851，输入单元850还可以包括其他输入设备852。具体地，其他输入设备852可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆等中的一种或多种。
显示单元860可用于显示由用户输入的信息或提供给用户的信息以及手机800的各种菜单。显示单元860可包括显示面板861，可选的，可以采用液晶显 示屏(liquid crystal display，LCD)、机电激光显示(organic light-emitting diode，OLED)等形式来配置显示面板861。进一步的，触控面板851可覆盖显示面板861，当触控面板851检测到在其上或附近的触摸操作后，传送给处理器830以确定触摸事件的类型，随后处理器830根据触摸事件的类型在显示面板861上提供相应的视觉输出。虽然在图8中，触控面板851与显示面板861是作为两个独立的部件来实现手机800的输入和输入功能，但是在某些实施例中，可以将触控面板851与显示面板861集成而实现移动终端110的输入和输出功能。
移动终端110还可包括至少一种传感器870，比如光传感器、运动传感器以及其他传感器。具体地，光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示面板861的亮度，接近传感器可在移动终端110移动到耳边时，关闭显示面板861和/或背光。作为运动传感器的一种，加速计传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等。移动终端110还可以配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
音频电路880、扬声器881、麦克风882可提供用户与移动终端110之间的音频接口。音频电路880可将接收到的音频数据转换后的电信号，传输到扬声器881，由扬声器881转换为声音信号输出；另一方面，麦克风882将收集的声音信号转换为电信号，由音频电路880接收后转换为音频数据，再将音频数据输出至RF电路810以发送给比如另一手机，或者将音频数据输出至存储器840以便进一步处理。
Wi-Fi属于短距离无线传输技术，移动终端110通过Wi-Fi模块890可以帮助用户收发电子邮件、浏览网页和访问流式媒体等，它为用户提供了无线的宽带互联网访问。虽然图8示出了Wi-Fi模块890，但是可以理解的是，其并不属于移动终端110的必须构成，完全可以根据需要在不改变发明的本质的范围内而省略。
处理器830是移动终端110的控制中心，利用各种接口和线路连接整个手机的各个部分，通过运行或执行存储在存储器840内的软件程序和/或模块，以及调用存储在存储器840内的数据，执行移动终端110的各种功能和处理数据，从而实现基于手机的多种业务。可选的，处理器830可包括一个或多个处理单元；优选的，处理器830可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器830中。
本申请实施例中，处理器830可以执行存储器840中存储的程序指令，来在实现以上实施例所示的方法。例如，执行上述图2或图3A、3B中示出的移动终端110侧的方法程序指令被存储在存储器840中，处理器830在执行上述程序指 令时，使得移动终端110执行图2、图3A或图3B中移动终端110执行的方法步骤。例如，图2中的步骤202、206、208、210，图3A中示出的步骤342、346、352、358和图3B示出的步骤302、308、320、322和330。移动终端110中摄像头用于对智能设备进行拍照和录像，麦克风用于采集智能设备的声音信息。移动终端110还可以通过视频编码器对拍摄到的图像进行编码，并通过音频编码器对麦克风采集到的声音进行编码。存储器840还用于存储录制的音视频数据。显示单元860用于显示图4A-图4G所示的用户界面。
移动终端110还包括给各个部件供电的电源820(比如电池)，优选的，电源可以通过电源管理系统与处理器830逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗等功能。
尽管未示出，移动终端110还可以包括摄像头、蓝牙模块等，在此不予赘述。
图9示出了一种通信设备的结构示意图，该通信设备可以是图1中的智能设备118或服务器116。如图9所示，该通信设备可以包括通信模块910、处理器920和存储器930。
其中，存储器930可用于存储数据、软件程序以及软件模块，可以是易失性存储器(volatile memory)，例如随机存取存储器(random-access memory，RAM)；或者非易失性存储器(non-volatile memory)，例如只读存储器(read-only memory，ROM)，快闪存储器(flash memory)，硬盘(hard disk drive，HDD)或固态硬盘(solid-state drive，SSD)，或者上述种类的存储器的组合。具体的，存储器930内可存储程序代码，该程序代码用于使处理器920通过执行该程序代码，执行本申请实施例提供的智能设备管理方法。
例如，对于智能设备118而言，存储器930内可存储程序代码，该程序代码用于使处理器920通过执行该程序代码执行图2或图3A或图3B中的智能设备118侧执行的方法步骤(例如，图2中的步骤202、204、212，图3A中的步骤350，图3B中的步骤314)。智能设备118主要负责接收服务器116发送的第一指令，并根据第一指令执行至少一种操作(例如，指示灯亮灭，灯颜色变化，显示特定字符/图标，蜂鸣器发声，或者人眼可以观测的运动等)，发送执行结果至服务器。
对于服务器116而言，存储器930内可存储程序代码，该程序代码用于使处理器920通过执行该程序代码执行图2或图3A或图3B中的服务器116侧执行的方法步骤(例如，图2中的步骤208，图3A中的步骤344、348、354、356、358，图3B中的步骤304、306、310、312、318、324、326、328、330)。服务器116还用于进行用户身份认证，并对用户账户登陆状态进行记录；管理用户账号和设备的绑定关系；管理设备注册信息、设备能力集。
存储器930可以包括用于在通信设备的操作期间存储程序和数据的快速读写存储器以及用于存储指令和数据所需的指令和数据的永久存储器。存储器930还可以存储要从通信设备发送的数据或者由通信设备接收的数据。
通信模块910可以包括无线通信模块和/或有线通信模块，例如Wi-Fi模块、蓝牙模块、红外模块、GPRS模块、以太网通信模块等中的一个或多个，可以用于收发信息，还可以将接收到的信息给处理器920处理；或者，将处理器920生成的信号发送出去。通信模块910可以接收期望操作的无线控制信号，控制信号可以源自远程通信设备，例如移动终端110。
处理器920耦合到通信模块910、存储器930。处理器920可以是任何处理设备，包括但不限于MIPS(microprocessor without interlocked piped stages)处理器，微处理器，数字信号处理器，专用集成电路电路，微控制器，状态机或任何类型的可编程逻辑阵列。处理器920是通信设备的控制中心，利用各种接口和线路连接整个通信设备的各个部分，通过运行或执行存储在存储器930内的软件程序和/或模块，以及调用存储在存储器930内的数据，执行通信设备的各种功能和处理数据。
此外，需要说明的是，图9所示结构并不作为对本申请实施例涉及的通信设备的结构的限制，该通信设备还可以包括其它模块，例如传感器、电源模块等，在此不再一一赘述。
本申请实施例可以根据上述方法示例对上述用户设备进行功能模块的划分，例如，可以对应各个功能划分各个功能模块，也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。需要说明的是，本申请实施例中对模块的划分是示意性的，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式。
本申请实施例还提供一种将智能设备与在服务器建立的用户管理账户绑定的系统，系统包括图1中示出的移动终端110、智能设备118、服务器116，该系统可以实现图2、图3A和图3B中示出的智能设备管理方法，移动终端110用于执行图2或图3A或3B中示出的移动终端110侧执行的方法步骤，智能设备118用于执行图2或图3A或3B中示出的智能设备118执行的方法步骤，服务器116执行图2或者图3中示出的服务器116执行的方法步骤。
本申请实施例还提供另一种将智能设备与在服务器建立的用户管理账户绑定的系统，系统包括图1中示出的移动终端110、智能设备118，该系统可以实现图2和图3A或3B中示出的智能设备管理方法步骤，移动终端110用于执行图2、图3A或图3B中示出的移动终端110侧执行的方法步骤，智能设备118用于执行图2、图3A或图3B中中示出的智能设备118执行的方法步骤。
本申请实施例还提供一种计算机存储介质，当该计算机程序产品在移动终端上运行时，使得移动终端执行图2、图3A或图3B中的相关方法步骤。
本申请实施例还提供了一种计算机程序产品，当该计算机程序产品在移动终端上运行时，使得移动终端执行图2、图3A或图3B中的相关方法步骤。
在上述实施例中，可以全部或部分的通过软件，硬件，固件或者其任意组合来实现。当使用软件程序实现时，可以全部或部分地以计算机程序产品的形式出 现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。该可用介质可以是磁性介质，(例如，软盘，硬盘、磁带)、光介质(例如，DVD)或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何在本申请揭露的技术范围内的变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (47)

  1. 一种智能设备管理方法，其特征在于，包括：
    移动终端发送第一请求至服务器，所述第一请求包括所述智能设备的第一标识；
    所述服务器响应于所述第一请求，发送第一指令至所述智能设备，并发送第二指令至所述移动终端；
    所述智能设备根据所述第一指令执行至少一种操作；
    所述移动终端响应于所述第二指令，录制所述智能设备执行所述至少一种操作的过程并生成录制的第一文件；
    所述移动终端发送所述第一文件至所述服务器；
    所述服务器根据所述第一文件确定所述智能设备执行的所述至少一种操作是否与所述第一指令匹配；
    所述服务器响应于确定所述智能设备执行的所述至少一种操作与所述第一指令匹配，将所述智能设备的第一标识与在所述服务器建立的用户管理账户相关联。
  2. 如权利要求1所述的方法，其特征在于，所述方法还包括：
    所述移动终端发送所述智能设备的第一信息至所述服务器；
    所述服务器根据所述第一信息获取所述智能设备的第一标识并将所述第一标识发送至所述移动终端，其中所述第一信息包括所述智能设备的序列号或所述智能设备的媒体访问控制地址。
  3. 如权利要求2所述的方法，其特征在于，所述第一标识是所述服务器根据所述第一信息随机生成的。
  4. 如权利要求1至3任一所述的方法，其特征在于，所述发送第一指令至所述智能设备包括：
    所述服务器根据所述智能设备的操作能力，生成所述第一指令；
    所述服务器发送所述第一指令至所述智能设备。
  5. 如权利要求1至4任一所述的方法，其特征在于，所述至少一种操作中的每一种操作包括以下操作中的一项或任意组合：声音调节操作、灯光调节操作、或运动操作。
  6. 如权利要求5所述的方法，其特征在于，所述声音调节操作包括以下操作中的一项或任意组合：音色调节、音调调节、音强调节或音长调节。
  7. 如权利要求5所述的方法，其特征在于，所述灯光操作包括灯光的颜色调节或灯光亮度调节。
  8. 如权利要求5所述的方法，其特征在于，所述运动操作包括振动或移动。
  9. 如权利要求1至8任一所述的方法，其特征在于，所述服务器根据所述第一文件确定所述智能设备执行的所述至少一种操作是否与所述第一指令匹配包括：
    所述服务器识别所述第一文件中的图像信息和音频信息以获取所述智能设备的操作行为特征；
    所述服务器确定所述智能设备的操作行为特征是否与所述第一指令匹配。
  10. 如权利要求1至9任一所述的方法，其特征在于，所述方法还包括：
    所述移动终端控制所述智能设备执行操作事件。
  11. 如权利要求1至10任一所述的方法，其特征在于，所述录制所述智能设备执行所述至少一种操作的过程包括：
    所述移动终端通过摄像头或麦克风中的至少一个录制所述智能设备执行所述至少一种操作的过程。
  12. 一种智能设备管理方法，其特征在于，包括：
    移动终端发送第一请求至服务器，所述第一请求包括所述智能设备的第一标识；
    所述智能设备接收所述服务器发送的第一指令；
    响应于所述第一指令，所述智能设备执行至少一种操作；
    所述移动终端接收所述服务器发送的第二指令；
    响应于所述第二指令，所述移动终端录制所述智能设备执行所述至少一种操作的过程并生成录制的第一文件；
    所述移动终端发送所述第一文件至所述服务器，所述第一文件被所述服务器用于确定所述智能设备执行的所述至少一种操作是否与所述第二指令匹配；
    所述移动终端从所述服务器接收关联成功通知，所述关联成功通知指示：所述服务器在确定所述智能设备执行的所述至少一种操作与所述第二指令匹配后，成功将所述智能设备的第一标识与在所述服务器建立的用户管理账户相关联。
  13. 如权利要求12所述的方法，其特征在于，所述方法还包括：
    所述移动终端发送所述智能设备的第一信息至所述服务器；
    所述移动终端接收所述服务器根据所述第一信息获取的所述智能设备的第一标识，其中所述第一信息包括所述智能设备的序列号或所述智能设备的媒体访问控制地址。
  14. 如权利要求13所述的方法，其特征在于，所述第一标识是所述服务器根据所述第一信息随机生成的。
  15. 如权利要求12至14任一所述的方法，其特征在于，所述第一指令是所述服务器根据所述智能设备的操作能力生成的。
  16. 如权利要求12至15任一所述的方法，其特征在于，所述至少一种操作中的每一种操作包括以下操作中的一项或任意组合：声音调节操作、灯光调节操作、或运动操作。
  17. 如权利要求16所述的方法，其特征在于，所述声音调节操作包括以下操作中的一项或任意组合：音色调节、音调调节、音强调节或音长调节。
  18. 如权利要求16所述的方法，其特征在于，所述灯光操作包括灯光的颜 色调节或灯光亮度调节。
  19. 如权利要求16所述的方法，其特征在于，所述运动操作包括振动或移动。
  20. 如权利要求12至19任一所述的方法，其特征在于，所述方法还包括：
    所述移动终端控制所述智能设备执行操作事件。
  21. 如权利要求12至20任一所述的方法，其特征在于，所述录制所述智能设备执行所述至少一种操作的过程包括：
    所述移动终端通过摄像头或麦克风中的至少一个录制所述智能设备执行所述至少一种操作的过程。
  22. 一种系统，其特征在于，所述系统包括：
    移动终端，被配置为发送第一请求至服务器，所述第一请求包括智能设备的第一标识；
    所述服务器，被配置为响应于响应于所述第一请求，发送第一指令至所述智能设备，并发送第二指令至所述移动终端；
    所述智能设备，被配置为根据所述第一指令执行至少一种操作；
    所述移动终端，还被配置为响应于所述第二指令，录制所述智能设备执行所述至少一种操作的过程并生成录制的第一文件，发送所述第一文件至所述服务器；
    所述服务器，还被配置为根据所述第一文件确定所述智能设备执行的所述至少一种操作是否与所述第一指令匹配，以及响应于确定所述智能设备执行的所述至少一种操作与所述第一指令匹配，将所述智能设备的第一标识与在所述服务器建立的用户管理账户相关联。
  23. 如权利要求22所述的系统，其特征在于，所述移动终端还被配置为发送所述智能设备的第一信息至所述服务器，所述服务器还被配置为根据所述第一信息生成所述智能设备的第一标识并将所述第一标识发送至所述移动终端。
  24. 如权利要求22或23所述的系统，其特征在于，所述第一指令是所述服务器根据所述智能设备的操作能力生成的。
  25. 如权利要求22至24任一所述的系统，其特征在于，所述至少一种操作中的每一种操作包括以下操作中的一项或任意组合：声音调节操作、灯光调节操作、或运动操作。
  26. 如权利要求25所述的系统，其特征在于，所述声音操作包括声音的音色、音调、音强和音长中的至少一种操作变化。
  27. 如权利要求25所述的系统，其特征在于，所述灯光操作包括灯光的颜色调节或灯光亮度调节。
  28. 如权利要求25所述的系统，其特征在于，所述运动操作包括振动或移动。
  29. 如权利要求22至28任一所述的系统，其特征在于，所述根据所述第一文件确定所述智能设备执行的所述至少一种操作是否与所述第一指令匹配包括： 识别所述第一文件中的图像信息和音频信息以获取所述智能设备的操作行为特征；确定所述智能设备的操作行为特征是否与所述第一指令匹配。
  30. 如权利要求22至29任一所述的系统，其特征在于，所述移动终端还被配置为控制所述智能设备执行操作事件。
  31. 如权利要求22至30任一所述的系统，其特征在于，所述录制所述智能设备执行所述至少一种操作的过程包括：
    通过所述移动终端的摄像头或麦克风中的至少一个录制所述智能设备执行所述至少一种操作的过程。
  32. 一种系统，其特征在于，所述系统包括：
    移动终端，被配置为：发送第一请求至服务器，所述第一请求包括智能设备的第一标识；
    所述智能设备，被配置为：接收所述服务器发送的第一指令，响应于所述第一指令，所述智能设备执行至少一种操作；
    所述移动终端还被配置为：接收所述服务器发送的第二指令，响应于所述第二指令，录制所述智能设备执行所述至少一种操作的过程并生成录制的第一文件，发送所述第一文件至所述服务器；所述第一文件被所述服务器被用于确定所述智能设备执行的所述至少一种操作是否与所述第二指令匹配；从所述服务器接收关联成功通知，所述关联成功通知指示：所述服务器在确定所述智能设备执行的所述至少一种操作与所述第二指令匹配后，成功将所述智能设备的第一标识与在所述服务器建立的用户管理账户相关联。
  33. 如权利要求32所述的系统，其特征在于，所述移动终端还被配置为发送所述智能设备的第一信息至所述服务器，接收所述服务器根据所述第一信息获取的所述智能设备的第一标识，其中所述第一信息包括所述智能设备的序列号或所述智能设备的媒体访问控制地址。
  34. 如权利要求32或33所述的系统，其特征在于，所述第一指令是所述服务器根据所述智能设备的操作能力生成的。
  35. 如权利要求32至34任一所述的系统，其特征在于，所述至少一种操作中的每一种操作包括以下操作中的一项或任意组合：声音调节操作、灯光调节操作、或运动操作。
  36. 如权利要求35所述的系统，其特征在于，所述声音操作包括声音的音色、音调、音强和音长中的至少一种操作变化。
  37. 如权利要求35所述的系统，其特征在于，所述灯光操作包括灯光的颜色调节或灯光亮度调节。
  38. 如权利要求35所述的系统，其特征在于，所述运动操作包括振动或移动。
  39. 如权利要求32至38任一所述的系统，其特征在于，所述移动终端还被配置为控制所述智能设备执行操作事件。
  40. 如权利要求32至39任一所述的系统，其特征在于，所述录制所述智能设备执行所述至少一种操作的过程包括：
    通过所述移动终端的摄像头或麦克风中的至少一个录制所述智能设备执行所述至少一种操作的过程。
  41. 一种移动终端，其特征在于，包括：
    触摸屏，其中，所述触摸屏包括触敏表面和显示屏；
    一个或多个处理器；
    一个或多个存储器；
    以及一个或多个计算机程序，其中所述一个或多个计算机程序被存储在所述一个或多个存储器中，所述一个或多个计算机程序包括指令，当所述指令被所述移动终端执行时，使得所述移动终端执行以下步骤：
    发送第一请求至服务器，所述第一请求包括所述智能设备的第一标识；
    接收所述服务器发送的第二指令；
    响应于所述第二指令，录制所述智能设备执行至少一种操作的过程并生成录制的第一文件，其中，所述智能设备响应所述服务器发送的第一指令执行所述至少一种操作；
    发送所述第一文件至所述服务器，所述第一文件被所述服务器用于确定所述智能设备执行的所述至少一种操作是否与所述第二指令匹配；
    从所述服务器接收关联成功通知，所述关联成功通知指示：所述服务器在确定所述智能设备执行的所述至少一种操作与所述第二指令匹配后，成功将所述智能设备的第一标识与在所述服务器建立的用户管理账户相关联。
  42. 根据权利要求41所述的移动终端，其特征在于，当所述指令被所述移动终端执行时，还使得所述移动终端执行以下步骤：
    发送所述智能设备的第一信息至所述服务器；
    接收所述服务器根据所述第一信息获取所述智能设备的第一标识，其中所述第一信息包括所述智能设备的序列号或所述智能设备的媒体访问控制地址。
  43. 根据权利要求42所述的移动终端，其特征在于，所述第一标识是所述服务器根据所述第一信息随机生成的。
  44. 根据权利要求41至43任一所述的移动终端，其特征在于，所述第一指令是所述服务器根据所述智能设备的操作能力生成的。
  45. 根据权利要求41至44任一所述的移动终端，其特征在于，所述至少一种操作中的每一种操作包括以下操作中的一项或任意组合：声音调节操作、灯光调节操作、或运动操作。
  46. 一种计算机可读存储介质，所述计算机可读存储介质中存储有指令，其特征在于，当所述指令在移动终端上运行时，使得所述移动终端执行以下步骤：
    发送第一请求至服务器，所述第一请求包括所述智能设备的第一标识；
    接收所述服务器发送的第二指令；
    响应于所述第二指令，录制所述智能设备执行至少一种操作的过程并生成录制的第一文件，其中，所述智能设备响应所述服务器发送的第一指令执行所述至少一种操作；
    发送所述第一文件至所述服务器，所述第一文件被所述服务器用于确定所述智能设备执行的所述至少一种操作是否与所述第二指令匹配；
    从所述服务器接收关联成功通知，所述关联成功通知指示：所述服务器在确定所述智能设备执行的所述至少一种操作与所述第二指令匹配后，成功将所述智能设备的第一标识与在所述服务器建立的用户管理账户相关联。
  47. 一种包含指令的计算机程序产品，其特征在于，当所述计算机程序产品在移动终端上运行时，使得所述移动终端执行以下步骤：
    发送第一请求至服务器，所述第一请求包括所述智能设备的第一标识；
    接收所述服务器发送的第二指令；
    响应于所述第二指令，录制所述智能设备执行至少一种操作的过程并生成录制的第一文件，其中，所述智能设备响应所述服务器发送的第一指令执行所述至少一种操作；
    发送所述第一文件至所述服务器，所述第一文件被所述服务器用于确定所述智能设备执行的所述至少一种操作是否与所述第二指令匹配；
    从所述服务器接收关联成功通知，所述关联成功通知指示：所述服务器在确定所述智能设备执行的所述至少一种操作与所述第二指令匹配后，成功将所述智能设备的第一标识与在所述服务器建立的用户管理账户相关联。
PCT/CN2018/125815 2018-12-29 2018-12-29 一种智能设备管理方法、移动终端及系统 WO2020133495A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/125815 WO2020133495A1 (zh) 2018-12-29 2018-12-29 一种智能设备管理方法、移动终端及系统
CN201880100359.2A CN113273151A (zh) 2018-12-29 2018-12-29 一种智能设备管理方法、移动终端及系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/125815 WO2020133495A1 (zh) 2018-12-29 2018-12-29 一种智能设备管理方法、移动终端及系统

Publications (1)

Publication Number Publication Date
WO2020133495A1 true WO2020133495A1 (zh) 2020-07-02

Family

ID=71128221

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/125815 WO2020133495A1 (zh) 2018-12-29 2018-12-29 一种智能设备管理方法、移动终端及系统

Country Status (2)

Country Link
CN (1) CN113273151A (zh)
WO (1) WO2020133495A1 (zh)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112019634A (zh) * 2020-09-06 2020-12-01 南京乐服智慧科技有限公司 基于策略的多用户多设备交互系统、策略更新方法和策略联合执行方法
CN113596124A (zh) * 2021-07-20 2021-11-02 四川虹美智能科技有限公司 智能设备的控制系统和方法
CN113641282A (zh) * 2021-06-17 2021-11-12 深圳市爱都科技有限公司 一种账户的设备关联方法、装置和终端设备
CN113920751A (zh) * 2021-10-19 2022-01-11 深圳市一诺成电子有限公司 高清数码相框动态追踪控制系统及方法
CN115019494A (zh) * 2022-06-02 2022-09-06 武汉领普科技有限公司 无线开关、无线开关的处理方法及控制系统

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140173049A1 (en) * 2012-12-18 2014-06-19 General Electric Company Binding an appliance to a network at point of purchase
CN106406112A (zh) * 2016-09-30 2017-02-15 佛山市顺德区美的电热电器制造有限公司 智能家电配网绑定方法和系统、智能终端
CN108834226A (zh) * 2018-06-25 2018-11-16 深圳市智能体科技有限公司 一种智能设备绑定的方法及系统

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9344437B2 (en) * 2011-09-23 2016-05-17 Jerome Svigals Internet of things security
CN104468524B (zh) * 2014-11-14 2018-12-25 小米科技有限责任公司 权限验证的方法及装置
CN104936304B (zh) * 2015-06-01 2018-09-18 小米科技有限责任公司 智能设备绑定方法、智能设备及服务器
CN105163402A (zh) * 2015-09-24 2015-12-16 劳海鹏 一种通过移动终端对码实现射频双向通讯的方法与系统
CN105446293B (zh) * 2015-11-27 2018-02-27 珠海格力电器股份有限公司 智能家居设备的绑定方法、装置和系统及智能终端
CN106911642A (zh) * 2015-12-23 2017-06-30 北京奇虎科技有限公司 一种智能设备绑定方法及装置
CN105632144A (zh) * 2015-12-30 2016-06-01 小米科技有限责任公司 智能设备的控制方法及装置
US10021094B2 (en) * 2016-04-07 2018-07-10 At&T Mobility Ii Llc System and method for providing wearable authentication and management
US11758399B2 (en) * 2017-05-25 2023-09-12 Huawei Technologies Co., Ltd. Wireless local area network configuration using probe request frame having authentication information
CN107766738A (zh) * 2017-09-12 2018-03-06 阿里巴巴集团控股有限公司 一种智能设备的绑定方法、装置和系统、通讯系统
CN108063704A (zh) * 2017-11-27 2018-05-22 海尔优家智能科技（北京）有限公司 一种网络接入方法和系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140173049A1 (en) * 2012-12-18 2014-06-19 General Electric Company Binding an appliance to a network at point of purchase
CN106406112A (zh) * 2016-09-30 2017-02-15 佛山市顺德区美的电热电器制造有限公司 智能家电配网绑定方法和系统、智能终端
CN108834226A (zh) * 2018-06-25 2018-11-16 深圳市智能体科技有限公司 一种智能设备绑定的方法及系统

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112019634A (zh) * 2020-09-06 2020-12-01 南京乐服智慧科技有限公司 基于策略的多用户多设备交互系统、策略更新方法和策略联合执行方法
CN113641282A (zh) * 2021-06-17 2021-11-12 深圳市爱都科技有限公司 一种账户的设备关联方法、装置和终端设备
CN113596124A (zh) * 2021-07-20 2021-11-02 四川虹美智能科技有限公司 智能设备的控制系统和方法
CN113596124B (zh) * 2021-07-20 2023-04-28 四川虹美智能科技有限公司 智能设备的控制系统和方法
CN113920751A (zh) * 2021-10-19 2022-01-11 深圳市一诺成电子有限公司 高清数码相框动态追踪控制系统及方法
CN115019494A (zh) * 2022-06-02 2022-09-06 武汉领普科技有限公司 无线开关、无线开关的处理方法及控制系统
CN115019494B (zh) * 2022-06-02 2024-02-06 武汉领普科技有限公司 无线开关、无线开关的处理方法及控制系统

Also Published As

Publication number Publication date
CN113273151A (zh) 2021-08-17

Similar Documents

Publication Publication Date Title
WO2020133495A1 (zh) 一种智能设备管理方法、移动终端及系统
AU2021269359B2 (en) Display method and apparatus
CN110601870B (zh) 一种设备配网注册的方法、设备及系统
US20180368058A1 (en) Method for controlling device access, and related device and system
KR101706479B1 (ko) 사물인터넷 제어방법, 단말 및 피제어 기기
KR102084507B1 (ko) 홈 네트워크 시스템에서 홈 디바이스를 원격으로 제어하는 방법 및 장치
CN107332976B (zh) K歌方法、装置、设备及系统
WO2017185711A1 (zh) 控制智能设备的方法、装置、系统和存储介质
US9503893B2 (en) Communication management system, relay device, communication control system, communication system, communication method, and recording medium storing communication control program
EP3425566A1 (en) Electronic device and method of registering personal cloud apparatus in user portal server thereof
CN110352606A (zh) 一种连接网络的方法、移动终端、电子设备和图形用户界面
WO2015024391A1 (zh) 一种对网络电视终端进行无线控制的方法以及设备
WO2017028396A1 (zh) 多媒体播放设备的连接方法、主设备、控制终端及系统
CN105682253A (zh) 建立通信的方法、设备、终端和计算机可读存储介质
CN117055833A (zh) 一种传屏方法、设备及存储介质
US11949938B2 (en) Techniques for authorizing controller devices
WO2013131477A1 (zh) 远程监控装置和方法
CN103957580A (zh) 一种用于智能硬件的wifi快速组网配对方法及模块
WO2016027561A1 (ja) ネットワークシステム、音声出力方法、サーバ、通信端末、および電気機器
US20200314925A1 (en) Network system, communication terminal, and recording medium
JP2016063415A (ja) ネットワークシステム、音声出力方法、サーバ、機器、および音声出力プログラム
WO2013145520A1 (ja) 情報処理装置、情報処理方法及びプログラム
CN105591755A (zh) 一种基于声波认证连接的智能家居系统及认证连接方法
CN104967637A (zh) 操作处理方法、装置及终端
CN105578109B (zh) 一种通过即时通信系统获取视频信息的视频输出设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18944258

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18944258

Country of ref document: EP

Kind code of ref document: A1