WO2023279882A1 - 一种可穿戴设备控制电子设备的方法及通信系统 - Google Patents

一种可穿戴设备控制电子设备的方法及通信系统 Download PDF

Info

Publication number
WO2023279882A1
WO2023279882A1 PCT/CN2022/095053 CN2022095053W WO2023279882A1 WO 2023279882 A1 WO2023279882 A1 WO 2023279882A1 CN 2022095053 W CN2022095053 W CN 2022095053W WO 2023279882 A1 WO2023279882 A1 WO 2023279882A1
Authority
WO
WIPO (PCT)
Prior art keywords
wearable device
electronic device
user
response
control instruction
Prior art date
Application number
PCT/CN2022/095053
Other languages
English (en)
French (fr)
Inventor
付颖科
Original Assignee
荣耀终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 荣耀终端有限公司 filed Critical 荣耀终端有限公司
Priority to EP22836637.3A priority Critical patent/EP4187362A4/en
Priority to US18/043,121 priority patent/US20230341926A1/en
Publication of WO2023279882A1 publication Critical patent/WO2023279882A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/163Wearable computers, e.g. on a belt
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1698Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/44Program or device authentication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/165Management of the audio stream, e.g. setting of volume, audio stream path
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/06Authentication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/30Security of mobile devices; Security of mobile applications
    • H04W12/33Security of mobile devices; Security of mobile applications using wearable devices, e.g. using a smartwatch or smart-glasses
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/20Pc systems
    • G05B2219/26Pc applications
    • G05B2219/2642Domotique, domestic, home control, automation, smart house

Definitions

  • the present application relates to the field of terminals, and in particular to a method and a communication system for a wearable device to control an electronic device.
  • the present application provides a method and a communication system for a wearable device to control an electronic device, which can identify various motion trajectories of a user when wearing a wearable device, and control the electronic device accordingly according to the motion trajectories.
  • the present application provides a method for controlling an electronic device by a wearable device, which is applied to a communication system including a wearable device and an electronic device.
  • the wearable device remains in a worn state.
  • the method includes: establishing a binding between the wearable device and the electronic device Among them, the binding relationship is used to indicate that the wearable device and the electronic device are bound through the preset account name and the preset password; in response to the user's operation of driving the wearable device to move, the wearable device generates and wearable device The motion data matched by the motion trajectory; the wearable device determines the control command corresponding to the motion data, and sends the control command to the electronic device; in response to receiving the control command, the electronic device switches from the first interface to the second interface; wherein, the second The interface is the interface displayed after the electronic device performs an operation corresponding to the control instruction on the first operation target, and the first operation target includes any one of a presentation, a video file, an audio file, and a document.
  • the user can perform preset actions while wearing the wearable device, and the wearable device can recognize its own motion trajectory and generate motion data matching the motion trajectory, thereby generating And send control instructions to realize the control of electronic equipment. Therefore, the user can perform different actions while wearing the wearable device to realize the control of different functions of the electronic device, which is simple and convenient, and can improve user experience.
  • the method further includes: re-establishing a binding relationship between the wearable device and the electronic device in response to determining that the wearing state of the wearable device has changed from the worn state to the shedding state.
  • the wearable device falls off, the user can be re-authenticated and the binding relationship can be established. In this way, it can be ensured that the user has the authority to control the electronic device, and the situation that an irrelevant user uses the wearable device to control the electronic device can be effectively avoided, thereby ensuring the security of the electronic device.
  • establishing a binding relationship between the wearable device and the electronic device includes: the electronic device displays a first prompt box; wherein, the first prompt box is used to prompt the user to establish a binding relationship between the wearable device and the electronic device. Binding relationship, the first prompt box includes the first option; in response to the user's operation on the first option, the electronic device displays the second prompt box; wherein, the second prompt box is used to remind the user to wear the wearable device, and the second prompt box The second option is included; in response to the user wearing the wearable device, the wearable device sends wearing state information to the electronic device; wherein, the wearing state information is used to indicate that the wearable device is in a worn state; in response to the user's operation on the second option and After receiving the wearing status information, the electronic device displays a password input prompt box; wherein, the password input prompt box includes a preset account name; in response to the user's operation of inputting a preset password in the password input prompt box, the electronic device and the wearable device
  • the wearable device can establish a binding relationship with the electronic device in the wearable state, so as to realize the authentication of the wearer of the wearable device.
  • the operation corresponding to the control instruction includes any one of turning pages forward, turning pages backward, maximizing, minimizing, increasing volume, and decreasing volume.
  • the user can use the wearable device to perform various controls on the interface on the electronic device.
  • the electronic device may display the change of the volume value on the interface, thereby realizing the switching of the interface.
  • the whole process is simple and convenient, and the user does not need to operate on the electronic device, which is convenient for the user to operate and explain during meetings and multimedia teaching.
  • the present application also provides a method for controlling an electronic device by a wearable device, which is applied to a communication system including a wearable device and an electronic device, where the wearable device and the electronic device are connected to the same local area network, and the method includes: the wearable device Establish a communication connection with the electronic device; in response to the user's operation of driving the wearable device to move, the wearable device generates motion data that matches the motion trajectory of the wearable device; the wearable device determines the control command corresponding to the motion data and sends it to the electronic device Control instruction; in response to receiving the control instruction, the electronic device switches from the first state to the second state; wherein, the second state is the state where the electronic device is after performing the operation corresponding to the control instruction, and the operation corresponding to the control instruction includes Any one of power on, power off, volume up, volume down, channel forward, channel backward, temperature up, temperature down.
  • the wearable device can also control electronic devices (for example, smart TV, refrigerator, etc.) belonging to the same local area network. Further, the user can perform different actions while wearing the wearable device, so as to control different functions of the electronic device, which is simple and convenient, and can improve user experience.
  • electronic devices for example, smart TV, refrigerator, etc.
  • the method further includes: the wearable device determines the distance between the wearable device and the at least two electronic devices; It is determined as the device to be controlled; the wearable device sends a control instruction to the device to be controlled; in response to receiving the control instruction, the device to be controlled executes an operation corresponding to the control instruction.
  • the wearable device can use the electronic device closest to it as the device to be controlled, and control the device to be controlled with different actions.
  • the method further includes: in response to determining the device to be controlled, the wearable device displays prompt information; wherein the prompt information is used to prompt the user that the wearable device can be used to control the device to be controlled.
  • the wearable device determines the device to be controlled, it can display prompt information, so as to inform the user of the device that can be controlled.
  • the present application also provides a communication system, including a wearable device and an electronic device.
  • the wearable device performs the method according to any one of the first aspect and the second aspect
  • the electronic device performs the method according to the first aspect and the second aspect. Either of the two methods.
  • the present application also provides a computer-readable storage medium, including computer instructions; when the computer instructions are run on the wearable device, the wearable device executes any one of the first aspect and the second aspect. method; or, when the computer instructions are run on the electronic device, the electronic device is made to execute the method according to any one of the first aspect and the second aspect.
  • the embodiment of the present application provides a chip system, where the chip system includes one or more interface circuits and one or more processors.
  • the interface circuit and the processor are interconnected by wires.
  • the chip system can be applied to an electronic device including a communication module and a memory.
  • the interface circuit can read instructions stored in the memory of the wearable device and send the instructions to the processor.
  • the wearable device can be made to execute the method according to any one of the first aspect and the second aspect.
  • the interface circuit can also read instructions stored in the memory in the electronic device and send the instructions to the processor.
  • the electronic device can be made to execute the method according to any one of the first aspect and the second aspect.
  • the communication system described in the third aspect provided above, the computer-readable storage medium described in the fourth aspect, and the chip system described in the fifth aspect are all used to perform the corresponding method provided above, Therefore, the beneficial effects that it can achieve can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
  • FIG. 1 is a schematic diagram of the architecture of a communication system provided by an embodiment of the present application.
  • FIG. 2 is a schematic structural diagram of a terminal device provided in an embodiment of the present application.
  • FIG. 3 is a schematic structural diagram of a wearable device provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of a scene
  • FIG. 5A is a schematic diagram of the interface of the personal computer 401.
  • FIG. 5B is a schematic diagram of the interface of the personal computer 401.
  • FIG. 6A is a schematic diagram of the interface of the personal computer 401.
  • FIG. 6B is a schematic diagram of the interface of the personal computer 401.
  • FIG. 6C is a schematic diagram of the interface of the personal computer 401.
  • FIG. 7A is a schematic diagram of the interface of the personal computer 401.
  • FIG. 7B is a schematic diagram of the interface of the personal computer 401.
  • FIG. 8 is a schematic diagram of the interface of the personal computer 401.
  • Fig. 9 is a schematic diagram of an application scenario
  • FIG. 10 is a schematic diagram of an application scenario
  • FIG. 11A is a schematic diagram of an application scenario
  • FIG. 11B is a schematic diagram of an application scenario
  • FIG. 12 is a flowchart of a method for a wearable device to control an electronic device
  • Figure 13 is a schematic diagram of another scenario
  • Fig. 14 is a schematic diagram of the interface of a mobile phone
  • Fig. 15 is a schematic diagram of the interface of a mobile phone
  • Fig. 16 is a schematic diagram of the interface of a mobile phone
  • Fig. 17A is a schematic diagram of the relative positions of a household device and a smart bracelet
  • FIG. 17B is a schematic diagram of an interface of a smart bracelet 402
  • FIG. 18A is a schematic diagram of an application scenario
  • FIG. 18B is a schematic diagram of an application scenario
  • FIG. 19A is a schematic diagram of an application scenario
  • FIG. 19B is a schematic diagram of an application scenario
  • Fig. 20 is a schematic diagram of the relative positions of another household device and the smart bracelet;
  • FIG. 21A is a schematic diagram of an application scenario
  • FIG. 21B is a schematic diagram of an application scenario
  • FIG. 22A is a schematic diagram of an application scenario
  • FIG. 22B is a schematic diagram of an application scenario
  • FIG. 23 is a flowchart of a method for a wearable device to control an electronic device
  • FIG. 24 is a schematic structural diagram of a chip system.
  • first and second are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as “first” and “second” may explicitly or implicitly include one or more of these features. In the description of this embodiment, unless otherwise specified, “plurality” means two or more.
  • FIG. 1 it is a schematic diagram of a system provided by an embodiment of the present application.
  • the system may include home devices, servers (for example, servers corresponding to Glory Cloud), terminal devices and wearable devices.
  • the first application for example, a smart life application
  • the server is a management server of the first application.
  • the terminal device in the embodiment of the present application may be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook, and a cellular Phones, personal digital assistants (personal digital assistant, PDA), augmented reality (augmented reality, AR) ⁇ virtual reality (virtual reality, VR) equipment and other equipment that can install the above-mentioned first application.
  • PDA personal digital assistants
  • augmented reality augmented reality, AR
  • VR virtual reality
  • the form is not particularly limited.
  • the household equipment provided in the embodiment of the present application may be a large screen (television, television), stereo, camera, air conditioner, refrigerator, smart curtain, desk lamp, chandelier, rice cooker, security equipment (such as an intelligent electronic lock), a personal computer (personal computer, PC) and other devices that can access the home wireless local area network.
  • the home equipment in the embodiment of the present application may also be a car stereo, a car air conditioner, etc., and the embodiment of the present application does not specifically limit the specific form of the home equipment.
  • a wireless fidelity (Wireless Fidelity, WIFI) module may be provided in a household device so as to be connected to a home local area network.
  • the wearable device provided in the embodiment of the present application may be a smart watch, a smart bracelet, and the like.
  • Fig. 2 shows a schematic structural diagram of a terminal device.
  • the terminal device 200 may include: a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (universal serial bus, USB) interface 230, a charging management module 240, a power management module 241, a battery 242, the wireless communication module 250 and the display screen 260 and so on.
  • a processor 210 may include: a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (universal serial bus, USB) interface 230, a charging management module 240, a power management module 241, a battery 242, the wireless communication module 250 and the display screen 260 and so on.
  • USB universal serial bus
  • the structure shown in this embodiment does not constitute a specific limitation on the first electronic device.
  • the first electronic device may include more or fewer components than shown in the illustrations, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 210 may include one or more processing units, for example: the processor 210 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • graphics processing unit graphics processing unit
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • the controller may be the nerve center and command center of the terminal device 200 .
  • the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 210 for storing instructions and data.
  • the memory in processor 210 is a cache memory.
  • the memory may hold instructions or data that the processor 210 has just used or recycled. If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 210 is reduced, thereby improving the efficiency of the system.
  • processor 210 may include one or more interfaces.
  • the interface may include I2C interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver/transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile Industrial processor interface (mobile industry processor interface, MIPI), general-purpose input/output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and/or USB interface, etc.
  • I2C interface integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (pulse code modulation, PCM) interface, universal asynchronous receiver/transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile Industrial processor interface (mobile industry processor interface, MIPI), general-purpose input/output (general-purpose input/output, GPIO) interface, subscriber identity module (subscribe
  • the interface connection relationship among the modules shown in this embodiment is only a schematic illustration, and does not constitute a structural limitation of the terminal device 200 .
  • the terminal device 200 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the charging management module 240 is configured to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger. While the charging management module 240 is charging the battery 242 , it can also supply power to the electronic device through the power management module 241 .
  • the power management module 241 is used for connecting the battery 242 , the charging management module 240 and the processor 210 .
  • the power management module 241 receives the input from the battery 242 and/or the charging management module 240 to provide power for the processor 210 , internal memory 221 , external memory, display screen 260 , camera 293 , and wireless communication module 250 .
  • the power management module 241 and the charging management module 240 can also be set in the same device.
  • the wireless communication module 250 can provide WLAN (such as Wi-Fi), Bluetooth, global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), short-range wireless communication technology applied on the terminal device 200. (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN such as Wi-Fi
  • Bluetooth global navigation satellite system
  • GNSS global navigation satellite system
  • FM frequency modulation
  • FM frequency modulation
  • short-range wireless communication technology applied on the terminal device 200 such as Wi-Fi
  • NFC near field communication
  • IR infrared technology
  • the terminal device 200 may establish a Bluetooth connection with the terminal device (such as the wireless headset 100 ) through the wireless communication module 250 .
  • the wireless communication module 250 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 250 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 210 .
  • the wireless communication module 250 can also receive the signal to be sent from the processor 210 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the terminal device 200 implements a display function through a GPU, a display screen 260, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 260 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 210 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 260 is used to display images, videos and the like.
  • the display screen 260 includes a display panel.
  • Fig. 3 shows a schematic structural diagram of a wearable device.
  • the wearable device may include a wireless communication module 310 , a motion sensor 320 , a processor 330 , an internal memory 340 , a power management module 350 , a battery 360 , a charging management module 370 , an antenna 3 and the like.
  • the wireless communication module 310 may include an NFC chip, and the NFC chip may include a device host (device host, DH) and an NFC controller (NFC controller, NFCC).
  • DH can be responsible for the management of NFCC, such as initialization, configuration and power management.
  • NFCC can be responsible for the physical transmission of data through the antenna.
  • the NFC chip can perform processing such as signal amplification, analog-to-digital conversion, digital-to-analog conversion, and storage.
  • the wireless communication function of the wearable device can be realized through the antenna 3 and the wireless communication module 310 .
  • processor 330 may include one or more processing units.
  • the processor 330 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc.
  • processor 330 may include one or more interfaces.
  • the interface may include I2C interface, I2S interface, PCM interface, UART interface, MIPI, GPIO interface, SIM card interface, and/or USB interface, etc. It can be understood that the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the wearable device. In other embodiments of the present application, the wearable device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
  • Internal memory 340 may be used to store one or more computer programs comprising instructions.
  • the motion sensor 320 may include an acceleration sensor, a gyroscope, and the like.
  • the wearable device is a wristband or a watch, based on the above motion sensor 320, the wristband or watch can detect the action of swiping a card.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the wearable device.
  • the wearable device may include more or fewer components than shown in the illustrations, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the meeting host can use a laser pointer to remotely control the computer to turn pages of the PPT.
  • terminal devices such as mobile phones
  • smart home devices to realize the control of smart home devices.
  • the user needs to hold the laser pointer all the time, which hinders the user's flexible presentation in gesture explanation and other aspects.
  • application, APP application program
  • an embodiment of the present application provides a method for a wearable device to control an electronic device.
  • the user can perform preset actions while wearing the wearable device, and the wearable device can recognize its own motion trajectory and generate a The trajectory matching motion data, so as to generate and send control instructions according to the motion data, and realize the control of electronic equipment. Therefore, the user can perform different actions while wearing the wearable device to realize the control of different functions of the electronic device, which is simple and convenient, and can improve user experience.
  • Fig. 4 shows a schematic diagram of a conference scene.
  • the user can use the projection screen 403 as the display screen of the personal computer 401 to display the content that the personal computer 401 needs to display.
  • the user can use the smart bracelet 402 worn by him to control the content displayed on the projection screen 403 to perform operations such as turning pages.
  • the user may perform a first operation to establish a communication connection between the smart bracelet 402 and the personal computer 401 .
  • the first operation may be an operation in which the user brings the smart bracelet 402 close to the personal computer 401 .
  • both the smart bracelet 402 and the personal computer 401 are provided with NFC chips.
  • the personal computer 401 can display the Connection prompt box 501 .
  • the first operation may also be an operation of turning on the Bluetooth function of the smart bracelet 402 .
  • both the smart bracelet 402 and the personal computer 401 are provided with chips that can be used to realize Bluetooth communication.
  • the personal computer 401 may display a connection prompt box 501 as shown in FIG. 5A after searching for the smart bracelet 401 .
  • the first operation may also be an operation in which the user makes the smart bracelet 402 join the local area network to which the personal computer 401 is connected.
  • the personal computer 401 detects that it joins the same local area network as the smart bracelet 402, it may display a connection prompt box 501 as shown in FIG. 5A. That is, the smart bracelet 402 and the personal computer 401 can communicate through any one of WIFI, Bluetooth or NFC.
  • the connection prompt box 501 may include prompt information 502 and yes option 503 .
  • the prompt information 502 is used to prompt the user that the personal computer 401 has detected a new smart bracelet, and ask the user whether to connect.
  • the prompt information 502 may be "smart bracelet detected, whether to connect”.
  • the personal computer 401 may receive the user's operation of clicking the yes option 503 , and in response to the operation, the personal computer 401 establishes a connection with the smart bracelet 402 .
  • the connection may refer to any one of WIFI connection, Bluetooth connection and NFC connection.
  • the personal computer 401 may display a connection status prompt box 505 as shown in FIG. 5B after establishing a connection with the smart bracelet 402 .
  • the connection status prompt box 505 is used to inform the user that the personal computer 401 has been connected with the smart bracelet 402 .
  • the connection status prompt box 505 may display "connected smart bracelet".
  • the connection status prompt box 505 may include a close option 506 .
  • the personal computer 401 may receive the user's operation of clicking the close option 506 , and in response to the operation, the personal computer 401 may close the connection status prompt box 505 .
  • the personal computer 401 may automatically close the connection status prompt box 505 .
  • the personal computer 401 can display a binding prompt box 601.
  • the binding prompt box 601 may include prompt information 602 and yes option 603 .
  • the prompt message 602 is used to ask the user whether to bind the personal computer 401 to the smart bracelet 402, and to explain that after the personal computer 401 and the smart bracelet 402 are bound, the smart bracelet 402 can control the personal computer 401.
  • the prompt information 602 may be "Is it bound to a smart bracelet? After binding, the smart bracelet can be used to control the PC". If the user can accept the binding of the personal computer 401 and the smart bracelet 402 , the user can click the yes option 603 .
  • the personal computer 401 may receive the user's operation of clicking the yes option 603 , and in response to the operation, the personal computer 401 may display a wearing confirmation prompt box 605 as shown in FIG. 6B .
  • the wearing confirmation prompt box 605 is used to ask whether the user has worn the smart bracelet 402 .
  • the smart bracelet 402 can monitor its own wearing status.
  • the wearing state is used to indicate that the smart wristband 402 is in a worn state or a detached state.
  • the smart bracelet 402 may be provided with a pressure sensor, and the smart bracelet 402 may confirm the wearing state through the data change of the pressure sensor.
  • the smart bracelet 402 sends wearing status information to the terminal device.
  • the user can click the confirmation option 606 of the wearing confirmation prompt box 605.
  • the personal computer 401 can receive the operation that the user clicks on the confirmation option 606, and in response to the operation, the personal computer 401 can confirm that the smart bracelet 402 is in the worn state or in the unworn state (not worn state) through the wearing state information.
  • the personal computer 401 can confirm that the smart bracelet 402 is in the off state, as shown in FIG.
  • the prompt information 607 is used to inform the user that the bracelet needs to be worn again.
  • the prompt message 607 may be "it is not detected that you are wearing a bracelet, please click to confirm after wearing the bracelet".
  • the user can click the confirmation option 606 again after wearing the smart bracelet 402 .
  • the personal computer 401 can receive the user's operation of clicking the confirmation option 606, and in response to the operation, the personal computer 401 can confirm that the smart bracelet 402 is in the worn state or in the detached state through the wearing state information again.
  • the personal computer 401 can confirm that the smart bracelet 402 is in the worn state, as shown in FIG. 7A , the personal computer 401 can display a password verification box 701.
  • the password verification box 701 may display an account name 702 , a password input field 703 and input options 704 .
  • the account name 702 may be pre-set by the user on the terminal device 701, for example, it may be a Windows system user name, such as SAM.
  • the password input column 703 is used for the user to input a password. After the user enters the password in the password input field 703, the user can click the input option 704 to indicate that the password input is complete.
  • the user may also use the Enter key on the physical/virtual keyboard to indicate that the password input is complete.
  • the personal computer 401 After receiving the password input by the user, the personal computer 401 needs to verify whether the password input by the user is consistent with the preset password.
  • the preset password is the password matching the account name 702 .
  • the account name 702 and the preset password can be the account name and password of the boot interface and lock screen interface of the personal computer 401, that is, the personal computer 401 can be normally started and unlocked only after the user enters the correct account name and password.
  • the wearer of the smart bracelet 402 can be identified whether the wearer of the smart bracelet 402 has the authority to control the personal computer 401 .
  • the password entered by the user is consistent with the preset password, it can be considered that the wearer of the smart bracelet 402 is the same as the owner of the personal computer 401, or that the wearer of the smart bracelet 402 has the authority to control the personal computer 401 .
  • the password entered by the user is inconsistent with the preset password, it is considered that the holder of the smart bracelet 402 does not have the authority to control the personal computer 401 .
  • the password verification box 701 also includes a confirm option 706 and a close option 707 . If the user needs to re-enter the password, he can click on the confirm option 706 .
  • the personal computer 401 may receive the user's operation of clicking the confirm option 706, and in response to the operation, the personal computer 401 may redisplay the password verification box 701 as shown in FIG. 7A so that the user may re-enter the password. If the user does not need to re-enter the password, the close option 707 can be clicked.
  • the personal computer 401 may receive the user's operation of clicking the close option 707, and in response to the operation, the personal computer 401 may close the password verification box 701. If the verification result shows that the password entered by the user is consistent with the preset password, the personal computer 401 may initiate a binding confirmation request to the smart bracelet 402 .
  • the personal computer 401 may display a binding confirmation prompt box 801 .
  • the binding confirmation prompt box 801 is used to remind the user that the personal computer 401 has been bound with the smart bracelet 402 .
  • the binding confirmation prompt box 801 may display "the smart bracelet has been bound".
  • the binding confirmation prompt box 801 may also include a confirmation option 802 .
  • the personal computer 401 may receive the user's operation on the confirmation option 802, and in response to the operation, the personal computer 401 may close the binding confirmation prompt box 801.
  • the user can use the smart bracelet 402 to control the personal computer 401 to switch the content displayed on the projection screen 403 .
  • the user can perform preset actions while wearing the smart bracelet 402 .
  • the smart bracelet 402 After the smart bracelet 402 generates the motion data matched with the motion track of the smart bracelet 402, it can query the control instruction matched with the motion track (motion data) from the preset motion track-instruction matching list, and The control command is sent to the personal computer 401 .
  • the personal computer 401 executes the operation corresponding to the control instruction, for example, turning the page forward, turning the page backward, maximizing, minimizing and so on.
  • the motion trajectory-instruction matching list can be shown in Table 1:
  • Movement track Control instruction turn clockwise page backward counterclockwise page forward draw zigzag minimize Draw a V shape maximize ... ...
  • the projection screen 403 may display an interface 901 .
  • the interface 901 may include a file 1 directory.
  • the interface 901 may include information such as "conference theme: theme 1, participants: Sam, A, B, C, D".
  • the user can drive the smart bracelet 402 to rotate clockwise; It is found in the matching list (Table 1) that the control instruction corresponding to the motion track is a page-turning instruction, and the page-turning instruction is sent to the personal computer 401 .
  • the personal computer 401 can receive the page-turning instruction, and in response to the instruction, the personal computer 401 can display the next page of the file 1 .
  • the projection screen 403 displays the interface 902
  • the interface 902 is the next page of the interface 901 .
  • the projection screen 403 may display an interface 902 .
  • interface 902 may include the title of file 1 (that is, "topic 1").
  • the user can drive the smart bracelet 402 to rotate counterclockwise; the smart bracelet 402 can It is found from the preset motion track-instruction matching list that the control command corresponding to the motion track is a forward page turning command, and the forward page turning command is sent to the personal computer 401 .
  • the personal computer 401 can receive the page forward instruction, and in response to the instruction, the personal computer 401 can display the previous page of the current page.
  • the projection screen 403 displays an interface 901 , and the interface 901 is the previous page of the interface 902 .
  • the projection screen 403 may display an interface 902 .
  • the user can drive the smart bracelet 402 to draw a "Z" shape; It is found that the control command corresponding to the motion trajectory is a minimization command, and the minimization command is sent to the personal computer 401 . Therefore, the personal computer 401 can receive the minimizing instruction, and in response to the instruction, the personal computer 401 can minimize the window of the file 1 .
  • the projection screen 403 displays the desktop 1101 , and the icon 1102 of the file 1 can be displayed on the desktop 1101 .
  • the projection screen 403 can display a desktop 1101 , and the desktop 1101 includes a map 1102 of file 1 . It can be seen that file 1 is minimized.
  • the user can drive the smart bracelet 402 to draw a "V" shape; It is found that the control command corresponding to the motion trajectory is a maximization command, and the maximization command is sent to the personal computer 401 .
  • the personal computer 401 can receive the maximize instruction, and in response to the instruction, the personal computer 401 will maximize the window of the file 1 .
  • the projection screen 403 displays the interface 902 of the file 1 .
  • Fig. 12 shows a flowchart of a method for a wearable device to control an electronic device provided by an embodiment of the present application. As shown in Figure 12, the method includes:
  • the electronic device establishes a communication connection with the wearable device.
  • any one of communication methods such as NFC, WIFI, and Bluetooth can be used for communication between the electronic device and the wearable device.
  • the electronic device may be a personal computer 401
  • the wearable device may be a smart bracelet 402 .
  • establishing a binding relationship may refer to binding the smart bracelet and the electronic device through a preset account name and password.
  • a preset account name and password For example, reference may be made to FIGS. 6A-8 and corresponding contents.
  • the wearable device judges whether it has been disconnected from the user.
  • the wearable device has been separated from the user, it can be considered that the holder of the smart bracelet 402 may change, so the holder of the smart bracelet 402 needs to be verified again, and S1204 can be executed. If the wearable device has not been separated from the user, it can be considered that the wearer of the smart bracelet 402 has not changed, and the smart bracelet 402 has the authority to control the electronic device 401, and S1205 can be executed.
  • the wearable device may initiate a binding request to the electronic device. After receiving the binding request, the electronic device may redisplay the password input box 701 as shown in FIG. 7A . The user can input the correct password through the password input box 701, so as to re-establish the binding relationship between the wearable device and the electronic device.
  • the wearable device In response to the user's operation of driving the wearable device to move, the wearable device generates motion data that matches the motion track of the wearable device.
  • the wearable device can use its motion sensor to recognize the user's motion, and generate motion data that matches the motion track of the wearable device.
  • the wearable device generates a control instruction corresponding to the exercise data.
  • the wearable device can find out the control instruction corresponding to the motion track (ie, motion data) from a preset motion track-instruction matching list.
  • the wearable device sends a control instruction to the electronic device.
  • the electronic device switches from the first interface to the second interface.
  • the second interface is an interface displayed after the electronic device performs an operation corresponding to the control instruction on the first operation target, and the first operation target includes any one of a presentation, a video file, an audio file, and a document.
  • the first operation target may be a presentation
  • the first interface may be the interface 901 shown in (a) of FIG. 9
  • the second interface may be the interface 902 shown in (c) of FIG. 9 .
  • the first interface may be the interface 902 shown in (a) in FIG. 11A
  • the second interface may be the interface 1102 shown in (c) in FIG. 11A .
  • control instruction includes any one of turning pages forward, turning pages backward, maximizing, minimizing, increasing volume, and decreasing volume.
  • Fig. 13 shows a schematic diagram of a smart home scenario.
  • the user can use the smart bracelet 402 to control home devices such as smart TVs and smart speakers.
  • home devices such as smart TVs and smart speakers are connected to the home LAN through their WIFI modules. If you want to use the smart bracelet 402 to control household devices, you need to add the smart bracelet 402 to the home LAN.
  • the terminal device as a mobile phone as an example, the process of adding the smart bracelet 402 to the home local area network will be described.
  • the mobile phone may display a main interface 1401 .
  • Home interface 1401 may include icons 1402 for smart home applications.
  • the mobile phone may receive the user's operation of clicking the icon 1402 of the smart home application, and in response to the operation, the mobile phone may open the smart home application 1402 and enter the interface 1403 shown in (b) in FIG. 14 .
  • the interface 1403 may include a display area 1404 and an add option 1405, and the display area 1404 may be used to display devices connected to the home local area network.
  • devices connected to the home local area network may include Honor TV, smart speakers, smart aroma lamps, smart sockets, smart speakers, routers, and so on.
  • the mobile phone may receive that the user clicks on the add option 1405 , and in response to this operation, as shown in (c) in FIG. 14 , the mobile phone may display a function box 1406 .
  • Functional block 1406 may include add device option 1406, create scene option, share device option, and the like.
  • the mobile phone may receive the user's operation of clicking the add device option 1406, and in response to the operation, a device search interface 1501 as shown in (a) in FIG. 15 is displayed.
  • the device search interface 1501 may display the word "searching".
  • an icon 1502 of the smart bracelet 402 may be displayed on the device search interface 1501 .
  • the mobile phone may receive an operation of clicking the icon 1502 by the user, and in response to the operation, as shown in (c) in FIG. 15 , the mobile phone may display an input box 1503 .
  • the mobile phone can verify whether the account name and password match. If the account name matches the password, it can be considered that the holder of the smart bracelet 402 has the authority to connect to the home LAN, and the mobile phone can display a prompt box 1505 as shown in (a) in FIG. 16 .
  • the prompt box 1505 is used to prompt the user that the smart bracelet 402 has been added to the home LAN.
  • the mobile phone may receive the user's operation on the confirmation option 1506 of the prompt box 1505, and in response to the operation, as shown in (b) in FIG.
  • the user can enable the WLAN sensing service (also called NAN sensing service) of the home device and the WLAN sensing service of the smart bracelet 402 through the smart home application.
  • the home device can publish one or more discoverable services, and the smart bracelet 402 can subscribe to one or more services published by the home device. It can also be called a home device as a service publisher, and the smart bracelet 402 as a service subscriber.
  • the home device After the home device starts the WLAN service, it can continuously transmit the target frame (publish frame) on the target channel (WIFI fixed channel, for example, 6 channels), and the publish frame carries the service information published by the home device.
  • target frame publish frame
  • WIFI fixed channel for example, 6 channels
  • the smart bracelet 402 After the smart bracelet 402 turns on the WLAN sensing service, it can continue to scan WIFI fixed channels (for example, 6 channels). If it scans the publish frame and determines that the service information contained in the publish frame is the service it subscribes to, it can reply to the home device. information. The two parties can establish a WLAN connection (for example, establish a WIFI channel on a WIFI fixed channel), and can create a socket (Socket) for data transmission. After the home device receives the response message sent by the smart bracelet 402, the home device may determine that the smart bracelet 402 has entered the WLAN coverage (geo-fence) of the home device.
  • WIFI fixed channels for example, 6 channels.
  • the smart bracelet 402 can control the household devices with which the WLAN connection is established.
  • the smart bracelet 402 can establish a WLAN connection with the two or more home devices.
  • the smart bracelet 402 can determine the distance between itself and two or more household devices, and use the household device with the smallest distance as the device to be controlled.
  • the smart bracelet 402 enters the overlapping area of the WIFI coverage of the TV, the smart speaker 1, the smart speaker 2 and the air purifier, and is connected to the TV, the smart speaker 1, the smart speaker 2 and the air purifier respectively.
  • the purifier establishes a WLAN connection.
  • both the smart bracelet 402 and the home equipment are provided with NFC chips and/or infrared sensors, and the smart bracelet 402 can use the NFC chips and/or infrared sensors to determine the distance between itself and the home equipment.
  • the smart bracelet 402 may display an interface 1701 as shown in FIG. 17B .
  • the interface 1701 is used to prompt the user that the smart bracelet 402 can be used to control the TV.
  • a specific user can perform preset actions while wearing the smart bracelet 402 .
  • the smart bracelet 402 After the smart bracelet 402 generates the motion data matched with the motion track of the smart bracelet 402, it can query the control instruction matched with the motion track (motion data) from the preset motion track-instruction matching list, and The control command is sent to the TV.
  • the television In response to the control instruction, the television performs an operation corresponding to the control instruction, for example, power on, power off, switch channels backward, switch channels forward, turn down the volume, turn up the volume, and so on.
  • the motion trajectory-instruction matching list can be shown in Table 2:
  • the TV may display channel 1801 . If the user wants to watch the next channel, as shown in (b) in Figure 18A, the user can drive the smart bracelet 402 to draw an "M" font; It is found that the control command corresponding to the motion trajectory is a backward switching channel command, and the backward switching channel command is sent to the TV.
  • the television may receive the instruction to switch channels backward, and in response to the instruction, as shown in (c) in FIG. 18A , the television switches to channel 1802, which is the next channel of channel 1801.
  • the television may display channel 1802 as shown in (a) of FIG. 18B . If the user wants to watch the previous channel, as shown in (b) in Figure 18B, the user can drive the smart bracelet 402 to draw a "W" font; It is found that the control instruction corresponding to the movement trajectory is a forward channel switching command, and the forward channel switching command is sent to the TV.
  • the television may receive the instruction to switch channels forward, and in response to the instruction, as shown in (c) in FIG. 18B , the television switches to channel 1801, which is the previous channel of channel 1802.
  • the TV may display channel 1801 . If the user does not want to watch TV and needs to shut down, as shown in (b) in Figure 19A, the user can drive the smart bracelet 402 to draw a "Z" shape; the smart bracelet 402 can query from the preset motion track-command matching list
  • the control command corresponding to the motion track is a power-off command, and the power-off command is sent to the TV.
  • the television may receive the power-off instruction, and in response to the instruction, as shown in (c) in FIG. 19A , the television is powered off.
  • the TV may be in a power-off state. If the user wants to watch TV, as shown in (b) in Figure 19B, the user can drive the smart bracelet 402 to draw a "V";
  • the control command corresponding to the motion track is a power-on command, and the power-on command is sent to the TV.
  • the television may receive the power-on instruction, and in response to the instruction, as shown in (c) in FIG. 19B , the television is powered on.
  • the smart bracelet 402 enters the overlapping area of the WIFI coverage of the TV, the smart speaker 1, the smart speaker 2 and the air purifier, and is connected to the TV, the smart speaker 1, the smart speaker 2 and the air purifier respectively.
  • the purifier establishes a WLAN connection.
  • the smart bracelet 402 determines that the distances between itself and the air purifier, smart audio 1, TV, and smart audio 2 are L1, L2, L3, and L4 respectively, and L1>L2>L3>L4. Therefore, the smart bracelet 402 takes the smart audio 2 as the device to be controlled, and controls the smart audio 2 to perform operations such as starting up, shutting down, turning down the volume, and turning up the volume.
  • the user can perform preset actions while wearing the smart bracelet 402 .
  • the smart bracelet 402 After the smart bracelet 402 generates the motion data matched with the motion track of the smart bracelet 402, it can query the control instruction matched with the motion track (motion data) from the preset motion track-instruction matching list, and The control command is sent to the smart audio 2.
  • the smart speaker 2 executes the operation corresponding to the control instruction, for example, power on, power off, turn down the volume, turn up the volume, and so on.
  • the smart bracelet 402 may prompt the user on the smart bracelet 402 that the smart speaker 2 can be controlled by the smart bracelet 402 .
  • the prompting method may be similar to that shown in FIG. 17B , which will not be repeated here.
  • the motion trajectory-instruction matching list can be shown in Table 3:
  • Movement track Control instruction draw zigzag shutdown Draw a V shape start up turn clockwise turn down the volume counterclockwise turn up the volume ... ...
  • the smart speaker 2 can play audio at a volume value of 60. If the user needs to lower the volume, as shown in (b) in Figure 21A, the user can drive the smart bracelet 402 to rotate clockwise;
  • the control command is a volume down command, and the volume down command is sent to the smart audio 2.
  • the smart audio 2 can receive the volume down instruction, and in response to the instruction, as shown in (c) in FIG. 21A , the smart audio 2 adjusts the volume value to 50.
  • the smart speaker 2 can play audio at a volume value of 50. If the user needs to increase the volume, as shown in (b) in Figure 21B, the user can drive the smart bracelet 402 to rotate counterclockwise; the smart bracelet 402 can query the motion track from the preset motion track-command matching list The corresponding control command is a volume up command, and the volume up command is sent to the smart speaker 2 .
  • the smart speaker 2 may receive the volume up instruction, and in response to the instruction, as shown in (c) in FIG. 21B , the smart speaker 2 adjusts the volume value to 60.
  • the smart speaker 2 can play audio at a volume value of 50. If the user does not want to listen to music, as shown in (b) in Figure 22A, the user can drive the smart bracelet 402 to draw a "Z" shape;
  • the control instruction corresponding to the motion track is a shutdown instruction, and the shutdown instruction is sent to the smart audio 2 .
  • the smart audio 2 may receive the shutdown instruction, and in response to the instruction, as shown in (c) in FIG. 22A , the smart audio 2 is turned off.
  • the smart speaker 2 can be turned off. If the user wants to listen to music, as shown in (b) in Figure 22B, the user can drive the smart bracelet 402 to draw a "V"; The control command corresponding to the motion track is a power-on command, and the power-on command is sent to the smart speaker 2 .
  • the smart audio 2 can receive the power-on instruction, and in response to the instruction, as shown in (c) in FIG. 22B , the smart audio 2 is turned on and plays audio at a volume value of 50.
  • the wearer of the smart bracelet 402 can be authenticated, that is, it is necessary to confirm that the wearer of the smart bracelet 402 has not changed. Control the household equipment; the wearer of the smart bracelet 402 may not be authenticated, that is, anyone can use the smart bracelet 402 to control the household equipment, and no specific limitation is set here.
  • Fig. 23 shows a flowchart of a method for a wearable device to control an electronic device provided by an embodiment of the present application. As shown in Figure 23, the method includes:
  • the wearable device is connected to the local area network where the electronic device A and the electronic device B are located.
  • FIG. 14 , FIG. 15 and FIG. 16 can be used to connect the wearable device to the local area network where electronic device A and electronic device B are located.
  • the WLAN sensing service of the electronic device A is in the enabled state
  • the WLAN sensing service of the wearable device is in the enabled state
  • the wearable device When the wearable device scans the publish frame transmitted by the electronic device A and determines that the service information contained in the publish frame is the service it subscribes to, it can reply a response message to the electronic device A. In response to receiving the pending response information, electronic device A establishes a WLAN connection with the wearable device.
  • the wearable device When the wearable device scans the publish frame transmitted by the electronic device B and determines that the service information contained in the publish frame is the service it subscribes to, it can reply a response message to the electronic device B. In response to receiving the pending response information, electronic device B establishes a WLAN connection with the wearable device.
  • the wearable device obtains the distance between itself and electronic device A and the distance between itself and electronic device B.
  • the wearable device can obtain the distance between itself and the electronic device A and the distance between itself and the electronic device B by using infrared technology or NFC technology.
  • the wearable device takes the electronic device with the smallest distance (for example, electronic device A) as the device to be controlled.
  • the electronic device A is used as the device to be controlled.
  • the wearable device In response to the user's operation of driving the wearable device to move, the wearable device generates motion data matching the motion track of the wearable device.
  • the wearable device can use its motion sensor to recognize the user's motion, and generate motion data that matches the motion track of the wearable device.
  • the wearable device generates a control instruction corresponding to the exercise data.
  • the wearable device may find the operation identifier from a preset motion trajectory-instruction matching list, and generate a control instruction corresponding to the operation identifier.
  • the wearable device sends a control instruction to electronic device A.
  • the second state is the state in which the electronic device is after performing the operation corresponding to the control instruction, and the operation corresponding to the control instruction includes power on, power off, volume up, volume down, channel switching forward, channel switching backward, Either increase the temperature or decrease the temperature.
  • the electronic device A may be a smart speaker, wherein the first state may be a state with a volume value of 60 as shown in (a) in FIG. 21A , and the second state may be a state as shown in (c) in FIG. 21A The volume value shown is 50.
  • the user can perform preset actions while wearing the wearable device, and the wearable device can recognize its own motion trajectory and generate an action that matches the motion trajectory.
  • Motion data so as to generate and send control instructions according to the motion data, so as to realize the control of electronic equipment. Therefore, the user can perform different actions while wearing the wearable device to realize the control of different functions of the electronic device, which is simple and convenient, and can improve user experience.
  • the chip system includes at least one processor 2401 and at least one interface circuit 2402 .
  • the processor 2401 and the interface circuit 2402 may be interconnected through wires.
  • the interface circuit 2402 may be used to receive signals from other devices (eg, a memory of a wearable device, a memory of a terminal device).
  • the interface circuit 2402 may be used to send signals to other devices (such as the processor 2401).
  • the interface circuit 2402 may read instructions stored in a memory in the device and send the instructions to the processor 2401 .
  • the wearable device or the terminal device may execute various steps in the foregoing embodiments.
  • Each functional unit in each embodiment of the embodiment of the present application may be integrated into one processing unit, or each unit may physically exist separately, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage
  • the medium includes several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk, and other various media capable of storing program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供一种可穿戴设备控制电子设备的方法及通信系统,可以识别出用户在佩戴可穿戴设备时的各种动作轨迹,并生成与该运动轨迹匹配的运动数据,从而根据运动数据生成并发送控制指令,实现对电子设备的控制。从而,用户可以在佩戴可穿戴设备的情况下做出不同的动作,即可实现对电子设备的不同功能的控制,简单方便,可以提升用户体验。该方法包括:可穿戴设备与电子设备建立绑定关系;响应于用户带动可穿戴设备运动的操作,可穿戴设备生成与可穿戴设备的运动轨迹匹配的运动数据;可穿戴设备确定运动数据对应的控制指令,并向电子设备发送控制指令;响应于接收到控制指令,电子设备从第一界面切换至第二界面。

Description

一种可穿戴设备控制电子设备的方法及通信系统
本申请要求于2021年07月08日提交国家知识产权局、申请号为202110774696.3、发明名称为“一种可穿戴设备控制电子设备的方法及通信系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端领域,尤其涉及一种可穿戴设备控制电子设备的方法及通信系统。
背景技术
随着科技的发展,现代社会中出现了越来越多不同功能的电子设备,如手机、电脑、智能电视、智能冰箱等。在实际使用这些电子设备的过程中,常常存在需要近距离控制电子设备的场景。例如,在开会时,会议主持人可以使用激光笔遥控电脑,实现对PPT的翻页。又例如,在智能家居领域,用户可以利用与智能家居设备连接的手机实现对智能家居设备的控制。
然而,在利用激光笔遥控PPT翻页时,需要用户始终手握激光笔,阻碍用户手势讲解等方面的灵活演示。同时,在利用手机控制智能家居设备时,需要用户在手机上打开该智能家居设备对应的应用程序(application,APP),操作比较繁琐。
可见,现有的对电子设备进行近距离控制的方式较为繁琐,并不便利。
发明内容
本申请提供一种可穿戴设备控制电子设备的方法及通信系统,可以识别出用户在佩戴可穿戴设备时的各种动作轨迹,并根据该动作轨迹对电子设备进行相应控制。
为达到上述目的,本申请采用如下技术方案:
第一方面,本申请提供一种可穿戴设备控制电子设备的方法,应用于包括可穿戴设备及电子设备的通信系统,可穿戴设备保持被穿戴状态,方法包括:可穿戴设备与电子设备建立绑定关系;其中,绑定关系用于指示可穿戴设备及电子设备通过预设的账户名及预设的密码绑定;响应于用户带动可穿戴设备运动的操作,可穿戴设备生成与可穿戴设备的运动轨迹匹配的运动数据;可穿戴设备确定运动数据对应的控制指令,并向电子设备发送控制指令;响应于接收到控制指令,电子设备从第一界面切换至第二界面;其中,第二界面为电子设备对第一操作目标执行与控制指令对应的操作后所显示的界面,第一操作目标包括演示文稿、视频文件、音频文件、文档中的任意一种。
基于本申请实施例提供的方法,用户可以在佩戴可穿戴设备的情况下做预设动作,可穿戴设备可以识别出自身的运动轨迹并生成与该运动轨迹匹配的运动数据,从而根据运动数据生成并发送控制指令,实现对电子设备的控制。从而,用户可以在佩戴可穿戴设备的情况下做出不同的动作,即可实现对电子设备的不同功能的控制,简单方便,可以提升用户体验。
在一种可选的实施方式中,方法还包括:响应于确定可穿戴设备的穿戴状态由被穿戴状态变化为脱落状态,可穿戴设备与电子设备重新建立绑定关系。
基于本申请实施例提供的方法,可以在可穿戴设备脱落以后,重新对用户进行验 证并建立绑定关系。如此,可以确保用户具备控制电子设备的权限,有效避免不相关用户利用可穿戴设备控制电子设备的情况发生,从而保证电子设备的安全性。
在一种可选的实施方式中,可穿戴设备与电子设备建立绑定关系,包括:电子设备显示第一提示框;其中,第一提示框用于提示用户建立可穿戴设备与电子设备间的绑定关系,第一提示框包括第一选项;响应于用户对第一选项的操作,电子设备显示第二提示框;其中,第二提示框用于提醒用户穿戴可穿戴设备,第二提示框包括第二选项;响应于用户穿戴可穿戴设备,可穿戴设备向电子设备发送佩戴状态信息;其中,佩戴状态信息用于指示可穿戴设备处于被穿戴状态;响应于用户对第二选项的操作及接收到佩戴状态信息,电子设备显示密码输入提示框;其中,密码输入提示框包括预设的账户名;响应于用户在密码输入提示框输入预设的密码的操作,电子设备与可穿戴设备建立绑定关系。
基于本申请实施例提供的方法,可穿戴设备可以在处于被穿戴状态下,与电子设备建立绑定关系,实现对可穿戴设备的佩戴者的认证。
在一种可选的实施方式中,控制指令对应的操作包括向前翻页、向后翻页、最大化、最小化、增大音量、减小音量中的任意一种。
基于本申请实施例提供的方法,用户可利用可穿戴设备对电子设备上的界面进行各种控制。例如,在增大音量、减小音量时,电子设备可以在界面上显示音量值的变化,从而实现界面的切换。整个过程简单、方便,无需用户在电子设备上进行操作,便于用户在会议、多媒体教学时进行操作、讲解。
第二方面,本申请还提供了一种可穿戴设备控制电子设备的方法,应用于包括可穿戴设备及电子设备的通信系统,可穿戴设备与电子设备连接至同一局域网,方法包括:可穿戴设备与电子设备建立通信连接;响应于用户带动可穿戴设备运动的操作,可穿戴设备生成与可穿戴设备的运动轨迹匹配的运动数据;可穿戴设备确定运动数据对应的控制指令,并向电子设备发送控制指令;响应于接收到控制指令,电子设备从第一状态切换至第二状态;其中,第二状态为电子设备执行与控制指令对应的操作后所处的状态,与控制指令对应的操作包括开机、关机、增大音量、减小音量、向前切换频道、向后切换频道、调高温度、调低温度中的任意一种。
基于本申请实施例提供的方法,可穿戴设备还可以对属于同一局域网内的电子设备(例如,智能电视、冰箱等)进行控制。进一步的,用户可以在佩戴可穿戴设备的情况下做出不同的动作,以实现对电子设备的不同功能的控制,简单方便,可以提升用户体验。
在一种可选的实施方式中,若可穿戴设备与至少两个电子设备通信连接,方法还包括:可穿戴设备确定与至少两个电子设备间的距离;可穿戴设备将距离最小的电子设备确定为待控制设备;可穿戴设备向待控制设备发送控制指令;响应于接收到控制指令,待控制设备执行与控制指令对应的操作。
基于本申请实施例提供的方法,若可穿戴设备与至少两个电子设备通信连接,可穿戴设备可以将与其距离最近的电子设备作为待控制设备,并以不同动作控制该待控制设备。
在一种可选的实施方式中,方法还包括:响应于确定待控制设备,可穿戴设备显 示提示信息;其中,提示信息用于提示用户可利用可穿戴设备控制待控制设备。
基于本申请实施例提供的方法,可穿戴设备确定待控制设备后,可以显示提示信息,便于告知用户可以控制的设备。
第三方面,本申请还提供了一种通信系统,包括可穿戴设备及电子设备,可穿戴设备执行如第一方面、第二方面中任一项的方法,电子设备执行如第一方面、第二方面中任一项的方法。
第四方面,本申请还提供了一种计算机可读存储介质,包括计算机指令;当计算机指令在可穿戴设备上运行时,使得可穿戴设备执行如第一方面、第二方面中任一项的方法;或者,当计算机指令在电子设备上运行时,使得电子设备执行如第一方面、第二方面中任一项的方法。
第五方面,本申请实施例提供一种芯片系统,该芯片系统包括一个或多个接口电路和一个或多个处理器。该接口电路和处理器通过线路互联。该芯片系统可以应用于包括通信模块和存储器的电子设备。该接口电路可以读取可穿戴设备中存储器中存储的指令,并将该指令发送给处理器。当指令被处理器执行时,可使得可穿戴设备执行如第一方面、第二方面中任一项的方法。接口电路还可以读取电子设备中存储器中存储的指令,并将该指令发送给处理器。当指令被处理器执行时,可使得电子设备执行如第一方面、第二方面中任一项的方法。
可以理解地,上述提供的第三方面所述的通信系统、第四方面所述的计算机可读存储介质,以及第五方面所述的芯片系统均用于执行上文所提供的对应的方法,因此,其所能达到的有益效果可参考上文所提供的对应的方法中的有益效果,此处不再赘述。
附图说明
图1为本申请实施例提供的通信系统的架构示意图;
图2为本申请实施例提供的终端设备的结构示意图;
图3为本申请实施例提供的可穿戴设备的结构示意图;
图4为一种场景示意图;
图5A为个人电脑401的界面示意图;
图5B为个人电脑401的界面示意图;
图6A为个人电脑401的界面示意图;
图6B为个人电脑401的界面示意图;
图6C为个人电脑401的界面示意图;
图7A为个人电脑401的界面示意图;
图7B为个人电脑401的界面示意图;
图8为个人电脑401的界面示意图;
图9为一种应用场景示意图;
图10为一种应用场景示意图;
图11A为一种应用场景示意图;
图11B为一种应用场景示意图;
图12为一种可穿戴设备控制电子设备的方法的流程图;
图13为另一种场景示意图;
图14为一种手机的界面示意图;
图15为一种手机的界面示意图;
图16为一种手机的界面示意图;
图17A为一种家居设备与智能手环的相对位置示意图;
图17B为一种智能手环402的界面示意图;
图18A为一种应用场景示意图;
图18B为一种应用场景示意图;
图19A为一种应用场景示意图;
图19B为一种应用场景示意图;
图20为另一种家居设备与智能手环的相对位置示意图;
图21A为一种应用场景示意图;
图21B为一种应用场景示意图;
图22A为一种应用场景示意图;
图22B为一种应用场景示意图;
图23为一种可穿戴设备控制电子设备的方法的流程图;
图24为一种芯片系统的结构示意图。
具体实施方式
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
下面将结合附图对本实施例的实施方式进行详细描述。
如图1所示,为本申请实施例提供的一种系统示意图。该系统可以包括家居设备、服务器(例如,荣耀云对应的服务器)、终端设备和可穿戴设备。其中,终端设备中安装有第一应用(例如,智慧生活应用)。服务器是第一应用的管理服务器。
示例性的,本申请实施例中的终端设备可以是手机、平板电脑、桌面型、膝上型、手持计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,以及蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(augmented reality,AR)\虚拟现实(virtual reality,VR)设备等可以安装上述第一应用的设备,本申请实施例对终端设备的具体形态不作特殊限制。
本申请实施例提供的家居设备可以是大屏(电视、电视机)、音响、摄像头、空调、电冰箱、智能窗帘、台灯、吊灯、电饭煲、安防设备(如智能电子锁)、个人计算机(personal computer,PC)等可以接入家庭无线局域网的设备。另外,本申请实施例中的家居设备还可以是车载音响、车载空调等,本申请实施例对家居设备的具体形态不作特殊限制。家居设备中可以具备无线保真(wireless fidelity,WIFI)模组,以便连接到家庭局域网。
本申请实施例提供的可穿戴设备可以是智能手表、智能手环等等。
图2示出了一种终端设备的结构示意图。如图2所示,终端设备200可以包括:处理器210,外部存储器接口220,内部存储器221,通用串行总线(universal serial bus, USB)接口230,充电管理模块240,电源管理模块241,电池242,无线通信模块250以及显示屏260等。
可以理解的是,本实施例示意的结构并不构成对第一电子设备的具体限定。在另一些实施例中,第一电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器210可以包括一个或多个处理单元,例如:处理器210可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以是终端设备200的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器210中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器210中的存储器为高速缓冲存储器。该存储器可以保存处理器210刚用过或循环使用的指令或数据。如果处理器210需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器210的等待时间,因而提高了系统的效率。
在一些实施例中,处理器210可以包括一个或多个接口。接口可以包括I2C接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或USB接口等。
可以理解的是,本实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对终端设备200的结构限定。在另一些实施例中,终端设备200也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块240用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。充电管理模块240为电池242充电的同时,还可以通过电源管理模块241为电子设备供电。
电源管理模块241用于连接电池242,充电管理模块240与处理器210。电源管理模块241接收电池242和/或充电管理模块240的输入,为处理器210,内部存储器221,外部存储器,显示屏260,摄像头293,和无线通信模块250等供电。在一些实施例中,电源管理模块241和充电管理模块240也可以设置于同一个器件中。
无线通信模块250可以提供应用在终端设备200上的包括WLAN(如Wi-Fi),蓝牙,全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。例如,本申请实施例中,终端设备200可以通过无线通信模块250与终端设备(如无线耳机100)建立蓝牙连接。
无线通信模块250可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块250经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器210。无线通信模块250还可以从处理器210接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
终端设备200通过GPU,显示屏260,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏260和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器210可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏260用于显示图像,视频等。该显示屏260包括显示面板。
图3示出了一种可穿戴设备的结构示意图。如图3所示,可穿戴设备可以包括无线通信模块310,运动传感器320,处理器330,内部存储器340,电源管理模块350,电池360,充电管理模块370,天线3等。
在一些实施例中,无线通信模块310可以包括NFC芯片,该NFC芯片可以包括设备主机(device host,DH)和NFC控制器(NFC controller,NFCC)。DH可以负责NFCC的管理,如初始化、配置和电源管理等。NFCC可以负责通过天线进行数据的物理传输。此外,该NFC芯片能够对信号进行放大、模数转换及数模转换、存储等处理。
可穿戴设备的无线通信功能可以通过天线3以及无线通信模块310等实现。
此外,处理器330可以包括一个或多个处理单元。例如:处理器330可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。
在一些实施例中,处理器330可以包括一个或多个接口。接口可以包括I2C接口,I2S接口,PCM接口,UART接口,MIPI,GPIO接口,SIM卡接口,和/或USB接口等。可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对可穿戴设备的结构限定。在本申请另一些实施例中,可穿戴设备也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
内部存储器340可以用于存储一个或多个计算机程序,该一个或多个计算机程序包括指令。
运动传感器320可以包括加速度传感器、陀螺仪等。当可穿戴设备为手环或手表时,基于上述运动传感器320,手环或手表可以进行刷卡动作检测。
可以理解的是,本申请实施例示意的结构并不构成对可穿戴设备的具体限定。在本申请另一些实施例中,可穿戴设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
目前,在开会时,会议主持人可以使用激光笔遥控电脑,实现对PPT的翻页。在智能家居领域,用户可以利用与智能家居设备连接的终端设备(如手机)实现对智能家居设备的控制。然而,在利用激光笔遥控PPT翻页时,需要用户始终手握激光笔, 阻碍用户手势讲解等方面的灵活演示。同时,在利用手机控制智能家居设备时,需要用户在手机上打开该智能家居设备对应的应用程序(application,APP),操作比较繁琐。可见,现有的对电子设备进行近距离控制的方式较为繁琐,并不便利。
有鉴于此,本申请实施例提供一种可穿戴设备控制电子设备的方法,用户可以在佩戴可穿戴设备的情况下做预设动作,可穿戴设备可以识别出自身的运动轨迹并生成与该运动轨迹匹配的运动数据,从而根据运动数据生成并发送控制指令,实现对电子设备的控制。从而,用户可以在佩戴可穿戴设备的情况下做出不同的动作,即可实现对电子设备的不同功能的控制,简单方便,可以提升用户体验。
接下来,以可穿戴设备为智能手环为例,说明在不同场景下,智能手环控制不同电子设备的过程。
示例性的,图4示出了会议场景的示意图。在会议场景中,用户可以利用投影屏幕403作为个人电脑401的显示屏,以显示个人电脑401所需显示的内容。在此场景下,用户可以利用其佩戴的智能手环402控制投影屏幕403所显示的内容进行翻页等操作。
其中,若智能手环402与个人电脑401处于未连接状态,则需要先建立智能手环402与个人电脑401间的通信连接。示例性的,用户可以进行第一操作,以使智能手环402与个人电脑401建立通信连接。例如,第一操作可以为用户携带智能手环402靠近个人电脑401的操作。可以理解地,智能手环402及个人电脑401上均设置有NFC芯片,当智能手环402与个人电脑401间的距离小于预设的连接距离时,个人电脑401可以显示如图5A所示的连接提示框501。又例如,第一操作也可以为开启智能手环402的蓝牙功能的操作。其中,智能手环402及个人电脑401上均设置有可用于实现蓝牙通信的芯片。个人电脑401可以在搜索到该智能手环401后显示如图5A所示的连接提示框501。又例如,第一操作还可以为用户使智能手环402加入个人电脑401所连接的局域网的操作。当个人电脑401检测到与智能手环402加入同一局域网时,可以显示如图5A所示的连接提示框501。也即,智能手环402与个人电脑401可以通过WIFI、蓝牙或者NFC中的任意一种方式进行通信。
其中,连接提示框501可以包括提示信息502以及是选项503。其中,提示信息502用于提示用户个人电脑401检测到新的智能手环,并询问用户是否连接。例如,提示信息502可以为“检测到智能手环,是否连接”。个人电脑401可以接收用户点击是选项503的操作,响应于该操作,个人电脑401与智能手环402建立连接。可以理解地,连接可以指WIFI连接、蓝牙连接及NFC连接中的任意一种。
在一种可能的设计中,个人电脑401可以在与智能手环402建立连接后,显示如图5B所示的连接状态提示框505。该连接状态提示框505用于通知用户个人电脑401已与智能手环402连接。示例性的,该连接状态提示框505可以显示“已连接智能手环”。连接状态提示框505可以包括关闭选项506。个人电脑401可以接收用户点击该关闭选项506的操作,响应于该操作,个人电脑401可以关闭该连接状态提示框505。在一种可能的设计中,若个人电脑401在预设时间内未检测到用户点击该连接状态提示框505的关闭选项506的操作,个人电脑401可以自动关闭该连接状态提示框505。
在个人电脑401与智能手环402建立连接后,如图6A所示,个人电脑401可以 显示绑定提示框601。其中,绑定提示框601可以包括提示信息602及是选项603。其中,提示信息602用于询问用户是否需要将个人电脑401与智能手环402绑定,并说明在个人电脑401与智能手环402绑定后,智能手环402可以对个人电脑401进行控制。示例性的,提示信息602可以为“是否与智能手环绑定?绑定后可用智能手环控制PC”。若用户可以接受个人电脑401与智能手环402绑定,用户可以点击该是选项603。个人电脑401可以接收用户点击是选项603的操作,响应于该操作,如图6B所示,个人电脑401可以显示穿戴确认提示框605。穿戴确认提示框605用于询问用户是否已佩戴智能手环402。其中,智能手环402可以监测自身的佩戴状态。佩戴状态用于指示智能手环402处于被佩戴状态或者脱落状态。在一种可能的设计中,智能手环402上可以设置有压力传感器,智能手环402可以通过该压力传感器的数据变化,确认佩戴状态。此外,智能手环402向终端设备发送佩戴状态信息。用户可以在穿戴智能手环402后,点击穿戴确认提示框605的确认选项606。个人电脑401可以接收用户点击该确认选项606的操作,响应于该操作,个人电脑401可以通过佩戴状态信息确认该智能手环402处于被佩戴状态或者处于脱落状态(未被佩戴状态)。
若佩戴状态信息指示智能手环402处于脱落状态,则个人电脑401可以确认该智能手环402处于脱落状态,如图6C所示,个人电脑401在穿戴确认提示框605中显示提示信息607。提示信息607用于告知用户需要重新佩戴手环。示例性的,提示信息607可以为“未检测到您佩戴手环,请在佩戴手环后点击确认”。用户可以在穿戴好智能手环402后,再次点击该确认选项606。个人电脑401可以接收用户点击该确认选项606的操作,响应于该操作,个人电脑401可以再次通过佩戴状态信息确认该智能手环402处于被佩戴状态或者处于脱落状态。若佩戴状态信息指示智能手环402处于被佩戴状态,则个人电脑401可以确认该智能手环402处于被佩戴状态,如图7A所示,个人电脑401可以显示密码验证框701。密码验证框701中可以显示账户名702、密码输入栏703及输入选项704。其中,账户名702可以为用户预先在终端设备701上设置的,例如可以为Windows系统的用户名,如SAM。密码输入栏703用于供用户输入密码。用户在密码输入栏703输入密码后,可以点击输入选项704,以表明密码输入完毕。当然,在其他实施方式中,用户也可以利用物理/虚拟键盘上的回车键表明密码输入完毕。个人电脑401接收到用户输入的密码后,需要验证用户输入的密码与预设的密码是否一致。其中,预设的密码为与账户名702匹配的密码。例如,账户名702及预设的密码可以为个人电脑401的开机界面、锁屏界面的账户名及密码,即用户只有输入正确的账户名及密码后,个人电脑401才可以正常开机、解锁。可以理解地,通过验证用户输入的密码与预设的密码是否一致,可以鉴别智能手环402的佩戴者是否具备控制个人电脑401的权限。当用户输入的密码与预设的密码一致时,可以认为智能手环402的佩戴者与个人电脑401的持有者为同一个人,或者认为智能手环402的佩戴者具备控制个人电脑401的权限。反之,当用户输入的密码与预设的密码不一致时,则认为智能手环402的持有者不具备控制个人电脑401的权限。
因此,若验证结果为用户输入的密码与预设的密码不一致,如图7B所示,个人电脑401可以在密码验证框701内显示提示信息705,该提示信息705用于提示用户输入的密码不正确。例如,提示信息705可以为“密码不正确,请重新输入”。此外, 密码验证框701中还包括确定选项706以及关闭选项707。若用户需要重新输入密码,则可以点击该确定选项706。个人电脑401可以接收用户点击该确定选项706的操作,响应于该操作,个人电脑401可以重新显示如图7A所示的密码验证框701,以便用户重新输入密码。若用户不需要再重新输入密码,可以点击该关闭选项707。个人电脑401可以接收用户点击该关闭选项707的操作,响应于该操作,个人电脑401可以关闭该密码验证框701。若验证结果为用户输入的密码与预设的密码一致,个人电脑401可以向智能手环402发起确认绑定的请求。在一种可选的实施方式中,如图8所示,个人电脑401可以显示绑定确认提示框801。绑定确认提示框801用于提醒用户个人电脑401已与智能手环402绑定。示例性的,绑定确认提示框801可以显示“已绑定智能手环”。此外,绑定确认提示框801还可以包括确认选项802。个人电脑401可以接收用户对该确认选项802的操作,响应于该操作,个人电脑401可以关闭该绑定确认提示框801。
个人电脑401与智能手环402建立绑定关系后,用户便可以利用智能手环402控制个人电脑401,从而切换投影屏幕403所显示的内容。具体的,用户可以在佩戴智能手环402的情况下做预设动作。智能手环402在生成与该智能手环402的运动轨迹匹配的运动数据后,可以从预设的运动轨迹-指令匹配列表中查询到与该运动轨迹(运动数据)匹配的控制指令,并将该控制指令发送给个人电脑401。响应于该控制指令,个人电脑401执行该控制指令对应的操作,例如,向前翻页、向后翻页、最大化、最小化操作等。
示例性的,运动轨迹-指令匹配列表可以如表1所示:
表1
运动轨迹 控制指令
顺时针转动 向后翻页
逆时针转动 向前翻页
画Z字型 最小化
画V字型 最大化
…… ……
如图9中的(a)所示,投影屏幕403可以显示界面901。示例性的,界面901可以包括文件1的目录。例如,界面901可以包括“会议主题:主题1,与会人员:Sam、甲、乙、丙、丁”等信息。当用户需要显示文件1的下一页内容时,如图9中的(b)所示,用户可以带动智能手环402按顺时针方向转动;智能手环402可以从预设的运动轨迹-指令匹配列表(表1)中查询到该运动轨迹对应的控制指令为向后翻页指令,并向个人电脑401发送该向后翻页指令。由此,个人电脑401可以接收该向后翻页指令,响应于该指令,个人电脑401可以显示文件1的下一页。由此,如图9中的(c)所示,投影屏幕403显示界面902,界面902为界面901的下一页。
如图10中的(a)所示,投影屏幕403可以显示界面902。示例性的,界面902可以包括文件1的标题(即“主题1”)。当用户需要显示当前页面的上一页(即文件1的上一页)时,如图10中的(b)所示,用户可以带动智能手环402按逆时针方向转动;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应 的控制指令为向前翻页指令,并向个人电脑401发送该向前翻页指令。由此,个人电脑401可以接收该向前翻页指令,响应于该指令,个人电脑401可以显示当前页面的上一页。由此,如图10中的(c)所示,投影屏幕403显示界面901,界面901为界面902的上一页。
如图11A中的(a)所示,投影屏幕403可以显示界面902。当用户需要最小化该文件1时,如图11A中的(b)所示,用户可以带动智能手环402画“Z”字型;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为最小化指令,并向个人电脑401发送该最小化指令。由此,个人电脑401可以接收该最小化指令,响应于该指令,个人电脑401可以最小化该文件1的窗口。由此,如图11A中的(c)所示,投影屏幕403显示桌面1101,且桌面1101上可以显示文件1的图标1102。
如图11B中的(a)所示,投影屏幕403可以显示桌面1101,桌面1101中包括文件1的图谱1102。可见,文件1处于最小化状态。当用户需要最大化该文件1时,如图11B中的(b)所示,用户可以带动智能手环402画“V”字型;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为最大化指令,并向个人电脑401发送该最大化指令。由此,个人电脑401可以接收该最大化指令,响应于该指令,个人电脑401将最大化该文件1的窗口。由此,如图11B中的(c)所示,投影屏幕403显示文件1的界面902。
图12示出了本申请实施例提供的可穿戴设备控制电子设备的方法的流程图。如图12所示,该方法包括:
S1201、电子设备与可穿戴设备建立通信连接。
其中,电子设备与可穿戴设备间可以采用NFC、WIFI、蓝牙等通信方式中的任意一种方式进行通信。示例性的,电子设备可以为个人电脑401,可穿戴设备可以为智能手环402。
S1202、电子设备与可穿戴设备建立绑定关系。
可以理解地,建立绑定关系可以指智能手环与电子设备通过预设的账户名名及密码进行绑定。示例性的,可以参考如图6A-图8及相应内容。
S1203、可穿戴设备判断是否脱离过用户。
若可穿戴设备脱离过用户,则执行S1204;若可穿戴设备未脱离过用户,则执行S1205。
可以理解地,若可穿戴设备脱离过用户,则可以认为智能手环402的持有者可能发生变化,因此需要重新对智能手环402的持有者进行验证,可以执行S1204。若可穿戴设备未脱离过用户,可以认为智能手环402的佩戴者未发生变化,智能手环402具备控制电子设备401的权限,可以执行S1205。
S1204、可穿戴设备与电子设备重新建立绑定关系。
在一种可选的实施方式中,可穿戴设备可以向电子设备发起绑定请求。电子设备接收到该绑定请求后,可以重新显示如图7A所示的密码输入框701。用户可以通过该密码输入框701输入正确密码,从而重新建立可穿戴设备与电子设备间的绑定关系。
S1205、响应于用户带动可穿戴设备运动的操作,可穿戴设备生成与可穿戴设备的 运动轨迹匹配的运动数据。
在一种可选的实施方式中,可穿戴设备可以利用其运动传感器识别用户的动作,并生成与可穿戴设备的运动轨迹匹配的运动数据。
S1206、可穿戴设备生成运动数据对应的控制指令。
在一种可选的实施方式中,可穿戴设备可以从预设的运动轨迹-指令匹配列表中查找到该运动轨迹(即运动数据)对应控制指令。
S1207、可穿戴设备向电子设备发送控制指令。
S1208、响应于接收到控制指令,电子设备从第一界面切换至第二界面。
其中,第二界面为电子设备对第一操作目标执行与控制指令对应的操作后所显示的界面,第一操作目标包括演示文稿、视频文件、音频文件、文档中的任意一种。示例性的,第一操作目标可以为演示文稿,第一界面可以为图9中(a)所示的界面901,第二界面可以为图9中(c)所示的界面902。又例如,第一界面可以为图11A中(a)所示的界面902,第二界面可以为图11A中(c)所示的界面1102。
此外,需要说明的是,控制指令对应的操作包括向前翻页、向后翻页、最大化、最小化、增大音量、减小音量中的任意一种。
图13示出了智能家居场景的示意图。在智能家居场景中,用户可以利用智能手环402控制智能电视、智能音响等家居设备。需要说明的是,智能电视、智能音响等家居设备均通过其WIFI模组连接至家庭局域网。如需利用智能手环402控制家居设备,则需要将智能手环402也添加至家庭局域网内。接下来,以终端设备为手机为例,说明将智能手环402添加至家庭局域网内的过程。
如图14中的(a)所示,手机可以显示主界面1401。主界面1401可以包括智能家居应用的图标1402。手机可以接收用户点击该智能家居应用的图标1402的操作,响应于该操作,手机可以打开智能家居应用1402,进入如图14中的(b)所示的界面1403。界面1403可以包括显示区域1404及添加选项1405,显示区域1404可用于显示已连接至家庭局域网的设备。示例性的,已连接至家庭局域网的设备可以包括荣耀电视、智能音响、智能香薰灯、智能插座、智能音响、路由器等。手机可以接收用户点击该添加选项1405,响应于该操作,如图14中的(c)所示,手机可以显示功能框1406。功能框1406可以包括添加设备选项1406、创建场景选项、共享设备选项等。手机可以接收用户点击该添加设备选项1406的操作,响应于该操作,如图15中的(a)所示的设备搜索界面1501。设备搜索界面1501可以显示“正在搜索”字样。手机搜索到智能手环402后,如图15中的(b)所示,可以在设备搜索界面1501显示智能手环402的图标1502。手机可以接收用户点击该图标1502的操作,响应于该操作,如图15中的(c)所示,手机可以显示输入框1503。在用户通过输入框1503输入账户名及密码后,可以点击密码输入框1503中的确认选项1504,响应于用户对该确认选项1504的点击操作,手机可以验证账户名及密码是否匹配。若账户名与密码匹配,则可以认为智能手环402的持有者具备连接家庭局域网的权限,手机可以显示如图16中的(a)所示的提示框1505。提示框1505用于提示用户已将智能手环402添加至家庭局域网。手机可以接收用户对提示框1505的确认选项1506的操作,响应于该操作,如图16中的(b)所示,手机可以在显示区域1404添加智能手环402的图标1507。
在将智能手环402添加至家庭局域网后,用户可以通过智能家居应用打开家居设备的WLAN感知服务(也可以称为NAN感知服务)和智能手环402的WLAN感知服务。家居设备可以发布(publish)一项或多项可发现服务,智能手环402可以订阅家居设备发布的一项或多项服务。也可以称家居设备为服务发布方,智能手环402为服务订阅方。家居设备开启WLAN服务后,可以在目标信道(WIFI固定信道,例如,6信道)持续发射目标帧(publish帧),publish帧中携带家居设备发布的服务信息。智能手环402开启WLAN感知服务后,可以持续扫描WIFI固定信道(例如,6信道),若扫描到publish帧且确定该publish帧中包含的服务信息是自己订阅的服务,可以向家居设备回复响应消息。双方可以建立WLAN连接(例如,在WIFI固定信道上建立一条WIFI通道),并可以创建用于数据发送的套接字(Socket)。当家居设备接收到智能手环402发送的响应消息后,家居设备可以确定智能手环402进入家居设备的WLAN覆盖范围(地理围栏)。
智能手环402可以控制与其建立WLAN连接的家居设备。当智能手环402进入两个或两个以上的家居设备的WIFI覆盖范围的重叠区域内时,智能手环402可以与两个或两个以上的家居设备建立WLAN连接。此时,智能手环402可以确定自身与两个或两个以上的家居设备间的距离,并将距离最小的家居设备作为待控制设备。
示例性的,如图17A所示,智能手环402进入电视、智能音响1、智能音响2以及空气净化器的WIFI覆盖范围的重叠区域,并分别与电视、智能音响1、智能音响2以及空气净化器建立WLAN连接。其中,智能手环402确定自身与空气净化器、智能音响1、电视以及智能音响2的距离分别为L1、L2、L3及L4,且L1>L2=L4>L3。因此,智能手环402将电视作为待控制设备,并控制电视进行开机、关机、向后切换频道、向前切换频道、调小音量、调大音量等操作。
在一种可选的实施方式中,智能手环402及家居设备上均设置有NFC芯片和/或红外传感器,智能手环402可以利用NFC芯片和/或红外传感器确定自身与家居设备的距离。
在一种可选的实施方式中,智能手环402将电视作为待控制设备后,可以显示如图17B所示的界面1701。界面1701用于提示用户可以利用智能手环402控制电视。
具体的用户可以在佩戴智能手环402的情况下做预设动作。智能手环402在生成与该智能手环402的运动轨迹匹配的运动数据后,可以从预设的运动轨迹-指令匹配列表中查询到与该运动轨迹(运动数据)匹配的控制指令,并将该控制指令发送给电视。响应于该控制指令,电视执行该控制指令对应的操作,例如,开机、关机、向后切换频道、向前切换频道、调小音量、调大音量等。
示例性的,运动轨迹-指令匹配列表可以如表2所示:
表2
运动轨迹 控制指令
画M字型 向后切换频道
画W字型 向前切换频道
画Z字型 关机
画V字型 开机
顺时针转动 调小音量
逆时针转动 调大音量
…… ……
如图18A中的(a)所示,电视可以显示频道1801。若用户想要观看下一个频道,如图18A中的(b)所示,用户可以带动智能手环402画“M”字型;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为向后切换频道指令,并向电视发送该向后切换频道指令。电视可以接收该向后切换频道指令,响应于该指令,如图18A中的(c)所示,电视切换至频道1802,频道1802为频道1801的下一个频道。
如图18B中的(a)所示,电视可以显示频道1802。若用户想要观看上一个频道,如图18B中的(b)所示,用户可以带动智能手环402画“W”字型;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为向前切换频道指令,并向电视发送该向前切换频道指令。电视可以接收该向前切换频道指令,响应于该指令,如图18B中的(c)所示,电视切换至频道1801,频道1801为频道1802的上一个频道。
如图19A中的(a)所示,电视可以显示频道1801。若用户不想观看电视需要关机,如图19A中的(b)所示,用户可以带动智能手环402画“Z”字型;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为关机指令,并向电视发送该关机指令。电视可以接收该关机指令,响应于该指令,如图19A中的(c)所示,电视关机。
如图19B中的(a)所示,电视可以处于关机状态。若用户想要观看电视,如图19B中的(b)所示,用户可以带动智能手环402画“V”字型;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为开机指令,并向电视发送该开机指令。电视可以接收该开机指令,响应于该指令,如图19B中的(c)所示,电视开机。
示例性的,如图20所示,智能手环402进入电视、智能音响1、智能音响2以及空气净化器的WIFI覆盖范围的重叠区域,并分别与电视、智能音响1、智能音响2以及空气净化器建立WLAN连接。其中,智能手环402确定自身与空气净化器、智能音响1、电视以及智能音响2的距离分别为L1、L2、L3及L4,且L1>L2>L3>L4。因此,智能手环402将智能音响2作为待控制设备,并控制智能音响2进行开机、关机、调小音量、调大音量等操作。
具体的,用户可以在佩戴智能手环402的情况下做预设动作。智能手环402在生成与该智能手环402的运动轨迹匹配的运动数据后,可以从预设的运动轨迹-指令匹配列表中查询到与该运动轨迹(运动数据)匹配的控制指令,并将该控制指令发送给智能音响2。响应于该控制指令,智能音响2执行该控制指令对应的操作,例如,开机、关机、调小音量、调大音量等。
在一种可选的实施方式中,智能手环402将智能音响2作为待控制设备后,可以在智能手环402上提示用户可以利用智能手环402控制智能音响2。其中,提示方式可以与图17B所示类似,在此不再赘述。
示例性的,运动轨迹-指令匹配列表可以如表3所示:
表3
运动轨迹 控制指令
画Z字型 关机
画V字型 开机
顺时针转动 调小音量
逆时针转动 调大音量
…… ……
如图21A中的(a)所示,智能音响2可以以60的音量值播放音频。若用户需要降低音量,如图21A中的(b)所示,用户可以带动智能手环402顺时针转动;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为调小音量指令,并向智能音响2发送该调小音量指令。智能音响2可以接收该调小音量指令,响应于该指令,如图21A中的(c)所示,智能音响2将音量值调节为50。
如图21B中的(a)所示,智能音响2可以以50的音量值播放音频。若用户需要增大音量,如图21B中的(b)所示,用户可以带动智能手环402逆时针转动;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为调大音量指令,并向智能音响2发送该调大音量指令。智能音响2可以接收该调大音量指令,响应于该指令,如图21B中的(c)所示,智能音响2将音量值调节为60。
如图22A中的(a)所示,智能音响2可以以50的音量值播放音频。若用户不想听音乐,如图22A中的(b)所示,用户可以带动智能手环402画“Z”字型;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为关机指令,并向智能音响2发送该关机指令。智能音响2可以接收该关机指令,响应于该指令,如图22A中的(c)所示,智能音响2关机。
如图22B中的(a)所示,智能音响2可以处于关机状态。若用户想听音乐,如图22B中的(b)所示,用户可以带动智能手环402画“V”字型;智能手环402可以从预设的运动轨迹-指令匹配列表中查询到该运动轨迹对应的控制指令为开机指令,并向智能音响2发送该开机指令。智能音响2可以接收该开机指令,响应于该指令,如图22B中的(c)所示,智能音响2开机,并以50的音量值播放音频。
需要说明的是,在本场景中,在对家居设备进行控制的过程中,可以对智能手环402的佩戴者进行认证,即需要确认智能手环402的佩戴者未发生过变化的情况下才能对家居设备进行控制;也可以不对智能手环402的佩戴者进行认证,即任何人都可以使用该智能手环402对家居设备进行控制,在此不做具体限制。
图23示出了本申请实施例提供的可穿戴设备控制电子设备的方法的流程图。如图23所示,该方法包括:
S2301、可穿戴设备连接至电子设备A与电子设备B所在的局域网。
示例性的,可以采用如图14、图15及图16所示的流程,将可穿戴设备连接至电子设备A与电子设备B所在的局域网。
S2302、可穿戴设备与电子设备A与建立WLAN连接。
可以理解地,电子设备A的WLAN感知服务处于开启状态,可穿戴设备的WLAN 感知服务处于开启状态。
当可穿戴设备扫描到电子设备A发射的publish帧且确定该publish帧中包含的服务信息是自己订阅的服务,可以向电子设备A回复响应消息。响应于接收待该响应信息,电子设备A与可穿戴设备建立WLAN连接。
S2303、可穿戴设备与电子设备B与建立WLAN连接。
当可穿戴设备扫描到电子设备B发射的publish帧且确定该publish帧中包含的服务信息是自己订阅的服务,可以向电子设备B回复响应消息。响应于接收待该响应信息,电子设备B与可穿戴设备建立WLAN连接。
S2304、可穿戴设备获取自身与电子设备A间的距离及自身与电子设备B间的距离。
在一种可选的实施方式中,可穿戴设备可以利用红外技术或者NFC技术获取自身与电子设备A间的距离及自身与电子设备B间的距离。
S2305、可穿戴设备将距离最小的电子设备(例如,电子设备A)作为待控制设备。
示例性的,可穿戴设备与电子设备A间的距离小于可穿戴设备与电子设备B间的距离,则将电子设备A作为待控制设备。
S2306、响应于用户带动可穿戴设备运动的操作,可穿戴设备生成与可穿戴设备的运动轨迹匹配的运动数据。
在一种可选的实施方式中,可穿戴设备可以利用其运动传感器识别用户的动作,并生成与可穿戴设备的运动轨迹匹配的运动数据。
S2307、可穿戴设备生成运动数据对应的控制指令。
在一种可选的实施方式中,可穿戴设备可以从预设的运动轨迹-指令匹配列表中查找到操作标识,并生成该操作标识对应的控制指令。
S2308、可穿戴设备向电子设备A发送控制指令。
S2309、响应于接收到控制指令,电子设备A从第一状态切换至第二状态。
其中,第二状态为电子设备执行与控制指令对应的操作后所处的状态,与控制指令对应的操作包括开机、关机、增大音量、减小音量、向前切换频道、向后切换频道、调高温度、调低温度中的任意一种。示例性的,电子设备A可以为智能音响,其中,第一状态可以为如图21A中的(a)所示的音量值为60的状态,第二状态可以为如图21A中的(c)所示的音量值为50的状态。
可见,本申请实施例提供的可穿戴设备控制电子设备的方法,用户可以在佩戴可穿戴设备的情况下做预设动作,可穿戴设备可以识别出自身的运动轨迹并生成与该运动轨迹匹配的运动数据,从而根据运动数据生成并发送控制指令,实现对电子设备的控制。从而,用户可以在佩戴可穿戴设备的情况下做出不同的动作,即可实现对电子设备的不同功能的控制,简单方便,可以提升用户体验。
本申请另一实施例提供一种芯片系统,如图24所示,该芯片系统包括至少一个处理器2401和至少一个接口电路2402。处理器2401和接口电路2402可通过线路互联。例如,接口电路2402可用于从其它装置(例如,可穿戴设备的存储器,终端设备的存储器)接收信号。又例如,接口电路2402可用于向其它装置(例如处理器2401)发送信号。
例如,接口电路2402可读取设备中存储器中存储的指令,并将该指令发送给处理器2401。当所述指令被处理器2401执行时,可使得可穿戴设备或终端设备执行上述实施例中的各个步骤。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请实施例的具体实施方式,但本申请实施例的保护范围并不局限于此,任何在本申请实施例揭露的技术范围内的变化或替换,都应涵盖在本申请实施例的保护范围之内。因此,本申请实施例的保护范围应以所述权利要求的保护范围为准。

Claims (9)

  1. 一种可穿戴设备控制电子设备的方法,其特征在于,应用于包括可穿戴设备及电子设备的通信系统,所述可穿戴设备保持被穿戴状态,所述方法包括:
    所述可穿戴设备与所述电子设备建立绑定关系;其中,所述绑定关系用于指示所述可穿戴设备及所述电子设备通过预设的账户名及预设的密码绑定;
    响应于用户带动所述可穿戴设备运动的操作,所述可穿戴设备生成与所述可穿戴设备的运动轨迹匹配的运动数据;
    所述可穿戴设备确定所述运动数据对应的控制指令,并向所述电子设备发送所述控制指令;
    响应于接收到所述控制指令,所述电子设备从第一界面切换至第二界面;其中,所述第二界面为所述电子设备对第一操作目标执行与所述控制指令对应的操作后所显示的界面,所述第一操作目标包括演示文稿、视频文件、音频文件、文档中的任意一种。
  2. 根据权利要求1所述的可穿戴设备控制电子设备的方法,其特征在于,所述方法还包括:
    响应于确定所述可穿戴设备的穿戴状态由被穿戴状态变化为脱落状态,所述可穿戴设备与所述电子设备重新建立绑定关系。
  3. 根据权利要求1或2所述的可穿戴设备控制电子设备的方法,其特征在于,所述可穿戴设备与所述电子设备建立绑定关系,包括:
    所述电子设备显示第一提示框;其中,所述第一提示框用于提示用户建立所述可穿戴设备与所述电子设备间的绑定关系,所述第一提示框包括第一选项;
    响应于用户对所述第一选项的操作,所述电子设备显示第二提示框;其中,所述第二提示框用于提醒用户穿戴所述可穿戴设备,所述第二提示框包括第二选项;
    响应于用户穿戴所述可穿戴设备,所述可穿戴设备向所述电子设备发送佩戴状态信息;其中,所述佩戴状态信息用于指示所述可穿戴设备处于被穿戴状态;
    响应于用户对所述第二选项的操作及接收到所述佩戴状态信息,所述电子设备显示密码输入提示框;其中,所述密码输入提示框包括所述预设的账户名;
    响应于用户在所述密码输入提示框输入所述预设的密码的操作,所述电子设备与所述可穿戴设备建立绑定关系。
  4. 根据权利要求1-3中任意一项所述的可穿戴设备控制电子设备的方法,其特征在于,所述控制指令对应的操作包括向前翻页、向后翻页、最大化、最小化、增大音量、减小音量中的任意一种。
  5. 一种可穿戴设备控制电子设备的方法,其特征在于,应用于包括可穿戴设备及电子设备的通信系统,所述可穿戴设备与所述电子设备连接至同一局域网,所述方法包括:
    所述可穿戴设备与所述电子设备建立通信连接;
    响应于用户带动所述可穿戴设备运动的操作,所述可穿戴设备生成与所述可穿戴设备的运动轨迹匹配的运动数据;
    所述可穿戴设备确定所述运动数据对应的控制指令,并向所述电子设备发送所述 控制指令;
    响应于接收到所述控制指令,所述电子设备从第一状态切换至第二状态;其中,所述第二状态为所述电子设备执行与所述控制指令对应的操作后所处的状态,与所述控制指令对应的操作包括开机、关机、增大音量、减小音量、向前切换频道、向后切换频道、调高温度、调低温度中的任意一种。
  6. 根据权利要求5所述的可穿戴设备控制电子设备的方法,其特征在于,若所述可穿戴设备与至少两个电子设备通信连接,所述方法还包括:
    所述可穿戴设备确定与所述至少两个电子设备间的距离;
    所述可穿戴设备将距离最小的所述电子设备确定为待控制设备;
    所述可穿戴设备向所述待控制设备发送所述控制指令;
    响应于接收到所述控制指令,所述待控制设备执行与所述控制指令对应的操作。
  7. 根据权利要求6所述的可穿戴设备控制电子设备的方法,其特征在于,所述方法还包括:
    响应于确定所述待控制设备,所述可穿戴设备显示提示信息;其中,所述提示信息用于提示用户可利用所述可穿戴设备控制所述待控制设备。
  8. 一种通信系统,其特征在于,包括可穿戴设备及电子设备,所述可穿戴设备执行如权利要求1-7中任一项所述的方法,所述电子设备执行如权利要求1-7中任一项所述的方法。
  9. 一种计算机可读存储介质,其特征在于,包括计算机指令;
    当所述计算机指令在可穿戴设备上运行时,使得所述可穿戴设备执行如权利要求1-7中任一项所述的方法;
    或者,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如权利要求1-7中任一项所述的方法。
PCT/CN2022/095053 2021-07-08 2022-05-25 一种可穿戴设备控制电子设备的方法及通信系统 WO2023279882A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP22836637.3A EP4187362A4 (en) 2021-07-08 2022-05-25 METHOD FOR WEARABLE DEVICE FOR CONTROLLING AN ELECTRONIC DEVICE, AND COMMUNICATION SYSTEM
US18/043,121 US20230341926A1 (en) 2021-07-08 2022-05-25 Method for Controlling Electronic Device by Wearable Device and Communication System

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110774696.3 2021-07-08
CN202110774696.3A CN113655945A (zh) 2021-07-08 2021-07-08 一种可穿戴设备控制电子设备的方法及通信系统

Publications (1)

Publication Number Publication Date
WO2023279882A1 true WO2023279882A1 (zh) 2023-01-12

Family

ID=78489289

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/095053 WO2023279882A1 (zh) 2021-07-08 2022-05-25 一种可穿戴设备控制电子设备的方法及通信系统

Country Status (4)

Country Link
US (1) US20230341926A1 (zh)
EP (1) EP4187362A4 (zh)
CN (1) CN113655945A (zh)
WO (1) WO2023279882A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113655945A (zh) * 2021-07-08 2021-11-16 荣耀终端有限公司 一种可穿戴设备控制电子设备的方法及通信系统
CN116055989B (zh) * 2022-06-30 2023-09-15 荣耀终端有限公司 一种星历信息获取方法、电子设备和智能可穿戴设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104121663A (zh) * 2014-07-24 2014-10-29 海信集团有限公司 一种控制智能空调的方法及设备
CN105700680A (zh) * 2015-12-31 2016-06-22 宇龙计算机通信科技(深圳)有限公司 一种智能设备的控制方法及可穿戴设备
CN107241647A (zh) * 2016-03-28 2017-10-10 中兴通讯股份有限公司 一种视频播放控制方法、装置及机顶盒
CN108900698A (zh) * 2018-05-31 2018-11-27 努比亚技术有限公司 控制终端的方法、可穿戴设备、终端及计算机存储介质
US20190295429A1 (en) * 2013-02-14 2019-09-26 Steven M. McHugh System and Method for displaying personalized interactive and/or instructive data
CN113655945A (zh) * 2021-07-08 2021-11-16 荣耀终端有限公司 一种可穿戴设备控制电子设备的方法及通信系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8725565B1 (en) * 2006-09-29 2014-05-13 Amazon Technologies, Inc. Expedited acquisition of a digital item following a sample presentation of the item
US9069380B2 (en) * 2011-06-10 2015-06-30 Aliphcom Media device, application, and content management using sensory input
US20120317024A1 (en) * 2011-06-10 2012-12-13 Aliphcom Wearable device data security
KR102127927B1 (ko) * 2013-07-30 2020-07-09 엘지전자 주식회사 이동 단말기, 스마트 워치 및 이동 단말기와 스마트 워치간 보안 인증방법
US9363640B2 (en) * 2014-08-05 2016-06-07 Samsung Electronics Co., Ltd. Electronic system with transformable mode mechanism and method of operation thereof
WO2016047902A1 (ko) * 2014-09-23 2016-03-31 엘지전자 주식회사 이동 단말기 및 그 제어 방법
CN104283876A (zh) * 2014-09-29 2015-01-14 小米科技有限责任公司 操作授权方法及装置
US9892249B2 (en) * 2014-09-29 2018-02-13 Xiaomi Inc. Methods and devices for authorizing operation
WO2016196838A1 (en) * 2015-06-05 2016-12-08 Apple Inc. Changing companion communication device behavior based on status of wearable device
CN105407373A (zh) * 2015-12-11 2016-03-16 小米科技有限责任公司 音视频播放方法及装置
WO2017113383A1 (zh) * 2015-12-31 2017-07-06 华为技术有限公司 解锁方法、装置和系统
CN106095136A (zh) * 2016-06-10 2016-11-09 北京行云时空科技有限公司 一种可穿戴设备控制智能终端的方法
CN108417009A (zh) * 2018-02-08 2018-08-17 青岛真时科技有限公司 一种终端设备控制方法以及电子设备
CN108848427A (zh) * 2018-04-26 2018-11-20 Oppo广东移动通信有限公司 佩戴状态检测方法及相关设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190295429A1 (en) * 2013-02-14 2019-09-26 Steven M. McHugh System and Method for displaying personalized interactive and/or instructive data
CN104121663A (zh) * 2014-07-24 2014-10-29 海信集团有限公司 一种控制智能空调的方法及设备
CN105700680A (zh) * 2015-12-31 2016-06-22 宇龙计算机通信科技(深圳)有限公司 一种智能设备的控制方法及可穿戴设备
CN107241647A (zh) * 2016-03-28 2017-10-10 中兴通讯股份有限公司 一种视频播放控制方法、装置及机顶盒
CN108900698A (zh) * 2018-05-31 2018-11-27 努比亚技术有限公司 控制终端的方法、可穿戴设备、终端及计算机存储介质
CN113655945A (zh) * 2021-07-08 2021-11-16 荣耀终端有限公司 一种可穿戴设备控制电子设备的方法及通信系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4187362A4

Also Published As

Publication number Publication date
EP4187362A4 (en) 2024-02-21
US20230341926A1 (en) 2023-10-26
CN113655945A (zh) 2021-11-16
EP4187362A1 (en) 2023-05-31

Similar Documents

Publication Publication Date Title
WO2023279882A1 (zh) 一种可穿戴设备控制电子设备的方法及通信系统
WO2021018153A1 (zh) 一种设备配网注册的方法、设备及系统
US10459511B2 (en) Display device and terminal for controlling the same
US11350413B2 (en) Display apparatus and method of setting operating channel of the same
US8656316B2 (en) Device, system and method for selecting, sharing and displaying electronic content
EP2911417B1 (en) Method for communicating with neighbor device, electronic device and storage medium
US10296284B2 (en) Audio processing device and audio processing method
US20150065053A1 (en) Method of controlling short-range wireless communication and apparatus supporting the same
US20150236806A1 (en) Method for sharing and playing multimedia content and electronic device implementing the same
WO2023179425A1 (zh) 一种输入设备的连接方法、设备及系统
US11051147B2 (en) Electronic apparatus and method of outputting content by the electronic apparatus
KR102190436B1 (ko) 데이터를 송수신하는 전자 장치 및 방법
CN114360495A (zh) 唤醒音箱的方法及设备
US20150293670A1 (en) Method for operating message and electronic device therefor
WO2022228028A1 (zh) 一种文件分享方法和电子设备
WO2022052760A1 (zh) 一种组合音箱的配置方法、音箱和电子设备
WO2023011418A1 (zh) 一种跨设备输入方法、设备及系统
TWM464730U (zh) 個人化參數自動同步系統與相關裝置
US20240314388A1 (en) Combined display method, mobile device, and electronic device
WO2023236800A1 (zh) 控制跨设备应用的方法以及电子设备
US20240236226A9 (en) Method and apparatus for sharing device
CN102981642A (zh) 一种云终端鼠标及实现方法
WO2024012413A1 (zh) 显示控制方法、电子设备及计算机可读存储介质
EP4266630A1 (en) Conference access method and electronic device
AU2015203637B2 (en) Method and system for reproducing contents, and computer-readable recording medium thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22836637

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022836637

Country of ref document: EP

Effective date: 20230223

NENP Non-entry into the national phase

Ref country code: DE