CN117692994A

CN117692994A - Terminal equipment control method, device, equipment, storage medium and chip

Info

Publication number: CN117692994A
Application number: CN202211074211.0A
Authority: CN
Inventors: 彭聪
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2022-09-02
Filing date: 2022-09-02
Publication date: 2024-03-12

Abstract

The disclosure relates to a terminal device control method, a device, equipment, a storage medium and a chip, and relates to the field of wireless communication, wherein the method comprises the following steps: responding to the connection between the first sensing element of the wearable electronic device and the second sensing element of the terminal device, detecting gesture information of the wearable electronic device by using gesture information detected by the wearable electronic device, sending the detected gesture information to the terminal device through wireless communication connection between the wearable electronic device and the terminal device, wherein the gesture information is used for indicating the terminal device to execute operations corresponding to the gesture information. The convenience of the idle operation can be improved, and the electric quantity consumption of the terminal equipment can be reduced.

Description

Terminal equipment control method, device, equipment, storage medium and chip

Technical Field

The disclosure relates to the field of wireless communication, and in particular relates to a terminal device control method, a device, equipment, a storage medium and a chip.

Background

In the related art, the current blank operation is usually implemented by using a camera or a depth sensor to continuously detect the user action, so that in the using process, the user needs to aim at the camera or the sensor part of the mobile phone all the time to finish the blank operation, the convenience of operation is poor, and the power consumption is higher by using the camera or the depth sensor to continuously detect the user action.

Disclosure of Invention

In order to overcome the problems in the related art, the present disclosure provides a terminal device control method, apparatus, device, storage medium, and chip.

According to a first aspect of embodiments of the present disclosure, there is provided a terminal device control method, applied to a wearable electronic device, including:

responding to the connection between a first sensing element of the wearable electronic device and a second sensing element of a terminal device, and detecting gesture information by using the wearable electronic device;

and sending the detected gesture information to the terminal equipment through wireless communication connection between the wearable electronic equipment and the terminal equipment, wherein the gesture information is used for indicating the terminal equipment to execute the operation corresponding to the gesture information.

Optionally, the method further comprises:

and in the process of detecting the gesture information of the wearable electronic device, responding to disconnection of the first sensing element and the second sensing element, and stopping detecting the gesture information of the wearable electronic device.

Optionally, the first sensing element is a first UWB antenna, and the second sensing element is a second UWB antenna; the responding to the connection between the first sensing element of the wearable electronic device and the second sensing element of the terminal device, detecting gesture information by the wearable electronic device, comprises:

And responding to the first UWB antenna and the second UWB antenna to establish UWB antenna connection, and detecting gesture information by using the wearable electronic equipment.

Optionally, the first sensing element is a first UWB antenna, and the second sensing element is a second UWB antenna; the stopping detecting gesture information of the wearable electronic device in response to the disconnection of the first sensing element from the second sensing element, comprising:

and stopping detecting gesture information of the wearable electronic device in response to the first UWB antenna being disconnected from the UWB antenna of the second UWB antenna.

Optionally, the method further comprises:

establishing the UWB antenna connection if the second UWB antenna is detected by the first UWB antenna;

wherein, under the condition that the relative angle of the first UWB antenna and the second UWB antenna is in a set angle range, the first UWB antenna and the second UWB antenna can mutually detect.

Optionally, the detecting gesture information of the wearable electronic device includes:

detecting a motion trail and/or a spatial gesture of the wearable electronic device;

and determining the gesture information according to the motion trail and/or the spatial gesture.

Optionally, the wireless communication connection includes: bluetooth or wireless local area network.

According to a second aspect of embodiments of the present disclosure, there is provided a terminal device control method, applied to a terminal device, the method including:

responding to the connection between a first sensing element of a wearable electronic device and a second sensing element of the terminal device, and starting the receiving of gesture information of the wearable electronic device;

receiving gesture information sent by the wearable electronic equipment through wireless communication connection between the wearable electronic equipment and the terminal equipment;

and executing an operation corresponding to the gesture information.

Optionally, the method further comprises: and under the condition that the receiving of the gesture information of the wearable electronic device is started, responding to the disconnection of the first sensing element and the second sensing element, stopping receiving the gesture information sent by the wearable electronic device, or not responding to the gesture information sent by the wearable electronic device.

Optionally, the first sensing element is a first UWB antenna, and the second sensing element is a second UWB antenna; the method for receiving gesture information of the wearable electronic device comprises the steps of:

And responding to the first UWB antenna and the second UWB antenna to establish UWB antenna connection, and starting the receiving of gesture information of the wearable electronic equipment.

Optionally, the first sensing element is a first UWB antenna, and the second sensing element is a second UWB antenna; the stopping receiving the gesture information sent by the wearable electronic device or not responding to the gesture information sent by the wearable electronic device in response to the disconnection of the first sensing element and the second sensing element comprises:

and responding to the disconnection of the first UWB antenna and the UWB antenna of the second UWB antenna, stopping receiving gesture information sent by the wearable electronic device, or not responding to gesture information sent by the wearable electronic device.

According to a third aspect of embodiments of the present disclosure, there is provided a terminal device control apparatus applied to a wearable electronic device, including:

an information detection module configured to detect gesture information with the wearable electronic device in response to the first sensing element of the wearable electronic device establishing a connection with the second sensing element of the terminal device;

the information sending module is configured to send the detected gesture information to the terminal device through wireless communication connection between the wearable electronic device and the terminal device, wherein the gesture information is used for indicating the terminal device to execute an operation corresponding to the gesture information.

According to a fourth aspect of embodiments of the present disclosure, there is provided a terminal device control apparatus, applied to a terminal device, including:

a receiving management module configured to start receiving gesture information of a wearable electronic device in response to a connection between a first sensing element of the wearable electronic device and a second sensing element of the terminal device;

the information receiving module is configured to receive gesture information sent by the wearable electronic equipment through wireless communication connection between the wearable electronic equipment and the terminal equipment;

and the execution module is configured to execute an operation corresponding to the gesture information.

According to a fifth aspect of embodiments of the present disclosure, there is provided an electronic device, comprising:

a memory having a computer program stored thereon;

a processor for executing the computer program in the memory to implement the steps of the method of any one of the first aspects of the disclosure, or for executing the computer program in the memory to implement the steps of the method of any one of the second aspects of the disclosure.

According to a sixth aspect of embodiments of the present disclosure, there is provided a computer readable storage medium, the program instructions, when executed by a processor, implementing the steps of the method of any one of the first aspects of the present disclosure, or the program instructions, when executed by a processor, implementing the steps of the method of any one of the second aspects of the present disclosure.

According to a seventh aspect of embodiments of the present disclosure, there is provided a chip comprising a processor and an interface; the processor is configured to read instructions to perform the method of any of the first aspects of the present disclosure or the processor is configured to read instructions to perform the method of any of the second aspects of the present disclosure.

In the above technical scheme, in response to the connection between the first sensing element of the wearable electronic device and the second sensing element of the terminal device, the gesture information of the wearable electronic device is detected by using the gesture information detected by the wearable electronic device, and the detected gesture information is sent to the terminal device through wireless communication connection between the wearable electronic device and the terminal device. Through the scheme, the terminal equipment can be isolated by wearing the electronic equipment, the gestures of the user do not need to be continuously detected through the camera or the depth sensor, convenience of the isolated operation can be improved, and electricity consumption of the terminal equipment is reduced.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a flowchart illustrating a terminal device control method according to an exemplary embodiment.

Fig. 2 is a flowchart illustrating another terminal device control method according to an exemplary embodiment.

Fig. 3 is a flowchart illustrating another terminal device control method according to an exemplary embodiment.

Fig. 4 is a flowchart illustrating another terminal device control method according to an exemplary embodiment.

Fig. 5 is a flowchart illustrating another terminal device control method according to an exemplary embodiment.

Fig. 6 is a block diagram illustrating a terminal device control apparatus according to an exemplary embodiment.

Fig. 7 is a block diagram illustrating another terminal device control apparatus according to an exemplary embodiment.

Fig. 8 is a block diagram of an electronic device 800, according to an example embodiment.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.

It is understood that the term "plurality" in this disclosure means two or more, and other adjectives are similar thereto. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. The singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

It is further understood that the terms "first," "second," and the like are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish one type of information from another and do not denote a particular order or importance. Indeed, the expressions "first", "second", etc. may be used entirely interchangeably. For example, a first UWB antenna may also be referred to as a second UWB antenna, and similarly, a second UWB antenna may also be referred to as a first UWB antenna without departing from the scope of the present disclosure.

It will be further understood that although operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous.

It should be noted that, all actions for acquiring signals, information or data in the present application are performed under the condition of conforming to the corresponding data protection rule policy of the country of the location and obtaining the authorization given by the owner of the corresponding device.

Fig. 1 is a flowchart illustrating a terminal device control method according to an exemplary embodiment, and as shown in fig. 1, the terminal device control method is applied to a wearable electronic device, and includes the following steps:

in step S101, gesture information is detected with the wearable electronic device in response to the first sensing element of the wearable electronic device establishing a connection with the second sensing element of the terminal device.

The wearable electronic device can comprise an intelligent bracelet, an intelligent watch or an intelligent finger ring, the terminal device can be electronic devices with screens such as mobile phones, tablet computers, personal computers and intelligent televisions, the wearable electronic device can be connected to the terminal device in a wireless communication connection mode, and the wireless communication mode can comprise Bluetooth, wireless local area network (such as WiFi), zigBee (ZigBee) and other wireless communication technologies.

The connection of the wearable electronic device and the terminal device may be achieved by a sensing element provided on the wearable electronic device and/or the terminal device. In one implementation, a first sensing key is disposed on the wearable electronic device, a second sensing element is disposed on the terminal device, the first sensing element and the second sensing element may be infrared sensors disposed on the terminal device and the wearable electronic device, one or more infrared sensors may be disposed on the terminal device at one or more designated locations around a screen of the terminal device, the infrared sensors may include an infrared emitter and an infrared receiver, the terminal device may determine that the wearable electronic device is directed to the screen of the terminal device when an infrared signal emitted by the infrared emitter on the wearable electronic device is capable of being received by the infrared receiver on the terminal device, and the wearable electronic device may determine that the wearable electronic device is directed to the screen of the terminal device when an infrared signal emitted by the infrared emitter on the terminal device is capable of being received by the infrared receiver on the wearable electronic device. In another implementation manner, the first sensing element and the second sensing element may be UWB (Ultra Wide Band) antennas, and UWB antennas are disposed on the terminal device and the wearable electronic device, when the UWB antennas on the wearable electronic device can detect the UWB antennas on the terminal device, the wearable electronic device may determine that the wearable electronic device points to the screen of the terminal device, and when the UWB antennas on the wearable electronic device can detect the UWB antennas on the terminal device, the UWB antennas on the terminal device can also detect the UWB antennas on the wearable electronic device, so that the terminal device may also determine that the wearable electronic device points to the screen of the terminal device. In another implementation manner, the first sensing element and the second sensing element may be image capturing devices, for example, a camera may be provided on the wearable electronic device, an image is acquired through the camera, image analysis is performed based on the image, the terminal device appears in the image determined through the image analysis, and if the position of the terminal device in the image is within a set area, it may be determined that the wearable electronic device points to a screen of the terminal device, a camera may also be provided on the terminal device, whether the wearable electronic device is within the set area of the image is identified through the image analysis, and when the wearable electronic device is within the set area in the image acquired by the terminal device, the terminal device may determine that the wearable electronic device points to the screen of the terminal device. It should be noted that several implementations of the above-mentioned sensing element may be adopted alone or two or more of them may be combined for detection.

In step S102, the detected gesture information is sent to the terminal device through the wireless communication connection between the wearable electronic device and the terminal device, where the gesture information is used to instruct the terminal device to execute an operation corresponding to the gesture information.

Optionally, in the process of detecting the gesture information of the wearable electronic device, in response to the disconnection of the first sensing element and the second sensing element, the gesture information of the wearable electronic device is stopped being detected.

For example, the gesture information may include gesture information of basic operations such as up stroke, down stroke, left stroke, right stroke, clicking (including single click, double click, continuous click, etc.), dragging, and the like, and may also be other gesture information customized by a user. For example, the spatial gesture and the motion trajectory of the wearable electronic device may be identified by a gesture sensor built in the wearable electronic device, where the gesture sensor may include, for example, a gyroscope, an acceleration sensor, an electronic compass, and the like, and gesture information is determined according to the spatial gesture and the motion trajectory. The corresponding relation between various gesture information and various operations can be stored in the terminal equipment in advance, the corresponding relation can be configured by a manufacturer of the terminal equipment, the user of the terminal equipment can also carry out self-defined setting, and when certain gesture information sent by the wearable electronic equipment is received, the terminal equipment can determine the corresponding operation according to the stored corresponding relation and execute the operation. Taking a bracelet and a mobile phone as examples, the wireless communication connection may be bluetooth, the bracelet worn by the user is connected with the mobile phone of the user through bluetooth, after the bracelet detects that the bracelet points to a screen of the mobile phone, movement of the bracelet is detected to obtain gesture information, the gesture information is sent to the mobile phone through bluetooth, the mobile phone executes an operation corresponding to the gesture information, for example, the gesture information is a gesture, and the mobile phone executes an operation of sliding a screen upwards.

Fig. 2 is a flowchart illustrating another terminal device control method according to an exemplary embodiment, and as shown in fig. 2, the method is applied to a wearable electronic device, the first sensing element may be a first UWB antenna provided on the wearable electronic device, and the second sensing element may be a second UWB antenna provided on the terminal device, and the method includes the steps of:

in step S201, gesture information is detected with the wearable electronic device in response to the first UWB antenna establishing a UWB antenna connection with the second UWB antenna. Wherein, can include:

under the condition that the first UWB antenna and the second UWB antenna are connected, the wearable electronic device detects gesture information; and stopping detecting gesture information of the wearable electronic device under the condition that the UWB antenna connection of the first UWB antenna and the UWB antenna connection of the second UWB antenna are disconnected.

Illustratively, the UWB antenna connection is established in the event that the second UWB antenna is detected by the first UWB antenna, and the UWB antenna connection is broken in the event that the second UWB antenna is not detected by the first UWB antenna. Wherein, when the relative angle between the first UWB antenna and the second UWB antenna is within a set angle range, the first UWB antenna and the second UWB antenna can detect each other.

In the case that UWB antenna connection is established through the first UWB antenna and the second UWB antenna, it may be determined that the wearable electronic device points to the terminal device, and at this time, the wearable electronic device may start the idle operation function, and detect gesture information of the wearable electronic device, which may include steps S202 and S203 described below. Under the condition that the first UWB antenna cannot detect the second UWB antenna, the UWB antenna is disconnected, and the fact that the wearable electronic equipment does not point to the terminal equipment can be judged, at the moment, the idle operation function can be closed, and detection of gesture information of the wearable electronic equipment can be stopped.

In step S202, a motion trajectory and/or a spatial pose of the wearable electronic device is detected.

For example, the motion track of the wearable electronic device may include a moving route of the wearable electronic device in the air, and may be obtained by using an attitude sensor of the wearable electronic device, where the attitude sensor may be one or more of a gyroscope, an acceleration sensor, and an electronic compass, and real-time motion data, such as a spatial displacement, a moving direction, etc., of the wearable electronic device moving in the air may be obtained by using the above sensor, so that the motion track of the wearable electronic device in the air may be determined. Alternatively, in addition to the above-mentioned motion trajectory, the spatial pose of the wearable electronic device may be acquired based on a pose sensor, for example, a rotation angle and a rotation direction of the wearable electronic device may be acquired, where the rotation angle may be an inclination angle of a plane in which a screen of the wearable electronic device is located with respect to a horizontal plane.

In step S203, the gesture information is determined according to the motion trajectory and/or the spatial gesture.

In step S204, the detected gesture information is sent to the terminal device through the wireless communication connection between the wearable electronic device and the terminal device, where the gesture information is used to instruct the terminal device to execute an operation corresponding to the gesture information.

The corresponding relation between various gesture information and various operations can be stored in the terminal equipment in advance, the corresponding relation can be configured by a manufacturer of the terminal equipment, the user of the terminal equipment can also carry out self-defined setting, and when certain gesture information sent by the wearable electronic equipment is received, the terminal equipment can determine the corresponding operation according to the stored corresponding relation and execute the operation. For example, if the gesture information is a swipe, the terminal device performs an operation of sliding the screen upward. In addition, in step S202, it may also be determined that the movement speed and the movement acceleration of the wearable electronic device may be carried in the gesture information, so as to send the gesture information to the terminal device, so that the terminal device may perform an operation based on the movement speed and the movement acceleration when performing a corresponding operation, for example, when the gesture information of the wearable electronic device is a swipe, the greater the movement speed and the movement acceleration of the swipe, the faster the terminal device controls the screen to slide upwards when performing a swipe operation.

Optionally, in addition to the above motion track, gesture information may be determined based on the above spatial gesture, for example, a rotation angle and a rotation direction of the wearable electronic device may be obtained, where the rotation angle may be an inclination angle of a plane where a screen of the wearable electronic device is located with respect to a horizontal plane, for example, when it is detected that the rotation angle of the wearable electronic device to the right is greater than a set angle (for example, 90 °), the gesture information may be determined to be turned right, so that the terminal device controls a display interface of the terminal device to perform a right turning operation after receiving the gesture information.

In addition, the wireless communication connection between the terminal device and the wearable electronic device may be already established before step S101, or the wireless communication connection may be triggered to be established when the screen of the wearable electronic device pointing to the terminal device is detected. Taking bluetooth as an example, the wearable electronic device and the terminal device may complete pairing and connection of bluetooth in advance, and then execute the steps described in steps S201 to S205.

Through the implementation scheme, the terminal equipment can be subjected to the air-isolation operation through the wearable electronic equipment.

In step S205, in response to the UWB antenna connection of the first UWB antenna and the second UWB antenna being disconnected, detection of gesture information of the wearable electronic device is stopped.

For example, when a user may deviate from the detection range due to the movement of the wearable electronic device during the idle operation, if the antenna connection between the first UWB antenna and the second UWB antenna is disconnected during the detection of the gesture information of the wearable electronic device, the wearable electronic device stops detecting the gesture information of the wearable electronic device, and if gesture information that has been detected but not transmitted to the terminal device exists, the gesture information may be regarded as invalid gesture information.

It can be understood that after the connection of the first UWB antenna and the second UWB antenna is disconnected, the terminal device closes the function of the idle operation, and the detection is finished until the first UWB antenna and the second UWB antenna are connected next time, and then the gesture information is re-detected.

Fig. 3 is a flowchart illustrating another terminal device control method according to an exemplary embodiment, which is applied to a terminal device as shown in fig. 3, the method comprising the steps of:

in step S301, in response to the first sensing element of the wearable electronic device establishing a connection with the second sensing element of the terminal device, reception of gesture information of the wearable electronic device is turned on.

The method for establishing connection between the first sensing element of the wearable electronic device and the second sensing element of the terminal device is the same as the method shown in step S101, and reference may be made to step S101, which is not repeated.

In step S302, gesture information sent by the wearable electronic device is received through a wireless communication connection between the wearable electronic device and the terminal device.

The method for the wearable electronic device to send the gesture information to the terminal device through the wireless communication may refer to step S204, which is not described herein.

In step S303, an operation corresponding to the gesture information is performed.

The method for the terminal device to execute the operation corresponding to the gesture information is the same as the method shown in step S102, and reference may be made to step S102, which is not repeated.

Optionally, the method may further include:

Under the condition that the receiving of the gesture information of the wearable electronic device is started, responding to the disconnection of the first sensing element and the second sensing element, stopping receiving the gesture information sent by the wearable electronic device, or not responding to the gesture information sent by the wearable electronic device;

Fig. 4 is a flowchart illustrating another terminal device control method according to an exemplary embodiment, which is applied to a terminal device, as shown in fig. 4, the first sensing element may be a first UWB antenna provided on the wearable electronic device, and the second sensing element may be a second UWB antenna provided on the terminal device, the method comprising the steps of:

In step 401, in response to the first UWB antenna establishing a UWB antenna connection with the second UWB antenna, reception of gesture information of the wearable electronic device is turned on.

Under the condition that the first UWB antenna and the second UWB antenna are connected, starting to receive gesture information of the wearable electronic equipment; and under the condition that the UWB antennas of the first UWB antenna and the second UWB antenna are disconnected, stopping receiving gesture information sent by the wearable electronic equipment, or not responding gesture information sent by the wearable electronic equipment. The method for establishing the UWB antenna connection between the first UWB antenna and the second UWB antenna is the same as step S201, and reference may be made to step S201, which is not described herein.

In step S402, gesture information sent by the wearable electronic device is received through a wireless communication connection between the wearable electronic device and the terminal device.

The method for detecting the gesture information by the wearable electronic device and transmitting the gesture information to the terminal device by the wearable electronic device may refer to the methods shown in the steps S202 to S204, and will not be described again.

In step S403, an operation corresponding to the gesture information is performed.

The method for the terminal device to execute the operation corresponding to the gesture information may refer to the method described in step S204, which is not described herein.

In step S404, in response to the first UWB antenna being disconnected from the UWB antenna of the second UWB antenna, the reception of the gesture information transmitted by the wearable electronic device is stopped, or the gesture information transmitted by the wearable electronic device is not responded.

For example, when the UWB antenna connection of the first UWB antenna and the second UWB antenna is disconnected, the terminal device may close the idle operation function, so after the UWB antenna connection is disconnected, if gesture information sent by the wearable electronic device is continuously received, the terminal device does not respond to the gesture information any more, for example, in the case that the UWB antenna connection of the first UWB antenna and the UWB antenna of the second UWB antenna is disconnected, the bluetooth connection of the wearable electronic device and the terminal device may remain connected, so at this time the wearable electronic device still has a possibility of sending gesture information to the terminal device, so if gesture information is still received after the UWB antenna connection is disconnected, the terminal device does not respond to the gesture information; or after the UWB antenna is disconnected, stopping receiving gesture information sent by the wearable electronic device.

Fig. 5 is a flowchart illustrating another method for controlling a terminal device according to an exemplary embodiment, where, as shown in fig. 5, a first UWB antenna is disposed on a wearable electronic device, and a second UWB antenna is disposed on the terminal device, the method includes the steps of:

in step S501, the wearable electronic device determines whether the second UWB antenna of the terminal device can be detected by the first UWB antenna.

Whether the first UWB antenna can detect the second UWB antenna of the terminal device may refer to the method shown in step S201, which is not described herein. Executing step S502 in the case that the first UWB antenna cannot detect the second UWB antenna of the terminal equipment; under the condition that the first UWB antenna can detect the second UWB antenna, establishing antenna connection of the first UWB antenna and the second UWB antenna, and detecting gesture information by the wearable electronic device, and executing steps S503-S504.

In step S502, detection of gesture information of the wearable electronic device is stopped.

In step S503, a motion trajectory and/or a spatial gesture of the wearable electronic device is detected.

In step S504, the gesture information is determined according to the motion trajectory and/or the spatial gesture.

The step S202 to the step S203 may be referred to for detecting the motion track and/or the spatial gesture of the wearable electronic device and the method for determining the gesture information according to the motion track and/or the spatial gesture, which are not described herein.

In step S505, the detected gesture information is sent to the terminal device through a wireless communication connection between the wearable electronic device and the terminal device.

It will be appreciated that the detection of the first UWB antenna and the second UWB antenna is mutual and the terminal device needs to perform the following step S506.

Whether the second UWB antenna can detect the first UWB antenna of the terminal device may refer to the method shown in step S401, which is not described herein. In the case where the first UWB antenna is not detected by the second UWB antenna, the terminal device performs step S507; and under the condition that the second UWB antenna can detect the first UWB antenna, establishing antenna connection of the first UWB antenna and the second UWB antenna with the wearable electronic device, and executing steps S508-S509.

In step S506, the terminal device determines whether the first UWB antenna of the terminal device can be detected through the second UWB antenna.

In step S507, the reception of the gesture information transmitted by the wearable electronic device is stopped, or the gesture information transmitted by the wearable electronic device is not responded.

In step S508, reception of gesture information of the wearable electronic device is turned on.

In step S509, the terminal device performs an operation corresponding to the gesture information.

The step S204 may be referred to for the method for receiving the gesture information sent by the wearable electronic device and executing the operation corresponding to the gesture information by the terminal device, which is not described herein.

Optionally, when the user may deviate from the detection range due to the movement of the wearable electronic device during the idle operation, if the antenna connection between the first UWB antenna and the second UWB is disconnected during the detection of the gesture information of the wearable electronic device, the antenna connection between the first UWB antenna and the second UWB may be detected during the detection of the gesture information of the wearable electronic device, which may include the following steps:

in step S510, the wearable electronic device stops receiving the gesture information sent by the wearable electronic device or does not respond to the gesture information sent by the wearable electronic device when detecting that the antenna connection between the first UWB antenna and the second UWB antenna is disconnected.

It can be appreciated that in the case that the antenna connection between the first UWB antenna and the second UWB antenna is disconnected, the wearable electronic device stops detecting gesture information of the wearable electronic device, and at this time, the terminal device also stops receiving, or does not respond to the gesture information sent by the wearable electronic device. After the antenna connection is reestablished between the first UWB antenna and the second UWB antenna, the above steps S501 to S510 are restarted.

Through the scheme, the terminal equipment can be isolated by wearing the electronic equipment, the gestures of the user do not need to be continuously detected through the camera or the depth sensor, convenience of the isolated operation can be improved, and electricity consumption of the terminal equipment is reduced.

Fig. 6 is a block diagram of a terminal device control apparatus according to an exemplary embodiment, which is applied to a wearable electronic device, and referring to fig. 6, the control apparatus 600 includes an information detection module 601 and an information transmission module 602.

The information detection module 601 is configured to detect gesture information with the wearable electronic device in response to the first sensing element of the wearable electronic device establishing a connection with the second sensing element of the terminal device.

The information sending module 602 is configured to send the detected gesture information to the terminal device through a wireless communication connection between the wearable electronic device and the terminal device, where the gesture information is used to instruct the terminal device to perform an operation corresponding to the gesture information.

Optionally, the apparatus 600 may further include: a first detection module;

the first detection module is configured to respond to disconnection of the first sensing element and the second sensing element in the process of detecting gesture information of the wearable electronic device, and stop detecting the gesture information of the wearable electronic device.

Optionally, the first sensing element is a first UWB antenna, the second sensing element is a second UWB antenna, and the information detection module 601 is configured to:

and detecting gesture information by using the wearable electronic device under the condition that the first UWB antenna and the second UWB antenna are connected.

Optionally, the first sensing element is a first UWB antenna, the second sensing element is a second UWB antenna, and the first detection module is configured to:

and stopping detecting gesture information of the wearable electronic device in response to the UWB antenna connection disconnection of the first UWB antenna and the second UWB antenna.

Optionally, the apparatus 600 further includes: a first connection module; the first connection module is configured to:

establishing the UWB antenna connection in the event that the second UWB antenna is detected by the first UWB antenna;

wherein, when the relative angle between the first UWB antenna and the second UWB antenna is within a set angle range, the first UWB antenna and the second UWB antenna can detect each other.

Optionally, the information sending module 602 includes:

a motion detection sub-module configured to detect a motion trajectory and/or a spatial pose of the wearable electronic device.

The gesture determination submodule is configured to determine the gesture information according to the motion track and/or the spatial gesture.

In the above technical solution, in response to the connection between the first sensing element of the wearable electronic device and the second sensing element of the terminal device, the gesture information of the wearable electronic device is detected by using the gesture information detected by the wearable electronic device, the detected gesture information is sent to the terminal device through the wireless communication connection between the wearable electronic device and the terminal device, and the gesture information is used for indicating the terminal device to execute the operation corresponding to the gesture information. Through the scheme, the terminal equipment can be isolated by wearing the electronic equipment, the gestures of the user do not need to be continuously detected through the camera or the depth sensor, convenience of the isolated operation can be improved, and electricity consumption of the terminal equipment is reduced.

Fig. 7 is a block diagram of another terminal device control apparatus according to an exemplary embodiment, which is applied to a terminal device, and referring to fig. 7, the terminal device control apparatus 700 includes a reception management module 701, an information reception module 702, and an execution module 703.

The receiving management module 701 is configured to start receiving gesture information of the wearable electronic device in response to the first sensing element of the wearable electronic device establishing a connection with the second sensing element of the terminal device;

the information receiving module 702 is configured to receive gesture information sent by the wearable electronic device through a wireless communication connection between the wearable electronic device and the terminal device;

the execution module 703 is configured to execute an operation corresponding to the gesture information.

Optionally, the receiving management module 701 is configured to: and under the condition that the receiving of the gesture information of the wearable electronic device is started, responding to the disconnection of the first sensing element and the second sensing element, stopping receiving the gesture information sent by the wearable electronic device, or not responding to the gesture information sent by the wearable electronic device.

Optionally, the first sensing element is a first UWB antenna, the second sensing element is a second UWB antenna, and the reception management module 701 is configured to:

and the second detection sub-module is configured to start receiving gesture information of the wearable electronic device in response to the first UWB antenna and the second UWB antenna being connected.

Optionally, the first sensing element is a first UWB antenna, the second sensing element is a second UWB antenna, and the second transmission module 702 is configured to: and responding to the disconnection of the first UWB antenna and the second UWB antenna, stopping receiving gesture information sent by the wearable electronic device, or not responding to gesture information sent by the wearable electronic device.

The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein.

The present disclosure also provides a computer-readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the terminal device control method provided by the present disclosure.

Fig. 8 is a block diagram of an electronic device 800, according to an example embodiment. For example, apparatus 800 may be a mobile phone, a wearable electronic device, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, or the like.

Referring to fig. 8, apparatus 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output interface 812, a sensor component 814, and a communication component 816.

The processing component 802 generally controls overall operation of the apparatus 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of a terminal device control method. Further, the processing component 802 can include one or more modules that facilitate interactions between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

The power supply component 806 provides power to the various components of the device 800. The power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 800.

The multimedia component 808 includes a screen between the device 800 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. The front camera and/or the rear camera may receive external multimedia data when the apparatus 800 is in an operational mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 further includes a speaker for outputting audio signals.

Input/output interface 812 provides an interface between processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.

The sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of the apparatus 800. For example, the sensor assembly 814 may detect an on/off state of the device 800, a relative positioning of the components, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, an orientation or acceleration/deceleration of the device 800, and a change in temperature of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communication between the apparatus 800 and other devices, either in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for performing the terminal device control methods described above.

In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 804 including instructions executable by processor 820 of apparatus 800 to perform the above-described terminal device control method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

The apparatus may be a stand-alone electronic device or may be part of a stand-alone electronic device, for example, in one embodiment, the apparatus may be an integrated circuit (Integrated Circuit, IC) or a chip, where the integrated circuit may be an IC or may be a collection of ICs; the chip may include, but is not limited to, the following: GPU (Graphics Processing Unit, graphics processor), CPU (Central Processing Unit ), FPGA (Field Programmable Gate Array, programmable logic array), DSP (Digital Signal Processor ), ASIC (Application Specific Integrated Circuit, application specific integrated circuit), SOC (System on Chip, SOC, system on Chip or System on Chip), etc. The integrated circuits or chips may be used to execute executable instructions (or code) to implement the terminal device control methods described above. The executable instructions may be stored on the integrated circuit or chip or may be retrieved from another device or apparatus, such as the integrated circuit or chip including a processor, memory, and interface for communicating with other devices. The executable instructions may be stored in the memory, which when executed by the processor implement the terminal device control method described above; alternatively, the integrated circuit or chip may receive the executable instructions through the interface and transmit the executable instructions to the processor for execution, so as to implement the terminal device control method described above.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A terminal device control method, characterized by being applied to a wearable electronic device, the method comprising:

2. The method according to claim 1, wherein the method further comprises:

3. The method of claim 1, wherein the first sensing element is a first UWB antenna and the second sensing element is a second UWB antenna; the responding to the connection between the first sensing element of the wearable electronic device and the second sensing element of the terminal device, detecting gesture information by the wearable electronic device, comprises:

4. The method of claim 2, wherein the first sensing element is a first UWB antenna and the second sensing element is a second UWB antenna; the stopping detecting gesture information of the wearable electronic device in response to the disconnection of the first sensing element from the second sensing element, comprising:

5. The method according to claim 3 or 4, characterized in that the method further comprises:

6. The method of claim 1, wherein the detecting gesture information of the wearable electronic device comprises:

7. The method of claim 1, wherein the wireless communication connection comprises: bluetooth or wireless local area network.

8. A terminal device control method, characterized by being applied to a terminal device, the method comprising:

And executing an operation corresponding to the gesture information.

9. The method of claim 8, wherein the method further comprises:

and under the condition that the receiving of the gesture information of the wearable electronic device is started, responding to the disconnection of the first sensing element and the second sensing element, stopping receiving the gesture information sent by the wearable electronic device, or not responding to the gesture information sent by the wearable electronic device.

10. The method of claim 8, wherein the first sensing element is a first UWB antenna and the second sensing element is a second UWB antenna; the method for receiving gesture information of the wearable electronic device comprises the steps of:

11. The method of claim 9, wherein the first sensing element is a first UWB antenna and the second sensing element is a second UWB antenna; the stopping receiving the gesture information sent by the wearable electronic device or not responding to the gesture information sent by the wearable electronic device in response to the disconnection of the first sensing element and the second sensing element comprises:

12. A terminal device control apparatus, characterized by being applied to a wearable electronic device, the apparatus comprising:

13. A terminal device control apparatus, characterized by being applied to a terminal device, comprising:

14. An electronic device, comprising:

a memory having a computer program stored thereon;

a processor for executing the computer program in the memory to carry out the steps of the method of any one of claims 1-7 or for executing the computer program in the memory to carry out the steps of the method of any one of claims 8-11.

15. A computer readable storage medium having stored thereon computer program instructions, which when executed by a processor perform the steps of the method according to any of claims 1-7 or which when executed by a processor perform the steps of the method according to any of claims 8-11.

16. A chip, comprising a processor and an interface; the processor is configured to read instructions to perform the method of any of claims 1-7 or the processor is configured to read instructions to perform the method of any of claims 8-11.