WO2022041532A1

WO2022041532A1 - Method for using smart wearable device to control wireless headset

Info

Publication number: WO2022041532A1
Application number: PCT/CN2020/132315
Authority: WO
Inventors: 王晓晨; 刘若宇; 董科
Original assignee: 歌尔股份有限公司
Priority date: 2020-08-31
Filing date: 2020-11-27
Publication date: 2022-03-03
Also published as: CN112035088A

Abstract

A method for using a smart wearable device to control a wireless headset, comprising: a smart wearable device detects the distance between itself and a wireless headset; an inertial measurement sensor is activated when the distance is less than a threshold, and the inertial measurement sensor is used to detect whether an arm is in a moving state; and if the arm is in a moving state, then a corresponding first control command is sent to the wireless headset according to movement parameters of the arm so that the wireless headset executes the first control command. The method uses the inertial measurement sensor to detect whether the arm is in a moving state; and if so, the corresponding first control command is sent to the wireless headset according to the movement parameters of the arm. The whole process conveniently and quickly controls the wireless headset according to the movement parameters of the arm without requiring the user to touch a control terminal or the wireless headset itself by means of the limbs thereof. Meanwhile, further provided are a smart wearable device and a readable storage medium, which have the foregoing beneficial effects.

Description

A method of using smart wearable device to control wireless headset

This application claims the priority of the Chinese patent application with the application number 202010895532.1 and the invention titled "A method of controlling wireless earphones by using a smart wearable device", which was filed with the China Patent Office on August 31, 2020, the entire contents of which are incorporated by reference in this application.

technical field

The present application relates to the field of earphone control, and in particular, to a method for controlling a wireless earphone by using a smart wearable device, a smart wearable device, and a readable storage medium.

Background technique

At present, there are two main control methods for wireless earphones. One is to establish a wireless connection with the control terminal, and to adjust the control terminal through various methods such as voice and touch to adjust the volume, make calls or realize other functions. The other is that the wireless headset has its own pressure sensor, which can directly sense the gestures of clicking, long-pressing, and sliding, and perform corresponding actions.

However, when the user needs to adjust the wireless earphone, the two existing control methods both require the user to touch the control terminal or the wireless earphone itself through their limbs to complete the control of the wireless earphone. Under certain circumstances (such as when holding something in your hand or when your hand is dirty), the control of the wireless headset cannot be successfully completed.

Therefore, how to conveniently and quickly realize the control of the wireless earphone is a technical problem that needs to be solved by those skilled in the art.

SUMMARY OF THE INVENTION

The purpose of this application is to provide a method for controlling a wireless earphone by using a smart wearable device, an intelligent wearable device and a readable storage medium, which are used to conveniently and quickly realize the control of the wireless earphone.

In order to solve the above technical problems, the present application provides a method for controlling a wireless headset by using a smart wearable device, the method comprising:

The smart wearable device detects the distance from the wireless headset;

Activate the inertial measurement sensor when the distance is less than a threshold, and use the inertial measurement sensor to detect whether the arm is in a moving state;

If the arm is in a moving state, a corresponding first control command is sent to the wireless headset according to the movement parameter of the arm, so that the wireless headset executes the first control command.

Optionally, send a corresponding first control command to the wireless headset according to the movement parameters of the arm, including:

Searching for the first control command corresponding to the movement parameter of the arm in the preset storage space, and sending the first control command to the wireless headset;

Wherein, the movement parameters of the arm include at least one of a movement direction, a movement path, and a movement number of the arm.

Optionally, also include:

Receive input editing commands;

The corresponding relationship between the movement parameters of the arm and the first control command in the preset storage space is edited according to the editing command.

Optionally, the first control command includes at least one of a song switching command, a call on/off command, a volume control command, a voice assistant wake-up command, and a fast-forward/fast-rewind command.

Optionally, the smart wearable device detects the distance from the wireless headset, including:

transmitting a detection signal to the wireless earphone, and determining the power value of the reflected signal of the detection signal;

Calculate the distance between the smart wearable device and the wireless headset according to the power value.

Optionally, also include:

If the arm is not in a moving state, activate a millimeter-wave radar sensor, and use the millimeter-wave radar sensor to detect whether the hand is in a moving state;

If the hand is in a moving state, a corresponding second control command is sent to the wireless headset according to the movement parameter of the hand, so that the wireless headset executes the second control command.

Optionally, the movement parameters of the hand include palm movement parameters and/or fingertip movement parameters.

The application also provides a smart wearable device, the smart wearable device includes:

a first detection module, used for the smart wearable device to detect the distance from the wireless headset;

a second detection module, configured to activate an inertial measurement sensor when the distance is less than a threshold, and use the inertial measurement sensor to detect whether the arm is in a moving state;

A first sending module, configured to send a corresponding first control command to the wireless headset according to a movement parameter of the arm if the arm is in a moving state, so that the wireless headset executes the first control command.

memory for storing computer programs;

The processor is configured to implement the steps of the method for using the smart wearable device to control the wireless headset according to any one of the above when executing the computer program.

The present application also provides a readable storage medium, where a computer program is stored on the readable storage medium, and when the computer program is executed by a processor, the method for controlling a wireless headset by using a smart wearable device according to any one of the above-mentioned methods is implemented. step.

The method of using a smart wearable device to control a wireless headset provided by this application includes: the smart wearable device detects the distance from the wireless headset; when the distance is less than a threshold, the inertial measurement sensor is activated, and the inertial measurement sensor is used to detect whether the arm is in a moving state; if the arm is in a moving state; In the moving state, the corresponding first control command is sent to the wireless earphone according to the movement parameter of the arm, so that the wireless earphone executes the first control command.

The technical solution provided by this application detects the distance from the wireless headset through a smart wearable device; when the distance is less than a threshold, the inertial measurement sensor is activated, and the inertial measurement sensor is used to detect whether the arm is in a moving state; if the arm is in a moving state, according to the arm Send the corresponding first control command to the wireless headset. The whole process does not require the user to touch the control terminal or the wireless headset itself through the limbs, but the control of the wireless headset can be conveniently and quickly completed according to the movement parameters of the arm. . At the same time, the present application also provides a smart wearable device and a readable storage medium, which have the above beneficial effects, and will not be repeated here.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only It is a part of the drawings of the present application. For those of ordinary skill in the art, other drawings can also be obtained from the provided drawings without any creative effort.

1 is a flowchart of a method for controlling a wireless headset by using a smart wearable device according to an embodiment of the present application;

2 is a schematic diagram of a smart wearable device detecting a distance from a wireless headset according to an embodiment of the present application;

3 is a schematic diagram of coordinates of an arm movement provided by an embodiment of the present application;

4 is a schematic diagram of an arm motion recognition provided by an embodiment of the present application;

5 is a flowchart of another method for controlling a wireless headset by using a smart wearable device according to an embodiment of the present application;

6 is a schematic diagram of an arm motion recognition provided by an embodiment of the present application;

FIG. 7 is a schematic position diagram of a millimeter-wave radar sensor provided by an embodiment of the present application;

FIG. 8 is a structural diagram of a smart wearable device provided by an embodiment of the application;

FIG. 9 is a structural diagram of another smart wearable device provided by an embodiment of the present application.

detailed description

The core of the present application is to provide a method for controlling a wireless earphone by using a smart wearable device, an intelligent wearable device and a readable storage medium, which are used to conveniently and quickly realize the control of the wireless earphone.

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

Please refer to FIG. 1 , which is a flowchart of a method for controlling a wireless headset by using a smart wearable device according to an embodiment of the present application.

It specifically includes the following steps:

S101: The smart wearable device detects the distance from the wireless headset;

Based on the two existing control methods of wireless headsets, the user needs to touch the control terminal or the wireless headset itself through the body to complete the control of the wireless headset. Or when the hand is stained), the control of the wireless headset cannot be successfully completed; and although the existing gesture control method can realize the non-contact control of the wireless headset, it is impossible to judge whether it is operated by myself. When the hand intrudes into the recognition range, it is impossible to distinguish whether the gesture is made by itself, and other people may misuse it; therefore, the present application provides a method for controlling a wireless headset by using a smart wearable device to solve the above problems;

Please refer to FIG. 2 , which is a schematic diagram of a smart wearable device detecting a distance from a wireless headset according to an embodiment of the present application. As shown in Figure 2, the present application detects the distance from the wireless earphone through the smart wearable device, and controls the wireless earphone according to the state of the arm when the distance is less than the threshold value. It does not require the user to control the terminal or the wireless earphone itself through the limbs. Touching can also avoid misoperation caused by recognizing actions of outsiders, thereby realizing convenient and quick control of the wireless earphones.

Optionally, the distance from the wireless headset can be detected by the smart wearable device through power calculation, that is, the smart wearable device mentioned here detects the distance from the wireless headset, which can be specifically implemented by performing the following steps:

Transmit the detection signal to the wireless headset, and determine the power value of the reflected signal of the detection signal;

Optionally, the distance between the detection of the smart wearable device and the wireless headset may also be calculated according to the reflection time of the signal, which is not specifically limited in this application.

S102: Activate the inertial measurement sensor when the distance is less than a threshold, and use the inertial measurement sensor to detect whether the arm is in a moving state;

If the arm is in a moving state, go to step S103;

When the distance is less than the threshold, the inertial measurement sensor is activated, and then the inertial measurement sensor is used to detect whether the arm is in a moving state. If the arm is in a moving state, it proves that the user is controlling the wireless headset by moving the arm. At this time, step S103 is performed. The movement parameter sends a corresponding first control command to the wireless headset, so that the wireless headset executes the first control command.

In a specific embodiment, the wireless earphone can use the wireless sensor of the earphone as the reference point to establish a three-dimensional space with a radius of 20cm as the operation recognition range. The 20cm radius mentioned here is based on ergonomic dimensions (head and shoulders). It can be used as the threshold value of the operating range. Of course, the threshold value can also be determined according to industry standards or other requirements, which is not specifically limited in this application.

S103: Send a corresponding first control command to the wireless headset according to the movement parameter of the arm, so that the wireless headset executes the first control command.

Optionally, the sending of the corresponding first control command to the wireless headset according to the movement parameters of the arm mentioned here may specifically be:

Find the first control command corresponding to the movement parameter of the arm in the preset storage space, and send the first control command to the wireless headset;

The movement parameters of the arm mentioned here may include at least one of the movement direction, movement path, and movement times of the arm.

Optionally, on the basis of the above embodiment, the addition, modification and deletion of the correspondence between the movement parameters of the arm and the first control command in the preset storage space can also be implemented by performing the following steps:

Receive input editing commands;

Optionally, the first control command mentioned here includes at least one of a song switching command, a call on/off command, a volume control command, a voice assistant wake-up command, and a fast-forward/fast-rewind command.

In a specific embodiment, a coordinate system can be established according to the position of the human body to realize the recognition of the arm movement. For example, please refer to FIG. 3 and FIG. 4 . FIG. FIG. 4 is a schematic diagram of arm motion recognition according to an embodiment of the present application.

As shown in Figure 3, a three-dimensional coordinate system can be established based on the plane where the human body is located as the X-axis and the Y-axis, and the direction facing the human body is the Z-axis;

As shown in Figure 4, when the arm moves from outside to inside based on the swinging posture of the elbow, the sensor detects that the movement path is rotating around the X-axis, so different control commands can be designed according to different rotation directions. For example, take 1S as the The detection time period, with 10 degrees as the effective rotation degree threshold, can be set as gesture 1, clockwise rotation is detected once, and the wireless headset related application starts the function of switching songs (next song); set gesture 2 as detected Rotate clockwise 2 times, the wireless headset related application starts the fast forward function; set gesture 3 to, detect a counterclockwise rotation, the wireless headset related application starts the function of switching songs (previous song); set gesture 4 to detect reverse The hour hand rotates twice, and the wireless headset related application starts the rewind function.

Based on the above technical solutions, the present application provides a method for controlling a wireless headset by using a smart wearable device. The smart wearable device detects the distance from the wireless headset; when the distance is less than a threshold, the inertial measurement sensor is activated, and the inertial measurement sensor is used to detect the arm Whether it is in a moving state; if the arm is in a moving state, the corresponding first control command is sent to the wireless headset according to the movement parameters of the arm. The whole process does not require the user to touch the control terminal or the wireless headset itself through the limbs. The wireless headset can be controlled conveniently and quickly according to the movement parameters of the arm.

For the previous embodiment, after step S102 is performed to detect whether the arm is in a moving state by using an inertial measurement sensor, if the arm is not in a moving state, the steps shown in FIG.

Please refer to FIG. 5 , which is a flowchart of another method for controlling a wireless headset by using a smart wearable device according to an embodiment of the present application.

It specifically includes the following steps:

S501: Activate the millimeter-wave radar sensor, and use the millimeter-wave radar sensor to detect whether the hand is in a moving state;

If the hand is in a moving state, go to step S502;

When the distance between the smart wearable device and the wireless earphone is less than the threshold, and the arm is not in the moving state but the hand is in the moving state, it proves that the user controls the wireless earphone through hand movements at this time, and step S502 is executed at this time. The movement parameter of the part sends the corresponding second control command to the wireless headset to realize the control of the wireless headset;

Optionally, when the smart wearable device detects that the distance from the wireless headset is less than the threshold, and the arm is not moving and the hand is not moving, it proves that the user is just unconsciously placing the smart wearable device on the wireless headset. In a relatively close position, you can do nothing at this time.

S502: Send a corresponding second control command to the wireless headset according to the movement parameter of the hand, so that the wireless headset executes the second control command.

Optionally, the second control command mentioned here may be the same as or different from the first control command, which is not specifically limited in this application;

Optionally, the movement parameters of the hand mentioned here may specifically include palm movement parameters and/or fingertip movement parameters.

In a specific embodiment, a coordinate system can also be established according to the position of the human body to realize hand motion recognition. For example, please refer to FIG. 6 , which is a schematic diagram of arm motion recognition provided by an embodiment of the present application.

Optionally, with 1S as the detection time period, gesture 5 can be set as, when the millimeter wave radar sensor recognizes that the displacement direction of the four fingertip points is the negative direction of the X axis, the wireless headset related application starts the volume reduction function; Set gesture 6 as, when the millimeter-wave radar sensor recognizes that the displacement direction of the four fingertip points is the positive direction of the X axis, the wireless headset related application starts the volume increase function; you can set gesture 7 as, when the millimeter-wave radar sensor recognizes When the displacement direction of only one fingertip point is the positive X-axis, the wireless headset related application starts the pause/answer function; gesture 8 can be set as, when the millimeter wave radar sensor recognizes the displacement of only one fingertip point When the direction is the negative X-axis, the wireless headset-related application activates the wake-up voice assistant function.

Optionally, in order to save costs as much as possible on the premise that the measurement of hand movement parameters can be measured, the number of millimeter-wave radar sensors can be one;

Optionally, in order to improve the measurement accuracy of hand movement parameters, the number of millimeter-wave radar sensors may also be multiple;

For example, please refer to FIG. 7, which is a schematic diagram of the location of a millimeter-wave radar sensor provided by an embodiment of the present application. As shown in FIG. 7, in a specific embodiment, when the smart wearable device is a smart watch, it can be The millimeter-wave radar sensor is placed in the dial 1 and wristband 2 of the smart watch, so that the two millimeter-wave radar sensors can be symmetrically distributed on the upper and lower sides of the wrist, which can ensure the movement of the hand as much as possible under the premise of saving costs. The measurement accuracy of the parameter.

Please refer to FIG. 8 , which is a structural diagram of a smart wearable device provided by an embodiment of the present application.

The smart wearable device may include:

The first detection module 100 is used for the smart wearable device to detect the distance from the wireless headset;

The second detection module 200 is configured to activate the inertial measurement sensor when the distance is less than the threshold, and use the inertial measurement sensor to detect whether the arm is in a moving state;

The first sending module 300 is configured to send a corresponding first control command to the wireless earphone according to the movement parameter of the arm if the arm is in a moving state, so that the wireless earphone executes the first control command.

On the basis of the foregoing embodiment, in a specific embodiment, the first sending module 300 may include:

a first sending submodule, used for searching the first control command corresponding to the movement parameter of the arm in the preset storage space, and sending the first control command to the wireless headset;

Wherein, the movement parameters of the arm include at least one of the movement direction, movement path, and movement times of the arm.

On the basis of the foregoing embodiment, in a specific embodiment, the first sending module 300 may further include:

The receiving sub-module is used to receive the input editing command;

The editing sub-module is used for editing the correspondence between the movement parameters of the arm and the first control command in the preset storage space according to the editing command.

On the basis of the above embodiment, in a specific embodiment, the first control command includes at least one of a song switching command, a call on/off command, a volume control command, a voice assistant wake-up command, and a fast forward/rewind command. one.

On the basis of the foregoing embodiment, in a specific embodiment, the first detection module 100 may include:

a transmission sub-module, used for transmitting the detection signal to the wireless earphone, and determining the power value of the reflected signal of the detection signal;

The calculation sub-module is used to calculate the distance between the smart wearable device and the wireless headset according to the power value.

On the basis of the above embodiment, in a specific embodiment, the smart wearable device may further include:

The third detection module is used to activate the millimeter-wave radar sensor when the arm is not in a moving state, and use the millimeter-wave radar sensor to detect whether the hand is in a moving state;

The second sending module is configured to send a corresponding second control command to the wireless earphone according to the movement parameter of the hand if the hand is in a moving state, so that the wireless earphone executes the second control command.

Based on the above embodiments, in a specific embodiment, the movement parameters of the hand include palm movement parameters and/or fingertip movement parameters.

Since the embodiments of the smart wearable device part correspond to the embodiments of the method part, the embodiments of the smart wearable device part refer to the description of the embodiments of the method part, which will not be repeated here.

Please refer to FIG. 9 , which is a structural diagram of another smart wearable device provided by an embodiment of the present application.

The smart wearable device 900 may vary greatly due to different configurations or performances, and may include one or more processors (central processing units, CPU) 922 (for example, one or more processors) and a memory 932, one or more One or more storage media 930 (eg, one or more mass storage devices) storing applications 942 or data 944. Among them, the memory 932 and the storage medium 930 may be short-term storage or persistent storage. The program stored in the storage medium 930 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the smart wearable device. Further, the processor 922 may be configured to communicate with the storage medium 930, and execute a series of instruction operations in the storage medium 930 on the smart wearable device 900.

The smart wearable device 900 may also include one or more power supplies 929, one or more wired or wireless network interfaces 950, one or more input and output interfaces 958, and/or, one or more operating systems 941, such as Windows Server™, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

The steps in the method for controlling a wireless headset by using a smart wearable device described above in FIGS. 1 to 7 are implemented by the smart wearable device based on the structure shown in FIG. 9 .

Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the smart wearable device and the module described above, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed smart wearable device and method may be implemented in other ways. For example, the above-described smart wearable device embodiments are only illustrative. For example, the division of modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple modules or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or modules, and may be in electrical, mechanical or other forms.

Modules described as separate components may or may not be physically separated, and components shown as modules may or may not be physical modules, that is, they may be located in one place, or may be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist physically alone, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules.

The integrated modules, if implemented in the form of software functional modules and sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , which includes several instructions to cause a computer device (which may be a personal computer, a function invocation device, or a network device, etc.) to execute all or part of the steps of the methods in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program codes .

A method for controlling a wireless headset by using a smart wearable device, the smart wearable device, and the readable storage medium provided in the present application are described above in detail. Specific examples are used herein to illustrate the principles and implementations of the present application, and the descriptions of the above embodiments are only used to help understand the methods and core ideas of the present application. It should be pointed out that for those of ordinary skill in the art, without departing from the principles of the present application, several improvements and modifications can also be made to the present application, and these improvements and modifications also fall within the protection scope of the claims of the present application.

It should also be noted that, in this specification, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations. There is no such actual relationship or sequence between operations. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article, or device that includes the element.

Claims

A method for controlling a wireless headset by using a smart wearable device, comprising:

The smart wearable device detects the distance from the wireless headset;

Activate the inertial measurement sensor when the distance is less than a threshold, and use the inertial measurement sensor to detect whether the arm is in a moving state;

If the arm is in a moving state, a corresponding first control command is sent to the wireless headset according to the movement parameter of the arm, so that the wireless headset executes the first control command.
The method according to claim 1, wherein sending a corresponding first control command to the wireless headset according to the movement parameter of the arm, comprising:

Find the first control command corresponding to the movement parameter of the arm in the preset storage space, and send the first control command to the wireless headset;

Wherein, the movement parameters of the arm include at least one of a movement direction, a movement path, and a movement number of the arm.
The method of claim 2, further comprising:

Receive input editing commands;

The corresponding relationship between the movement parameters of the arm and the first control command in the preset storage space is edited according to the editing command.
The method according to claim 2, wherein the first control command comprises at least one of a song switching command, a call on/off command, a volume control command, a voice assistant wake-up command, and a fast-forward/fast-rewind command an item.
The method according to claim 1, wherein detecting the distance from the smart wearable device to the wireless headset comprises:

transmitting a detection signal to the wireless earphone, and determining the power value of the reflected signal of the detection signal;

Calculate the distance between the smart wearable device and the wireless headset according to the power value.
The method according to any one of claims 1 to 5, further comprising:

If the arm is not in a moving state, activate the millimeter-wave radar sensor, and use the millimeter-wave radar sensor to detect whether the hand is in a moving state;

If the hand is in a moving state, a corresponding second control command is sent to the wireless earphone according to the movement parameter of the hand, so that the wireless earphone executes the second control command.
The method according to claim 6, wherein the hand movement parameters include palm movement parameters and/or fingertip movement parameters.
A smart wearable device, comprising:

The first detection module is used for the smart wearable device to detect the distance from the wireless headset;

a second detection module, configured to activate an inertial measurement sensor when the distance is less than a threshold, and use the inertial measurement sensor to detect whether the arm is in a moving state;

A first sending module, configured to send a corresponding first control command to the wireless headset according to a movement parameter of the arm if the arm is in a moving state, so that the wireless headset executes the first control command.
A smart wearable device, comprising:

memory for storing computer programs;

The processor is configured to implement the steps of the method for controlling a wireless headset by using a smart wearable device according to any one of claims 1 to 7 when executing the computer program.
A readable storage medium, characterized in that, a computer program is stored on the readable storage medium, and when the computer program is executed by a processor, the computer program can realize wireless control using a smart wearable device according to any one of claims 1 to 7. The steps of the method of the headset.