WO2024000853A1

WO2024000853A1 - Wearable device control method and apparatus, terminal device, and storage medium

Info

Publication number: WO2024000853A1
Application number: PCT/CN2022/120506
Authority: WO
Inventors: 郭倪宏
Original assignee: 歌尔科技有限公司
Priority date: 2022-06-28
Filing date: 2022-09-22
Publication date: 2024-01-04
Also published as: CN114999489A

Abstract

A wearable device control method and apparatus, a terminal device, and a computer readable storage medium (1005). The method comprises: when preset wake-up voice is recognized from voice information collected by means of a first wearable device from an environment, performing sound source localization on the voice information to obtain sound source information of the voice information (S10); performing broadcast signal source localization on second wearable devices in the environment to obtain broadcast signal source information of the second wearable devices (S20); and if the sound source information matches target signal source information among the broadcast signal source information, creating a communication link to a target wearable device corresponding to a target signal source, and performing interaction control with the target wearable device by means of the communication link (S30). Therefore, rapid and flexible connection and control between different wearable devices can be implemented by means of voice, thereby improving the interaction efficiency of users using the wearable devices.

Description

Control method, device, terminal equipment and storage medium of wearable device

This application requests the priority of the Chinese patent application submitted to the China Patent Office on June 28, 2022, with application number 202210744564.0 and the application name "Control method, device, terminal equipment and storage medium for wearable devices", and its entire content incorporated herein by reference.

Technical field

The invention belongs to the technical field of intelligent wearable devices, and in particular relates to a control method, device, terminal equipment and computer-readable storage medium for a wearable device.

Background technique

Nowadays, smart wearable devices are becoming more and more popular in the market.

The connection of smart wearable devices is an essential step for interaction and control between various devices. However, to achieve interconnection with smart wearable devices, users usually need to use a traditional remote control or a specific mobile phone App (Application, application) to realize the connection between the wearable device and other wearable terminal devices.

In this way, once there are many wearable devices in the user's environment, the user will need to use multiple remote controls to control them separately or frequently add and control multiple devices through mobile apps, which leads to user confusion. The control process is extremely cumbersome and greatly affects the user's interaction efficiency when using wearable devices.

Contents of the invention

The main purpose of the present invention is to provide a control method, device, terminal equipment and computer-readable storage medium for a wearable device. It aims to achieve fast and flexible connection and control between different wearable devices through voice, thereby improving the efficiency of users' interaction with wearable devices.

In order to achieve the above object, the present invention provides a control method for a wearable device, the wearable device is applied to a first wearable device, and the control method for a wearable device includes:

When the preset wake-up voice is recognized from the voice information collected from the environment, performing sound source positioning on the voice information to obtain the sound source information of the voice information;

Perform broadcast signal source positioning on each second wearable device in the environment to obtain broadcast signal source information of each second wearable device;

If the sound source information matches the target signal source information in each of the broadcast signal source information, a communication link between the target wearable devices corresponding to the target signal source is created, and the communication link is Perform interactive control with the target wearable device.

Optionally, the first wearable device is configured with an array microphone, and the sound source information includes: sound source azimuth angle;

The step of performing sound source localization on the voice information to obtain the sound source information of the voice information includes:

Obtain the arrival time difference of the voice information through the array microphone;

Calculation is performed based on the arrival time difference to determine the sound source azimuth angle of the speech information.

Optionally, the first wearable device is configured with an array antenna, and the broadcast signal source information includes: broadcast signal azimuth angle;

The step of locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device includes:

Receive broadcast signals from each of the second wearable devices through the array antenna;

Calculate the phase difference of each broadcast signal in sequence based on different array elements in the array antenna;

A preset signal angle estimation algorithm is called to perform calculations based on each of the phase differences to determine the broadcast signal azimuth angle of each of the second wearable devices.

Optionally, the step of creating a communication link between the target wearable device corresponding to the target signal source, and performing interactive control with the target wearable device through the communication link includes:

Establish a Bluetooth connection between the target wearable devices corresponding to the target signal source in each of the second wearable devices;

Create a communication link with the target wearable device through the Bluetooth connection;

Preset voice prompts are output through the communication link for interactive control with the target wearable device.

Optionally, before the step of performing sound source positioning on the voice information to obtain the sound source information of the voice information when a preset wake-up voice is recognized from the voice information collected from the environment, the step Methods also include:

The preset wake-up voice is set based on the unique identification of the first wearable device, where the unique identification includes at least one of a Bluetooth name, a device name, and a custom name.

Optionally, the method also includes:

When the voice information is collected in the environment and the unique identifier is detected in the text information corresponding to the voice information, it is determined that the wake-up voice is recognized from the voice information.

Optionally, the first wearable device includes: a master device and a slave device;

After the step of locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device, the method further includes:

Each of the broadcast signal source information is summarized to the master device for calibration processing to obtain the final angle value of each of the second wearable devices, wherein each of the broadcast signal source information is obtained by the master device and/or the slave device. The equipment performs positioning of the broadcast signal source;

Detect whether there is a target angle value consistent with the sound source information in each of the final angle values;

If it exists, the broadcast signal source information corresponding to the target angle value is determined as the target signal source information that matches the sound source information.

In addition, to achieve the above object, the present invention also provides a control device for a wearable device, the control device for the wearable device is applied to the first wearable device, and the control device for the wearable device includes:

A sound source positioning module, used to perform sound source positioning on the voice information to obtain the sound source information of the voice information when the preset wake-up voice is recognized from the voice information collected from the environment;

A broadcast positioning module is used to locate the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device;

A connection control module configured to create a communication link between target wearable devices corresponding to the target signal source if the sound source information matches the target signal source information in each of the broadcast signal source information, and Interactive control with the target wearable device is performed through the communication link.

Each functional module of the control device of the wearable device of the present invention implements the steps of the control method for motion monitoring of wireless earphones as described above when running.

In addition, to achieve the above object, the present invention also provides a terminal device, which includes: a memory, a processor, and a control program of a wearable device stored on the memory and capable of running on the processor. When the control program for motion monitoring of the wireless earphone is executed by the processor, the steps of the control method for motion monitoring of the wireless earphone as described above are implemented.

In addition, to achieve the above object, the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a control program for a wearable device, and the control program for the wearable device is executed by a processor. The steps of implementing the above-mentioned control method for a wearable device are implemented.

Embodiments of the present invention propose a control method, device, terminal device and computer-readable storage medium for a wearable device. When the first wearable device recognizes the preset wake-up voice in the voice information collected from the environment, , performing sound source positioning on the voice information to obtain the sound source information of the voice information; and performing broadcast signal source positioning on each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device. ; Therefore, if the sound source information matches the target signal source information in each of the broadcast signal source information, a communication link between the target wearable devices corresponding to the target signal source is created, and the communication link is created through the The communication link performs interactive control with the target wearable device.

In this way, compared with the traditional way for users to add and control wearable devices through remote controls or mobile Apps, the present invention wakes up the first wearable device through voice to trigger connection preparation, and then performs sound source positioning operations to find the source of the voice. The user's position, and perform broadcast signal source positioning to search for the positions of other second wearable devices, and directly connect to the target wearable device that matches the position, and create a communication link for interactive control between the two devices, thereby, It enables users to quickly and flexibly connect and interactively control different wearable devices through voice, greatly simplifying user operations and effectively improving the efficiency and experience of users interacting with wearable devices.

Description of drawings

Figure 1 is a schematic diagram of the equipment structure of the terminal equipment hardware operating environment involved in the embodiment of the present invention;

Figure 2 is a schematic flowchart of a first embodiment of a control method for a wearable device of the present invention;

Figure 3 is a schematic diagram illustrating the principle of locating a broadcast signal source according to an embodiment of the control method for a wearable device of the present invention;

Figure 4 is a schematic diagram of an application scenario for wearable device orientation recognition according to an embodiment of the wearable device control method of the present invention;

Figure 5 is a schematic diagram of an application scenario for voice interaction with a wearable device according to an embodiment of the wearable device control method of the present invention;

FIG. 6 is a functional module schematic diagram of an embodiment of a control device for a wearable device of the present invention.

The realization of the purpose, functional features and advantages of the present invention will be further described with reference to the embodiments and the accompanying drawings.

Detailed ways

It should be understood that the specific embodiments described here are only used to explain the present invention and are not intended to limit the present invention.

Referring to Figure 1, Figure 1 is a schematic diagram of the equipment structure of the terminal equipment hardware operating environment involved in the embodiment of the present invention.

The terminal device in the embodiment of the present invention may be a wearable device such as a bracelet, a watch, glasses, a headset, a TWS (True Wireless Stereo) headset, etc. The wearable device is equipped with an array microphone and an array antenna.

As shown in Figure 1, the terminal device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize connection communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard). The optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.

Those skilled in the art can understand that the structure of the terminal device shown in Figure 1 does not constitute a limitation on the terminal device, and may include more or fewer components than shown, or combine certain components, or arrange different components.

As shown in Figure 1, memory 1005, which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and a control program for a wearable device.

In the terminal shown in Figure 1, the network interface 1004 is mainly used to connect to the backend server and communicate with the backend server; the user interface 1003 is mainly used to connect to the client and communicate with the client; and the processor 1001 can be used to The various embodiments of the control method of the wearable device of the present invention are implemented by calling the control program of the wearable device stored in the memory 1005.

Based on the above terminal equipment, various embodiments of the control method of the wearable device of the present invention are proposed. In each embodiment of the motion monitoring method of the wireless headset of the present invention, the control method of the wearable device of the present invention is applied to the process of monitoring the movement of the headset wearer based on the wireless headset.

Please refer to FIG. 2 , which is a schematic flowchart of a control method for a wearable device according to a first embodiment of the present invention. In the first embodiment of the control method of the wearable device of the present invention, the control method of the wearable device of the present invention is applied to the first wearable device in an environment where multiple wearable devices exist at the same time. Control methods include:

Step S10: When the preset wake-up voice is recognized from the voice information collected from the environment, perform sound source positioning on the voice information to obtain the sound source information of the voice information;

In this embodiment, in an environment where multiple wearable devices exist at the same time, each wearable device serves as the first wearable device to collect voice information in the current environment, and detects whether the preset is recognized in the collected voice information. The wake-up voice is recognized in the voice information, so that when the wake-up voice is recognized in the voice information, the sound source positioning operation is immediately performed on the voice information to obtain the sound source information of the voice information in the current environment.

For example, as shown in the schematic diagram of the application scenario in Figure 4, in this embodiment, it is assumed that there are four users A, B, C, and D indoors, all wearing smart wearable devices, and the smart wearable device worn by user A is specifically: TWS earphones, when user B needs to connect and interact with the TWS earphones worn by user A through the earphones he wears, user B sends a voice message of "connect with user A". In this way, the TWS earphones worn by user A serve as the first The wearable device collects voice information in the current indoor environment, recognizes the wake-up voice of "User A" from the voice information sent by user B, confirms that the wake-up is successful, and immediately begins to collect the voice information collected by the respective microphones of its left and right earphones. The sound features are synchronized to perform a TDOA (time difference positioning method) sound source identification operation to obtain the sound source information of the voice information sent by user B.

In addition, in some feasible embodiments, before the above step S10, the control method of the wearable device of the present invention may also include:

Step A: Set the preset wake-up voice based on the unique identification of the first wearable device, where the unique identification includes at least one of a Bluetooth name, a device name, and a custom name.

In this embodiment, during the startup process, the first wearable device can set its own unique identification: Bluetooth name, device name and/or custom name through voice interaction with the user to wake up itself and other devices. Wake-up voice for connected interaction with wearable devices.

In addition, the first wearable device can also be set by the user through the associated mobile app to confirm that the Bluetooth name, device name and/or custom name are set as the wake-up voice used to wake up the first wearable device for connection and interaction with other wearable devices. .

It should be understood that based on different design needs of practical applications, in different feasible implementations, the Bluetooth name of the wearable device itself, the device name and the custom name set by the user may of course be different. Based on this, the present invention The control method of a wearable device does not limit the specific content of the Bluetooth name, device name and/or custom name of the wearable device, as long as each name can be used as a unique identifier of the wearable device for the wearable device to determine whether it is being used. Just wake it up.

Further, in some feasible embodiments, the control method of the wearable device of the present invention also includes:

Step B: Collect the voice information in the environment and detect that the unique identifier exists in the text information corresponding to the voice information, determine that the wake-up voice is recognized from the voice information.

In this embodiment, after the above-mentioned first wearable device collects the voice information sent by the wearer of other wearable devices from the current environment, it immediately performs voice content recognition on the voice information to obtain the text information corresponding to the voice information. , thereby detecting whether there is text content that is the same as its own unique identifier: Bluetooth name, device name and/or custom name in the text message, and when detecting the presence, it is determined that the unique identifier exists in the text message corresponding to the voice message. , and further determine that the wake-up voice used to wake up the self to connect and interact with other devices is currently recognized from the voice information.

In addition, in some feasible embodiments, the above-mentioned first wearable device is configured with an array microphone, and the sound source information of the voice information obtained by the above-mentioned first wearable device performing a sound source positioning operation on the collected voice information includes: sound source orientation angle.

The step of "locating the sound source of the voice information to obtain the sound source information of the voice information" in step S10 above may include:

Step S101: Obtain the arrival time difference of the voice information through the array microphone;

In this embodiment, after determining that the wake-up voice is recognized from the collected voice information, the first wearable device immediately performs a TDOA sound source recognition operation to obtain the sound source information of the voice information. That is, the first wearable device synchronizes the sound characteristics of the respectively collected voice information through the array microphones configured on it, thereby determining the arrival time difference between the voice information arriving at any two microphones among the array microphones.

Step S102: Calculate based on the arrival time difference to determine the sound source azimuth angle of the voice information.

In this embodiment, after the above-mentioned first wearable device determines the arrival time difference between the voice information reaching any two microphones in its configured array microphone, it calculates the distance difference by combining the speed of the voice information propagating in the air and the time difference. , and then calculate the azimuth angle of the sound source of the voice information relative to the first wearable device in the current environment.

In addition, as a feasible implementation manner, the above-mentioned first wearable device can also perform a sound source localization operation on the collected voice information based on beam forming and high-resolution spectrum estimation to identify the sound source of the voice information. Azimuth angle.

Step S20: Position the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device;

In this embodiment, after the first wearable device performs a sound source positioning operation on the collected voice information to identify the sound source information of the voice information, it further targets all Bluetooth signal broadcasters in the current environment. The second wearable device performs a broadcast signal source positioning operation to identify and obtain the broadcast signal source information of each second wearable device.

For example, in the application scenario shown in Figure 4, it is assumed that there are four users A, B, C, and D indoors, all wearing smart wearable devices. The smart wearable device worn by user A is specifically a TWS headset, and each smart wearable device Each device broadcasts Bluetooth signals in the current indoor environment. In this way, when user B needs to connect and interact with the TWS headset worn by user A through the headset he wears, and user B sends a voice message of "connect with user A", the TWS headset worn by user A serves as the first wearable device. Collect voice information in the current indoor environment, and perform sound source positioning operations on the voice information "connected to user A" to confirm the azimuth and angle of the sound source relative to user B in the current indoor environment.

In addition, when the TWS headset worn by user A starts to perform the sound source positioning operation on the voice information connected to user A, or after it starts to perform the sound source positioning operation on the voice information connected to user A, the smart wearable devices worn by the three users B, C and D are all used as second Wear the device, and start to perform broadcast signal source positioning operations for the Bluetooth signals broadcast by each second wearable device to obtain the broadcast signal source information of each second wearable device. That is, the TWS headset worn by user A serves as the first The wearable device scans the radio frequency information of the second wearable device b worn by user B, the second wearable device c worn by user C, and the second wearable device d worn by user D through the left and right earphones and calculates the angle of each radio frequency information, and then, The TWS headset aggregates the calculated angles into the main headset for position averaging and calibration. The broadcast signal source information of the second wearable device b is: L1_1, R1_1, and the broadcast signal source information of the second wearable device c: L2_1, R2_1. The broadcast signal source information of the second wearable device d is: L3_1, R3_1.

In addition, in some feasible embodiments, the above-mentioned first wearable device is configured with an array antenna, and the first wearable device performs a broadcast signal source positioning operation for each of the above-mentioned second wearable devices, and the obtained respective Broadcast signal source information includes: broadcast signal azimuth angle.

The above-mentioned step S20: locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device may include:

Step S201: Receive the broadcast signal of each second wearable device through the array antenna;

Step S202: Calculate the phase difference of each broadcast signal in sequence based on different elements in the array antenna;

Step S203: Call a preset signal angle estimation algorithm to perform calculations based on each of the phase differences to determine the broadcast signal azimuth angle of each of the second wearable devices.

It should be noted that in this embodiment, the preset signal angle estimation algorithm is an algorithm that calculates the azimuth angle between the signal emission source and the device where the array antenna is located based on the phase difference and the signal wavelength. For example, the signal angle estimation algorithm Specifically it can be:

Among them, θ is the azimuth angle, λ is the wavelength of the broadcast signal, △Φ is the phase difference, and d is the relative distance between the two elements in the array antenna.

In this embodiment, based on the principle of broadcast signal source positioning as shown in Figure 3, the first wearable device scans the broadcast signals output by each of the above-mentioned second wearable devices in a radio frequency manner through its own array antenna. Therefore, the first wearable device can perform IQ sampling through the array antenna to determine the phase difference caused by the different distances between the broadcast signals of each second wearable device reaching any two elements in the array antenna. Finally, the first wearable device further calculates the respective broadcast signal azimuth angles of each of the above-mentioned second wearable devices through the above-mentioned signal angle estimation algorithm.

Step S30: If the sound source information matches the target signal source information in each of the broadcast signal source information, create a communication link between the target wearable devices corresponding to the target signal source, and use the The communication link performs interactive control with the target wearable device.

In this embodiment, after the first wearable device further performs a broadcast signal source positioning operation on each second wearable device to identify the broadcast signal source information of each second wearable device relative to itself, the first wearable device passes The sound source information corresponding to the above voice information is matched with the broadcast signal source information one by one, so that when the sound source information matches a target signal source among the broadcast signal source information, the first wearable device immediately Connect with the target wearable device corresponding to the target signal source among the second wearable devices, and create a communication link with the target wearable device, so as to further conduct communication with the target wearable device through the communication link. Interactive control.

In some feasible embodiments, the above-mentioned first wearable device includes: a master device and a slave device; based on this, in the above-mentioned step S20: perform broadcast signal source positioning on each second wearable device in the environment to obtain each of the third wearable devices. After broadcasting the signal source information of the wearable device, the control method of the wearable device of the present invention may also include:

Step C: Summarize each of the broadcast signal source information to the main device for calibration processing to obtain the final angle value of each of the second wearable devices, wherein each of the broadcast signal source information is provided by the main device and/or The slave device performs positioning of the broadcast signal source;

Step D: Detect whether there is a target angle value consistent with the sound source information in each of the final angle values;

Step E: If it exists, determine the broadcast signal source information corresponding to the target angle value as the target signal source information that matches the sound source information.

In this embodiment, the above-mentioned first wearable device performs a broadcast signal source positioning operation on each second wearable device through the master device and/or the slave device to identify and obtain the broadcast signal source information of each second wearable device relative to itself. After that, the broadcast signal source information is further summarized to the main device for calibration processing, thereby obtaining the final angle value of each second wearable device. After that, the first wearable device passes the sound source information corresponding to the above voice information one by one. Match each final angle value, so that when the sound source information matches a target angle value among each final angle value, confirm that the target angle value corresponds to the broadcast signal source among each broadcast signal source, that is, The sound source information matches the target signal source.

For example, in the application scenario shown in Figure 4, the main earphone of the TWS earphone worn by user A uses data fusion to obtain the results obtained by performing the above-mentioned steps S201 to S203 on the main earphone and/or the slave earphone. The broadcast signal source information L1_1, R1_1 of the second wearable device b (worn by user B), the broadcast signal source information L2_1, R2_1 of the second wearable device c (worn by user C), and the broadcast of the second wearable device d (worn by user D) The signal source information L3_1, R3_1 is aggregated to the main headset for angle calibration calculation to obtain the final angle between the TWS headset of user A and the second wearable device b, second wearable device c and second wearable device d respectively. Angle values: T1, T2 and T3. Then, the TWS headset worn by user A compares the azimuth and angle of the sound source relative to itself in the current indoor environment of user B, who has confirmed the sound source positioning operation based on the above voice information, with the T1, T2 and T3 respectively. Thus, the target angle value T1 that is consistent with the azimuth angle of the sound source is detected among T1, T2, and T3. Furthermore, the TWS headset worn by user A determines that the target angle value T1 corresponds to the third value in the above-mentioned broadcast signal source information. The broadcast signal source information of the second wearable device b is the target signal source that matches the azimuth angle of the sound source.

Further, in some feasible embodiments, in the above-mentioned step S30, "Create a communication link between the target wearable device corresponding to the target signal source, and conduct communication with the target wearable device through the communication link. "Interaction Control" steps may include:

Step S301: Establish a Bluetooth connection between the target wearable devices corresponding to the target signal sources in each of the second wearable devices;

Step S302: Create a communication link with the target wearable device through the Bluetooth connection;

Step S303: Output a preset voice prompt through the communication link to perform interactive control with the target wearable device.

In this embodiment, when the above-mentioned first wearable device determines that the above-mentioned sound source information matches the target signal source in each broadcast signal source information, it immediately matches the target signal source in each second wearable device corresponding to the target signal source. The wearable device performs a Bluetooth connection, and then further creates a Bluetooth communication link between itself and the target wearable device based on the Bluetooth connection, thereby further outputting voice prompts for the respective wearers of itself and the target wearable device through the communication link. This allows the wearer to perform interactive control based on a list of functions supported by both the wearer and the target wearable device.

For example, in the application scenario shown in Figure 5, after determining that the second wearable device b worn by user B is the target wearable device, the TWS headset worn by user A parses the support of the second wearable device b through its own main headset. The service type is to perform a Bluetooth connection with the second wearable device b. After that, the TWS headset further creates a LE Audio link (lower power consumption in Bluetooth 5.2 technology) with the second wearable device based on the Bluetooth connection. The communication link adopts the new LC3 encoding, which can transmit multiple streaming audio and supports broadcast function). Furthermore, the TWS headset worn by user A can play the supported function list (such as synchronized equalizer parameters, etc.) through the LE audio link with the second wearable device b worn by user B, and user A can directly use the TWS headset through voice. The voice prompts output in the form of broadcast perform corresponding functional interaction. Among them, the second wearable device b worn by user B transmits a voice prompt including the functional information of the second wearable device b to the TWS headset through the LE audio link, and the TWS headset outputs it to user A through voice broadcast. At the same time, Therefore, user B can also perform corresponding functional interaction according to the voice prompt output by the second wearable device b through voice broadcast.

In this way, in this embodiment, in an environment where multiple wearable devices exist at the same time, each wearable device serves as the first wearable device to collect voice information in the current environment, and detects whether the voice information is recognized in the collected voice information. The preset wake-up voice is used, so that when the wake-up voice is recognized from the voice information, the sound source positioning operation is immediately performed on the voice information to obtain the sound source information of the voice information in the current environment. Afterwards, the first wearable device further performs a broadcast signal source positioning operation on all second wearable devices that broadcast Bluetooth signals in the current environment to identify the broadcast signal source information of each second wearable device. Finally, the first wearable device matches the sound source information corresponding to the above-mentioned voice information with the broadcast signal source information one by one, so that when the sound source information matches a target signal source among the broadcast signal source information, The first wearable device immediately connects with the target wearable device corresponding to the target signal source among the second wearable devices, and creates a communication link with the target wearable device, so as to further communicate with the target wearable device through the communication link. Interactive control between the target wearable devices.

Therefore, compared with the traditional way for users to add and control wearable devices through remote controls or mobile apps, the present invention wakes up the first wearable device through voice to trigger connection preparation, and then performs sound source positioning operations to find the source of the voice. The user's position, and perform broadcast signal source positioning to search for the positions of other second wearable devices, and directly connect to the target wearable device that matches the position, and create a communication link for interactive control between the two devices, thereby, It enables users to quickly and flexibly connect and interactively control different wearable devices through voice, greatly simplifying user operations and effectively improving the efficiency and experience of users interacting with wearable devices. .

In addition, an embodiment of the present invention also provides a control device for a wearable device. The control device for a wearable device of the present invention is applied to a first wearable device. Please refer to Figure 6. Figure 6 is a functional module schematic diagram of an embodiment of the control device of the wearable device of the present invention. As shown in Figure 6, the control device of the wearable device of the present invention includes:

The sound source positioning module 10 is used to perform sound source positioning on the voice information to obtain the sound source information of the voice information when the preset wake-up voice is recognized from the voice information collected from the environment;

The broadcast positioning module 20 is used to locate the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device;

The connection control module 30 is configured to create a communication link between target wearable devices corresponding to the target signal source if the sound source information matches the target signal source information in each of the broadcast signal source information, And perform interactive control with the target wearable device through the communication link.

Sound source localization module 10 includes:

An acquisition unit configured to acquire the arrival time difference of the voice information through the array microphone;

A first calculation unit configured to perform calculations based on the arrival time difference to determine the sound source azimuth angle of the voice information.

Broadcast positioning module 20 includes:

A signal scanning unit configured to receive broadcast signals from each of the second wearable devices through the array antenna;

A second calculation unit, configured to calculate the phase difference of each broadcast signal sequentially based on different array elements in the array antenna;

A third calculation unit configured to call a preset signal angle estimation algorithm to perform calculations based on each of the phase differences to determine the broadcast signal azimuth angle of each of the second wearable devices.

Optionally, the connection control module 30 includes:

A connection unit configured to establish a Bluetooth connection between the target wearable devices corresponding to the target signal sources in each of the second wearable devices;

A link creation unit, configured to create a communication link with the target wearable device through the Bluetooth connection;

An interactive control unit, configured to output preset voice prompts through the communication link to perform interactive control with the target wearable device.

Optionally, the control device of the wearable device of the present invention also includes:

A wake-up setting module, configured to set the preset wake-up voice based on the unique identification of the first wearable device, wherein the unique identification includes at least one of a Bluetooth name, a device name, and a custom name.

Optionally, the wake-up setting module is also configured to collect the voice information in the environment and detect that the unique identifier exists in the text information corresponding to the voice information, determine that the voice information is recognized from the voice information. The wake-up voice.

The control device of the wearable device of the present invention also includes:

A signal source angle calibration module, configured to summarize each of the broadcast signal source information to the main device for calibration processing to obtain the final angle value of each of the second wearable devices, wherein each of the broadcast signal source information is obtained by the The master device and/or the slave device perform positioning of the broadcast signal source;

A detection module, configured to detect whether there is a target angle value consistent with the sound source information in each of the final angle values;

An angle matching confirmation module is configured to determine the broadcast signal source information corresponding to the target angle value as the target signal source information that matches the sound source information if the detection module detects that the target angle value exists.

The specific embodiments of each functional module of the control device of the wearable device of the present invention when running are basically the same as the above embodiments of the control program method of the wearable device of the present invention, and will not be described again here.

The present invention also provides a computer storage medium, which stores a control program for a wearable device. When the control program for the wearable device is executed by a processor, the control program as described in any of the above embodiments can be implemented. Steps of the control program method for wearable devices.

The specific embodiments of the computer storage medium of the present invention are basically the same as the above-mentioned embodiments of the control program method for the wearable device of the present invention, and will not be described again here.

The present invention also provides a computer program product. The computer program product includes a computer program. When the computer program is executed by a processor, the steps of the control method of the wearable device of the present invention as described in any of the above embodiments are implemented. , will not be described in detail here.

It should be noted that, as used herein, the terms "include", "comprising" or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or system that includes a list of elements not only includes those elements, but It also includes other elements not expressly listed or that are inherent to the process, method, article or system. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

The above serial numbers of the embodiments of the present invention are only for description and do not represent the advantages and disadvantages of the embodiments.

Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better. implementation. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product that is essentially or contributes to the existing technology. The computer software product is stored in a storage medium (such as ROM/RAM) as mentioned above. , magnetic disk, optical disk), including several instructions to cause a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the method described in various embodiments of the present invention.

The above are only preferred embodiments of the present invention, and do not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the description and drawings of the present invention may be directly or indirectly used in other related technical fields. , are all similarly included in the scope of patent protection of the present invention.

Claims

A method for controlling a wearable device, characterized in that the wearable device is applied to a first wearable device, and the method for controlling a wearable device includes:

When the preset wake-up voice is recognized from the voice information collected from the environment, performing sound source positioning on the voice information to obtain the sound source information of the voice information;

Perform broadcast signal source positioning on each second wearable device in the environment to obtain broadcast signal source information of each second wearable device;

If the sound source information matches the target signal source information in each of the broadcast signal source information, a communication link between the target wearable devices corresponding to the target signal source is created, and the communication link is Perform interactive control with the target wearable device.
The control method of a wearable device according to claim 1, wherein the first wearable device is configured with an array microphone, and the sound source information includes: sound source azimuth angle;

The step of performing sound source localization on the voice information to obtain the sound source information of the voice information includes:

Obtain the arrival time difference of the voice information through the array microphone;

Calculation is performed based on the arrival time difference to determine the sound source azimuth angle of the speech information.
The control method of a wearable device according to claim 1, wherein the first wearable device is configured with an array antenna, and the broadcast signal source information includes: broadcast signal azimuth angle;

The step of locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device includes:

Receive broadcast signals from each of the second wearable devices through the array antenna;

Calculate the phase difference of each broadcast signal in sequence based on different array elements in the array antenna;

A preset signal angle estimation algorithm is called to perform calculations based on each of the phase differences to determine the broadcast signal azimuth angle of each of the second wearable devices.
The method for controlling a wearable device according to claim 1, wherein the step is to create a communication link between target wearable devices corresponding to the target signal source, and to communicate with the wearable device through the communication link. Describe the steps of interactive control between target wearable devices, including:

Establish a Bluetooth connection between the target wearable devices corresponding to the target signal source in each of the second wearable devices;

Create a communication link with the target wearable device through the Bluetooth connection;

Preset voice prompts are output through the communication link for interactive control with the target wearable device.
The control method of a wearable device according to claim 1, characterized in that, when the preset wake-up voice is recognized from the voice information collected from the environment, sound source positioning is performed on the voice information. Before obtaining the sound source information of the speech information, the method further includes:

The preset wake-up voice is set based on the unique identification of the first wearable device, where the unique identification includes at least one of a Bluetooth name, a device name, and a custom name.
The method for controlling a wearable device according to claim 5, wherein the method further includes:

When the voice information is collected in the environment and the unique identifier is detected in the text information corresponding to the voice information, it is determined that the wake-up voice is recognized from the voice information.
The method of controlling a wearable device according to claim 1, wherein the first wearable device includes: a master device and a slave device;

After the step of locating the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device, the method further includes:

Each of the broadcast signal source information is summarized to the master device for calibration processing to obtain the final angle value of each of the second wearable devices, wherein each of the broadcast signal source information is obtained by the master device and/or the slave device. The equipment performs positioning of the broadcast signal source;

Detect whether there is a target angle value consistent with the sound source information in each of the final angle values;

If it exists, the broadcast signal source information corresponding to the target angle value is determined as the target signal source information that matches the sound source information.
A control device for a wearable device, characterized in that the control device for a wearable device is applied to a first wearable device, and the control device for a wearable device includes:

A sound source positioning module, used to perform sound source positioning on the voice information to obtain the sound source information of the voice information when the preset wake-up voice is recognized from the voice information collected from the environment;

A broadcast positioning module is used to locate the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device;

A connection control module configured to create a communication link between target wearable devices corresponding to the target signal source if the sound source information matches the target signal source information in each of the broadcast signal source information, and Interactive control with the target wearable device is performed through the communication link.
A terminal device, characterized in that the terminal device includes: a memory, a processor, and a control program of a wearable device stored on the memory and capable of running on the processor, and the wearable device When the control program is executed by the processor, the steps of the control method for a wearable device according to any one of claims 1 to 7 are implemented.
A computer-readable storage medium, characterized in that a control program for a wearable device is stored on the computer-readable storage medium, and when the control program for the wearable device is executed by a processor, the implementation of claims 1 to 1 The steps of the control method for a wearable device according to any one of 7.