CN114999489A - Wearable device control method and apparatus, terminal device and storage medium - Google Patents
Wearable device control method and apparatus, terminal device and storage medium Download PDFInfo
- Publication number
- CN114999489A CN114999489A CN202210744564.0A CN202210744564A CN114999489A CN 114999489 A CN114999489 A CN 114999489A CN 202210744564 A CN202210744564 A CN 202210744564A CN 114999489 A CN114999489 A CN 114999489A
- Authority
- CN
- China
- Prior art keywords
- wearable device
- information
- voice
- broadcast signal
- signal source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 238000004891 communication Methods 0.000 claims abstract description 45
- 230000003993 interaction Effects 0.000 claims abstract description 19
- 230000002452 interceptive effect Effects 0.000 claims abstract description 15
- 230000004807 localization Effects 0.000 claims description 13
- 238000004422 calculation algorithm Methods 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 5
- 238000004590 computer program Methods 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000002360 preparation method Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
- G01S5/18—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using ultrasonic, sonic, or infrasonic waves
- G01S5/22—Position of source determined by co-ordinating a plurality of position lines defined by path-difference measurements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
- H04W76/14—Direct-mode setup
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Selective Calling Equipment (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention discloses a control method and a control device of wearable equipment, terminal equipment and a computer readable storage medium, wherein when a preset awakening voice is identified from voice information collected from the environment, the voice information is subjected to sound source positioning through first wearable equipment to obtain sound source information of the voice information; positioning a broadcast signal source of each second wearable device in the environment to obtain broadcast signal source information of each second wearable device; and if the sound source information is matched with the target signal source information in each broadcast signal source information, establishing a communication link between the target wearable devices corresponding to the target signal source, and performing interactive control between the target wearable devices through the communication link. By adopting the technical scheme of the invention, the quick and flexible connection and control between different wearable devices can be realized in a voice mode, so that the interaction efficiency of a user using the wearable device is improved.
Description
Technical Field
The invention belongs to the technical field of intelligent wearable devices, and particularly relates to a wearable device control method and device, a terminal device and a computer readable storage medium.
Background
In the meantime, intelligent wearable devices are increasingly widespread in the market.
The connection of intelligence wearing formula equipment is the essential key step of carrying on between the various equipment mutual and control. However, to realize the interconnection with the smart wearable device, the user is usually required to connect the wearable device with other wearable terminal devices through a conventional remote controller or a specific mobile phone App (Application program).
So, in case there are more wearing formula equipment in user's environment space, then the user just need use a plurality of remote controllers to control respectively or frequently carry out the interpolation and the control of a plurality of equipment through cell-phone App, this control process that has led to the user is loaded down with trivial details unusually and very big influence the user and used the interactive efficiency of wearable equipment.
Disclosure of Invention
The invention mainly aims to provide a control method and device of a wearable device, a terminal device and a computer readable storage medium. The aim is to realize quick and flexible connection and control between different wearable devices through a voice mode, so that the interaction efficiency of a user using the wearable device is improved.
In order to achieve the above object, the present invention provides a method for controlling a wearable device, where the method for controlling a wearable device is applied to a first wearable device, and the method for controlling a wearable device includes:
when a preset awakening voice is recognized from voice information collected from the environment, carrying out sound source positioning on the voice information to obtain sound source information of the voice information;
positioning a broadcast signal source of each second wearable device in the environment to obtain broadcast signal source information of each second wearable device;
and if the sound source information is matched with target signal source information in each piece of broadcast signal source information, establishing a communication link between target wearable equipment corresponding to the target signal source, and performing interactive control between the communication link and the target wearable equipment.
Optionally, the first wearable device is configured with an array microphone, and the sound source information includes: a sound source azimuth angle;
the step of obtaining the sound source information of the voice information by performing sound source localization on the voice information includes:
acquiring the arrival time difference of the voice information through the array microphone;
performing a calculation based on the time difference of arrival to determine the sound source bearing angle of the voice information.
Optionally, the first wearable device is configured with an array antenna, and the broadcast signal source information includes: a broadcast signal bearing angle;
the step of positioning the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device comprises:
receiving a broadcast signal of each second wearable device through the array antenna;
sequentially calculating the phase difference of each broadcast signal based on different array elements in the array antenna;
and calling a preset signal angle estimation algorithm to calculate based on the phase differences so as to determine the broadcast signal azimuth angle of the second wearable device.
Optionally, the step of creating a communication link between target wearable devices corresponding to the target signal source, and performing interaction control between the target wearable devices through the communication link includes:
establishing Bluetooth connection between target wearable devices corresponding to the target signal sources in the second wearable devices;
establishing a communication link with the target wearable device through the Bluetooth connection;
and outputting a preset voice prompt through the communication link so as to carry out interactive control with the target wearable device.
Optionally, before the step of performing sound source localization on the voice information to obtain sound source information of the voice information when a preset wake-up voice is recognized from the voice information collected from the environment, the method further includes:
and setting the preset awakening voice based on the unique identifier of the first wearable device, wherein the unique identifier comprises at least one of a Bluetooth name, a device name and a user-defined name.
Optionally, the method further comprises:
and when the voice information is collected in the environment and the unique identifier is detected to exist in the text information corresponding to the voice information, determining that the awakening voice is identified from the voice information.
Optionally, the first wearable device comprises: a master device and a slave device;
after the step of performing broadcast signal source positioning on each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device, the method further includes:
summarizing the information of each broadcast signal source to the main equipment to carry out calibration processing to obtain a final angle value of each second wearable equipment, wherein the information of each broadcast signal source is obtained by the main equipment and/or the slave equipment positioning the broadcast signal source;
detecting whether a target angle value matched with the sound source information exists in each final angle value;
and if so, determining the broadcast signal source information corresponding to the target angle value as the target signal source information matched with the sound source information.
Further, to achieve the above object, the present invention also provides a control apparatus of a wearable device applied to a first wearable device, the control apparatus of the wearable device including:
the voice source positioning module is used for carrying out voice source positioning on the voice information to obtain the voice source information of the voice information when a preset awakening voice is identified from the voice information collected from the environment;
the broadcast positioning module is used for positioning a broadcast signal source of each second wearable device in the environment to obtain broadcast signal source information of each second wearable device;
and the connection control module is used for establishing a communication link between target wearable equipment corresponding to the target signal source if the sound source information is matched with target signal source information in each piece of broadcast signal source information, and performing interactive control between the communication link and the target wearable equipment.
Each functional module of the control device of the wearable device of the present invention realizes the steps of the control method for monitoring the motion of the wireless headset as described above when operating.
In addition, to achieve the above object, the present invention also provides a terminal device, including: the control program of the wearable device is stored in the memory and can run on the processor, and when being executed by the processor, the control program of the motion monitoring of the wireless headset realizes the steps of the control method of the motion monitoring motion of the wireless headset.
Further, to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a control program of a wearable device, which when executed by a processor, realizes the steps of the control method of the wearable device as described above.
According to the control method and device of the wearable device, the terminal device and the computer readable storage medium provided by the embodiment of the invention, when the preset awakening voice is identified from the voice information collected from the environment, the first wearable device carries out sound source positioning on the voice information to obtain the sound source information of the voice information; positioning a broadcast signal source of each second wearable device in the environment to obtain broadcast signal source information of each second wearable device; therefore, if the sound source information is matched with target signal source information in each piece of broadcast signal source information, a communication link between target wearable devices corresponding to the target signal source is established, and interaction control between the target wearable devices is carried out through the communication link.
Therefore, compared with the traditional mode that a user adds and controls wearable equipment through a remote controller or a mobile phone App, the method and the system wake up the first wearable equipment through voice to trigger connection preparation, then carry out sound source positioning operation to search the position of the user sending voice, carry out broadcast signal source positioning search on the positions of other second wearable equipment, directly connect with target wearable equipment matched and matched with the positions, and establish a communication link to carry out interactive control between the two equipment, thereby realizing that the user carries out quick and flexible connection and interactive control between different wearable equipment through a voice mode, simplifying the operation of the user to the greatest extent, and effectively improving the efficiency and experience of the user in using the wearable equipment to carry out interaction.
Drawings
Fig. 1 is a schematic device structure diagram of a hardware operating environment of a terminal device according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a control method of a wearable device according to a first embodiment of the present invention;
fig. 3 is a schematic diagram illustrating a principle of positioning a broadcast signal source according to an embodiment of the control method of the wearable device of the present invention;
fig. 4 is a schematic view of an application scenario for performing orientation identification of a wearable device according to an embodiment of a control method for a wearable device of the present invention;
fig. 5 is a schematic view of an application scene of voice interaction with a wearable device according to an embodiment of a control method of a wearable device of the present invention;
fig. 6 is a schematic diagram of functional modules of a control apparatus of a wearable device according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a schematic device structure diagram of a terminal device hardware operating environment according to an embodiment of the present invention.
The terminal device in the embodiment of the present invention may be wearable devices such as a bracelet, a watch, glasses, a headset, a TWS (True Wireless Stereo) headset, and the like, and the wearable devices are equipped with an array microphone and an array antenna.
As shown in fig. 1, the terminal device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., a Wi-Fi interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the terminal device configuration shown in fig. 1 is not intended to be limiting of the terminal device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, the memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a control program of the wearable device.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client and performing data communication with the client; and the processor 1001 may be configured to call the control program of the wearable device stored in the memory 1005 to implement various embodiments of the control method of the wearable device of the present invention.
Based on the terminal device, embodiments of the control method of the wearable device according to the present invention are provided. In each embodiment of the motion monitoring method of the wireless headset, the control method of the wearable device is applied to a process of monitoring the motion of a headset wearer based on the wireless headset.
Referring to fig. 2, fig. 2 is a flowchart illustrating a control method of a wearable device according to a first embodiment of the present invention. In a first embodiment of the control method of the wearable device of the present invention, the control method of the wearable device of the present invention is applied to a first wearable device in an environment where a plurality of wearable devices exist simultaneously, and the control method of the wearable device of the present invention includes:
step S10: when a preset awakening voice is identified from voice information collected from the environment, carrying out sound source positioning on the voice information to obtain sound source information of the voice information;
in this embodiment, in the environment that has a plurality of wearing equipment simultaneously, each wearing equipment all carries out speech information collection as first wearing equipment in current environment to whether detect this speech information who gathers in the middle of discerning preset awakening voice, thereby when discerning this awakening voice in this speech information, immediately carry out the sound source location operation to this speech information in order to obtain the sound source information of this speech information in current environment.
For example, as shown in the schematic application scenario diagram shown in fig. 4, in this embodiment, it is assumed that A, B, C, D four users wear smart wearable devices indoors, and the smart wearable device worn by user a is specifically a TWS headset, when the user B needs to interact with the TWS headset connection worn by the user a through the headset worn by the user B, the user B sends out the voice message "connect with user a", thus, the TWS headset worn by the user A is used as the first wearing device to collect voice information in the current indoor environment, and recognizes the awakening voice of the user A from the voice information sent by the user B to confirm the awakening success, and immediately starts sound feature synchronization of the collected voice information of the respective microphones of the left and right earphones to perform TDOA (time difference for location) sound source recognition operation to obtain the sound source information of the voice information uttered by the user B.
In addition, in some possible embodiments, before step S10, the method for controlling a wearable device according to the present invention may further include:
step A: and setting the preset awakening voice based on the unique identifier of the first wearable device, wherein the unique identifier comprises at least one of a Bluetooth name, a device name and a user-defined name.
In this embodiment, the first wearable device may perform voice interaction with the user to identify its own unique identifier during the startup operation process: the Bluetooth name, the equipment name and/or the custom name are set as awakening voice for awakening the wearable equipment to be connected and interacted with other wearable equipment.
In addition, the first wearable device can be set by the user through the associated mobile phone App to confirm that the bluetooth name, the device name and/or the user-defined name are set as the awakening voice for awakening the first wearable device to perform connection interaction with other wearable devices.
It should be understood that, based on different design requirements of practical applications, in different possible embodiments, the bluetooth name, the device name, and the user-defined name of the wearable device itself may be different, and based on this, the control method of the wearable device of the present invention is not limited to the specific content of the bluetooth name, the device name, and/or the user-defined name of the wearable device itself, as long as each of the names can be used as a unique identifier of the wearable device for the wearable device to determine that the wearable device is awakened.
Further, in some possible embodiments, the method for controlling a wearable device of the present invention further includes:
and B: and when the voice information is collected in the environment and the unique identifier is detected to exist in the text information corresponding to the voice information, determining that the awakening voice is identified from the voice information.
In this embodiment, after the first wearable device collects the voice information sent by the wearer of another wearable device from the current environment, immediately perform voice content recognition on the voice information to obtain text information corresponding to the voice information, so as to detect whether there is a unique identifier corresponding to the text information: and text contents with the same Bluetooth name, device name and/or custom name are detected, the unique identifier is determined to exist in the text information corresponding to the voice information when the unique identifier exists, and the awakening voice for awakening the device to perform connection interaction with other devices is further determined to be recognized from the voice information at present.
In some possible embodiments, the first wearable device is configured with an array microphone, and the sound source information of the voice information obtained by the first wearable device performing a sound source localization operation on the collected voice information includes: the azimuth angle of the sound source.
The step of "performing sound source localization on the voice information to obtain the sound source information of the voice information" in the step S10 may include:
step S101: acquiring the arrival time difference of the voice information through the array microphone;
in this embodiment, the first wearable device operates to obtain the sound source information of the voice information based on the TDOA sound source recognition immediately after determining that the wake-up voice is recognized from the collected voice information. That is, the first wearable device performs sound feature synchronization on the collected voice information through the array microphone configured by the first wearable device, so as to determine the arrival time difference between any two microphones in the array microphone from which the voice information arrives.
Step S102: performing a calculation based on the time difference of arrival to determine the sound source bearing angle of the speech information.
In this embodiment, after determining a time difference between arrival times of the voice information at any two microphones of the array microphones configured by the first wearable device, the first wearable device calculates a distance difference by combining a speed of the voice information propagating in the air and the time difference, and further calculates a sound source azimuth angle of a sound source of the voice information relative to the first wearable device in the current environment.
In addition, as a possible implementation manner, the first wearable device may further perform a sound source localization operation on the collected voice information to identify a sound source azimuth angle at which the voice information is obtained, based on the beam forming and the high-resolution spectrum estimation.
Step S20: positioning a broadcast signal source of each second wearable device in the environment to obtain broadcast signal source information of each second wearable device;
in this embodiment, after the first wearable device performs the sound source localization operation on the collected voice information to identify the sound source information of the voice information, the first wearable device further performs the broadcast signal source localization operation on all the second wearable devices performing bluetooth signal broadcasting in the current environment, so as to identify and obtain the broadcast signal source information of each second wearable device.
For example, as an application scenario shown in fig. 4, it is assumed that A, B, C, D four users are wearing smart wearable devices indoors, the smart wearable device worn by user a is specifically a TWS headset, and each of the smart wearable devices broadcasts a bluetooth signal in a current indoor environment. Therefore, the user B needs to perform connection interaction with the TWS headset worn by the user A through the headset worn by the user B, and the user B sends out voice information of connection with the user A, so that the TWS headset worn by the user A is used as first wearing equipment to perform voice information collection in the current indoor environment, and sound source positioning operation of the voice information of connection with the user A is performed to confirm the position angle of the sound source of the user B relative to the user B in the current indoor environment.
In addition, while or after the TWS headset worn by the user a starts the sound source localization operation on the voice information connected to the user a, "the smart wearable devices worn by the B, C and the D users are all used as second wearable devices, and the broadcast signal source localization operation is started on the bluetooth signals broadcast by the second wearable devices, so as to obtain the broadcast signal source information of the second wearable devices. That is, the TWS headset worn by the user a is used as the first wearable device to scan the respective radio frequency information of the second wearable device B worn by the user B, the second wearable device C worn by the user C, and the second wearable device D worn by the user D through the left and right headsets and calculate the angle of each radio frequency information, then the TWS headset gathers the calculated angle into the main headset to perform position averaging and calibration, and the broadcast signal source information of the second wearable device B is obtained as follows: l1_1, R1_1, broadcast signal source information of the second wearable device c: l2_1, R2_1, the broadcast signal source information of the second wearable device d is: l3_1, R3_ 1.
In addition, in some possible embodiments, the first wearable device is configured with an array antenna, and the first wearable device performs a broadcast signal source positioning operation on each of the second wearable devices, where the obtained broadcast signal source information of each of the second wearable devices includes: broadcast signal bearing angle.
The above step S20: the positioning of the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device may include:
step S201: receiving a broadcast signal of each second wearable device through the array antenna;
step S202: sequentially calculating the phase difference of each broadcast signal based on different array elements in the array antenna;
step S203: and calling a preset signal angle estimation algorithm to calculate based on the phase differences so as to determine the broadcast signal azimuth angle of the second wearable device.
It should be noted that, in this embodiment, the preset signal angle estimation algorithm is an algorithm for calculating an azimuth angle between a signal emission source and a device where the array antenna is located based on the phase difference and the signal wavelength, and for example, the signal angle estimation algorithm may specifically be:
wherein, θ is the azimuth angle, λ is the wavelength of the broadcast signal, Δ Φ is the phase difference, and d is the relative distance of two array elements in the array antenna.
In this embodiment, as shown in fig. 3, according to the principle of positioning the broadcast signal source, the first wearable device scans the broadcast signals output by the second wearable devices in a radio frequency manner through its own configured array antenna. Therefore, the first wearable device can perform IQ sampling through the array antenna to determine the phase difference generated by different distances from the broadcast signals of the second wearable devices to any two array elements in the array antenna. Finally, the first wearable device further calculates the broadcast signal azimuth angle of each second wearable device through the signal angle estimation algorithm.
Step S30: and if the sound source information is matched with target signal source information in each piece of broadcast signal source information, establishing a communication link between target wearable equipment corresponding to the target signal source, and performing interactive control between the communication link and the target wearable equipment.
In this embodiment, after the first wearable device further performs a broadcast signal source positioning operation on each second wearable device to identify and obtain broadcast signal source information of each second wearable device relative to itself, the first wearable device matches the sound source information corresponding to the voice information with the broadcast signal source information one by one, so that when the sound source information matches a certain target signal source in the broadcast signal source information, the first wearable device is immediately connected with a target wearable device corresponding to the target signal source in each second wearable device, and a communication link with the target wearable device is created, thereby further performing interaction control with the target wearable device through the communication link.
In some possible embodiments, the first wearable device includes: a master device and a slave device; based on this, in step S20: after positioning the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device, the control method of the wearable device of the present invention may further include:
and C: summarizing the information of each broadcast signal source to the main equipment to carry out calibration processing to obtain a final angle value of each second wearable equipment, wherein the information of each broadcast signal source is obtained by the main equipment and/or the slave equipment positioning the broadcast signal source;
step D: detecting whether a target angle value matched with the sound source information exists in the final angle values or not;
step E: and if so, determining the broadcast signal source information corresponding to the target angle value as the target signal source information matched with the sound source information.
In this embodiment, the first wearable device performs a broadcast signal source positioning operation on each second wearable device through the master device and/or the slave device to identify and obtain broadcast signal source information of each second wearable device relative to itself, and further collects the broadcast signal source information to the master device to perform a calibration process, so as to obtain a final angle value of each second wearable device, and then the first wearable device matches the sound source information corresponding to the voice information with each final angle value one by one, so that when the sound source information matches any one of the final angle values, it determines a broadcast signal source corresponding to the target angle value in each broadcast signal source, that is, a target signal source matched with the sound source information.
For example, as shown in the application scenario shown in fig. 4, the primary earpiece of the TWS earpiece worn by the user a performs data fusion on the primary earpiece and/or the secondary earpiece to obtain the broadcast signal source information L1_1, R1_1 of the second wearable device B (worn by the user B), the broadcast signal source information L2_1, R2_1 of the second wearable device C (worn by the user C), and the broadcast signal source information L3_1, R3_1 of the second wearable device D (worn by the user D), which are obtained by performing the processes shown in the above steps S201 to S203, and all are collected on the primary earpiece to perform angle calibration calculation to obtain final angle values between the TWS earpiece of the user a and each of the second wearable device B, the second wearable device C, and the second wearable device D: t1, T2 and T3. Then, the TWS headset worn by the user a compares the sound source azimuth angle of the user B, which performs sound source localization operation confirmation on the voice information, with the T1, T2, and T3 in the current indoor environment, respectively, so as to detect that the target angle value matching the sound source azimuth angle in the T1, T2, and T3 is T1, and further, the TWS headset worn by the user a determines that the broadcast signal source information of the second wearable device B corresponding to the target angle value T1 in the broadcast signal source information is the target signal source matching the sound source azimuth angle.
Further, in some possible embodiments, the step of "creating a communication link between the target wearable devices corresponding to the target signal source and performing interaction control with the target wearable devices through the communication link" in the step S30 may include:
step S301: establishing Bluetooth connection between target wearable devices corresponding to the target signal sources in the second wearable devices;
step S302: establishing a communication link between the target wearable device and the target wearable device through the Bluetooth connection;
step S303: and outputting a preset voice prompt through the communication link so as to carry out interactive control with the target wearable device.
In this embodiment, when it is determined that the sound source information matches a target signal source in each piece of broadcast signal source information, the first wearable device immediately performs bluetooth connection with a target wearable device corresponding to the target signal source in each piece of second wearable device, and then further creates a bluetooth communication link between itself and the target wearable device based on the bluetooth connection, so as to further output a voice prompt for each wearer of itself and the target wearable device through the communication link, so that the wearer performs interactive control based on a function list supported by itself and the target wearable device.
For example, as shown in the application scenario of fig. 5, after determining that the second wearable device B worn by the user B is the target wearable device, the TWS headset worn by the user a parses the service type supported by the second wearable device B through its own primary headset to perform a bluetooth connection with the second wearable device B, and then the TWS headset further creates an LE Audio link with the second wearable device based on the bluetooth connection (a communication link with lower power consumption in bluetooth 5.2 technology, using a brand new LC3 code, capable of transmitting multiple streaming Audio and supporting a broadcast function). Furthermore, the TWS headset worn by the user a and the second wearable device B worn by the user B can play the supported function list (such as synchronous equalizer parameters) through the LE audio link, and the user a can directly perform corresponding function interaction according to the voice prompt output by the TWS headset in a voice broadcast manner. The second wearable device B worn by the user B transmits the voice prompt including the function information of the second wearable device B to the TWS earphone through the LE audio link, and the TWS earphone outputs the voice prompt to the user A in a voice broadcasting mode.
Therefore, in the embodiment, in an environment where a plurality of wearing devices exist simultaneously, each wearing device is used as a first wearing device to collect voice information in the current environment, and whether a preset awakening voice is recognized in the collected voice information is detected, so that when the awakening voice is recognized from the voice information, the voice information is immediately subjected to a sound source positioning operation to obtain the sound source information of the voice information in the current environment. And then, the first wearable device further performs broadcast signal source positioning operation on all second wearable devices which perform Bluetooth signal broadcasting in the current environment so as to identify and obtain respective broadcast signal source information of the second wearable devices. Finally, the first wearable device matches the sound source information corresponding to the voice information with the broadcast signal source information one by one, so that when the sound source information is matched with a certain target signal source in the broadcast signal source information, the first wearable device is immediately connected with the target wearable device corresponding to the target signal source in the second wearable device, and a communication link between the first wearable device and the target wearable device is established, and interaction control between the first wearable device and the target wearable device is further performed through the communication link.
Therefore, compared with the traditional mode that a user adds and controls wearable equipment through a remote controller or a mobile phone App, the method and the system wake up the first wearable equipment through voice to trigger connection preparation, then carry out sound source positioning operation to search the position of the user sending voice, carry out broadcast signal source positioning search on the positions of other second wearable equipment, directly connect with target wearable equipment matched and matched with the positions, and establish a communication link to carry out interactive control between the two equipment, thereby realizing that the user carries out quick and flexible connection and interactive control between different wearable equipment through a voice mode, simplifying the operation of the user to the greatest extent, and effectively improving the efficiency and experience of the user in using the wearable equipment for interaction. .
In addition, the embodiment of the invention also provides a control device of the wearable device, and the control device of the wearable device is applied to the first wearable device. Referring to fig. 6, fig. 6 is a schematic diagram of functional modules of a control apparatus of a wearable device according to an embodiment of the present invention, as shown in fig. 6, the control apparatus of the wearable device of the present invention includes:
the sound source positioning module 10 is configured to, when a preset wake-up voice is recognized from voice information collected from an environment, perform sound source positioning on the voice information to obtain sound source information of the voice information;
the broadcast positioning module 20 is configured to perform broadcast signal source positioning on each second wearable device in the environment to obtain broadcast signal source information of each second wearable device;
and the connection control module 30 is configured to create a communication link between target wearable devices corresponding to the target signal source if the sound source information matches target signal source information in each piece of broadcast signal source information, and perform interaction control between the target wearable devices through the communication link.
Optionally, the first wearable device is configured with an array microphone, and the sound source information includes: a sound source azimuth angle;
sound source localization module 10, comprising:
an acquisition unit configured to acquire a time difference of arrival of the voice information by the array microphone;
a first calculation unit configured to perform calculation based on the time difference of arrival to determine the sound source bearing angle of the voice information.
Optionally, the first wearable device is configured with an array antenna, and the broadcast signal source information includes: a broadcast signal bearing angle;
a broadcast positioning module 20 comprising:
the signal scanning unit is used for receiving the broadcast signals of the second wearable devices through the array antenna;
the second calculating unit is used for sequentially calculating the phase difference of each broadcast signal based on different array elements in the array antenna;
and the third calculating unit is used for calling a preset signal angle estimation algorithm to calculate based on the phase differences so as to determine the broadcast signal azimuth angle of each second wearable device.
Optionally, the connection control module 30 includes:
the connecting unit is used for establishing Bluetooth connection between target wearing equipment corresponding to the target signal source in each second wearing equipment;
the link establishing unit is used for establishing a communication link with the target wearable device through the Bluetooth connection;
and the interaction control unit is used for outputting a preset voice prompt through the communication link so as to carry out interaction control with the target wearable device.
Optionally, the control apparatus of the wearable device of the present invention further includes:
and the awakening setting module is used for setting the preset awakening voice based on the unique identifier of the first wearable device, wherein the unique identifier comprises at least one of a Bluetooth name, a device name and a user-defined name.
Optionally, the wake-up setting module is further configured to collect the voice information in the environment and determine that the wake-up voice is recognized from the voice information when the unique identifier is detected to exist in the text information corresponding to the voice information.
Optionally, the first wearable device comprises: a master device and a slave device;
the control device of the wearable device of the present invention further includes:
the signal source angle calibration module is used for summarizing the information of each broadcast signal source to the main equipment to perform calibration processing to obtain a final angle value of each second wearable equipment, wherein the information of each broadcast signal source is obtained by the main equipment and/or the slave equipment performing the positioning of the broadcast signal source;
the detection module is used for detecting whether a target angle value matched with the sound source information exists in each final angle value or not;
and the angle matching confirmation module is used for determining the broadcast signal source information corresponding to the target angle value as the target signal source information matched with the sound source information if the detection module detects that the target angle value exists.
The specific embodiment of the control apparatus of the wearable device in the present invention when operating is basically the same as the embodiments of the control program method of the wearable device in the present invention, and details are not described here.
The present invention also provides a computer storage medium having a control program of a wearable device stored thereon, where the control program of the wearable device implements the steps of the control program method of the wearable device according to any one of the above embodiments when executed by a processor.
The specific embodiment of the computer storage medium of the present invention is basically the same as the embodiments of the control program method of the wearable device of the present invention, and details are not described herein.
The present invention further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the control method of the wearable device according to any of the above embodiments are implemented, which are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the description of the foregoing embodiments, it is clear to those skilled in the art that the method of the foregoing embodiments may be implemented by software plus a necessary general hardware platform, and certainly may also be implemented by hardware, but in many cases, the former is a better implementation. Based on such understanding, the technical solutions of the present invention or portions thereof contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above and includes several instructions for enabling a terminal device (which may be a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A control method of a wearable device is applied to a first wearable device, and the control method of the wearable device includes:
when a preset awakening voice is recognized from voice information collected from the environment, carrying out sound source positioning on the voice information to obtain sound source information of the voice information;
positioning a broadcast signal source of each second wearable device in the environment to obtain broadcast signal source information of each second wearable device;
and if the sound source information is matched with target signal source information in each piece of broadcast signal source information, establishing a communication link between target wearable equipment corresponding to the target signal source, and performing interactive control between the target wearable equipment and the target wearable equipment through the communication link.
2. The wearable device control method according to claim 1, wherein the first wearable device is configured with an array microphone, and wherein the sound source information includes: a sound source azimuth angle;
the step of obtaining the sound source information of the voice information by performing sound source localization on the voice information includes:
acquiring the arrival time difference of the voice information through the array microphone;
performing a calculation based on the time difference of arrival to determine the sound source bearing angle of the speech information.
3. The method according to claim 1, wherein the first wearable device is configured with an array antenna, and wherein the broadcast signal source information includes: a broadcast signal bearing angle;
the step of positioning the broadcast signal source of each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device includes:
receiving a broadcast signal of each second wearable device through the array antenna;
sequentially calculating the phase difference of each broadcast signal based on different array elements in the array antenna;
and calling a preset signal angle estimation algorithm to calculate based on the phase differences so as to determine the broadcast signal azimuth angle of the second wearable device.
4. The method according to claim 1, wherein the step of creating a communication link between target wearable devices corresponding to the target signal sources and performing interaction control with the target wearable devices through the communication link includes:
establishing Bluetooth connection between target wearable devices corresponding to the target signal sources in the second wearable devices;
establishing a communication link with the target wearable device through the Bluetooth connection;
and outputting a preset voice prompt through the communication link so as to carry out interactive control with the target wearable device.
5. The method according to claim 1, wherein before the step of performing sound source localization on the voice information to obtain sound source information of the voice information when a preset wake-up voice is recognized from the voice information collected from the environment, the method further comprises:
and setting the preset awakening voice based on the unique identifier of the first wearable device, wherein the unique identifier comprises at least one of a Bluetooth name, a device name and a user-defined name.
6. The method of controlling the wearable device according to claim 5, further comprising:
and when the voice information is collected in the environment and the unique identifier is detected to exist in the text information corresponding to the voice information, determining that the awakening voice is identified from the voice information.
7. The wearable device control method according to claim 1, wherein the first wearable device includes: a master device and a slave device;
after the step of performing broadcast signal source positioning on each second wearable device in the environment to obtain the broadcast signal source information of each second wearable device, the method further includes:
summarizing the information of each broadcast signal source to the main equipment to carry out calibration processing to obtain a final angle value of each second wearable equipment, wherein the information of each broadcast signal source is obtained by the main equipment and/or the slave equipment positioning the broadcast signal source;
detecting whether a target angle value matched with the sound source information exists in each final angle value;
and if so, determining the broadcast signal source information corresponding to the target angle value as the target signal source information matched with the sound source information.
8. A control apparatus of a wearable device, applied to a first wearable device, comprising:
the voice source positioning module is used for carrying out voice source positioning on the voice information to obtain the voice source information of the voice information when a preset awakening voice is identified from the voice information collected from the environment;
the broadcast positioning module is used for positioning a broadcast signal source of each second wearable device in the environment to obtain broadcast signal source information of each second wearable device;
and the connection control module is used for establishing a communication link between target wearable equipment corresponding to the target signal source if the sound source information is matched with target signal source information in each piece of broadcast signal source information, and performing interactive control between the communication link and the target wearable equipment.
9. A terminal device, characterized in that the terminal device comprises: a memory, a processor, and a control program of the wearable device stored on the memory and executable on the processor, the control program of the wearable device implementing the steps of the control method of the wearable device according to any one of claims 1 to 7 when executed by the processor.
10. A computer-readable storage medium characterized in that a control program of a wearable device is stored thereon, and when executed by a processor, the control program of the wearable device realizes the steps of the control method of the wearable device according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210744564.0A CN114999489A (en) | 2022-06-28 | 2022-06-28 | Wearable device control method and apparatus, terminal device and storage medium |
| PCT/CN2022/120506 WO2024000853A1 (en) | 2022-06-28 | 2022-09-22 | Wearable device control method and apparatus, terminal device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210744564.0A CN114999489A (en) | 2022-06-28 | 2022-06-28 | Wearable device control method and apparatus, terminal device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114999489A true CN114999489A (en) | 2022-09-02 |
Family
ID=83037740
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210744564.0A Pending CN114999489A (en) | 2022-06-28 | 2022-06-28 | Wearable device control method and apparatus, terminal device and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114999489A (en) |
| WO (1) | WO2024000853A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024000853A1 (en) * | 2022-06-28 | 2024-01-04 | 歌尔科技有限公司 | Wearable device control method and apparatus, terminal device, and storage medium |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10224019B2 (en) * | 2017-02-10 | 2019-03-05 | Audio Analytic Ltd. | Wearable audio device |
| CN107705785A (en) * | 2017-08-01 | 2018-02-16 | 百度在线网络技术（北京）有限公司 | Sound localization method, intelligent sound box and the computer-readable medium of intelligent sound box |
| CN110556103B (en) * | 2018-05-31 | 2023-05-30 | 阿里巴巴集团控股有限公司 | Audio signal processing method, device, system, equipment and storage medium |
| CN108831483A (en) * | 2018-09-07 | 2018-11-16 | 马鞍山问鼎网络科技有限公司 | A kind of artificial intelligent voice identifying system |
| CN110808886A (en) * | 2019-10-18 | 2020-02-18 | 珠海格力电器股份有限公司 | Voice equipment control method and device, storage medium and voice equipment |
| CN111698003B (en) * | 2020-05-27 | 2022-03-25 | 歌尔科技有限公司 | Multi-Bluetooth equipment interaction system, neck-wearing Bluetooth device and signal processing method |
| CN112543446B (en) * | 2020-12-02 | 2023-04-25 | 歌尔科技有限公司 | Interaction method based on near field communication, wearable device and storage medium |
| CN112887871B (en) * | 2021-01-04 | 2023-06-23 | 深圳千岸科技股份有限公司 | Headset voice playing method based on permission, headset and storage medium |
| CN114999489A (en) * | 2022-06-28 | 2022-09-02 | 歌尔科技有限公司 | Wearable device control method and apparatus, terminal device and storage medium |
-
2022
- 2022-06-28 CN CN202210744564.0A patent/CN114999489A/en active Pending
- 2022-09-22 WO PCT/CN2022/120506 patent/WO2024000853A1/en unknown
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024000853A1 (en) * | 2022-06-28 | 2024-01-04 | 歌尔科技有限公司 | Wearable device control method and apparatus, terminal device, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024000853A1 (en) | 2024-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170142538A1 (en) | Smart device grouping system, method and apparatus | |
| US20150358768A1 (en) | Intelligent device connection for wireless media in an ad hoc acoustic network | |
| CN111462746B (en) | TWS earphone-based control method, system, device and equipment | |
| EP2928212B1 (en) | A hearing instrument with a separate link | |
| CN109155130A (en) | Handle the voice from distributed microphone | |
| CN108922537B (en) | Audio recognition method, device, terminal, earphone and readable storage medium | |
| US20220109944A1 (en) | Multimedia information processing method and apparatus, and storage medium | |
| US10210739B2 (en) | Proximity-based control of media devices | |
| CN113015065B (en) | Connection method, device, equipment and computer storage medium | |
| CN112543446B (en) | Interaction method based on near field communication, wearable device and storage medium | |
| CN106506437B (en) | Audio data processing method and device | |
| CN106878915B (en) | Control method, device and the playback equipment and mobile terminal of playback equipment | |
| CN114999489A (en) | Wearable device control method and apparatus, terminal device and storage medium | |
| JP2022050516A (en) | Terminal, voice cooperation and reproduction system, and content display device | |
| JP2022514325A (en) | Source separation and related methods in auditory devices | |
| JP2016080894A (en) | Electronic apparatus, consumer electronics, control system, control method, and control program | |
| DK3149964T3 (en) | HEARING ASSISTANCE SYSTEM AND METHOD | |
| US10812916B2 (en) | Hearing instrument with a separate link | |
| KR20210097544A (en) | Method and electronic device for short-range wireless communication | |
| CN115278624A (en) | Information updating method and device, audio sharing method and system and electronic equipment | |
| CN112887483B (en) | Event reminding method and electronic equipment | |
| CN114173321B (en) | Equipment communication connection establishment method and equipment communication system | |
| CN111615219B (en) | PC5 link establishing method, equipment and system | |
| US20230188942A1 (en) | Method for providing location confirmation service for electronic device, and device therefor | |
| CN114501449B (en) | Information query method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |