WO2024000836A1 - Voice control method and apparatus for home device, wearable device and storage medium - Google Patents

Voice control method and apparatus for home device, wearable device and storage medium Download PDF

Info

Publication number
WO2024000836A1
WO2024000836A1 PCT/CN2022/119911 CN2022119911W WO2024000836A1 WO 2024000836 A1 WO2024000836 A1 WO 2024000836A1 CN 2022119911 W CN2022119911 W CN 2022119911W WO 2024000836 A1 WO2024000836 A1 WO 2024000836A1
Authority
WO
WIPO (PCT)
Prior art keywords
wake
home
data
voice
word
Prior art date
Application number
PCT/CN2022/119911
Other languages
French (fr)
Chinese (zh)
Inventor
尚家乐
Original Assignee
歌尔股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歌尔股份有限公司 filed Critical 歌尔股份有限公司
Publication of WO2024000836A1 publication Critical patent/WO2024000836A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/06Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L2012/284Home automation networks characterised by the type of medium used

Definitions

  • the present invention relates to the field of smart home technology, and in particular to a voice control method and device for home equipment, a wearable device and a computer-readable storage medium.
  • the purpose of the present invention is to provide a voice control method, device, wearable device and computer-readable storage medium for home equipment, so as to reduce the control links of intermediate equipment in the voice control process of smart homes and improve the human-computer interaction of smart homes. Efficiency and naturalness.
  • the present invention provides a voice control method for home equipment, which is applied to wearable devices, including:
  • Wake-up broadcast data is obtained according to the wake-up word data collected by the microphone; wherein the microphone is provided in the wearable device;
  • the target home device is controlled to perform a corresponding voice control operation.
  • the relative position information of the home device includes the reception time information of the wake-up broadcast data and/or the received signal strength indication value of the Bluetooth connection with the wearable device.
  • the relative position information of home devices includes the reception time information and the received signal strength indication value, and identifying the target home device among the home devices according to the response data includes:
  • a target home device among the home devices is determined; wherein the target home device is any of the home devices.
  • determining the target home device among the home devices based on the reception time information, the received signal strength indication value and the wake word comparison information includes:
  • each of the reception time differences is the The difference between the sending time information of the wake-up broadcast data and the receiving time information of the corresponding home equipment;
  • the weighted calculation value is the receiving time difference of each of the home equipment, the received signal strength indication value and the wake-up word comparison information and the corresponding preset Let the sum of the products of the weights be;
  • the home equipment corresponding to the target weighted calculation value is determined as the target home equipment; wherein the target weighted calculation value is the weighted calculation value with the largest value among the weighted calculation values.
  • the wake-up broadcast data includes a wake-up identifier. Before obtaining the wake-up broadcast data based on the wake-up word data collected by the microphone, the following steps are included:
  • the field data corresponding to the wake-up word in the voice data is determined as the wake-up word data.
  • receiving response data returned by a home device connected to the wearable device via Bluetooth includes:
  • the response data sent by each of the home devices is received through the communication channel of the Bluetooth multi-point connection of the wearable device.
  • controlling the target home device to perform corresponding voice control operations based on the control voice data corresponding to the wake-up word data collected by the microphone includes:
  • control voice data in the voice data collected by the microphone; wherein the control voice data is the voice data within a preset time period after the wake-up word data;
  • the voice control instruction is sent to the target home device, and the voice control operation corresponding to the voice control instruction of the target home device is controlled.
  • the invention also provides a voice control device for home equipment, applied to wearable equipment, including:
  • a wake-up acquisition module configured to obtain wake-up broadcast data according to the wake-up word data collected by the microphone; wherein the microphone is provided in the wearable device;
  • a broadcast sending module configured to perform BLE broadcast on the wake-up broadcast data, and receive response data returned by the home device connected to the wearable device via Bluetooth; wherein the response data includes relative position information of the home device or the home device's relative position information. Device relative position information and wake word comparison information;
  • a home identification module configured to identify target home equipment among the home equipment according to the response data
  • a voice control module configured to control the target home device to perform corresponding voice control operations according to the control voice data corresponding to the wake-up word data collected by the microphone.
  • the invention also provides a wearable device, including:
  • Memory used to store computer programs
  • a processor configured to implement the steps of the voice control method for home equipment as described above when executing the computer program.
  • the present invention also provides a computer-readable storage medium.
  • a computer program is stored on the computer-readable storage medium.
  • the voice control method for home equipment as described above is implemented. step.
  • the present invention provides a voice control method for home equipment, which is applied to wearable devices and includes: obtaining wake-up broadcast data based on wake-up word data collected by a microphone; wherein the microphone is set in the wearable device; and performing the wake-up broadcast data BLE broadcasts and receives the response data returned by the home device connected to the wearable device via Bluetooth; the response data includes the relative position information of the home device or the relative position information of the home device and the wake-up word comparison information; according to the response data, the home device is identified The target home device; based on the control voice data corresponding to the wake word data collected by the microphone, control the target home device to perform the corresponding voice control operation;
  • the present invention identifies the target home device among the home devices according to the response data, so that the wearable device can automatically identify the home device that the user wants to control, so as to directly control the home device to perform operations corresponding to the control voice data, thereby making the wearable device Users of wearable devices can naturally face nearby home devices to directly control the home devices, reducing the control links of intermediate devices and improving the efficiency and naturalness of human-computer interaction in smart homes.
  • the present invention also provides a voice control device for home equipment, a wearable device and a computer-readable storage medium, which also have the above beneficial effects.
  • Figure 1 is a flow chart of a voice control method for home equipment provided by an embodiment of the present invention
  • Figure 2 is a schematic flow chart of another voice control method for home equipment provided by an embodiment of the present invention.
  • FIG. 3 is a structural block diagram of a voice control device for home equipment provided by an embodiment of the present invention.
  • FIG. 1 is a flow chart of a voice control method for home equipment provided by an embodiment of the present invention. This method is applied to wearable devices and can include:
  • Step 101 Obtain wake-up broadcast data based on the wake-up word data collected by the microphone; wherein the microphone is set in the wearable device.
  • the wearable device in this embodiment can be a device with Bluetooth (BT) function that the user can wear, such as a wireless headset, a head-mounted display device, a watch device, a bracelet device, etc.
  • BT Bluetooth
  • the specific device type of the wearable device in this embodiment can be set by the designer according to practical scenarios and user needs.
  • the wearable device can be a Bluetooth headset, such as a TWS (True Wireless Stereo) headset;
  • Wearable devices can also be specifically head-mounted display devices, such as AR (Augmented Reality, augmented reality) glasses and VR (Virtual Reality, virtual reality) glasses; wearable devices can also be other devices such as watch devices and bracelet devices.
  • the microphone in this embodiment may be a microphone provided in a wearable device for collecting voice data, such as the main Mic (microphone) in Figure 2 .
  • the wake word data in this step can be the field data corresponding to the wake word collected by the microphone, that is, the voice data of the wake word field.
  • the wake-up broadcast data in this step can be the BLE broadcast data corresponding to the wake-up word data that the wearable device needs to send through BLE (Bluetooth Low Energy) broadcast.
  • the specific way for the processor in the wearable device to obtain the wake-up broadcast data based on the wake-up word data collected by the microphone can be set by the designer according to practical scenarios and user needs.
  • the processor can obtain the wake-up broadcast data based on the wake-up word data. data and wake-up identifier to generate wake-up broadcast data, so that the home device can determine the wake-up broadcast data based on the wake-up identifier in the received BLE broadcast data, and perform the corresponding response process, such as obtaining the relative position information of the home device and wake-up word ratio Peer-to-peer, that is, the wake-up broadcast data in this embodiment may include wake-up word data and wake-up identification.
  • the wake-up broadcast data in this embodiment may not include wake-up word data.
  • the processor may generate a wake-up identification corresponding to the wake-up word data based on the wake-up word data in the voice data collected by the microphone; generate wake-up broadcast data according to the wake-up identification to Enables home devices to find the wake-up word data corresponding to the wake-up sign (i.e., device wake-up word data) from the voice data collected by its own microphone based on the wake-up sign in the received BLE broadcast data, thereby using its own device wake-up word data.
  • Wake word comparison i.e., device wake-up word data
  • this step may also include identifying wake word data in the voice data collected by the microphone.
  • the specific way for the processor to identify the wake word data in the voice data collected by the microphone can be set by the designer according to practical scenarios and user needs. For example, the processor obtains the voice data collected by the microphone; detects whether there is a wake word in the voice data; If yes, the field data corresponding to the wake-up word in the voice data is determined as the wake-up word data; if not, the process can be ended or return to the step of obtaining the voice data collected by the microphone; that is to say, the processor can process the voice data collected by the microphone.
  • the data is subjected to wake word detection, and the voice data (ie, field data) corresponding to the detected wake word field is determined as wake word data.
  • the processor can also directly use all or part of the voice data as wake word data, and use the wake word comparison information in the response data returned by the home device to determine whether there is a wake word in the wake word data; for example, because the user is speaking During control, the wake-up word will be spoken first and then the control instruction.
  • the processor can use the voice data within the preset time in each detected voice data as the wake-up word data.
  • this step may also include detecting whether the wearable device is in a wearing state; if so, obtain the wake-up broadcast data based on the wake-up word data collected by the microphone; if not, the process may be ended directly or return to detection. Steps to determine whether the wearable device is in a wearing state; to ensure the accuracy of voice control of home devices through wear detection of the wearable device.
  • Step 102 Perform BLE broadcast of the wake-up broadcast data, and receive response data returned by the home device connected to the wearable device via Bluetooth; where the response data includes relative position information of the home device or relative position information of the home device and wake-up word comparison information.
  • the home device in this step can be connected to the wearable device via Bluetooth, that is, the wearable device can be connected to multiple home devices via Bluetooth.
  • the response data in this step can be the data sent to the wearable device after the home device receives the wake-up broadcast data broadcast by BLE, such as the ACK (confirmation character) in Figure 2.
  • the response data can include relative position information of the home device, that is, the relative position of the home device.
  • Information related to the position of the wearable device for example, the relative position information of the home device may include the reception time information (such as a timestamp) of the wake-up broadcast data, which is used to represent the distance of the home device relative to the wearable device; the relative position information of the home device may also be Including the Received Signal Strength Indication (RSSI) value, which is used to characterize the distance and angle of home devices relative to wearable devices.
  • RSSI Received Signal Strength Indication
  • the response data may also include wake word comparison information, such as the result information obtained by comparing the wake word data of the home device or the device wake word data and the preset wake word.
  • the wake word comparison information may be the device wake word data stored by the home device. The result information obtained after the preset wake-up word.
  • each home device can generate response data based on the scanned wake-up broadcast data broadcast by BLE and send it to the wearable device.
  • each home device can generate response data based on the scanned wake-up broadcast data of BLE broadcast.
  • the wake-up broadcast data includes a wake-up logo
  • the home device can scan the BLE broadcast. After receiving the wake-up broadcast data containing the wake-up logo, record the timestamp of scanning the wake-up broadcast data (ie, receiving time information); compare the wake-up word data in the wake-up broadcast data or the device wake-up word data corresponding to the wake-up logo with the preset wake-up word.
  • the smart home device i.e. home device
  • the smart home device scans the wake-up broadcast data of this BLE broadcast, it can first record the timestamp at this time (i.e., receive time information); then the smart home will recognize the Mic FIFO (First-in, first-out queue)
  • the memory section where the device wake-up word data corresponding to the wake-up identification in the cache is located. The data is then extracted for binary sampling conversion.
  • the user-defined wake-up word will be stored in the memory.
  • the standard binary data i.e., the preset wake word
  • the smart home will perform a binary comparison between the two data, and obtain a positive indicator (i.e., the difference value) of the wake word in the Mic-enrolled environment and the standard wake word as a judgment Whether the user speaks one of the values of the voice command toward the device; at the same time, the smart home will also obtain the RSSI value in the current BT connection based on the RSSI protocol of the BT physical layer; finally, the smart home device will form these three indicators into ACK data
  • the frame is sent to the TWS headset worn by the user in real time through the SPP (Serial Port Profile, Bluetooth protocol stack serial port protocol) channel in BT.
  • SPP Serial Port Profile, Bluetooth protocol stack serial port protocol
  • the specific way in which the wearable device receives the response data returned by the home device connected to the wearable device via Bluetooth can be set by the designer.
  • each home device can send response data to the wearable device through BLE broadcast, that is, the wearable device can scan through BLE and receive the response data returned by the home device; in order to improve the efficiency of receiving response data, each home device can also use the wearable device to
  • the Bluetooth multi-point connection communication channel sends response data to the wearable device, that is, the wearable device can receive the response data sent by each home device through the Bluetooth multi-point connection communication channel (SPP channel in Figure 2).
  • each home device can perform clock calibration; as shown in Figure 2, each home device can perform clock calibration through the network; the wearable device can also control the home device before performing BLE broadcast of the wake-up broadcast data. Perform clock calibration.
  • Step 103 Identify the target home device among the home devices based on the response data.
  • the target home device in this step can be a home device that needs to respond to wake word data and perform corresponding voice control operations; for example, the target home device can be any home device that is connected to the wearable device via Bluetooth.
  • the wearable device can identify the target home device among the home devices based on the response data returned by each home device, so as to use the target home device to complete the corresponding voice control operation.
  • the specific way for the processor to identify the target home device in the home device based on the response data can be set by the designer according to the practical scenario and user needs.
  • the response data includes reception time information and received signal strength indication.
  • the processor can determine the target home device in the home device based on the corresponding reception time information, received signal strength indication value and wake word comparison information of each home device; where, the target home device is Any home device.
  • the processor can calculate the corresponding weighted calculation value of each home device based on the reception time difference, received signal strength indication value and wake word comparison information of each home device; where each reception time difference is the sending time information of the wake broadcast data and The difference between the reception time information of the corresponding home devices; the weighted calculation value is the reception time difference, received signal strength indication value and wake word comparison information of each home device and the corresponding preset weight (such as time weight, signal weight and comparison weight) ); determine the home equipment corresponding to the target weighted calculation value as the target home equipment; wherein, the target weighted calculation value is the weighted calculation value with the largest value among the calculated weighted calculation values.
  • Step 104 Control the target home device to perform corresponding voice control operations according to the control voice data corresponding to the wake word data collected by the microphone.
  • the processor of the wearable device can control the target home device to perform corresponding voice control operations based on the control voice data corresponding to the wake-up word data collected by the microphone, so as to utilize the wearable device to organize the home devices. Management and information interaction, realizing voice control of home equipment, reducing the control links of intermediate devices (such as mobile phones), and improving the efficiency and naturalness of human-computer interaction in smart homes.
  • control voice data in this step can be the control voice data after the wake-up word data in the voice data collected by the microphone; if the user wants to control a certain home device, he can directly issue a voice command to the home device.
  • the voice command It mainly consists of two parts. The first part is the wake-up word, and the second part is the specific voice control command, such as: "Hi, turn on the phone.” In this example, "Hi" is the wake-up word. The user can also define it by himself in actual application.
  • “Power on” is a specific voice control command; after the wearable device (such as TWS headset) worn by the user recognizes the wake-up word, it can automatically collect all voice commands, that is, wake-up word data and control voice data, thereby determining the target home device , use the target home device to complete the voice control instructions corresponding to the control voice data.
  • the wearable device such as TWS headset
  • control voice data can be the first piece of voice data after the wake-up word data in the voice data collected by the microphone;
  • the control voice data can also be the voice data within a preset time period after the wake-up word data in the voice data collected by the microphone. That is, after the user speaks the wake-up word, he can say multiple voice control instructions within the preset time period, thereby multiple times. Control target home devices.
  • the specific way for the processor to control the target home device to perform the corresponding voice control operation based on the control voice data corresponding to the wake-up word data collected by the microphone can be set by the designer according to the practical scenario and user needs, such as
  • the processor obtains voice control instructions based on the control voice data in the voice data collected by the microphone; where the control voice data is the voice data within a preset time period after the wake word data; sends the voice control instructions to the target home device to control the target
  • the home device performs the voice control operation corresponding to the voice control command.
  • the processor can send the voice control command to the target home device through a Bluetooth connection link, such as the BT A2DP (Bluetooth Audio Transfer Model Protocol) link in Figure 2.
  • BT A2DP Bluetooth Audio Transfer Model Protocol
  • the target home device enables the target home device to perform voice control operations corresponding to the voice control instructions; the processor can also directly send the control voice data corresponding to the wake word data to the target home device to control, parse and execute the voice corresponding to the control voice data. For control operations, for example, the processor can send wake word data and corresponding control voice data to the target home device. This embodiment does not impose any restrictions on this.
  • the voice control instructions can include control voice data so that the target home equipment can use wearable devices to collect more accurate information.
  • the voice data is used to control voice recognition and function execution to improve the accuracy of voice control of home devices;
  • the voice control instructions can also include control identifiers corresponding to the control voice data, so that the target home device can use the control identifiers to collect from its own microphone Extract the corresponding control voice data (i.e., device control voice data) from the stored voice data, and use the device control voice data collected and stored by itself to perform control voice recognition and function execution, thereby reducing the communication between the wearable device and the target home device.
  • the amount of data increases the communication speed of voice control instructions. This embodiment does not impose any restrictions on this.
  • the embodiment of the present invention identifies the target home device among the home devices according to the response data, so that the wearable device can automatically identify the home device that the user wants to control, so as to directly control the home device to perform operations corresponding to the control voice data. , so that users wearing wearable devices can naturally direct control of the home devices toward nearby home devices, reducing the control links of intermediate devices and improving the efficiency and naturalness of human-computer interaction in smart homes.
  • embodiments of the present invention also provide a voice control device for home equipment.
  • the voice control device for home equipment described below and the voice control method for home equipment described above can interact with each other. Corresponding reference.
  • FIG. 3 is a structural block diagram of a voice control device for home equipment provided by an embodiment of the present invention.
  • the device is applied to wearable devices and can include:
  • the wake-up acquisition module 10 is used to obtain wake-up broadcast data based on the wake-up word data collected by the microphone; wherein the microphone is set in the wearable device;
  • the broadcast sending module 20 is used to perform BLE broadcast of wake-up broadcast data, and receive response data returned by home devices connected to the wearable device via Bluetooth; where the response data includes home device relative position information or home device relative position information and wake-up words. Compare information;
  • the home identification module 30 is used to identify the target home equipment among the home equipment according to the response data
  • the voice control module 40 is used to control the target home device to perform corresponding voice control operations based on the control voice data corresponding to the wake-up word data collected by the microphone.
  • the relative position information of the home device includes reception time information of wake-up broadcast data and/or received signal strength indication value of the Bluetooth connection with the wearable device.
  • the relative position information of the home device includes reception time information and received signal strength indication value.
  • the home identification module 30 may be specifically configured to determine the location of the home device based on the reception time information, the received signal strength indication value and the wake word comparison information.
  • Target home equipment wherein, the target home equipment is any home equipment.
  • the home identification module 30 may include:
  • the calculation submodule is used to calculate the corresponding weighted calculation value of each home device based on the reception time difference, received signal strength indication value and wake word comparison information of each home device; where each reception time difference is the sending time of the wake broadcast data The difference between the information and the reception time information of the corresponding home device; the weighted calculation value is the sum of the products of the reception time difference of each home device, the received signal strength indication value and the wake word comparison information and the corresponding preset weight;
  • the determination sub-module is used to determine the home equipment corresponding to the target weighted calculation value as the target home equipment; wherein the target weighted calculation value is the weighted calculation value with the largest value among the weighted calculation values.
  • the wake-up broadcast data includes wake-up word data and wake-up identification.
  • the device may also include:
  • the voice collection module is used to obtain the voice data collected by the microphone
  • Wake-up detection module used to detect whether there is a wake-up word in the voice data
  • the wake-up word determination module is used to determine the field data corresponding to the wake-up word in the voice data as the wake-up word data if there is a wake-up word.
  • the broadcast sending module 20 may include:
  • the communication receiving submodule is used to receive the response data sent by each home device through the communication channel of the Bluetooth multi-point connection of the wearable device.
  • the voice control module 40 may include:
  • the instruction acquisition submodule is used to obtain voice control instructions based on the control voice data in the voice data collected by the microphone; wherein the control voice data is the voice data within a preset time period after the wake-up word data;
  • the command sending sub-module is used to send voice control commands to the target home equipment and control the voice control operations corresponding to the voice control commands of the target home equipment.
  • the embodiment of the present invention uses the home recognition module 30 to identify the target home device among the home devices according to the response data, so that the wearable device can automatically identify the home device that the user wants to control, so as to directly control the home device for voice control.
  • Data-corresponding operations allow users wearing wearable devices to naturally direct control of the home devices toward nearby home devices, reducing the control links of intermediate devices and improving the efficiency and naturalness of human-computer interaction in smart homes. Spend.
  • embodiments of the present invention also provide a wearable device.
  • the wearable device described below and the voice control method for home equipment described above may be mutually referenced.
  • a wearable device including:
  • Memory used to store computer programs
  • a processor configured to implement the steps of the voice control method for home equipment provided in the above embodiments when executing a computer program.
  • the wearable device may be a Bluetooth headset, such as a TWS headset; the wearable device may also be a head-mounted display device, such as AR glasses; the wearable device It can also be specifically a watch device and a bracelet device.
  • a Bluetooth headset such as a TWS headset
  • the wearable device may also be a head-mounted display device, such as AR glasses
  • the wearable device It can also be specifically a watch device and a bracelet device.
  • embodiments of the present invention also provide a computer-readable storage medium.
  • the computer-readable storage medium described below and the voice control method for home equipment described above can correspond to each other. .
  • a computer-readable storage medium has a computer program stored on the computer-readable storage medium.
  • the computer program is executed by a processor, the steps of the voice control method for home equipment provided by the above method embodiment are implemented.
  • the computer-readable storage medium can specifically be a U disk, a mobile hard disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk that can store program codes. medium.
  • ROM Read-Only Memory
  • RAM Random Access Memory

Abstract

Disclosed in the present invention are a voice control method and apparatus for a home device, a wearable device and a computer readable storage medium, which are applied to the technical field of smart homes. The method is applied to a wearable device, and comprises: obtaining wake-up broadcast data according to wake-up word data acquired by a microphone; performing BLE broadcasting on the wake-up broadcast data, and receiving response data returned by home devices in Bluetooth connection with the wearable device; identifying a target home device among the home devices according to the response data; and according to control voice data corresponding to the wake-up word data acquired by the microphone, controlling the target home device to execute a corresponding voice control operation. According to the present invention, a wearable device can automatically identify a home device to be controlled by a user so as to directly control the home device to perform an operation corresponding to control voice data, so that the user can naturally face a nearby home device and directly issue control over the home device, and the efficiency and naturalness of human-computer interaction in smart homes are improved.

Description

家居设备的语音控制方法、装置、可穿戴设备及存储介质Voice control method, device, wearable device and storage medium for home equipment
本申请要求于2022年6月29日提交中国专利局、申请号为202210753455.5、发明名称为“家居设备的语音控制方法、装置、可穿戴设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application submitted to the China Patent Office on June 29, 2022, with the application number 202210753455.5 and the invention title "Voice control method, device, wearable device and storage medium for home equipment", all of which The contents are incorporated into this application by reference.
技术领域Technical field
本发明涉及智能家居技术领域,特别涉及一种家居设备的语音控制方法、装置、可穿戴设备及计算机可读存储介质。The present invention relates to the field of smart home technology, and in particular to a voice control method and device for home equipment, a wearable device and a computer-readable storage medium.
背景技术Background technique
目前,智能家居的语音控制技术领域中,需要通过可穿戴设备与智能家居产品之间的中间设备(如手机)进行用户语音指令的收集、分析和转达,且用户在通过中间设备语音控制某个智能家居产品时,需要提前设定好该智能家居的语音名称,人机交互的效率和自然度较差。因此,如何能够在智能家居的语音控制过程中减少中间设备的控制环节,提高智能家居的人机交互效率和自然度,是现今急需解决的问题。Currently, in the field of smart home voice control technology, it is necessary to collect, analyze and convey user voice instructions through an intermediate device (such as a mobile phone) between wearable devices and smart home products, and the user is using the intermediate device to voice control a certain When using smart home products, the voice name of the smart home needs to be set in advance, and the efficiency and naturalness of human-computer interaction are poor. Therefore, how to reduce the control links of intermediate devices in the voice control process of smart homes and improve the efficiency and naturalness of human-computer interaction in smart homes is an urgent problem that needs to be solved today.
发明内容Contents of the invention
本发明的目的是提供一种家居设备的语音控制方法、装置、可穿戴设备及计算机可读存储介质,以在智能家居的语音控制过程中减少中间设备的控制环节,提高智能家居的人机交互效率和自然度。The purpose of the present invention is to provide a voice control method, device, wearable device and computer-readable storage medium for home equipment, so as to reduce the control links of intermediate equipment in the voice control process of smart homes and improve the human-computer interaction of smart homes. Efficiency and naturalness.
为解决上述技术问题,本发明提供一种家居设备的语音控制方法,应用于可穿戴设备,包括:In order to solve the above technical problems, the present invention provides a voice control method for home equipment, which is applied to wearable devices, including:
根据麦克风采集的唤醒词数据,得到唤醒广播数据;其中,所述麦克风设置在所述可穿戴设备中;Wake-up broadcast data is obtained according to the wake-up word data collected by the microphone; wherein the microphone is provided in the wearable device;
对所述唤醒广播数据进行BLE广播,并接收与所述可穿戴设备蓝牙连接的家居设备返回的应答数据;其中,所述应答数据包括家居设备相对位置信息或所述家居设备相对位置信息和唤醒词比对信息;Perform BLE broadcast on the wake-up broadcast data, and receive response data returned by the home device connected to the wearable device via Bluetooth; wherein the response data includes home device relative position information or the home device relative position information and wake-up time. word comparison information;
根据所述应答数据,识别所述家居设备中的目标家居设备;Identify a target home device among the home devices according to the response data;
根据所述麦克风采集的所述唤醒词数据对应的控制语音数据,控制所述目标家居设备执行相应的语音控制操作。According to the control voice data corresponding to the wake-up word data collected by the microphone, the target home device is controlled to perform a corresponding voice control operation.
可选的,所述家居设备相对位置信息包括所述唤醒广播数据的接收时间信息和/或与所述可穿戴设备的蓝牙连接的接收信号强度指示值。Optionally, the relative position information of the home device includes the reception time information of the wake-up broadcast data and/or the received signal strength indication value of the Bluetooth connection with the wearable device.
可选的,所述家居设备相对位置信息包括所述接收时间信息和所述接收信号强度指示值,所述根据所述应答数据,识别所述家居设备中的目标家居设备,包括:Optionally, the relative position information of home devices includes the reception time information and the received signal strength indication value, and identifying the target home device among the home devices according to the response data includes:
根据所述接收时间信息、所述接收信号强度指示值和所述唤醒词比对信息,确定所述家居设备中的目标家居设备;其中,所述目标家居设备为任一所述家居设备。According to the reception time information, the received signal strength indication value and the wake word comparison information, a target home device among the home devices is determined; wherein the target home device is any of the home devices.
可选的,所述根据所述接收时间信息、所述接收信号强度指示值和所述唤醒词比对信息,确定所述家居设备中的目标家居设备,包括:Optionally, determining the target home device among the home devices based on the reception time information, the received signal strength indication value and the wake word comparison information includes:
根据各所述家居设备的接收时间差、所述接收信号强度指示值和所述唤醒词比对信息,计算各所述家居设备各自对应的加权计算值;其中,每个所述接收时间差为所述唤醒广播数据的发送时间信息与相应的家居设备的接收时间信息之差;所述加权计算值为各所述家居设备各自的接收时间差、接收信号强度指示值和唤醒词比对信息与对应的预设权重的乘积之和;According to the reception time difference of each of the home devices, the received signal strength indication value and the wake word comparison information, a weighted calculation value corresponding to each of the home devices is calculated; wherein each of the reception time differences is the The difference between the sending time information of the wake-up broadcast data and the receiving time information of the corresponding home equipment; the weighted calculation value is the receiving time difference of each of the home equipment, the received signal strength indication value and the wake-up word comparison information and the corresponding preset Let the sum of the products of the weights be;
将目标加权计算值对应的家居设备确定为所述目标家居设备;其中,目标加权计算值为所述加权计算值中数值最大的加权计算值。The home equipment corresponding to the target weighted calculation value is determined as the target home equipment; wherein the target weighted calculation value is the weighted calculation value with the largest value among the weighted calculation values.
可选的,所述唤醒广播数据包括唤醒标识,所述根据麦克风采集的唤醒词数据,得到唤醒广播数据之前,包括:Optionally, the wake-up broadcast data includes a wake-up identifier. Before obtaining the wake-up broadcast data based on the wake-up word data collected by the microphone, the following steps are included:
获取所述麦克风采集的语音数据;Obtain the voice data collected by the microphone;
检测所述语音数据中是否存在唤醒词;Detect whether there is a wake-up word in the voice data;
若是,则将所述语音数据中所述唤醒词对应的字段数据确定为所述唤醒词数据。If so, the field data corresponding to the wake-up word in the voice data is determined as the wake-up word data.
可选的,所述接收与所述可穿戴设备蓝牙连接的家居设备返回的应答数据,包括:Optionally, receiving response data returned by a home device connected to the wearable device via Bluetooth includes:
通过所述可穿戴设备的蓝牙多点连接的通信通道,接收各所述家居设备发送的所述应答数据。The response data sent by each of the home devices is received through the communication channel of the Bluetooth multi-point connection of the wearable device.
可选的,所述根据所述麦克风采集的所述唤醒词数据对应的控制语音数据,控制所述目标家居设备执行相应的语音控制操作,包括:Optionally, controlling the target home device to perform corresponding voice control operations based on the control voice data corresponding to the wake-up word data collected by the microphone includes:
根据所述麦克风采集的语音数据中的控制语音数据,获取语音控制指令;其中,所述控制语音数据为所述唤醒词数据之后预设时间段内的语音数据;Obtain voice control instructions according to the control voice data in the voice data collected by the microphone; wherein the control voice data is the voice data within a preset time period after the wake-up word data;
将所述语音控制指令发送到所述目标家居设备,控制所述目标家居设备所述语音控制指令对应的语音控制操作。The voice control instruction is sent to the target home device, and the voice control operation corresponding to the voice control instruction of the target home device is controlled.
本发明还提供了一种家居设备的语音控制装置,应用于可穿戴设备,包括:The invention also provides a voice control device for home equipment, applied to wearable equipment, including:
唤醒获取模块,用于根据麦克风采集的唤醒词数据,得到唤醒广播数据;其中,所述麦克风设置在所述可穿戴设备中;A wake-up acquisition module, configured to obtain wake-up broadcast data according to the wake-up word data collected by the microphone; wherein the microphone is provided in the wearable device;
广播发送模块,用于对所述唤醒广播数据进行BLE广播,并接收与所述可穿戴设备蓝牙连接的家居设备返回的应答数据;其中,所述应答数据包括家居设备相对位置信息或所述家居设备相对位置信息和唤醒词比对信息;A broadcast sending module, configured to perform BLE broadcast on the wake-up broadcast data, and receive response data returned by the home device connected to the wearable device via Bluetooth; wherein the response data includes relative position information of the home device or the home device's relative position information. Device relative position information and wake word comparison information;
家居识别模块,用于根据所述应答数据,识别所述家居设备中的目标家居设备;A home identification module, configured to identify target home equipment among the home equipment according to the response data;
语音控制模块,用于根据所述麦克风采集的所述唤醒词数据对应的控制语音数据,控制所述目标家居设备执行相应的语音控制操作。A voice control module, configured to control the target home device to perform corresponding voice control operations according to the control voice data corresponding to the wake-up word data collected by the microphone.
本发明还提供了一种可穿戴设备,包括:The invention also provides a wearable device, including:
存储器,用于存储计算机程序;Memory, used to store computer programs;
处理器,用于执行所述计算机程序时实现如上述所述的家居设备的语音控制方法的步骤。A processor, configured to implement the steps of the voice control method for home equipment as described above when executing the computer program.
此外,本发明还提供了一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如上述所述的家居设备的语音控制方法的步骤。In addition, the present invention also provides a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, the voice control method for home equipment as described above is implemented. step.
本发明所提供的一种家居设备的语音控制方法,应用于可穿戴设备,包括:根据麦克风采集的唤醒词数据,得到唤醒广播数据;其中,麦克风设置在可穿戴设备中;对唤醒广播数据进行BLE广播,并接收与可穿戴设备蓝牙连接的家居设备返回的应答数据;其中,应答数据包括家居设备相对位置信息或家居设备相对位置信息和唤醒词比对信息;根据应答数据,识别家居设备中的目标家居设备;根据麦克风采集的唤醒词数据对应的控制语音数据, 控制目标家居设备执行相应的语音控制操作;The present invention provides a voice control method for home equipment, which is applied to wearable devices and includes: obtaining wake-up broadcast data based on wake-up word data collected by a microphone; wherein the microphone is set in the wearable device; and performing the wake-up broadcast data BLE broadcasts and receives the response data returned by the home device connected to the wearable device via Bluetooth; the response data includes the relative position information of the home device or the relative position information of the home device and the wake-up word comparison information; according to the response data, the home device is identified The target home device; based on the control voice data corresponding to the wake word data collected by the microphone, control the target home device to perform the corresponding voice control operation;
可见,本发明通过根据应答数据,识别家居设备中的目标家居设备,使可穿戴设备能够自动识别用户所要控制的家居设备,以直接控制该家居设备进行控制语音数据对应的操作,从而使佩戴可穿戴设备的用户能够自然的朝向附近的家居设备来直接发出对于该家居设备的控制,减少了中间设备的控制环节,提高了智能家居的人机交互效率和自然度。此外,本发明还提供了一种家居设备的语音控制装置、可穿戴设备及计算机可读存储介质,同样具有上述有益效果。It can be seen that the present invention identifies the target home device among the home devices according to the response data, so that the wearable device can automatically identify the home device that the user wants to control, so as to directly control the home device to perform operations corresponding to the control voice data, thereby making the wearable device Users of wearable devices can naturally face nearby home devices to directly control the home devices, reducing the control links of intermediate devices and improving the efficiency and naturalness of human-computer interaction in smart homes. In addition, the present invention also provides a voice control device for home equipment, a wearable device and a computer-readable storage medium, which also have the above beneficial effects.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据提供的附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are only These are embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on the provided drawings without exerting creative efforts.
图1为本发明实施例所提供的一种家居设备的语音控制方法的流程图;Figure 1 is a flow chart of a voice control method for home equipment provided by an embodiment of the present invention;
图2为本发明实施例所提供的另一种家居设备的语音控制方法的流程示意图;Figure 2 is a schematic flow chart of another voice control method for home equipment provided by an embodiment of the present invention;
图3为本发明实施例所提供的一种家居设备的语音控制装置的结构框图。FIG. 3 is a structural block diagram of a voice control device for home equipment provided by an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments These are some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of the present invention.
请参考图1,图1为本发明实施例所提供的一种家居设备的语音控制方法的流程图。该方法应用于可穿戴设备,可以包括:Please refer to FIG. 1 , which is a flow chart of a voice control method for home equipment provided by an embodiment of the present invention. This method is applied to wearable devices and can include:
步骤101:根据麦克风采集的唤醒词数据,得到唤醒广播数据;其中,麦克风设置在可穿戴设备中。Step 101: Obtain wake-up broadcast data based on the wake-up word data collected by the microphone; wherein the microphone is set in the wearable device.
具体的,本实施例中的可穿戴设备可以用户能够穿戴的具备蓝牙(BT) 功能的设备,如无线耳机、头戴显示设备、手表设备和手环设备等。对于本实施例中的可穿戴设备的具体设备类型,可以由设计人员根据实用场景和用户需求自行设置,如可穿戴设备可以具体为蓝牙耳机,如TWS(True Wireless Stereo,真正无线立体声)耳机;可穿戴设备也可以具体为头戴显示设备,如AR(Augmented Reality,增强现实)眼镜和VR(Virtual Reality,虚拟现实)眼镜等;可穿戴设备还可以为如手表设备和手环设备等其其它可穿戴设备,只要可穿戴设备可以具备蓝牙功能,本实施例对此不做任何限制。本实施例中的麦克风可以为可穿戴设备中设置的用于采集语音数据的麦克风,如图2中主Mic(麦克风)。Specifically, the wearable device in this embodiment can be a device with Bluetooth (BT) function that the user can wear, such as a wireless headset, a head-mounted display device, a watch device, a bracelet device, etc. The specific device type of the wearable device in this embodiment can be set by the designer according to practical scenarios and user needs. For example, the wearable device can be a Bluetooth headset, such as a TWS (True Wireless Stereo) headset; Wearable devices can also be specifically head-mounted display devices, such as AR (Augmented Reality, augmented reality) glasses and VR (Virtual Reality, virtual reality) glasses; wearable devices can also be other devices such as watch devices and bracelet devices. Wearable devices, as long as the wearable devices can have Bluetooth functions, this embodiment does not place any restrictions on this. The microphone in this embodiment may be a microphone provided in a wearable device for collecting voice data, such as the main Mic (microphone) in Figure 2 .
可以理解的是,本步骤中的唤醒词数据可以为麦克风采集的唤醒词对应的字段数据,即唤醒词字段的语音数据。本步骤中的唤醒广播数据可以为可穿戴设备需要通过BLE(Bluetooth Low Energy,蓝牙低功耗)广播发送的唤醒词数据对应的BLE广播数据。It can be understood that the wake word data in this step can be the field data corresponding to the wake word collected by the microphone, that is, the voice data of the wake word field. The wake-up broadcast data in this step can be the BLE broadcast data corresponding to the wake-up word data that the wearable device needs to send through BLE (Bluetooth Low Energy) broadcast.
具体的,对于本步骤中可穿戴设备中的处理器根据麦克风采集的唤醒词数据,得到唤醒广播数据的具体方式,可以由设计人员根据实用场景和用户需求自行设置,如处理器可以根据唤醒词数据和唤醒标识,生成唤醒广播数据,以使家居设备能够根据接收的BLE广播数据中的唤醒标识,确定唤醒广播数据,并进行相应的应答流程,如家居设备相对位置信息的获取和唤醒词比对等,即本实施例中的唤醒广播数据可以包括唤醒词数据和唤醒标识。本实施例中的唤醒广播数据也可以不包括唤醒词数据,如处理器可以根据麦克风采集的语音数据中的唤醒词数据,生成唤醒词数据对应的唤醒标识;根据唤醒标识生成唤醒广播数据,以使家居设备能够根据接收的BLE广播数据中的唤醒标识,从自身麦克风采集的语音数据中查找到该唤醒标识对应的唤醒词数据(即设备唤醒词数据),从而利用自身的设备唤醒词数据进行唤醒词比对。Specifically, in this step, the specific way for the processor in the wearable device to obtain the wake-up broadcast data based on the wake-up word data collected by the microphone can be set by the designer according to practical scenarios and user needs. For example, the processor can obtain the wake-up broadcast data based on the wake-up word data. data and wake-up identifier to generate wake-up broadcast data, so that the home device can determine the wake-up broadcast data based on the wake-up identifier in the received BLE broadcast data, and perform the corresponding response process, such as obtaining the relative position information of the home device and wake-up word ratio Peer-to-peer, that is, the wake-up broadcast data in this embodiment may include wake-up word data and wake-up identification. The wake-up broadcast data in this embodiment may not include wake-up word data. For example, the processor may generate a wake-up identification corresponding to the wake-up word data based on the wake-up word data in the voice data collected by the microphone; generate wake-up broadcast data according to the wake-up identification to Enables home devices to find the wake-up word data corresponding to the wake-up sign (i.e., device wake-up word data) from the voice data collected by its own microphone based on the wake-up sign in the received BLE broadcast data, thereby using its own device wake-up word data. Wake word comparison.
对应的,本实施例中本步骤之前还可以包括识别麦克风采集的语音数据中的唤醒词数据。对于处理器识别麦克风采集的语音数据中的唤醒词数据的具体方式,可以由设计人员根据实用场景和用户需求自行设置,如处理器获取麦克风采集的语音数据;检测语音数据中是否存在唤醒词;若是,则将语音数据中唤醒词对应的字段数据确定为唤醒词数据;若否,则可以结束本流 程或返回获取麦克风采集的语音数据的步骤;也就是说,处理器可以对麦克风采集的语音数据进行唤醒词检测,将检测出的唤醒词字段对应的语音数据(即字段数据)确定为唤醒词数据。处理器也可以将全部语音数据或部分语音数据直接作为唤醒词数据,利用家居设备返回的应答数据中的唤醒词比对信息,确定是否存在唤醒词数据中是否存在唤醒词;例如由于用户进行语音控制时会先说出唤醒词再说出控制指令,处理器可以将每次检测到的语音数据中前预设时间内的语音数据作为唤醒词数据。Correspondingly, in this embodiment, this step may also include identifying wake word data in the voice data collected by the microphone. The specific way for the processor to identify the wake word data in the voice data collected by the microphone can be set by the designer according to practical scenarios and user needs. For example, the processor obtains the voice data collected by the microphone; detects whether there is a wake word in the voice data; If yes, the field data corresponding to the wake-up word in the voice data is determined as the wake-up word data; if not, the process can be ended or return to the step of obtaining the voice data collected by the microphone; that is to say, the processor can process the voice data collected by the microphone. The data is subjected to wake word detection, and the voice data (ie, field data) corresponding to the detected wake word field is determined as wake word data. The processor can also directly use all or part of the voice data as wake word data, and use the wake word comparison information in the response data returned by the home device to determine whether there is a wake word in the wake word data; for example, because the user is speaking During control, the wake-up word will be spoken first and then the control instruction. The processor can use the voice data within the preset time in each detected voice data as the wake-up word data.
进一步的,本实施例中本步骤之前还可以包括检测可穿戴设备是否处于佩戴状态;若是,则根据麦克风采集的唤醒词数据,得到唤醒广播数据;若否,则可以直接结束本流程或返回检测可穿戴设备是否处于佩戴状态的步骤;以通过对可穿戴设备的佩戴检测,保证家居设备的语音控制的准确性。Furthermore, in this embodiment, before this step, it may also include detecting whether the wearable device is in a wearing state; if so, obtain the wake-up broadcast data based on the wake-up word data collected by the microphone; if not, the process may be ended directly or return to detection. Steps to determine whether the wearable device is in a wearing state; to ensure the accuracy of voice control of home devices through wear detection of the wearable device.
步骤102;对唤醒广播数据进行BLE广播,并接收与可穿戴设备蓝牙连接的家居设备返回的应答数据;其中,应答数据包括家居设备相对位置信息或家居设备相对位置信息和唤醒词比对信息。Step 102: Perform BLE broadcast of the wake-up broadcast data, and receive response data returned by the home device connected to the wearable device via Bluetooth; where the response data includes relative position information of the home device or relative position information of the home device and wake-up word comparison information.
可以理解的是,本步骤中的家居设备可以与可穿戴设备蓝牙连接,即可穿戴设备可以蓝牙连接多个家居设备。本步骤中的应答数据可以为家居设备接收BLE广播的唤醒广播数据后向可穿戴设备发送的数据,如图2中的ACK(确认字符)。It can be understood that the home device in this step can be connected to the wearable device via Bluetooth, that is, the wearable device can be connected to multiple home devices via Bluetooth. The response data in this step can be the data sent to the wearable device after the home device receives the wake-up broadcast data broadcast by BLE, such as the ACK (confirmation character) in Figure 2.
具体的,对于本步骤中各家居设备向可穿戴设备返回的应答数据的具体内容,可以由设计人员根据实用场景和用户需求自行设置,如应答数据可以包括家居设备相对位置信息,即家居设备相对于可穿戴设备的位置的信息;例如,家居设备相对位置信息可以包括唤醒广播数据的接收时间信息(如时间戳),用于表征家居设备相对可穿戴设备的距离;家居设备相对位置信息也可以包括接收信号强度指示(RSSI,Received Signal Strength Indication)值,用于表征家居设备相对可穿戴设备的距离和角度。应答数据也可以包括唤醒词比对信息,如家居设备对比唤醒词数据或设备唤醒词数据与预设唤醒词后得到的结果信息,例如唤醒词比对信息可以为家居设备存储的设备唤醒词数据与预设唤醒词后得到的结果信息。Specifically, the specific content of the response data returned by each home device to the wearable device in this step can be set by the designer according to practical scenarios and user needs. For example, the response data can include relative position information of the home device, that is, the relative position of the home device. Information related to the position of the wearable device; for example, the relative position information of the home device may include the reception time information (such as a timestamp) of the wake-up broadcast data, which is used to represent the distance of the home device relative to the wearable device; the relative position information of the home device may also be Including the Received Signal Strength Indication (RSSI) value, which is used to characterize the distance and angle of home devices relative to wearable devices. The response data may also include wake word comparison information, such as the result information obtained by comparing the wake word data of the home device or the device wake word data and the preset wake word. For example, the wake word comparison information may be the device wake word data stored by the home device. The result information obtained after the preset wake-up word.
需要说明的是,本实施例中可穿戴设备对唤醒广播数据进行BLE广播之后,各家居设备可以根据扫描到的BLE广播的唤醒广播数据,生成应答数据 并发送给可穿戴设备。It should be noted that in this embodiment, after the wearable device broadcasts the wake-up broadcast data via BLE, each home device can generate response data based on the scanned wake-up broadcast data broadcast by BLE and send it to the wearable device.
具体的,对于各家居设备可以根据扫描到的BLE广播的唤醒广播数据,生成应答数据的具体方式,可以由设计人员自行设置,如唤醒广播数据包括唤醒标识时,家居设备可以在扫描到BLE广播的含有唤醒标识的唤醒广播数据后,记录扫描到唤醒广播数据的时间戳(即接收时间信息);将唤醒广播数据中的唤醒词数据或唤醒标识对应的设备唤醒词数据与预设唤醒词进行对比,得到唤醒词比对信息,例如设备唤醒词数据与预设唤醒词(即标准正向唤醒词)进行二进制对比得到差异值;获取当前与可穿戴设备蓝牙连接的RSSI值;根据时间戳、唤醒词比对信息和RSSI值,生成应答数据。如图2所示,智能家居设备(即家居设备)一旦扫描到这种BLE广播的唤醒广播数据,可以首先记录下此时的时间戳(即接收时间信息);然后智能家居会识别出Mic FIFO(先入先出队列)缓存中的唤醒标识对应的设备唤醒词数据所在的内存区段,之后提取数据进行二进制采样转换,同时,智能家居在初始状态时,会在内存中存储用户定义的唤醒词的标准二进制数据(即预设唤醒词),智能家居会对这两种数据进行二进制比较,得出一个Mic录取的环境中的唤醒词语标准唤醒词的正向指标(即差异值),作为判断用户是否朝着设备说出的语音指令的数值之一;同时智能家居还会基于BT物理层的RSSI协议,获取当前BT连接中的RSSI值;最后智能家居设备会将这三个指标组成ACK数据帧通过BT中的SPP(Serial Port Profile,蓝牙协议栈串口协议)通道实时发送给用户佩戴的TWS耳机。Specifically, the specific way in which each home device can generate response data based on the scanned wake-up broadcast data of BLE broadcast can be set by the designer. For example, when the wake-up broadcast data includes a wake-up logo, the home device can scan the BLE broadcast. After receiving the wake-up broadcast data containing the wake-up logo, record the timestamp of scanning the wake-up broadcast data (ie, receiving time information); compare the wake-up word data in the wake-up broadcast data or the device wake-up word data corresponding to the wake-up logo with the preset wake-up word. Compare and obtain the wake word comparison information, such as binary comparison between the device wake word data and the preset wake word (that is, the standard forward wake word) to obtain the difference value; obtain the RSSI value of the current Bluetooth connection with the wearable device; according to the timestamp, The wake word compares the information with the RSSI value to generate response data. As shown in Figure 2, once the smart home device (i.e. home device) scans the wake-up broadcast data of this BLE broadcast, it can first record the timestamp at this time (i.e., receive time information); then the smart home will recognize the Mic FIFO (First-in, first-out queue) The memory section where the device wake-up word data corresponding to the wake-up identification in the cache is located. The data is then extracted for binary sampling conversion. At the same time, in the initial state of the smart home, the user-defined wake-up word will be stored in the memory. The standard binary data (i.e., the preset wake word), the smart home will perform a binary comparison between the two data, and obtain a positive indicator (i.e., the difference value) of the wake word in the Mic-enrolled environment and the standard wake word as a judgment Whether the user speaks one of the values of the voice command toward the device; at the same time, the smart home will also obtain the RSSI value in the current BT connection based on the RSSI protocol of the BT physical layer; finally, the smart home device will form these three indicators into ACK data The frame is sent to the TWS headset worn by the user in real time through the SPP (Serial Port Profile, Bluetooth protocol stack serial port protocol) channel in BT.
对应的,对于本实施例中可穿戴设备接收与可穿戴设备蓝牙连接的家居设备返回的应答数据的具体方式,即家居设备向可穿戴设备发送应答数据的具体方式,可以由设计人员自行设置,如各家居设备可以通过BLE广播向可穿戴设备发送应答数据,即可穿戴设备可以通过BLE扫描,接收家居设备返回的应答数据;为了提高应答数据的接收效率,各家居设备也可以通过可穿戴设备的蓝牙多点连接的通信通道,向可穿戴设备发送应答数据,即可穿戴设备可以通过蓝牙多点连接的通信通道(如图2中的SPP通道),接收各家居设备发送的应答数据。Correspondingly, in this embodiment, the specific way in which the wearable device receives the response data returned by the home device connected to the wearable device via Bluetooth, that is, the specific way in which the home device sends response data to the wearable device, can be set by the designer. For example, each home device can send response data to the wearable device through BLE broadcast, that is, the wearable device can scan through BLE and receive the response data returned by the home device; in order to improve the efficiency of receiving response data, each home device can also use the wearable device to The Bluetooth multi-point connection communication channel sends response data to the wearable device, that is, the wearable device can receive the response data sent by each home device through the Bluetooth multi-point connection communication channel (SPP channel in Figure 2).
进一步的,本实施例中各家居设备可以进行时钟校准;如图2所示,各家居设备可以通过网络进行时钟校准;可穿戴设备还可以在对唤醒广播数据 进行BLE广播之前,控制家居设备可以进行时钟校准。Furthermore, in this embodiment, each home device can perform clock calibration; as shown in Figure 2, each home device can perform clock calibration through the network; the wearable device can also control the home device before performing BLE broadcast of the wake-up broadcast data. Perform clock calibration.
步骤103:根据应答数据,识别家居设备中的目标家居设备。Step 103: Identify the target home device among the home devices based on the response data.
可以理解的是,本步骤中的目标家居设备可以为需要响应唤醒词数据并执行相应语音控制操作的家居设备;如目标家居设备可以为与可穿戴设备蓝牙连接的家居设备中的任一家居设备。本步骤中可穿戴设备可以根据各家居设备返回的应答数据,识别家居设备中的目标家居设备,以利用目标家居设备完成相应的语音控制操作。It can be understood that the target home device in this step can be a home device that needs to respond to wake word data and perform corresponding voice control operations; for example, the target home device can be any home device that is connected to the wearable device via Bluetooth. . In this step, the wearable device can identify the target home device among the home devices based on the response data returned by each home device, so as to use the target home device to complete the corresponding voice control operation.
具体的,对于本步骤中处理器根据应答数据,识别家居设备中的目标家居设备的具体方式,可以由设计人员根据实用场景和用户需求自行设置,如应答数据包括接收时间信息、接收信号强度指示值和唤醒词比对信息时,处理器可以根据各家居设备各自对应的接收时间信息、接收信号强度指示值和唤醒词比对信息,确定家居设备中的目标家居设备;其中,目标家居设备为任一家居设备。例如,唤醒词比对信息为唤醒词数据或设备唤醒词数据与预设唤醒词的差异值(如正向指标)时,处理器可通过D=
Figure PCTCN2022119911-appb-000001
(α·V,β·R,δ·T,Q),计算出目标家居设备;其中,Q代表家居设备的设备队列,T代表各家居设备各自对应的接收时间信息,δ代表其权重(即时间权重);R代表各家居设备各自对应的RSSI值,β代表其权重(即信号权重);V各家居设备各自对应的唤醒词比对信息,α代表其权重(即对比权重);
Figure PCTCN2022119911-appb-000002
代表具体加权计算方法,其主要功能为根据各权重计算出加权计算值,并将结果映射到各设备后,输出最终的目标家居设备D。如处理器可以根据各家居设备的接收时间差、接收信号强度指示值和唤醒词比对信息,计算各家居设备各自对应的加权计算值;其中,每个接收时间差为唤醒广播数据的发送时间信息与相应的家居设备的接收时间信息之差;加权计算值为各家居设备各自的接收时间差、接收信号强度指示值和唤醒词比对信息与对应的预设权重(如时间权重、信号权重和对比权重)的乘积之和;将目标加权计算值对应的家居设备确定为目标家居设备;其中,目标加权计算值为计算得到的加权计算值中数值最大的加权计算值。
Specifically, in this step, the specific way for the processor to identify the target home device in the home device based on the response data can be set by the designer according to the practical scenario and user needs. For example, the response data includes reception time information and received signal strength indication. When comparing information with value and wake word, the processor can determine the target home device in the home device based on the corresponding reception time information, received signal strength indication value and wake word comparison information of each home device; where, the target home device is Any home device. For example, when the wake word comparison information is wake word data or the difference value (such as a positive indicator) between the device wake word data and the preset wake word, the processor can pass D=
Figure PCTCN2022119911-appb-000001
(α·V, β·R, δ·T, Q), calculate the target home device; among them, Q represents the device queue of the home device, T represents the corresponding reception time information of each home device, and δ represents its weight (i.e. Time weight); R represents the corresponding RSSI value of each home device, β represents its weight (i.e., signal weight); V represents the wake word comparison information corresponding to each home device, and α represents its weight (i.e., comparison weight);
Figure PCTCN2022119911-appb-000002
Represents a specific weighted calculation method. Its main function is to calculate the weighted calculation value based on each weight, map the results to each device, and then output the final target home device D. For example, the processor can calculate the corresponding weighted calculation value of each home device based on the reception time difference, received signal strength indication value and wake word comparison information of each home device; where each reception time difference is the sending time information of the wake broadcast data and The difference between the reception time information of the corresponding home devices; the weighted calculation value is the reception time difference, received signal strength indication value and wake word comparison information of each home device and the corresponding preset weight (such as time weight, signal weight and comparison weight) ); determine the home equipment corresponding to the target weighted calculation value as the target home equipment; wherein, the target weighted calculation value is the weighted calculation value with the largest value among the calculated weighted calculation values.
步骤104:根据麦克风采集的唤醒词数据对应的控制语音数据,控制目标家居设备执行相应的语音控制操作。Step 104: Control the target home device to perform corresponding voice control operations according to the control voice data corresponding to the wake word data collected by the microphone.
可以理解的是,本实施例中可穿戴设备的处理器可以根据麦克风采集的 唤醒词数据对应的控制语音数据,控制目标家居设备执行相应的语音控制操作,以利用可穿戴设备对家居设备的组织管理和信息交互,实现家居设备的语音控制,减少中间设备(如手机)的控制环节,提高智能家居的人机交互效率和自然度。It can be understood that in this embodiment, the processor of the wearable device can control the target home device to perform corresponding voice control operations based on the control voice data corresponding to the wake-up word data collected by the microphone, so as to utilize the wearable device to organize the home devices. Management and information interaction, realizing voice control of home equipment, reducing the control links of intermediate devices (such as mobile phones), and improving the efficiency and naturalness of human-computer interaction in smart homes.
具体的,本步骤中控制语音数据可以为麦克风采集的语音数据中唤醒词数据之后的控制语音数据;如用户想要控制某一个家居设备时,可以直接朝向该家居设备发出语音指令,该语音指令主要包含两部分,第一部分为唤醒词,第二部分为具体的语音控制指令,例如:“嗨,开机”,这个例子中,“嗨”就是唤醒词,用户实际应用时也可自行定义,而“开机”为具体的语音控制指令;用户佩戴的可穿戴设备(如TWS耳机)识别到唤醒词后,可以自动收录全部的语音指令,即醒词数据和控制语音数据,从而在确定目标家居设备,利用目标家居设备完成控制语音数据对应的语音控制指令。Specifically, the control voice data in this step can be the control voice data after the wake-up word data in the voice data collected by the microphone; if the user wants to control a certain home device, he can directly issue a voice command to the home device. The voice command It mainly consists of two parts. The first part is the wake-up word, and the second part is the specific voice control command, such as: "Hi, turn on the phone." In this example, "Hi" is the wake-up word. The user can also define it by himself in actual application. "Power on" is a specific voice control command; after the wearable device (such as TWS headset) worn by the user recognizes the wake-up word, it can automatically collect all voice commands, that is, wake-up word data and control voice data, thereby determining the target home device , use the target home device to complete the voice control instructions corresponding to the control voice data.
对应的,对于本步骤中控制语音数据的具体选择,可以由设计人员根据使用场景和用户需求自行设置,如控制语音数据可以为麦克风采集的语音数据中唤醒词数据之后的第一段语音数据;控制语音数据也可以为麦克风采集的语音数据中唤醒词数据之后预设时间段内的语音数据,即用户说出唤醒词后可以在预设时间段内说出多个语音控制指令,从而多次控制目标目标家居设备。Correspondingly, the specific selection of control voice data in this step can be set by the designer according to the usage scenario and user needs. For example, the control voice data can be the first piece of voice data after the wake-up word data in the voice data collected by the microphone; The control voice data can also be the voice data within a preset time period after the wake-up word data in the voice data collected by the microphone. That is, after the user speaks the wake-up word, he can say multiple voice control instructions within the preset time period, thereby multiple times. Control target home devices.
具体的,对于本步骤中处理器根据麦克风采集的唤醒词数据对应的控制语音数据,控制目标家居设备执行相应的语音控制操作的具体方式,可以由设计人员根据实用场景和用户需求自行设置,如处理器根据麦克风采集的语音数据中的控制语音数据,获取语音控制指令;其中,控制语音数据为唤醒词数据之后预设时间段内的语音数据;将语音控制指令发送到目标家居设备,控制目标家居设备执行语音控制指令对应的语音控制操作,例如处理器可以通过与目标家居设备的蓝牙连接链路,如图2中的BT A2DP(蓝牙音频传输模型协定)链路,将语音控制指令发送到目标家居设备,使目标家居设备能够执行语音控制指令对应的语音控制操作;处理器也可以直接将唤醒词数据对应的控制语音数据发送到目标家居设备,以控制解析并执行控制语音数据对应的语音控制操作,例如处理器可以将唤醒词数据和对应的控制语音数据共同发送到目标家居设备。本实施例对此不做任何限制。Specifically, in this step, the specific way for the processor to control the target home device to perform the corresponding voice control operation based on the control voice data corresponding to the wake-up word data collected by the microphone can be set by the designer according to the practical scenario and user needs, such as The processor obtains voice control instructions based on the control voice data in the voice data collected by the microphone; where the control voice data is the voice data within a preset time period after the wake word data; sends the voice control instructions to the target home device to control the target The home device performs the voice control operation corresponding to the voice control command. For example, the processor can send the voice control command to the target home device through a Bluetooth connection link, such as the BT A2DP (Bluetooth Audio Transfer Model Protocol) link in Figure 2. The target home device enables the target home device to perform voice control operations corresponding to the voice control instructions; the processor can also directly send the control voice data corresponding to the wake word data to the target home device to control, parse and execute the voice corresponding to the control voice data. For control operations, for example, the processor can send wake word data and corresponding control voice data to the target home device. This embodiment does not impose any restrictions on this.
对应的,对于上述语音控制指令的具体内容,可以由设计人员根据使用场景和用户需求自行设置,如语音控制指令可以包括控制语音数据,以使目标家居设备能够利用可穿戴设备采集的更为准确的语音数据进行控制语音的识别和功能执行,以提升家居设备的语音控制的准确性;语音控制指令也可以包括控制语音数据对应的控制标识,以使目标家居设备能够利用控制标识从自身麦克风采集存储的语音数据中提取相应的控制语音数据(即设备控制语音数据),利用自身采集存储的设备控制语音数据进行控制语音的识别和功能执行,从而减少可穿戴设备与目标家居设备之间的通信数据量,提高语音控制指令的通信速度。本实施例对此不做任何限制。Correspondingly, the specific content of the above voice control instructions can be set by the designer according to the usage scenario and user needs. For example, the voice control instructions can include control voice data so that the target home equipment can use wearable devices to collect more accurate information. The voice data is used to control voice recognition and function execution to improve the accuracy of voice control of home devices; the voice control instructions can also include control identifiers corresponding to the control voice data, so that the target home device can use the control identifiers to collect from its own microphone Extract the corresponding control voice data (i.e., device control voice data) from the stored voice data, and use the device control voice data collected and stored by itself to perform control voice recognition and function execution, thereby reducing the communication between the wearable device and the target home device. The amount of data increases the communication speed of voice control instructions. This embodiment does not impose any restrictions on this.
本实施例中,本发明实施例通过根据应答数据,识别家居设备中的目标家居设备,使可穿戴设备能够自动识别用户所要控制的家居设备,以直接控制该家居设备进行控制语音数据对应的操作,从而使佩戴可穿戴设备的用户能够自然的朝向附近的家居设备来直接发出对于该家居设备的控制,减少了中间设备的控制环节,提高了智能家居的人机交互效率和自然度。In this embodiment, the embodiment of the present invention identifies the target home device among the home devices according to the response data, so that the wearable device can automatically identify the home device that the user wants to control, so as to directly control the home device to perform operations corresponding to the control voice data. , so that users wearing wearable devices can naturally direct control of the home devices toward nearby home devices, reducing the control links of intermediate devices and improving the efficiency and naturalness of human-computer interaction in smart homes.
相应于上面的方法实施例,本发明实施例还提供了一种家居设备的语音控制装置,下文描述的一种家居设备的语音控制装置与上文描述的一种家居设备的语音控制方法可相互对应参照。Corresponding to the above method embodiments, embodiments of the present invention also provide a voice control device for home equipment. The voice control device for home equipment described below and the voice control method for home equipment described above can interact with each other. Corresponding reference.
请参考图3,图3为本发明实施例所提供的一种家居设备的语音控制装置的结构框图。该装置应用于可穿戴设备,可以包括:Please refer to FIG. 3 , which is a structural block diagram of a voice control device for home equipment provided by an embodiment of the present invention. The device is applied to wearable devices and can include:
唤醒获取模块10,用于根据麦克风采集的唤醒词数据,得到唤醒广播数据;其中,麦克风设置在可穿戴设备中;The wake-up acquisition module 10 is used to obtain wake-up broadcast data based on the wake-up word data collected by the microphone; wherein the microphone is set in the wearable device;
广播发送模块20,用于对唤醒广播数据进行BLE广播,并接收与可穿戴设备蓝牙连接的家居设备返回的应答数据;其中,应答数据包括家居设备相对位置信息或家居设备相对位置信息和唤醒词比对信息;The broadcast sending module 20 is used to perform BLE broadcast of wake-up broadcast data, and receive response data returned by home devices connected to the wearable device via Bluetooth; where the response data includes home device relative position information or home device relative position information and wake-up words. Compare information;
家居识别模块30,用于根据应答数据,识别家居设备中的目标家居设备;The home identification module 30 is used to identify the target home equipment among the home equipment according to the response data;
语音控制模块40,用于根据麦克风采集的唤醒词数据对应的控制语音数据,控制目标家居设备执行相应的语音控制操作。The voice control module 40 is used to control the target home device to perform corresponding voice control operations based on the control voice data corresponding to the wake-up word data collected by the microphone.
可选的,家居设备相对位置信息包括唤醒广播数据的接收时间信息和/或与可穿戴设备的蓝牙连接的接收信号强度指示值。Optionally, the relative position information of the home device includes reception time information of wake-up broadcast data and/or received signal strength indication value of the Bluetooth connection with the wearable device.
可选的,家居设备相对位置信息包括接收时间信息和接收信号强度指示值,家居识别模块30可以具体用于根据接收时间信息、接收信号强度指示值和唤醒词比对信息,确定家居设备中的目标家居设备;其中,目标家居设备为任一家居设备。Optionally, the relative position information of the home device includes reception time information and received signal strength indication value. The home identification module 30 may be specifically configured to determine the location of the home device based on the reception time information, the received signal strength indication value and the wake word comparison information. Target home equipment; wherein, the target home equipment is any home equipment.
可选的,家居识别模块30可以包括:Optionally, the home identification module 30 may include:
计算子模块,用于根据各家居设备的接收时间差、接收信号强度指示值和唤醒词比对信息,计算各家居设备各自对应的加权计算值;其中,每个接收时间差为唤醒广播数据的发送时间信息与相应的家居设备的接收时间信息之差;加权计算值为各家居设备各自的接收时间差、接收信号强度指示值和唤醒词比对信息与对应的预设权重的乘积之和;The calculation submodule is used to calculate the corresponding weighted calculation value of each home device based on the reception time difference, received signal strength indication value and wake word comparison information of each home device; where each reception time difference is the sending time of the wake broadcast data The difference between the information and the reception time information of the corresponding home device; the weighted calculation value is the sum of the products of the reception time difference of each home device, the received signal strength indication value and the wake word comparison information and the corresponding preset weight;
确定子模块,用于将目标加权计算值对应的家居设备确定为目标家居设备;其中,目标加权计算值为加权计算值中数值最大的加权计算值。The determination sub-module is used to determine the home equipment corresponding to the target weighted calculation value as the target home equipment; wherein the target weighted calculation value is the weighted calculation value with the largest value among the weighted calculation values.
可选的,唤醒广播数据包括唤醒词数据和唤醒标识,该装置还可以包括:Optionally, the wake-up broadcast data includes wake-up word data and wake-up identification. The device may also include:
语音采集模块,用于获取麦克风采集的语音数据;The voice collection module is used to obtain the voice data collected by the microphone;
唤醒检测模块,用于检测语音数据中是否存在唤醒词;Wake-up detection module, used to detect whether there is a wake-up word in the voice data;
唤醒词确定模块,用于若存在唤醒词,则将语音数据中唤醒词对应的字段数据确定为唤醒词数据。The wake-up word determination module is used to determine the field data corresponding to the wake-up word in the voice data as the wake-up word data if there is a wake-up word.
可选的,广播发送模块20可以包括:Optionally, the broadcast sending module 20 may include:
通信接收子模块,用于通过可穿戴设备的蓝牙多点连接的通信通道,接收各家居设备发送的应答数据。The communication receiving submodule is used to receive the response data sent by each home device through the communication channel of the Bluetooth multi-point connection of the wearable device.
可选的,语音控制模块40可以包括:Optionally, the voice control module 40 may include:
指令获取子模块,用于根据麦克风采集的语音数据中的控制语音数据,获取语音控制指令;其中,控制语音数据为唤醒词数据之后预设时间段内的语音数据;The instruction acquisition submodule is used to obtain voice control instructions based on the control voice data in the voice data collected by the microphone; wherein the control voice data is the voice data within a preset time period after the wake-up word data;
指令发送子模块,用于将语音控制指令发送到目标家居设备,控制目标家居设备语音控制指令对应的语音控制操作。The command sending sub-module is used to send voice control commands to the target home equipment and control the voice control operations corresponding to the voice control commands of the target home equipment.
本实施例中,本发明实施例通过家居识别模块30根据应答数据,识别家居设备中的目标家居设备,使可穿戴设备能够自动识别用户所要控制的家居设备,以直接控制该家居设备进行控制语音数据对应的操作,从而使佩戴可穿戴设备的用户能够自然的朝向附近的家居设备来直接发出对于该家居设备 的控制,减少了中间设备的控制环节,提高了智能家居的人机交互效率和自然度。In this embodiment, the embodiment of the present invention uses the home recognition module 30 to identify the target home device among the home devices according to the response data, so that the wearable device can automatically identify the home device that the user wants to control, so as to directly control the home device for voice control. Data-corresponding operations allow users wearing wearable devices to naturally direct control of the home devices toward nearby home devices, reducing the control links of intermediate devices and improving the efficiency and naturalness of human-computer interaction in smart homes. Spend.
相应于上面的方法实施例,本发明实施例还提供了一种可穿戴设备,下文描述的一种可穿戴设备与上文描述的一种家居设备的语音控制方法可相互对应参照。Corresponding to the above method embodiments, embodiments of the present invention also provide a wearable device. The wearable device described below and the voice control method for home equipment described above may be mutually referenced.
一种可穿戴设备,包括:A wearable device including:
存储器,用于存储计算机程序;Memory, used to store computer programs;
处理器,用于执行计算机程序时实现如上述实施例所提供的家居设备的语音控制方法的步骤。A processor, configured to implement the steps of the voice control method for home equipment provided in the above embodiments when executing a computer program.
具体的,本实施例并不限定可穿戴设备的具体设备类型,如可穿戴设备可以具体为蓝牙耳机,例如TWS耳机;可穿戴设备也可以具体为头戴显示设备,例如AR眼镜;可穿戴设备还可以具体为手表设备和手环设备。Specifically, this embodiment does not limit the specific device type of the wearable device. For example, the wearable device may be a Bluetooth headset, such as a TWS headset; the wearable device may also be a head-mounted display device, such as AR glasses; the wearable device It can also be specifically a watch device and a bracelet device.
相应于上面的方法实施例,本发明实施例还提供了一种计算机可读存储介质,下文描述的一种计算机可读存储介质与上文描述的一种家居设备的语音控制方法可相互对应参照。Corresponding to the above method embodiments, embodiments of the present invention also provide a computer-readable storage medium. The computer-readable storage medium described below and the voice control method for home equipment described above can correspond to each other. .
一种计算机可读存储介质,该计算机可读存储介质上存储有计算机程序,计算机程序被处理器执行时实现上述方法实施例所提供的家居设备的语音控制方法的步骤。A computer-readable storage medium has a computer program stored on the computer-readable storage medium. When the computer program is executed by a processor, the steps of the voice control method for home equipment provided by the above method embodiment are implemented.
该计算机可读存储介质具体可以为U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可存储程序代码的介质。The computer-readable storage medium can specifically be a U disk, a mobile hard disk, a read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk that can store program codes. medium.
说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对于实施例公开的装置、可穿戴设备及计算机可读存储介质而言,由于其与实施例公开的方法相对应,所以描述的比较简单,相关之处参见方法部分说明即可。以上对本发明所提供的一种家居设备的语音控制方法、装置、可穿戴设备及计算机可读存储介质进行了详细介绍。本文中应用了具体个例对本发 明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想。应当指出,对于本技术领域的普通技术人员来说,在不脱离本发明原理的前提下,还可以对本发明进行若干改进和修饰,这些改进和修饰也落入本发明权利要求的保护范围内。Each embodiment in the specification is described in a progressive manner. Each embodiment focuses on its differences from other embodiments. The same and similar parts between the various embodiments can be referred to each other. As for the devices, wearable devices, and computer-readable storage media disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple. For relevant details, please refer to the description in the method section. The above has introduced in detail the voice control method, device, wearable device and computer-readable storage medium for home equipment provided by the present invention. This article uses specific examples to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention. It should be noted that those skilled in the art can make several improvements and modifications to the present invention without departing from the principles of the present invention, and these improvements and modifications also fall within the scope of the claims of the present invention.

Claims (10)

  1. 一种家居设备的语音控制方法,其特征在于,应用于可穿戴设备,包括:A voice control method for home equipment, characterized in that it is applied to wearable devices, including:
    根据麦克风采集的唤醒词数据,得到唤醒广播数据;其中,所述麦克风设置在所述可穿戴设备中;Wake-up broadcast data is obtained according to the wake-up word data collected by the microphone; wherein the microphone is provided in the wearable device;
    对所述唤醒广播数据进行BLE广播,并接收与所述可穿戴设备蓝牙连接的家居设备返回的应答数据;其中,所述应答数据包括家居设备相对位置信息或所述家居设备相对位置信息和唤醒词比对信息;Perform BLE broadcast on the wake-up broadcast data, and receive response data returned by the home device connected to the wearable device via Bluetooth; wherein the response data includes home device relative position information or the home device relative position information and wake-up time. word comparison information;
    根据所述应答数据,识别所述家居设备中的目标家居设备;Identify a target home device among the home devices according to the response data;
    根据所述麦克风采集的所述唤醒词数据对应的控制语音数据,控制所述目标家居设备执行相应的语音控制操作。According to the control voice data corresponding to the wake-up word data collected by the microphone, the target home device is controlled to perform a corresponding voice control operation.
  2. 根据权利要求1所述的家居设备的语音控制方法,其特征在于,所述家居设备相对位置信息包括所述唤醒广播数据的接收时间信息和/或与所述可穿戴设备的蓝牙连接的接收信号强度指示值。The voice control method of home equipment according to claim 1, characterized in that the relative position information of the home equipment includes the reception time information of the wake-up broadcast data and/or the reception signal of the Bluetooth connection with the wearable device. Intensity indication value.
  3. 根据权利要求2所述的家居设备的语音控制方法,其特征在于,所述家居设备相对位置信息包括所述接收时间信息和所述接收信号强度指示值,所述根据所述应答数据,识别所述家居设备中的目标家居设备,包括:The voice control method for home equipment according to claim 2, wherein the relative position information of the home equipment includes the reception time information and the received signal strength indication value, and the identification of the home equipment based on the response data is The target home equipment in the above-mentioned home equipment includes:
    根据所述接收时间信息、所述接收信号强度指示值和所述唤醒词比对信息,确定所述家居设备中的目标家居设备;其中,所述目标家居设备为任一所述家居设备。According to the reception time information, the received signal strength indication value and the wake word comparison information, a target home device among the home devices is determined; wherein the target home device is any of the home devices.
  4. 根据权利要求3所述的家居设备的语音控制方法,其特征在于,所述根据所述接收时间信息、所述接收信号强度指示值和所述唤醒词比对信息,确定所述家居设备中的目标家居设备,包括:The voice control method of home equipment according to claim 3, characterized in that: determining the number of words in the home equipment based on the reception time information, the received signal strength indication value and the wake-up word comparison information. Target home devices include:
    根据各所述家居设备的接收时间差、所述接收信号强度指示值和所述唤醒词比对信息,计算各所述家居设备各自对应的加权计算值;其中,每个所述接收时间差为所述唤醒广播数据的发送时间信息与相应的家居设备的接收时间信息之差;所述加权计算值为各所述家居设备各自的接收时间差、接收信号强度指示值和唤醒词比对信息与对应的预设权重的乘积之和;According to the reception time difference of each of the home devices, the received signal strength indication value and the wake word comparison information, a weighted calculation value corresponding to each of the home devices is calculated; wherein each of the reception time differences is the The difference between the sending time information of the wake-up broadcast data and the receiving time information of the corresponding home equipment; the weighted calculation value is the receiving time difference of each of the home equipment, the received signal strength indication value and the wake-up word comparison information and the corresponding preset Let the sum of the products of the weights be;
    将目标加权计算值对应的家居设备确定为所述目标家居设备;其中,目标加权计算值为所述加权计算值中数值最大的加权计算值。The home equipment corresponding to the target weighted calculation value is determined as the target home equipment; wherein the target weighted calculation value is the weighted calculation value with the largest value among the weighted calculation values.
  5. 根据权利要求1所述的家居设备的语音控制方法,其特征在于,所述唤醒广播数据包括唤醒标识,所述根据麦克风采集的唤醒词数据,得到唤醒广播数据之前,包括:The voice control method for home equipment according to claim 1, wherein the wake-up broadcast data includes a wake-up identifier, and before obtaining the wake-up broadcast data based on the wake-up word data collected by the microphone, the method includes:
    获取所述麦克风采集的语音数据;Obtain the voice data collected by the microphone;
    检测所述语音数据中是否存在唤醒词;Detect whether there is a wake-up word in the voice data;
    若是,则将所述语音数据中所述唤醒词对应的字段数据确定为所述唤醒词数据。If so, the field data corresponding to the wake-up word in the voice data is determined as the wake-up word data.
  6. 根据权利要求1所述的家居设备的语音控制方法,其特征在于,所述接收与所述可穿戴设备蓝牙连接的家居设备返回的应答数据,包括:The voice control method for home equipment according to claim 1, wherein the receiving response data returned by the home equipment connected to the wearable device via Bluetooth includes:
    通过所述可穿戴设备的蓝牙多点连接的通信通道,接收各所述家居设备发送的所述应答数据。The response data sent by each of the home devices is received through the communication channel of the Bluetooth multi-point connection of the wearable device.
  7. 根据权利要求1至6任一项所述的家居设备的语音控制方法,其特征在于,所述根据所述麦克风采集的所述唤醒词数据对应的控制语音数据,控制所述目标家居设备执行相应的语音控制操作,包括:The voice control method for home equipment according to any one of claims 1 to 6, characterized in that, according to the control voice data corresponding to the wake-up word data collected by the microphone, the target home equipment is controlled to execute the corresponding control voice data. voice control operations, including:
    根据所述麦克风采集的语音数据中的控制语音数据,获取语音控制指令;其中,所述控制语音数据为所述唤醒词数据之后预设时间段内的语音数据;Obtain voice control instructions according to the control voice data in the voice data collected by the microphone; wherein the control voice data is the voice data within a preset time period after the wake-up word data;
    将所述语音控制指令发送到所述目标家居设备,控制所述目标家居设备所述语音控制指令对应的语音控制操作。The voice control instruction is sent to the target home device, and the voice control operation corresponding to the voice control instruction of the target home device is controlled.
  8. 一种家居设备的语音控制装置,其特征在于,应用于可穿戴设备,包括:A voice control device for home equipment, characterized in that it is applied to wearable devices, including:
    唤醒获取模块,用于根据麦克风采集的唤醒词数据,得到唤醒广播数据;其中,所述麦克风设置在所述可穿戴设备中;A wake-up acquisition module, configured to obtain wake-up broadcast data according to the wake-up word data collected by the microphone; wherein the microphone is provided in the wearable device;
    广播发送模块,用于对所述唤醒广播数据进行BLE广播,并接收与所述可穿戴设备蓝牙连接的家居设备返回的应答数据;其中,所述应答数据包括家居设备相对位置信息或所述家居设备相对位置信息和唤醒词比对信息;A broadcast sending module, configured to perform BLE broadcast on the wake-up broadcast data, and receive response data returned by the home device connected to the wearable device via Bluetooth; wherein the response data includes relative position information of the home device or the home device's relative position information. Device relative position information and wake word comparison information;
    家居识别模块,用于根据所述应答数据,识别所述家居设备中的目标家居设备;A home identification module, configured to identify target home equipment among the home equipment according to the response data;
    语音控制模块,用于根据所述麦克风采集的所述唤醒词数据对应的控制语音数据,控制所述目标家居设备执行相应的语音控制操作。A voice control module, configured to control the target home device to perform corresponding voice control operations according to the control voice data corresponding to the wake-up word data collected by the microphone.
  9. 一种可穿戴设备,其特征在于,包括:A wearable device, characterized by including:
    存储器,用于存储计算机程序;Memory, used to store computer programs;
    处理器,用于执行所述计算机程序时实现如权利要求1至7任一项所述的家居设备的语音控制方法的步骤。A processor, configured to implement the steps of the voice control method for home equipment according to any one of claims 1 to 7 when executing the computer program.
  10. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至7任一项所述的家居设备的语音控制方法的步骤。A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the home equipment according to any one of claims 1 to 7 is implemented. Steps of voice control method.
PCT/CN2022/119911 2022-06-29 2022-09-20 Voice control method and apparatus for home device, wearable device and storage medium WO2024000836A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210753455.5 2022-06-29
CN202210753455.5A CN115134182B (en) 2022-06-29 2022-06-29 Voice control method and device of household equipment, wearable equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2024000836A1 true WO2024000836A1 (en) 2024-01-04

Family

ID=83379431

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/119911 WO2024000836A1 (en) 2022-06-29 2022-09-20 Voice control method and apparatus for home device, wearable device and storage medium

Country Status (2)

Country Link
CN (1) CN115134182B (en)
WO (1) WO2024000836A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN206388060U (en) * 2017-01-13 2017-08-08 孙健 Pass through the wearable intelligent house control system of Voice command
CN110956963A (en) * 2019-11-20 2020-04-03 歌尔股份有限公司 Interaction method realized based on wearable device and wearable device
US20210151048A1 (en) * 2019-11-18 2021-05-20 Baidu Online Network Technology (Beijing) Co., Ltd. Smart Speaker Wake-Up Method and Device, Smart Speaker and Storage Medium
WO2021232797A1 (en) * 2020-05-18 2021-11-25 珠海格力电器股份有限公司 Method and apparatus for controlling home device, and computer device and storage medium
WO2022111579A1 (en) * 2020-11-27 2022-06-02 华为技术有限公司 Voice wakeup method and electronic device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160165387A1 (en) * 2014-08-26 2016-06-09 Hoang Nhu Smart home platform with data analytics for monitoring and related methods
CN105700364A (en) * 2016-01-20 2016-06-22 宇龙计算机通信科技(深圳)有限公司 Intelligent household control method and wearable equipment
CN108831448B (en) * 2018-03-22 2021-03-02 北京小米移动软件有限公司 Method and device for controlling intelligent equipment through voice and storage medium
KR20200036571A (en) * 2018-09-28 2020-04-07 삼성전자주식회사 Mehthod and an electronic device for contorolling a function based on a location and a direction of an objection

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN206388060U (en) * 2017-01-13 2017-08-08 孙健 Pass through the wearable intelligent house control system of Voice command
US20210151048A1 (en) * 2019-11-18 2021-05-20 Baidu Online Network Technology (Beijing) Co., Ltd. Smart Speaker Wake-Up Method and Device, Smart Speaker and Storage Medium
CN110956963A (en) * 2019-11-20 2020-04-03 歌尔股份有限公司 Interaction method realized based on wearable device and wearable device
WO2021232797A1 (en) * 2020-05-18 2021-11-25 珠海格力电器股份有限公司 Method and apparatus for controlling home device, and computer device and storage medium
WO2022111579A1 (en) * 2020-11-27 2022-06-02 华为技术有限公司 Voice wakeup method and electronic device

Also Published As

Publication number Publication date
CN115134182A (en) 2022-09-30
CN115134182B (en) 2023-07-07

Similar Documents

Publication Publication Date Title
CN112863547B (en) Virtual resource transfer processing method, device, storage medium and computer equipment
CN109905907B (en) Network searching method and mobile terminal
US9344878B2 (en) Method and system for operating communication service
US10216729B2 (en) Terminal device and hands-free device for hands-free automatic interpretation service, and hands-free automatic interpretation service method
US20230072352A1 (en) Speech Recognition Method and Apparatus, Terminal, and Storage Medium
WO2018219105A1 (en) Speech recognition and related products
WO2016160123A1 (en) Controlling electronic device based on direction of speech
CN107613146B (en) Volume adjustment method and device and mobile terminal
CN109994111B (en) Interaction method, interaction device and mobile terminal
CN109151789A (en) Interpretation method, device, system and bluetooth headset
WO2019015418A1 (en) Unlocking control method and related product
CN109286728A (en) A kind of dialog context processing method and terminal device
CN112634902A (en) Voice transcription method, device, recording pen and storage medium
CN110727349B (en) Human-computer interaction method and AR (augmented reality) glasses based on bone conduction interaction
CN110335590B (en) Voice recognition test method, device and system
CN110113779B (en) eSIM card testing method, system and medium
WO2024000836A1 (en) Voice control method and apparatus for home device, wearable device and storage medium
CN111491292B (en) Internet access mode adjusting method and device, storage medium and mobile terminal
CN108491471B (en) Text information processing method and mobile terminal
EP4102498A1 (en) Method for determining voice response speed, related device and computer program product
US20230376118A1 (en) Earphone, earphone control method and earphone control device
CN111897916B (en) Voice instruction recognition method, device, terminal equipment and storage medium
CN106200950A (en) A kind of method of adjustable font size and mobile terminal
CN112394346A (en) Distance measurement method and device and terminal equipment
CN111985252A (en) Dialogue translation method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22948925

Country of ref document: EP

Kind code of ref document: A1