WO2020215741A1 - Speech recognition device and wake-up response method therefor, and computer storage medium - Google Patents
Speech recognition device and wake-up response method therefor, and computer storage medium Download PDFInfo
- Publication number
- WO2020215741A1 WO2020215741A1 PCT/CN2019/124117 CN2019124117W WO2020215741A1 WO 2020215741 A1 WO2020215741 A1 WO 2020215741A1 CN 2019124117 W CN2019124117 W CN 2019124117W WO 2020215741 A1 WO2020215741 A1 WO 2020215741A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- distance information
- voice recognition
- wake
- voice
- recognition device
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
Definitions
- This application relates to the field of voice wake-up, in particular to a voice recognition device and its wake-up response method, and computer storage media.
- the present application provides a wake-up response method for a voice recognition device, a voice recognition device, and a computer storage medium, so as to solve the mutual interference problem caused by multiple voice recognition devices responding to the wake-up voice at the same time in the prior art.
- this application provides a wake-up response method for voice recognition devices.
- Multiple voice recognition devices form a network.
- the multiple voice recognition devices are divided into a central device and at least one non-central device;
- the wake-up response method includes: central The device analyzes the collected voice signals to obtain the distance information of the central device; the distance information of the central device indicates the distance between the central device and the signal source of the voice signal; the distance information of the non-central device is received, and the distance information of the non-central device is determined by the non-central device Obtained by analyzing the collected voice signals, indicating the distance between the non-central device and the signal source; comparing the distance information of the central device and the distance information of the non-central device; determining the voice recognition device to be responded, and the voice recognition device to be responded to the voice response in the regional network Signal voice recognition equipment.
- this application provides a wake-up response method for a voice recognition device.
- Multiple voice recognition devices form a regional network.
- the multiple voice recognition devices are divided into a central device and at least one non-central device;
- the wake-up response method includes:
- the non-central device analyzes the collected voice signals to obtain the distance information of the non-central device;
- the distance information of the non-central device indicates the distance between the non-central device and the signal source of the voice signal; and sends the distance information of the non-central device to the central device
- the hub device compares the distance information of the non-central device with the distance information of the hub device to determine the voice recognition device to be responded;
- the distance information of the hub device indicates the distance between the hub device and the source of the voice signal, and the voice recognition device to be responded is the area Voice recognition equipment that responds to voice signals in the network.
- the present application provides a voice recognition device, which includes a processor and a memory, a computer program is stored in the memory, and the processor is used to execute the computer program to implement the steps of the wake-up response method.
- this application provides a computer storage medium in which a computer program is stored, and when the computer program is executed, the steps of the above wake-up response method are realized.
- multiple voice recognition devices form a network, where the voice recognition device determines the distance information from the signal source of the voice signal by analyzing the collected voice signal.
- the multiple voice recognition devices are divided into a central device and at least one non-central device.
- the hub device obtains its own distance information, and accepts the distance information of the non-central device; then compares its own distance information with the distance information of the non-central device to determine the voice recognition device to be responded to, which is the local area network Voice recognition equipment in response to voice signals.
- the voice recognition devices forming the network do not respond temporarily after being awakened by the voice signal.
- the central device first determines which one should respond, so as to avoid the problem of mutual interference after multiple voice recognition devices respond.
- Figure 1 is a schematic diagram of the structure of a network formed by interconnecting voice recognition devices of the present application
- Figure 2 is a schematic flow diagram of the application of the wake-up response method of the voice recognition device of the present application in a single area network;
- Figure 3 is a schematic diagram of the positional relationship between three microphones of a linear array and a signal source
- FIG. 4 is a schematic flow diagram of the application of the wake-up response method of the voice recognition device of the present application in a multi-area network;
- FIG. 5 is a schematic diagram of the work flow of the hub device side of the wake-up response method of the voice recognition device of this application;
- FIG. 6 is a schematic diagram of the non-central device side work flow of the wake-up response method of the voice recognition device of this application;
- FIG. 7 is a schematic structural diagram of an embodiment of a speech recognition device according to the present application.
- Fig. 8 is a schematic structural diagram of an embodiment of a computer storage medium of the present application.
- the wake-up response method of the present application is applied to the situation where multiple voice recognition devices can respond to the same voice signal.
- voice recognition devices such as televisions, air conditioners, and refrigerators in the living room area; voice recognition devices such as refrigerators, microwave ovens, kettles, and rice cookers exist in the kitchen area.
- voice recognition devices such as televisions, air conditioners, and refrigerators in the living room area
- voice recognition devices such as refrigerators, microwave ovens, kettles, and rice cookers exist in the kitchen area.
- the response sound of the household appliance A may be received and responded by the household appliance B, which may cause mutual interference between the household appliances and fail to respond to the user's needs normally.
- the household appliance B may cause mutual interference between the household appliances and fail to respond to the user's needs normally.
- both areas can receive the voice signal and respond to the voice signal, and the problem of mutual interference may also occur.
- the speech recognition device of the present application it is a mode of waking up first and then responding, that is, being awakened by a voice signal sent by the user first, and then responding to the voice signal.
- this application introduces a selection determination mechanism between wake-up and response, that is, after being awakened by a voice signal, it does not respond temporarily, and then responds when it is determined that a response is needed.
- multiple voice recognition devices are connected to each other to form a regional network.
- One voice recognition device is used as the hub device in the regional network.
- the hub device determines which voice recognition device in the regional network responds to the regional network. voice signal.
- the hub device of each area network first determines the voice recognition device to be responded to the voice signal in the area network. After that, a first hub device among all the hub devices determines the waiting voice recognition device in which area network. Respond to the voice recognition device to respond, thereby solving the problem of mutual interference caused by multiple voice recognition devices responding to voice signals.
- the central device In the application of household appliances, since the central device needs to be able to respond to the user's voice signal at any time to determine the device that responds to the voice signal, it is generally selected to connect to the power source for a long time and basically not power off the household appliance; and the interactive screen is preferred.
- the network hub device which facilitates related settings through the interactive screen.
- the refrigerator serves as a central device.
- each area such as the living room area and the home appliance in the kitchen area, can form an area network.
- the area network corresponds to the division of areas. On the network connection, it does not necessarily form a separate area network, that is, it may be Home appliances in all areas of a family can be connected to each other to form a whole home appliance network.
- the network constituted in this application includes, but is not limited to, a local area network composed of WIFI wireless network, a local area network composed of a wired network, a LAN composed of Bluetooth mesh, a local area network composed of zigbee, a local area network composed of RS485, a local area network composed of LoRa, a local area network composed of 1394, LAN composed of CAN and so on.
- the communication mechanism of the formed network includes but is not limited to UDP, TCP/IP, HTTP, MQTT, CoAP, etc., to ensure that each voice recognition device on the same network can quickly and reliably exchange information.
- the following describes the wake-up response method starting from the network formed by the voice recognition device.
- FIG. 1 is a schematic diagram of the structure of a network formed by interconnecting voice recognition devices of this application.
- the area in Figure 1 is divided into living room area A, kitchen area B, and bedroom area C; in living room area A, voice recognition equipment includes: refrigerator A1, TV A2, air purifier A3; in kitchen area B, voice recognition equipment includes: Range hood B1, rice cooker B2, wall breaker B3; in bedroom area C, voice recognition equipment includes: air conditioner C1, humidifier C2. All voice recognition devices are connected to form a network, and the voice recognition devices in each area also form a regional network.
- the voice devices in each regional network are divided into a central device and at least one non-central device, and the central device determines the voice recognition device to respond to the voice signal in the local network.
- the hub devices of all regional networks are further divided into a first hub device and at least one second hub device. The first hub device determines which voice recognition device in the regional network will respond to the voice signal.
- voice devices in the local area network are not only divided into hub devices and non-central devices, but also have a wake-up priority.
- the wake-up priority can be set by the manufacturer when the voice recognition device is shipped from the factory. After the network, the voice recognition device with the highest wake-up priority automatically serves as the central device of the regional network; the wake-up priority can also be set when the network is constructed, set by the user, or set by the service provider who builds the network; according to the set wake-up priority The voice recognition device with the highest wake-up priority is the central device of the network.
- the priority of living room area A is A1>A2>A3
- the priority of kitchen area B is B1>B2>B3
- the priority of bedroom area C is C1>C2; where A1 , B1 and C1 respectively serve as the central equipment of their respective local area networks.
- A1 , B1 and C1 respectively serve as the central equipment of their respective local area networks.
- A1 is the first hub device
- B1 and C1 are the second hub devices.
- Figure 1 can realize wake-up response in a single area and wake-up response in multiple areas.
- Figure 2 is a schematic flow diagram of the application of the wake-up response method of the voice recognition device of this application on a single area network
- Figure 4 is a schematic flow diagram of the application of the wake-up response method of the voice recognition device of this application on a multi-area network .
- the implementation of the wake-up response method in a single area network includes the following steps.
- S201 The voice recognition device analyzes the collected voice signal to obtain distance information.
- the voice recognition device mainly performs two actions, collection and analysis. After the user, the signal source, sends out the voice signal, the voice recognition device can collect the voice signal. Because each voice recognition device has a different relative position with the user, the voice signal it collects is also different. Among them, the voice recognition equipment far away from the user may not be able to collect voice signals even in the local area network.
- the voice recognition devices analyze the voice signals collected by each.
- all voice recognition devices in each regional network have the same voice signal analysis mechanism to facilitate subsequent comparison calculations.
- the voice signal is analyzed and calculated to obtain distance information, which indicates the distance between the voice recognition device and the signal source of the voice signal.
- the distance information includes the identification of the voice recognition device and the distance value used for judgment.
- the distance value of the distance information may be determined according to the voice signals collected by at least three microphones. That is, at least three microphones are provided on the voice recognition device, and each microphone collects voice signals. Firstly, at least three microphones are used to separately collect voice signals, where the relative positions of the at least three microphones on the voice recognition device are fixed; then, the distance value of the distance information is calculated based on the relative positions of the at least three microphones and the voice signals respectively collected.
- the relative positions of the at least three microphones and the signal source are calculated; according to the relative positions of the at least three microphones and the signal source, and the relative positions between the at least three microphones, Calculate the distance value of the distance information.
- FIG. 3 is a schematic diagram of the positional relationship between the three microphones of the linear array and the signal source.
- d is the relative distance between the microphones mic
- the distance value l calculated above is the distance value of the distance information between the voice recognition device and the signal source.
- the distance value of the distance information obtained by the device A1 is recorded as LA1
- the distance value of the distance information obtained by the device A2 is recorded as LA2
- the distance value of the distance information obtained by the device A3 is recorded as LA3.
- the central hub device analyzes the collected voice signal to obtain the sound distance information of the central device; the non-central device analyzes the collected voice signal to obtain the distance information of the non-central device.
- S202 The hub device receives the distance information of the non-central device.
- the non-central device After the voice recognition device calculates and obtains the distance information, the non-central device sends the distance information obtained by itself to the central device.
- the hub device A1 receives the distance information sent by the non-central device.
- the hub device compares the distance information of the hub device with the distance information of the non-central device, and determines the voice recognition device to be responded.
- the hub device compares the distance information of the hub device with the distance information of the non-central device, so as to determine the voice recognition device in the area network that responds to the voice signal.
- the hub device uses a sorting algorithm to compare the distance values of the distance information, and obtains the sorting of the distance values of all the distance information, so as to obtain the distance information with the smallest distance value, that is, the voice recognition device that is closest to the signal source of the voice signal. The closer the distance, the larger the user may be the voice signal sent by the voice recognition device.
- the voice recognition device corresponding to the distance information with the smallest distance value is the voice recognition device to be responded.
- Sorting algorithms include, but are not limited to, insertion sort, Hill sort, selection sort, heap sort, bubble sort, quick sort, merge sort, computational sort, bucket sort, radix sort, etc.
- order of the distance value of the distance information is LA2 ⁇ LA1 ⁇ LA3.
- the device that responds to the voice signal is determined based on the wake-up priority of the voice recognition device.
- the voice recognition devices corresponding to the distance information with the smallest distance value the one with the highest priority is determined as the voice recognition device to be responded.
- the hub device sends a notification whether to respond to the voice signal to the non-central device.
- the hub device After the hub device determines the voice recognition device to respond to the voice signal, it can send a notification of whether to respond to the voice signal to the non-central device, that is, to all voice recognition devices that have been awakened but have not responded to the voice signal through the network.
- the notification may be a specific response or no response, and may also be device information of the determined voice recognition device that responds to the voice signal. It is also possible to only send a notification to the voice recognition device to be responded, and other voice recognition devices that have not received the notification do not respond, but those that receive the notification respond.
- S205 The voice recognition device to be responded responds to the voice signal.
- the identified voice recognition device can respond to the voice signal, while other voice recognition devices do not. It is ensured that only one voice recognition device responds to the voice signal without causing mutual interference.
- the method shown in Figure 2 above is applied to the voice wake-up recognition of a single area network. After the voice recognition device in the single area network is awakened by voice information, it does not respond immediately, but after the central device of the single area network determines the responding device, Respond again.
- a multi-area network is a plurality of interconnected area networks.
- the hub devices of each area network are connected to each other. They are divided into a first hub device and at least one second hub device. Each area network determines its response After the voice recognition device, the first hub device further confirms the voice recognition device that responds to the voice signal.
- the steps for implementing the wake-up response method for each regional network in the multi-regional network will not be repeated. Please also refer to FIG. 4.
- the wake-up response method of the multi-regional network further includes the following steps.
- S401 The second hub device sends second distance information to the first hub device, and the first hub device receives the second distance information.
- the first hub device needs to compare the distance information of the voice recognition device to be responded to in all regional networks to determine the voice recognition device that responds to the voice signal.
- the voice recognition device to be responded to is determined in a single regional network A voice recognition device that responds to voice signals; in the application of a multi-area network, the voice recognition device to be responded determined by a single regional network does not respond immediately; instead, the first central device receives multiple voice recognition
- the recognition device confirms which one responds to the voice signal, that is, the final voice recognition device that responds to the voice signal is determined. Therefore, in this step S401, the second central device sends its second distance information to the first central device.
- the second distance information is the distance information of the voice recognition device to be responded in the area where the second central device is located.
- A1 compares LA1, LA2, and LA3 to determine that the voice recognition device to be responded is A2; in area B, B1 compares LB1, LB2, and LB3 to determine that the voice recognition device to respond is B3; in area C, C1 compares LC1 and LC2 to determine that the responding device is C1.
- B1 sends the distance information LB3 of the voice recognition device B3 to be responded in its local area network to A1, and C1 also sends the distance information LC1 to A1, and the distance information of the voice recognition device A2 to be responded determined by A1 itself is LA2.
- the first hub device compares the second distance information with the first distance information, and determines a voice recognition device that responds to the voice signal.
- the first hub device compares the distance information of each voice recognition device to be responded, that is, the first distance information and the second distance information.
- the first distance information is the distance information of the voice recognition device to be responded in the local network where the first hub device is located.
- the comparison process of this step S402 is similar to the comparison process of the foregoing step S203, and the details are not repeated here. That is, the distance value of the first distance information and the distance value of the second distance information are compared to obtain the distance information with the smallest distance value; the voice recognition device corresponding to the distance information with the smallest distance value is determined to respond to the voice signal.
- A1 compares LA2, LB3, and LC1; thereby determining the voice recognition device that responds to the voice signal, for example, B2.
- the obtained distance information with the smallest distance value may have two or more.
- the device that responds to the voice signal is further determined according to the wake-up priority of the voice recognition device, that is, the distance information with the smallest distance value corresponds to Among the voice recognition devices, the one with the highest priority is determined as the voice recognition device to be responded.
- the first hub device sends a notification whether to respond to the voice signal to other voice recognition devices in the multi-area network.
- the first hub device After the first hub device determines the voice recognition device that responds to the voice signal, it can directly send notifications to the entire network, that is, multiple regional networks, or it can first send notifications to hub devices in each regional network, and then each hub device can send notifications to non- The hub device sends a notification. Similarly, it can only be sent to the voice recognition device that responds to the voice signal, and other devices that have not received the notification will not respond.
- S404 The determined voice recognition device responds to the voice signal.
- This step S404 is similar to the above step S205, and will not be described again.
- the method shown in Figure 4 is applied to multi-region voice wake-up recognition. After each region determines the voice device that should respond to the region, the first central device further determines which region’s voice device responds, so as to ensure that only A voice recognition device responds to voice signals.
- the voice recognition device has a wake-up priority sequence, so when the highest priority voice recognition device fails, the next wake-up priority can be determined according to the wake-up priority sequence.
- the voice recognition device serves as the hub device or the first hub device.
- the voice recognition equipment For voice recognition equipment, it can periodically detect whether it has the highest wake-up priority in the local area network, or detect whether it has the highest wake-up priority when the local network changes; if it detects that it is the current local network The highest wake-up priority in, that is, in response to detecting that it is the highest wake-up priority in the local area network, it operates as a hub device.
- the wake-up response method implemented in the network of this embodiment is based on the fact that the voice recognition device in the network has a wake-up priority order, and the voice recognition device as a network hub device can compare distance information. Therefore, the voice recognition device newly added to the network also needs to comply with the wake-up mechanism of this embodiment, which can be set by the hub device.
- the hub device can obtain the device information of the voice recognition device joining the network. Analyze device information according to preset rules to re-order the voice recognition devices in the network to wake up priority.
- Each voice recognition device is equipped with a voice recognition system, which determines the wake-up priority, voice recognition algorithm, wake-up template, etc. If the newly added voice recognition device has a different voice recognition system, that is, it has different wake-up priority settings, the network hub device can reorder according to its own wake-up priority settings. For example, in the network A1-A2-A3, the newly added voice recognition device A4, whose wake-up priority is set to be greater than A3, can reorder the wake-up priority as A1>A2>A4>A3.
- the wake-up priority of the voice recognition device that joins the network first will be higher.
- the newly added voice recognition device A3 has the same voice recognition system as the previous A3, the previous A3 is used as A31, the newly added one is used as A32, and the wake-up priority is reordered as A1>A2>A31>A32.
- the voice recognition device can play two roles, one is to operate as a central device, and the other is to operate as a non-central device.
- the voice recognition device can be used as a central device with more powerful functions; it can also be used as a non-central device with lighter weight.
- a voice recognition system with more powerful functions can be loaded into it, so that it can be used as a central device; for small household appliances, such as rice cookers, electric kettles, etc.,
- the voice recognition system with lightweight functions makes it only a non-central device.
- FIG. 5 is a schematic diagram of the hub device side workflow of the wake-up response method of the voice recognition device of the present application.
- its wake-up response method includes the following steps.
- S501 Analyze the collected voice signal to obtain distance information of the central device.
- this step S501 is completed in the above step S201, and the details will not be repeated.
- S502 Receive distance information of a non-central device that is a non-central device.
- This step S502 corresponds to the above step S202, and the details are not repeated here.
- S503 Compare the distance information of the central device with the distance information of the non-central device, and determine the voice recognition device to be responded in the regional network.
- This step S503 is similar to the above step S203, and the details will not be described in detail.
- the above steps use the voice recognition device as the role of the central device to illustrate the steps in implementing the single-area wake-up response method.
- the specific details of each step and the specific details of the operation of the central device have also been described above, so they will not be Repeat.
- the voice recognition device of this embodiment can determine a voice recognition device that responds to the voice signal from multiple voice recognition devices, thereby avoiding the problem of mutual interference due to all responses.
- the hub device is further divided into a first hub device and a second hub device.
- the first hub device it further performs the following steps.
- S504 The first hub device receives the second distance information.
- This step S504 is completed in the above step S401, and the details are not repeated here.
- S506 Compare the first distance information with the second distance information, and determine a voice recognition device that responds to the voice signal.
- This step S506 is similar to the above step S402, and the details are not repeated here.
- the second hub device For the second hub device, it performs the following steps.
- the second hub device sends second distance information to the first hub device, so that the first hub device compares the first distance information with the second distance information, so as to determine a voice recognition device that responds to the voice signal.
- This step S505 is completed in the above steps S401-S402, and the details are not repeated here.
- the first hub device further determines which area network's to-be-responsive voice recognition device responds to the voice signal.
- FIG. 6 is a schematic diagram of the non-central device side work flow of the voice recognition device wake-up response method of the present application.
- the voice recognition device is a non-central device, and the wake-up response method of this embodiment includes the following steps.
- S601 Analyze the collected voice signal to obtain distance information of the non-central device.
- This step S601 is similar to the above step S201, both of which are obtaining distance information, and the specific process will not be repeated.
- S602 Send the distance information of the non-central device to the central device, so that the central device compares the distance information of the non-central device with the distance information of the central device to determine the voice recognition device to be responded to.
- a non-central device after collecting the voice signal, it does not respond to the voice signal immediately, but performs calculation and analysis to obtain distance information, and then transmits the distance information to the central device for analysis and comparison, and the central device confirms the response Voice recognition equipment for voice signals.
- the role of the voice recognition device as a non-central device is used to illustrate the steps in implementing the wake-up response method.
- the specific details of each step and the specific details of the operation of the non-central device have also been described above. Repeat it again.
- the voice recognition device of this embodiment does not respond immediately after receiving the voice signal, but decides whether to respond after receiving the notification, which avoids the problem of mutual interference caused by simultaneous response with other voice recognition devices.
- FIG. 7 is a schematic structural diagram of an embodiment of the voice recognition device of this application.
- the voice recognition device 100 in this embodiment may be a household appliance. , which includes at least three microphones 11, a processor 12, and a memory 13 connected to each other.
- the voice recognition device 100 of this embodiment can implement the above-mentioned wake-up response method embodiment.
- at least three microphones 11 have a fixed relative position and are used to collect voice signals
- a computer program is stored in the memory 13, and the processor 12 is used to execute the computer program to implement the above wake-up response method.
- At least three microphones 11 are used to collect voice signals; the processor 12 is used to calculate the distance information between the voice recognition device and the signal source of the voice signal according to the relative positions of the at least three microphones and the voice signals collected respectively, And compare all distance information to determine the voice recognition device that responds to the voice signal; send notifications to other voice recognition devices whether they respond to the voice signal.
- At least three microphones 11 are used to collect voice signals; the processor 12 is used to calculate the distance information between the voice recognition device and the signal source of the voice signal based on the relative positions of the at least three microphones and the voice signals collected separately, and calculate the distance
- the information is sent to the central device, and it is determined whether to respond according to the received notification sent by the central device whether it responds to the voice signal.
- the processor 12 may be an integrated circuit chip with signal processing capability.
- the processor 12 may also be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component .
- DSP digital signal processor
- ASIC application specific integrated circuit
- FPGA off-the-shelf programmable gate array
- the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
- FIG. 8 is a schematic structural diagram of an embodiment of the computer storage medium of the present application.
- the computer storage medium 200 of this embodiment stores a computer program 21, which can be executed to implement the method in the foregoing embodiment.
- the computer storage medium 200 of this embodiment may be a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, etc., which can store program instructions. Or it may also be a server storing the program instructions, and the server may send the stored program instructions to other devices to run, or it may run the stored program instructions by itself.
- the disclosed method and device can be implemented in other ways.
- the device implementation described above is merely illustrative, for example, the division of modules or units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
- the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of this embodiment.
- each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
- the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
- the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
- the technical solution of this application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor execute all or part of the steps of the methods in the various embodiments of the present application.
- the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code .
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
Claims (22)
- 一种语音识别设备的唤醒响应方法,其特征在于,所述多个语音识别设备构成区域网络,所述多个语音识别设备分为一个中枢设备和至少一个非中枢设备;所述唤醒响应方法包括:A wake-up response method for a voice recognition device, wherein the multiple voice recognition devices form a regional network, and the multiple voice recognition devices are divided into a central device and at least one non-central device; the wake-up response method includes :所述中枢设备分析采集的语音信号,以获得所述中枢设备的距离信息;所述中枢设备的距离信息表示所述中枢设备与所述语音信号的信号源的距离;The hub device analyzes the collected voice signals to obtain distance information of the hub device; the distance information of the hub device indicates the distance between the hub device and the signal source of the voice signal;接收所述非中枢设备的距离信息,所述非中枢设备的距离信息由所述非中枢设备分析采集的所述语音信号而获得,表示所述非中枢设备与所述信号源的距离;Receiving distance information of the non-central device, where the distance information of the non-central device is obtained by analyzing the collected voice signal by the non-central device, and represents the distance between the non-central device and the signal source;比较所述中枢设备的距离信息和所述非中枢设备的距离信息;Comparing the distance information of the central device with the distance information of the non-central device;确定待响应语音识别设备,所述待响应语音识别设备为所述区域网络中响应所述语音信号的语音识别设备。A voice recognition device to be responded to is determined, and the voice recognition device to be responded is a voice recognition device that responds to the voice signal in the local area network.
- 根据权利要求1所述的唤醒响应方法,其特征在于,所述比较所述中枢设备的距离信息和所述非中枢设备的距离信息,确定待响应语音识别设备,包括:The wake-up response method according to claim 1, wherein the comparing the distance information of the central device with the distance information of the non-central device to determine the voice recognition device to be responded to comprises:比较所述中枢设备的距离信息的距离值和所述非中枢设备的距离信息的距离值,得到距离值最小的距离信息;Comparing the distance value of the distance information of the hub device with the distance value of the distance information of the non-central device to obtain the distance information with the smallest distance value;确定所述距离值最小的距离信息对应的语音识别设备为所述待响应语音识别设备。It is determined that the voice recognition device corresponding to the distance information with the smallest distance value is the voice recognition device to be responded.
- 根据权利要求2所述的唤醒响应方法,其特征在于,所述多个语音识别设备具有唤醒优先级;所述确定所述距离值最小的距离信息对应的语音识别设备为所述待响应语音识别设备,包括:The wake-up response method according to claim 2, wherein the multiple voice recognition devices have a wake-up priority; the voice recognition device corresponding to the distance information with the smallest distance value is determined to be the voice recognition device to be responded Equipment, including:在所述距离值最小的距离信息对应的语音识别设备中,确定唤醒优先级最高的作为所述待响应语音识别设备。Among the voice recognition devices corresponding to the distance information with the smallest distance value, the voice recognition device with the highest wake-up priority is determined as the voice recognition device to be responded.
- 根据权利要求1所述的唤醒响应方法,其特征在于,所述唤醒响应方法进一步包括:The wake-up response method according to claim 1, wherein the wake-up response method further comprises:所述中枢设备向所述非中枢设备发送是否响应所述语音信号的通知。The hub device sends a notification whether to respond to the voice signal to the non-central device.
- 根据权利要求1所述的唤醒响应方法,其特征在于,多个所述区域网络相互连接,所述区域网络中的多个中枢设备分为一个第一中枢设备和至少一个第二中枢设备;所述唤醒响应方法进一步包括:The wake-up response method according to claim 1, wherein a plurality of the regional networks are connected to each other, and the multiple central devices in the regional network are divided into a first central device and at least one second central device; The wake-up response method further includes:所述第二中枢设备向所述第一中枢设备发送第二距离信息,以由所述第一 中枢设备比较所述第二距离信息和第一距离信息,从而确定响应所述语音信号的语音识别设备;The second hub device sends second distance information to the first hub device, so that the first hub device compares the second distance information with the first distance information, thereby determining the voice recognition in response to the voice signal equipment;所述第一距离信息为所述第一中枢设备所在区域网络的待响应语音识别设备的距离信息,所述第二距离信息为所述第二中枢设备所在区域网络的待响应语音识别设备的距离信息。The first distance information is the distance information of the voice recognition device to be responded in the local area network where the first hub device is located, and the second distance information is the distance of the voice recognition device to be responded to in the area network where the second hub device is located information.
- 根据权利要求1所述的唤醒响应方法,其特征在于,多个所述区域网络相互连接,所述区域网络中的多个中枢设备分为一个第一中枢设备和至少一个第二中枢设备;所述唤醒响应方法进一步包括:The wake-up response method according to claim 1, wherein a plurality of the regional networks are connected to each other, and the multiple central devices in the regional network are divided into a first central device and at least one second central device; The wake-up response method further includes:所述第一中枢设备接收第二距离信息,所述第二距离信息为所述第二中枢设备所在区域网络的待响应语音识别设备的距离信息;Receiving, by the first hub device, second distance information, where the second distance information is the distance information of the voice recognition device to be responded to in the regional network where the second hub device is located;比较所述第二距离信息和第一距离信息,以确定响应所述语音信号的语音识别设备,所述第一距离信息为所述第一中枢设备所在区域网络的待响应语音识别设备的距离信息。The second distance information and the first distance information are compared to determine a voice recognition device that responds to the voice signal, and the first distance information is the distance information of the voice recognition device to be responded to in the area network where the first hub device is located .
- 根据权利要求5或6所述的唤醒响应方法,其特征在于,所述比较所述第二距离信息和第一距离信息,以确定响应所述语音信号的语音识别设备,包括:The wake-up response method according to claim 5 or 6, wherein the comparing the second distance information with the first distance information to determine a voice recognition device that responds to the voice signal comprises:比较所述第一距离信息的距离值和所述第二距离信息的距离值,得到距离值最小的距离信息;Comparing the distance value of the first distance information with the distance value of the second distance information to obtain the distance information with the smallest distance value;确定所述距离值最小的距离信息对应的语音识别设备响应所述语音信号。It is determined that the voice recognition device corresponding to the distance information with the smallest distance value responds to the voice signal.
- 根据权利要求7所述的唤醒响应方法,其特征在于,所述多个语音识别设备具有唤醒优先级;所述确定所述距离值最小的距离信息对应的语音识别设备响应所述语音信号,包括:The wake-up response method according to claim 7, wherein the multiple voice recognition devices have a wake-up priority; the determining that the voice recognition device corresponding to the distance information with the smallest distance value responds to the voice signal, comprising :在所述距离值最小的距离信息对应的语音识别设备中,确定唤醒优先级最高的语音识别设备响应所述语音信号。Among the voice recognition devices corresponding to the distance information with the smallest distance value, it is determined that the voice recognition device with the highest wake-up priority responds to the voice signal.
- 根据权利要求5或6所述的唤醒响应方法,其特征在于,所述唤醒响应方法进一步包括:The wake-up response method of claim 5 or 6, wherein the wake-up response method further comprises:所述第一中枢设备向所述多个区域网络中的其他语音识别设备发送是否响应所述语音信号的通知。The first hub device sends a notification whether to respond to the voice signal to other voice recognition devices in the multiple area networks.
- 根据权利要求1-6中任一项所述的唤醒响应方法,其特征在于,所述中枢设备的距离信息和所述非中枢设备的距离信息统称为距离信息;分析采集的语音信号获得距离信息,包括:The wake-up response method according to any one of claims 1-6, wherein the distance information of the central device and the distance information of the non-central device are collectively referred to as distance information; the collected voice signal is analyzed to obtain the distance information ,include:通过至少三个麦克风分别采集所述语音信号,所述至少三个麦克风在所述语音识别设备上的相对位置固定;Collecting the voice signals through at least three microphones respectively, and the relative positions of the at least three microphones on the voice recognition device are fixed;根据所述至少三个麦克风的相对位置及分别采集的语音信号,计算所述距离信息的距离值。The distance value of the distance information is calculated according to the relative positions of the at least three microphones and the voice signals collected respectively.
- 根据权利要求10所述的唤醒响应方法,其特征在于,所述根据所述至少三个麦克风的相对位置及分别采集的语音信号,计算所述距离信息的距离值,包括:The wake-up response method according to claim 10, wherein the calculating the distance value of the distance information according to the relative positions of the at least three microphones and the voice signals collected respectively includes:根据所述至少三个麦克风分别采集的语音信号,计算所述至少三个麦克风与所述信号源的相对方位;Calculating the relative positions of the at least three microphones and the signal source according to the voice signals collected by the at least three microphones;根据所述至少三个麦克风与所述信号源的相对方位,以及所述至少三个麦克风之间的相对位置,计算所述距离信息的距离值。The distance value of the distance information is calculated according to the relative position of the at least three microphones and the signal source, and the relative position between the at least three microphones.
- 根据权利要求11所述的唤醒响应方法,其特征在于,所述根据所述至少三个麦克风分别采集的语音信号,计算所述至少三个麦克风与所述信号源的相对方位,包括:The wake-up response method according to claim 11, wherein the calculating the relative positions of the at least three microphones and the signal source according to the voice signals collected by the at least three microphones respectively comprises:利用DOA算法计算线性阵列的三个麦克风分别采集到的语音信号,获得每两相邻所述麦克风与所述信号源的相对方位。The DOA algorithm is used to calculate the voice signals respectively collected by the three microphones of the linear array, and the relative positions of every two adjacent microphones and the signal source are obtained.
- 一种语音识别设备的唤醒响应方法,其特征在于,所述多个语音识别设备构成区域网络,所述多个语音识别设备分为一个中枢设备和至少一个非中枢设备;所述唤醒响应方法包括:A wake-up response method for a voice recognition device, wherein the multiple voice recognition devices form a regional network, and the multiple voice recognition devices are divided into a central device and at least one non-central device; the wake-up response method includes :所述非中枢设备分析采集的语音信号,以获得所述非中枢设备的距离信息;所述非中枢设备的距离信息表示所述非中枢设备与所述语音信号的信号源的距离;The non-central device analyzes the collected voice signal to obtain the distance information of the non-central device; the distance information of the non-central device indicates the distance between the non-central device and the signal source of the voice signal;向所述中枢设备发送非中枢设备的距离信息,以由所述中枢设备比较所述非中枢设备的距离信息和所述中枢设备的距离信息,来确定待响应语音识别设备;Sending the distance information of the non-central device to the central device, so that the central device compares the distance information of the non-central device with the distance information of the central device to determine the voice recognition device to be responded;所述中枢设备的距离信息表示所述中枢设备与所述语音信号的信号源的距离,所述待响应语音识别设备为所述区域网络中响应所述语音信号的语音识别设备。The distance information of the hub device indicates the distance between the hub device and the signal source of the voice signal, and the voice recognition device to be responded is a voice recognition device in the local area network that responds to the voice signal.
- 根据权利要求13所述的唤醒响应方法,其特征在于,所述中枢设备比较所述中枢设备的距离信息和所述非中枢设备的距离信息,确定待响应语音识别设备,包括:The wake-up response method of claim 13, wherein the central device compares the distance information of the central device with the distance information of the non-central device to determine the voice recognition device to be responded to, comprising:所述中枢设备比较所述中枢设备的距离信息的距离值和所述非中枢设备的距离信息的距离值,得到距离值最小的距离信息;The hub device compares the distance value of the distance information of the hub device with the distance value of the distance information of the non-central device to obtain the distance information with the smallest distance value;确定所述距离值最小的距离信息对应的语音识别设备为所述待响应语音识别设备。It is determined that the voice recognition device corresponding to the distance information with the smallest distance value is the voice recognition device to be responded.
- 根据权利要求14所述的唤醒响应方法,其特征在于,所述多个语音识别设备具有唤醒优先级;所述确定所述距离值最小的距离信息对应的语音识别设备为所述待响应语音识别设备,包括:The wake-up response method according to claim 14, wherein the plurality of voice recognition devices have a wake-up priority; the voice recognition device corresponding to the distance information with the smallest distance value is determined to be the voice recognition device to be responded Equipment, including:在所述距离值最小的距离信息对应的语音识别设备中,确定唤醒优先级最高的作为所述待响应语音识别设备。Among the voice recognition devices corresponding to the distance information with the smallest distance value, the voice recognition device with the highest wake-up priority is determined as the voice recognition device to be responded.
- 根据权利要求13所述的唤醒响应方法,其特征在于,所述唤醒响应方法进一步包括:The wake-up response method according to claim 13, wherein the wake-up response method further comprises:接收所述中枢设备发送的是否响应所述语音信号的通知。Receiving a notification sent by the hub device whether to respond to the voice signal.
- 根据权利要求13-16中任一项所述的唤醒响应方法,其特征在于,所述中枢设备的距离信息和所述非中枢设备的距离信息统称为距离信息;分析采集的语音信号获得距离信息,包括:The wake-up response method according to any one of claims 13-16, wherein the distance information of the central device and the distance information of the non-central device are collectively referred to as distance information; the collected voice signals are analyzed to obtain the distance information ,include:通过至少三个麦克风分别采集所述语音信号,所述至少三个麦克风在所述语音识别设备上的相对位置固定;Collecting the voice signals through at least three microphones respectively, and the relative positions of the at least three microphones on the voice recognition device are fixed;根据所述至少三个麦克风的相对位置及分别采集的语音信号,计算所述距离信息的距离值。The distance value of the distance information is calculated according to the relative positions of the at least three microphones and the voice signals collected respectively.
- 根据权利要求17所述的唤醒响应方法,其特征在于,所述根据所述至少三个麦克风的相对位置及分别采集的语音信号,计算所述距离信息的距离值,包括:The wake-up response method according to claim 17, wherein the calculating the distance value of the distance information according to the relative positions of the at least three microphones and the voice signals collected respectively comprises:根据所述至少三个麦克风分别采集的语音信号,计算所述至少三个麦克风与所述信号源的相对方位;Calculating the relative positions of the at least three microphones and the signal source according to the voice signals collected by the at least three microphones;根据所述至少三个麦克风与所述信号源的相对方位,以及所述至少三个麦克风之间的相对位置,计算所述距离信息的距离值。The distance value of the distance information is calculated according to the relative position of the at least three microphones and the signal source, and the relative position between the at least three microphones.
- 根据权利要求18所述的唤醒响应方法,其特征在于,所述根据所述至少三个麦克风分别采集的语音信号,计算所述至少三个麦克风与所述信号源的相对方位,包括:The wake-up response method according to claim 18, wherein the calculating the relative positions of the at least three microphones and the signal source according to the voice signals collected by the at least three microphones respectively comprises:利用DOA算法计算线性阵列的三个麦克风分别采集到的语音信号,获得每两相邻所述麦克风与所述信号源的相对方位。The DOA algorithm is used to calculate the voice signals respectively collected by the three microphones of the linear array, and the relative positions of every two adjacent microphones and the signal source are obtained.
- 一种语音识别设备,其特征在于,所述语音识别设备包括处理器和存储器;所述存储器中存储有计算机程序,所述处理器用于执行所述计算机程序以实现如权利要求1-19中任一项所述方法的步骤。A voice recognition device, characterized in that the voice recognition device includes a processor and a memory; a computer program is stored in the memory, and the processor is used to execute the computer program to implement any of claims 1-19 One of the steps of the method.
- 根据权利要求20所述的语音识别设备,其特征在于,所述语音识别设备包括相对位置固定的至少三个麦克风。The voice recognition device according to claim 20, wherein the voice recognition device comprises at least three microphones with fixed relative positions.
- 一种计算机存储介质,其特征在于,所述计算机存储介质存储有计算机程序,所述计算机程序被执行以实现如权利要求1-19中任一项所述方法的步骤。A computer storage medium, wherein the computer storage medium stores a computer program, and the computer program is executed to implement the steps of the method according to any one of claims 1-19.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910343044.7 | 2019-04-26 | ||
CN201910343044.7A CN111862964B (en) | 2019-04-26 | 2019-04-26 | Voice recognition equipment and wake-up response method thereof as well as computer storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020215741A1 true WO2020215741A1 (en) | 2020-10-29 |
Family
ID=72940705
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/124117 WO2020215741A1 (en) | 2019-04-26 | 2019-12-09 | Speech recognition device and wake-up response method therefor, and computer storage medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN111862964B (en) |
WO (1) | WO2020215741A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113450791A (en) * | 2021-04-28 | 2021-09-28 | 珠海格力电器股份有限公司 | Voice equipment control method and device, storage medium and voice equipment |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017135531A1 (en) * | 2016-02-05 | 2017-08-10 | 삼성전자(주) | Voice recognition apparatus and method, and voice recognition system |
CN108337601A (en) * | 2018-01-30 | 2018-07-27 | 出门问问信息科技有限公司 | The control method and device of speaker |
CN109377987A (en) * | 2018-08-31 | 2019-02-22 | 百度在线网络技术(北京)有限公司 | Exchange method, device, equipment and the storage medium of intelligent sound equipment room |
CN109509468A (en) * | 2018-11-01 | 2019-03-22 | 珠海格力电器股份有限公司 | A kind of equipment executes the method and device of voice broadcast task |
CN109658927A (en) * | 2018-11-30 | 2019-04-19 | 北京小米移动软件有限公司 | Wake-up processing method, device and the management equipment of smart machine |
-
2019
- 2019-04-26 CN CN201910343044.7A patent/CN111862964B/en active Active
- 2019-12-09 WO PCT/CN2019/124117 patent/WO2020215741A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017135531A1 (en) * | 2016-02-05 | 2017-08-10 | 삼성전자(주) | Voice recognition apparatus and method, and voice recognition system |
CN108337601A (en) * | 2018-01-30 | 2018-07-27 | 出门问问信息科技有限公司 | The control method and device of speaker |
CN109377987A (en) * | 2018-08-31 | 2019-02-22 | 百度在线网络技术(北京)有限公司 | Exchange method, device, equipment and the storage medium of intelligent sound equipment room |
CN109509468A (en) * | 2018-11-01 | 2019-03-22 | 珠海格力电器股份有限公司 | A kind of equipment executes the method and device of voice broadcast task |
CN109658927A (en) * | 2018-11-30 | 2019-04-19 | 北京小米移动软件有限公司 | Wake-up processing method, device and the management equipment of smart machine |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113450791A (en) * | 2021-04-28 | 2021-09-28 | 珠海格力电器股份有限公司 | Voice equipment control method and device, storage medium and voice equipment |
CN113450791B (en) * | 2021-04-28 | 2023-08-04 | 珠海格力电器股份有限公司 | Voice equipment control method and device, storage medium and voice equipment |
Also Published As
Publication number | Publication date |
---|---|
CN111862964A (en) | 2020-10-30 |
CN111862964B (en) | 2024-03-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9431014B2 (en) | Intelligent placement of appliance response to voice command | |
US11297470B2 (en) | User location aware smart event handling | |
US9438440B2 (en) | Proximity detection of internet of things (IoT) devices using sound chirps | |
US20220044685A1 (en) | Voice Recognition Device, Waking-Up and Responding Method of the Same, and Computer Storage Medium | |
CN105957519B (en) | Method and system for simultaneously performing voice control on multiple regions, server and microphone | |
JP2017524285A (en) | Generating location profiles for Internet of Things devices based on extended location information associated with one or more nearby Internet of Things devices | |
CN110568771B (en) | System and method for intelligently and cooperatively controlling intelligent household equipment | |
WO2021012581A1 (en) | Voice recognition device and wake-up response method therefor, and computer storage medium | |
CN104967617B (en) | A kind of data processing method and device | |
WO2020224265A1 (en) | Voice control method and apparatus | |
CN105049922A (en) | Proximity detection of candidate companion display device in same room as primary display using upnp | |
WO2020215741A1 (en) | Speech recognition device and wake-up response method therefor, and computer storage medium | |
CN109214497B (en) | People counting method and device, intelligent household equipment control method and device, and air conditioner | |
US11546688B2 (en) | Loudspeaker device, method, apparatus and device for adjusting sound effect thereof, and medium | |
WO2023193411A1 (en) | Network distribution method and apparatus for devices, computer device, and storage medium | |
CN107979641A (en) | A kind of intelligent domestic system based on cloud computing | |
CN112086097A (en) | Instruction response method of voice terminal, electronic device and computer storage medium | |
CN113496701A (en) | Voice interaction system, method, equipment and conference system | |
US20160127460A1 (en) | Multi-hop wireless peer-to-peer discovery protocol | |
US9801218B2 (en) | Establishing method for self-organization network of wireless nodes | |
CN110160219B (en) | Air conditioning system and control method thereof, air conditioner and control method of intelligent household appliance system | |
CN115312048A (en) | Equipment awakening method and device, storage medium and electronic device | |
WO2023033731A1 (en) | Sensing mesh network | |
CN117666371A (en) | Control method and device of intelligent equipment, storage medium and electronic device | |
CN115731928A (en) | Response device determination method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19926047 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19926047 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28.03.2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19926047 Country of ref document: EP Kind code of ref document: A1 |