CN111614768B

CN111614768B - Single awakening method, device and system

Info

Publication number: CN111614768B
Application number: CN202010443407.7A
Authority: CN
Inventors: 李旭滨; 陈晓松; 杨兴云
Original assignee: Unisound Intelligent Technology Co Ltd; Xiamen Yunzhixin Intelligent Technology Co Ltd
Current assignee: Unisound Intelligent Technology Co Ltd; Xiamen Yunzhixin Intelligent Technology Co Ltd
Priority date: 2020-05-22
Filing date: 2020-05-22
Publication date: 2022-10-18
Anticipated expiration: 2040-05-22
Also published as: CN111614768A

Abstract

The embodiment of the invention discloses a single awakening method, a device and a system, which comprises the following steps: all Zigbee equipment forms a Zigbee network in an ad hoc network mode; the Zigbee equipment supporting the WIFI function is networked with other WIFI equipment, and a Zigbee gateway is designated as an arbitration node; all the devices receive a wake-up command sent by a user and generate an arbitration request; the Zigbee equipment and other WIFI equipment send arbitration requests to the Zigbee gateway; the Zigbee gateway finishes the arbitration result and sends the arbitration result to Zigbee equipment in the Zigbee network; the Zigbee equipment which is networked with the WIFI equipment sends the arbitration result to the WIFI equipment in the network; the device selected as the result of arbitration is woken up. The embodiment of the invention covers the equipment of different media and different local area networks into the same network, thereby realizing single awakening in the whole house.

Description

Single awakening method, device and system

Technical Field

The present invention relates to the field of terminal technologies, and in particular, to a method, an apparatus, and a system for single wake-up.

Background

Along with the popularization of intelligent voice products, in the house scene, in the same space, probably there are a plurality of speech equipment simultaneously, common speech equipment type includes: household control nodes based on a Zigbee network, intelligent sound boxes serving as central control, accompanying robots, household appliances supporting voice control and the like.

Currently, a user can wake up a voice device by speaking a "wake-up word" to enable interaction between the user and the voice device. The same manufacturer or brand of product, usually the same wake-up word; in order to avoid the problem that a user wakes up to trigger a plurality of devices to respond simultaneously, the devices communicate with each other, and after the user is identified to wake up, a technology of interaction between the unique device and the user is selected through communication arbitration, namely single wake-up.

Two main current schemes:

networking arbitration based on a local WIFI local area network: the devices in the local area network are networked by exchanging broadcast messages, one device is selected as an arbitration node, when the devices are awakened, all the devices send arbitration requests (including voice data of awakening words, confidence coefficient of the awakening, and the like) to the arbitration node, and the arbitration node calls an arbitration algorithm to decide a unique device to respond to the awakening of a user;

based on cloud arbitration: similar to local area network arbitration, the only difference is that the arbitration request is sent to the cloud via the internet, and the cloud is responsible for arbitration.

However, both of the above solutions have problems:

according to the first scheme, for the condition that all equipment is in the same local area network, if the equipment is across the local area network, coverage cannot be performed;

in the second scheme, although the arbitration across the local area network is supported, the arbitration is greatly influenced by network transmission, and in the case of a weak network, the response delay is not controlled, so that the user experience is seriously influenced.

Disclosure of Invention

In order to solve the technical problems, a networking mode based on a WiFi and Zigbee mixed network is characterized in that a Zigbee network is used as a framework, a Zigbee node supporting a WIFI function is used as a relay node, other WIFI equipment is connected to the mixed network through the relay node, equipment of different media and different local area networks are covered in the same network, single awakening in the whole house range is really realized, and meanwhile, the problem of network transmission delay of cloud arbitration is avoided due to the fact that the equipment is completely based on local arbitration.

In order to achieve the above purpose, the embodiment of the present invention provides the following technical solutions:

in a first aspect, an embodiment of the present invention provides a single wake-up method, where the method includes:

all Zigbee nodes form a Zigbee network in an ad hoc network mode;

the Zigbee nodes supporting the WIFI function are networked with other WIFI equipment, and a Zigbee gateway is designated as an arbitration node;

all nodes receive a wake-up command sent by a user and generate an arbitration request;

the Zigbee equipment and other WIFI equipment send arbitration requests to the Zigbee gateway;

the Zigbee gateway finishes arbitration results and sends the arbitration results to Zigbee nodes in a Zigbee network;

the Zigbee node networking with the WIFI equipment sends the arbitration result to the WIFI node in the network;

the device selected as the result of arbitration is woken up.

In one possible design, after the Zigbee node supporting the WIFI function is networked with other WIFI devices, the devices in the group also need to maintain the network:

all the devices in the group acquire the information of other devices through heartbeat signaling, and update the information into respective 'device information lists', if the heartbeat signaling of a certain device is not received within a preset time, the device is considered to be disconnected from the group, and is removed from the 'device information list'.

In one possible design, the Zigbee devices include Zigbee routes and gateways.

In yet another possible design, the WIFI device sends an arbitration request to a Zigbee gateway through a Zigbee node with which it is networked.

In another possible design, the Zigbee gateway completes an arbitration result, specifically:

calculating the distance between the equipment and a user awakening sound source;

the Zigbee gateway arbitrates the device with the shortest distance to the user.

In a second aspect, an embodiment of the present invention provides a single wake-up apparatus, where the apparatus includes:

the self-networking unit is used for forming a Zigbee network by all Zigbee nodes in a self-networking mode;

the Zigbee gateway comprises a grouping unit, a judging unit and a judging unit, wherein the grouping unit is used for carrying out networking on Zigbee equipment supporting a WIFI function and other WIFI equipment and appointing the Zigbee gateway as an arbitration node;

the generation unit is used for receiving the awakening instruction sent by the user by all the nodes and generating an arbitration request;

the transmitting unit is used for the Zigbee equipment and other WIFI equipment to transmit the arbitration request to the arbitration node;

the Zigbee gateway finishes arbitration results and sends the arbitration results to Zigbee nodes in the Zigbee network;

the forwarding unit is used for sending an arbitration result to a WIFI node in the network by the Zigbee node which is networked with the WIFI equipment;

and the awakening unit is used for awakening the equipment selected by the arbitration result.

In one possible design, the apparatus further includes:

the maintenance unit is used for maintaining the network by the equipment in the group after the Zigbee equipment supporting the WIFI function is networked with other WIFI equipment:

In a third aspect, embodiments of the present invention provide a system, which includes at least one processor and a memory;

the memory to store one or more program instructions;

the processor is configured to execute one or more program instructions to perform any of the embodiments comprised in the method of the first aspect.

In a fourth aspect, an embodiment of the present invention provides a chip, where the chip is coupled to a memory in a system, so that the chip calls, when running, program instructions stored in the memory to implement any one implementation included in the method according to the first aspect.

In a fifth aspect, the present invention provides a computer-readable storage medium, which includes one or more program instructions, which are executable by the system according to the third aspect, so as to implement any one of the implementation manners included in the method according to the first aspect.

The single awakening method, the single awakening device and the single awakening system are based on a WiFi and Zigbee mixed network networking mode, the Zigbee network is used as a framework, the Zigbee nodes supporting the WIFI function are used as relay nodes, other WIFI equipment is connected to the mixed network through the relay nodes, equipment of different media and different local area networks are covered in the same network, single awakening in the whole house range is really achieved, and meanwhile the problem of network transmission delay of cloud arbitration is avoided due to the fact that local arbitration is completely based on.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the solutions in the prior art, the drawings that are needed in the description of the embodiments or the prior art will be briefly described below. It should be apparent that the drawings in the following description are merely exemplary, and that those skilled in the art will be able to refer to other embodiments without the exercise of inventive faculty, based on the drawings provided.

The structures, ratios, sizes, and the like shown in the specification are only used for matching with the contents disclosed in the specification, so that those skilled in the art can understand and read the invention, and do not limit the limit conditions of the invention, so that the invention has no technical essence, and any structural modification, ratio relationship change or size adjustment should still fall within the range covered by the technical contents disclosed in the invention without affecting the efficacy and the achievable purpose of the invention.

Fig. 1 is a schematic diagram of a hybrid network networking based on WIFI + Zigbee according to an embodiment of the present invention;

fig. 2 is a schematic flow chart of a single wake-up method according to an embodiment of the present invention;

fig. 3 is a schematic structural diagram of a single wake-up apparatus according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of another single wake-up apparatus according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a single wake-up system according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, shall fall within the scope of protection of the present invention.

For convenience of explanation, the technical solution of the embodiment of the present invention will be described in detail with reference to fig. 1 to 5. It should be understood that this is only an example for illustrating the technical solutions of the embodiments of the present invention, and does not constitute any limitation to the embodiments of the present invention.

The invention provides a networking mode based on a WiFi and Zigbee mixed network, which takes a Zigbee network as a framework and a Zigbee node supporting a WIFI function as a relay node, and other WIFI equipment is connected to the mixed network through the relay node to cover equipment of different media and different local area networks into the same network, thereby really realizing single awakening in the whole house range, and particularly as shown in figure 1:

based on the consideration of equipment reuse, WIFI support is added to Zigbee voice control nodes used in some household scenes, and the nodes can be used as bridges to access different WIFI local area networks into a hybrid network. After the hybrid network networking is completed, the device arbitrates interaction and single awakening based on the network.

Fig. 2 is a schematic flowchart of a single wake-up method according to an embodiment of the present invention, and as shown in fig. 2, the method performs inter-lan arbitration based on a WIFI + Zigbee hybrid networking mode, including the following steps:

step S210, all Zigbee nodes form a Zigbee network in an ad hoc network mode;

step S220, networking the Zigbee node supporting the WIFI function with other WIFI devices, and designating the Zigbee gateway as an arbitration node.

Specifically, in the same network, zigbee devices (including Zigbee routes or gateways) supporting a WIFI function and other WIFI devices perform networking through local area network broadcasting, and designate an arbitration node as a Zigbee gateway; for example, a networking mode can be illustrated as shown in fig. 1, such as Zigbee-node 3 and wifi-device 1 networking, zigbee-node 2 and wifi-device 2 networking

In step S230, all nodes receive the wake-up command sent by the user and generate an arbitration request.

And the user sends a wake-up instruction, and all nodes generate an arbitration request according to the wake-up word after receiving the wake-up instruction, wherein the arbitration request includes voice data of the wake-up word, the confidence coefficient of the wake-up, and the like.

Step S240, the Zigbee device and the other WIFI devices send an arbitration request to the Zigbee gateway.

After the user sends out the wake-up word, the Zigbee equipment directly sends the request to the Zigbee gateway, and the WIFI equipment sends an arbitration request to the Zigbee gateway through the Zigbee nodes which are networked with the WIFI equipment.

For example, as shown in fig. 1, the wifi device 1 sends a request to the Zigbee gateway through the Zigbee node 3, and the wifi device 2 sends a request to the Zigbee gateway through the Zigbee node 2.

Step S250, the Zigbee gateway completes the arbitration result, and sends the arbitration result to the Zigbee node in the Zigbee network.

The Zigbee gateway calculates a distance from each device to the user according to the arbitration request, specifically, after the wake-up model on the device is triggered, all devices that recognize the wake-up instruction calculate a distance from the device to the user locally according to the collected wake-up word audio, and the method is: firstly, carrying out necessary signal processing on the awakening audio to eliminate noise; and calculating the energy of the awakening word audio signal after noise reduction, and calculating the distance between the awakening word audio signal and a user awakening sound source according to the inverse relation between the awakening word audio energy and the transmission distance.

The device closest to the user is selected, and the arbitration result is sent to the Zigbee node in the Zigbee network, for example, as shown in fig. 1, the distance from the wifi-device 1 to the user is the shortest. Namely, the wifi-device 1 is selected to respond to the awakening of the user, and at the moment, the Zigbee gateway sends the arbitration result to the Zigbee-node 3 and the Zigbee node-2 in the Zigbee network.

Step S260, the Zigbee nodes forming a network with the WIFI equipment send the arbitration result to the WIFI nodes in the network.

The Zigbee-node 3 forwards the awakening arbitration result of the selected wifi-equipment 1 responding to the user to the wifi-equipment 1, and the Zigbee-node 2 forwards the awakening arbitration result of the selected wifi-equipment 1 responding to the user to the wifi-equipment 2

In step S270, the device selected as the arbitration result is awakened.

The wifi-device 1 is woken up, broadcasts a wake-up dialog, and is responsible for subsequent interaction with the user.

In one example, after the Zigbee node supporting the WIFI function performs networking with other WIFI devices, the devices in the group also need to maintain the network:

The preset time is too long, although the network is stable, the interaction delay of the user can be caused, the user experience is influenced, the preset time is too short, the network response is fast, the stability of the network cannot be guaranteed, the user experience is also influenced, and in order to consider the stability and the response speed of the network and guarantee the experience effect of the user, the preset time is preferably 3 heartbeat instruction times.

Under the conditions of network creation, new equipment addition, equipment disconnection and the like, the network ensures the integrity of a packet network through dynamic adjustment, so that the network has quick and reliable self-healing capability.

The single awakening method is based on a WiFi and Zigbee mixed network networking mode, a Zigbee network is used as a framework, a Zigbee node supporting a WIFI function is used as a relay node, other WIFI devices are connected to the mixed network through the relay node, devices of different media and different local area networks are covered in the same network, single awakening in the whole house range is really achieved, and meanwhile the problem of network transmission delay of cloud arbitration is avoided due to the fact that local arbitration is completely based on.

Corresponding to the above embodiment, the present invention further provides a single wake-up apparatus, specifically as shown in fig. 3, the apparatus includes:

an ad hoc network unit 31, configured to form a Zigbee network by all Zigbee nodes in an ad hoc network;

the grouping unit 32 is configured to perform networking between the Zigbee device supporting the WIFI function and other WIFI devices, and designate a Zigbee gateway as an arbitration node;

a generating unit 33, configured to receive, by all nodes, a wake-up instruction sent by a user, and generate an arbitration request;

a sending unit 34, configured to send an arbitration request to an arbitration node by the Zigbee device and another WIFI device;

the arbitration unit 35, the Zigbee gateway completes the arbitration result, and sends the arbitration result to the Zigbee node in the Zigbee network;

the forwarding unit 36 is configured to send an arbitration result to a WIFI node in the network by a Zigbee node that is networked with the WIFI device;

and a wake-up unit 37, configured to wake up the selected device as a result of the arbitration.

In one possible design, as shown in fig. 4, the apparatus further comprises:

the maintenance unit 38 is configured to, after the Zigbee device supporting the WIFI function is networked with other WIFI devices, maintain the network by the devices in the group:

The functions executed by each component in a single wake-up apparatus provided in the embodiments of the present invention have been described in detail in the above-mentioned methods, and therefore, redundant description is not repeated here.

Corresponding to the above embodiments, the embodiment of the present invention further provides a single wake-up system, specifically as shown in fig. 5, the system includes at least one processor 51 and a memory 52;

a memory 51 for storing one or more program instructions;

processor 52 is configured to execute one or more program instructions to perform any of the method steps of a single wake-up method as described in the above embodiments.

Corresponding to the above embodiment, an embodiment of the present invention further provides a chip, where the chip is coupled to the memory in the system, so that the chip calls the program instructions stored in the memory when running, and implements the single wake-up method described in the above embodiment.

In accordance with the above embodiments, the present invention also provides a computer storage medium including one or more programs, wherein the one or more program instructions are used for executing the single wake-up method described above by a single wake-up system.

The single awakening method, the single awakening device and the single awakening system are based on a WiFi and Zigbee mixed network networking mode, the Zigbee network is used as a framework, zigbee nodes supporting a WIFI function are used as relay nodes, other WIFI equipment is connected to the mixed network through the relay nodes, equipment of different media and different local area networks are covered in the same network, single awakening in the whole house range is really achieved, and meanwhile the problem of network transmission delay of cloud arbitration is avoided due to the fact that local arbitration is completely based on. .

In an embodiment of the invention, the processor may be an integrated circuit chip having signal processing capability. The Processor may be a general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete Gate or transistor logic device, discrete hardware component.

The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software modules may be located in ram, flash, rom, prom, or eprom, registers, etc. as is well known in the art. The processor reads the information in the storage medium and completes the steps of the method in combination with the hardware.

The storage medium may be a memory, for example, which may be volatile memory or nonvolatile memory, or which may include both volatile and nonvolatile memory.

The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory.

The volatile Memory may be a Random Access Memory (RAM) which serves as an external cache. By way of example and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), SLDRAM (SLDRAM), and Direct Rambus RAM (DRRAM).

The storage media described in connection with the embodiments of the invention are intended to comprise, without being limited to, these and any other suitable types of memory.

Those skilled in the art will recognize that the functionality described in this disclosure may be implemented in a combination of hardware and software in one or more of the examples described above. When software is applied, the corresponding functionality may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims

1. A single wake-up method, the method comprising:

all Zigbee equipment forms a Zigbee network in an ad hoc network mode;

the Zigbee equipment supporting the WIFI function is networked with other WIFI equipment, and a Zigbee gateway is designated as an arbitration node;

all the devices receive a wake-up command sent by a user and generate an arbitration request;

the Zigbee gateway finishes the arbitration result and sends the arbitration result to Zigbee equipment in the Zigbee network;

the Zigbee equipment which is networked with the WIFI equipment sends the arbitration result to the WIFI equipment in the network;

the device selected as the result of arbitration is woken up.

2. The method of claim 1, wherein after the Zigbee device supporting the WIFI function is networked with other WIFI devices, the devices in the group further need to maintain the network:

the devices in the group acquire the information of other devices through heartbeat signaling, and update the information into respective 'device information lists', if the heartbeat signaling of a certain device is not received within a preset time, the device is considered to be disconnected from the group, and is removed from the 'device information list'.

3. The method of claim 1, wherein said Zigbee devices comprise Zigbee routes and gateways.

4. The method of claim 1 or 2, wherein the WIFI device sends an arbitration request to the Zigbee gateway through the Zigbee device with which it is networked.

5. The method according to claim 1, wherein the Zigbee gateway completes an arbitration result, specifically:

6. A single wake-up unit, characterized in that the unit comprises:

the self-networking unit is used for forming a Zigbee network by all Zigbee equipment in a self-networking mode;

the generation unit is used for receiving the awakening instruction sent by the user by all the equipment and generating an arbitration request;

the Zigbee gateway finishes arbitration results and sends the arbitration results to Zigbee equipment in a Zigbee network;

the forwarding unit is used for sending an arbitration result to the WIFI equipment in the network with the Zigbee equipment in the WIFI equipment network;

7. The apparatus of claim 6, further comprising:

8. A system, comprising at least one processor and a memory;

the memory to store one or more program instructions;

the processor, configured to execute one or more program instructions to perform the method according to any one of claims 1 to 5.

9. A chip coupled to a memory in a system such that the chip, when executed, invokes program instructions stored in the memory to implement the method of any of claims 1 to 5.

10. A computer readable storage medium, characterized in that the computer readable storage medium comprises one or more program instructions executable by the system of claim 8 to implement the method of any one of claims 1 to 5.