CN113573292B - Speech equipment networking system and automatic networking method in smart home scene - Google Patents
Speech equipment networking system and automatic networking method in smart home scene Download PDFInfo
- Publication number
- CN113573292B CN113573292B CN202110950844.2A CN202110950844A CN113573292B CN 113573292 B CN113573292 B CN 113573292B CN 202110950844 A CN202110950844 A CN 202110950844A CN 113573292 B CN113573292 B CN 113573292B
- Authority
- CN
- China
- Prior art keywords
- voice
- equipment
- sound
- panel
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000006855 networking Effects 0.000 title claims abstract description 32
- 238000004891 communication Methods 0.000 claims abstract description 7
- 238000012549 training Methods 0.000 claims description 11
- 238000012163 sequencing technique Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 claims description 6
- 238000012216 screening Methods 0.000 claims description 3
- 238000013473 artificial intelligence Methods 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 3
- 238000007635 classification algorithm Methods 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 238000007637 random forest analysis Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2807—Exchanging configuration information on appliance services in a home automation network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W48/00—Access restriction; Network selection; Access point selection
- H04W48/16—Discovering, processing access restriction or access information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/10—Connection setup
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W76/00—Connection management
- H04W76/20—Manipulation of established connections
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Automation & Control Theory (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- Telephonic Communication Services (AREA)
- Selective Calling Equipment (AREA)
Abstract
The application discloses a voice equipment networking system and an automatic networking method under an intelligent home scene, wherein the system comprises a gateway, bluetooth hubs, voice equipment and equipment positioning software, the gateway is in communication connection with a plurality of Bluetooth hubs, the voice equipment comprises a plurality of sound equipment, a plurality of voice panels and a television, the equipment positioning software comprises an equipment control module, a positioning control module, an input module and a task triggering module, the positioning control module comprises a positioning model, and after the voice equipment is positioned by the equipment positioning software, the voice equipment and which Bluetooth hub are connected are comprehensively judged according to the physical position of the voice equipment, the stable connection quantity of the Bluetooth hubs and whether the voice equipment is in the same area. The application combines networking and automatic positioning of voice equipment, and can automatically establish a stable network. The application also automates the first connection result of the person in the house and then applies the result to the house of the same house, thereby achieving the purpose of saving the labor cost.
Description
Technical Field
The application relates to the technical field of intelligent home, in particular to a voice equipment networking system and an automatic networking method in an intelligent home scene.
Background
Smart households are a good way for people, in which devices in the household serve people in an intelligent way. Meanwhile, with the development of artificial intelligence technology, voice interaction becomes a good choice in a smart home scenario. Therefore, a plurality of voice panels and sound boxes can be deployed, people can interact at any time conveniently, and convenience brought to life by science and technology is enjoyed.
These intelligent devices first have to establish an interworking network. Bluetooth is a good choice in a smart home scenario as a low power transmission protocol. However, the bluetooth protocol also has its own drawbacks: the coverage area is smaller, and the number of connected devices is less. Thus, it is necessary to establish a stable network.
Disclosure of Invention
The application provides a voice equipment networking system and an automatic networking method in a smart home scene, which are used for solving the problems that in the prior art, in the smart home scene, due to the small Bluetooth coverage range, a plurality of deployed voice panels and sound equipment are connected on a network through Bluetooth to cause unstable connection, so that user experience is poor.
The technical scheme adopted by the application is as follows: the utility model provides a voice equipment networking system under wisdom family scene, include gateway, bluetooth hub, voice equipment, set up in high in the clouds or the equipment positioning software on the mobile device, gateway and a plurality of bluetooth hub communication connection, voice equipment includes a plurality of stereo set, a plurality of voice panel and a TV, equipment positioning software includes equipment control module, location control module, input module, task trigger module with location control module connects, location control module with equipment control module connects, input module with location control module connects, voice panel, stereo set and TV respectively with equipment control module communication connection, including the location model in the location control module, after the voice equipment passes through equipment positioning software location, according to the physical position of voice equipment, bluetooth hub stable connection quantity, whether voice equipment is in the same region comprehensive judgement voice equipment and which bluetooth hub establish connection.
As a preferred way of networking voice devices in smart home scenarios,
the task triggering module is used for carrying out unique identification ordering on voice equipment and giving instructions to a television and sound, wherein the instructions comprise unique identification information, wake-up words and playing volume;
the equipment control module is used for controlling the sound to play, and meanwhile, the equipment control module also collects the wake-up information of the voice panel, wherein the wake-up information comprises a unique identifier of the voice panel, the angle of sound of each sound relative to the voice panel and the sound energy of each sound;
the input module is used for inputting the physical position of each voice panel and the physical position of each sound equipment which are manually determined;
the positioning control module establishes a first corresponding relation among the unique voice panel identifier, the unique sound identifier and the awakening information of the voice panel, and a second corresponding relation among the physical position identifier of the voice panel, the physical position identifier of the sound and the awakening information of the voice panel;
the equipment positioning software is used for acquiring data in different time periods to obtain a plurality of first corresponding relations, converting the first corresponding relations into a plurality of second corresponding relations, and training a positioning model according to the second corresponding relations to obtain physical positions of the voice equipment corresponding to the voice panel wake-up information;
the gateway is used for controlling which Bluetooth hub the voice device is connected with.
As a preferred way of networking voice devices in smart home scenarios,
the first corresponding relation is embodied in the form of a first two-dimensional table, the first two-dimensional table takes a unique voice panel identifier as a horizontal axis and a unique sound identifier as a vertical axis, and voice panel awakening information is content;
the second corresponding relation is embodied in the form of a second two-dimensional table, wherein the second two-dimensional table takes the physical position of the voice panel as a horizontal axis and the physical position of the sound as a vertical axis, and the awakening information of the voice panel is the content.
The application also provides an automatic networking method of the voice equipment in the intelligent home scene, which comprises the following steps:
s1: establishing initial connection among a gateway, a plurality of Bluetooth hubs and a plurality of voice devices, wherein the voice devices comprise a television, a plurality of sound equipment and a plurality of voice panels;
s2: a television in a house and a plurality of sound and voice panels are subjected to unique identification ordering, wherein the television is provided with a sound and voice panel;
s3, controlling all the sound equipment to play wake-up words at the same volume in sequence;
s4, collecting wake-up information received by all voice panels, wherein the wake-up information comprises unique identifications of the voice panels, angles of sound of all the sounds relative to the voice panels and sound energy of all the sounds;
s5: establishing a first corresponding relation among the unique voice panel identifier, the unique sound identifier and the awakening information of the voice panel;
s6: manually recording the unique identifier of the sound equipment and the information of the corresponding physical position, and manually recording the unique identifier of the voice panel and the information of the corresponding physical position;
s7: repeating S3-S5 for multiple times in different time periods to obtain multiple first corresponding relations;
s8: according to the manually recorded information, converting the first corresponding relations into second corresponding relations among the physical position identification of the voice panel, the physical position identification of the sound equipment and the awakening information of the voice panel;
s9: training a positioning model according to the plurality of second corresponding relations;
s10: for other houses of the same house type, determining physical positions of all voice devices according to the positioning model;
s11: according to the physical position of the voice equipment, the stable connection quantity of the Bluetooth hub and whether the voice equipment is in the same area, comprehensively judging which Bluetooth hub the voice equipment is connected with through manual experience;
s12: and for other houses of the same house type, automatically completing connection of the voice equipment and the Bluetooth hub according to the physical positions of all the voice equipment obtained in S2 to S10 and the connection relation between the Bluetooth hub and the voice equipment determined in S11.
As a preferred mode of the voice device automatic networking method in the smart home scenario, the method for establishing initial connection among the gateway, the plurality of bluetooth hubs and the plurality of voice devices comprises the following steps:
s1-1: collecting information of surrounding voice equipment through the Bluetooth hub, and sending the collected information to a gateway, wherein the format of the information comprises the mac address of the Bluetooth hub, the mac address of the voice equipment and the signal RSSI intensity;
s1-2: the initial corresponding relation between the voice equipment and the Bluetooth hub is established, and the method specifically comprises the following steps:
s1-2-1: sorting the received information from large to small according to the RSSI intensity of the signals, traversing the sorted results after de-duplication, ensuring that the number of mac addresses of voice equipment is the initial number of voice equipment of a gateway, and recording the RSSI at the moment as a threshold value;
s1-2-2: screening information above an RSSI threshold;
s1-2-3: generating a corresponding relation between the voice equipment and the Bluetooth hub; counting the number of Bluetooth hubs which can be connected with each voice device, and sequencing from small to large;
s1-2-4: distributing the number of the Bluetooth hubs which can be connected to each voice device from small to large, and binding the voice device which can only be connected to one Bluetooth hub to the corresponding Bluetooth hub; for voice devices capable of connecting a plurality of Bluetooth hubs, counting the number of devices allocated to be connected by the Bluetooth hubs, and allocating the current voice device to one with the smallest number of devices allocated to be connected by the Bluetooth hubs until the corresponding relation between all voice devices and the Bluetooth hubs is established;
s1-2-5: the connection of the device is reestablished according to the results of S1-2-4.
As a preferred mode of the voice equipment automatic networking method in the smart home scene, the first corresponding relation is a first two-dimensional table, and the first two-dimensional table uses a voice panel unique identifier as a horizontal axis, a sound unique identifier as a vertical axis and voice panel wake-up information as contents;
the second corresponding relation is a second two-dimensional table, the second two-dimensional table takes the physical position of the voice panel as a horizontal axis and the physical position of the sound as a vertical axis, and the awakening information of the voice panel is the content.
As a preferred mode of the voice equipment automatic networking method in the smart home scene, the method for manually recording the unique identification of the sound equipment and the information of the corresponding physical position comprises the following steps: sequentially controlling all sound equipment to play, and manually recording unique identification of the sound equipment and information of corresponding physical positions;
the method for manually recording the information of the unique identifier and the corresponding physical position of the voice panel comprises the following steps: and manually speaking wake-up words to each voice panel, and judging the voice panel with the largest sound energy in all the voice panels as the voice panel which is currently waken up.
As a preferred mode of the automatic voice equipment networking method in the smart home scenario, the method for training the positioning model according to the plurality of second corresponding relations includes:
using the television as sound equipment, determining a voice panel with an unknown position by using the television with a known position, and determining the sound equipment with the unknown position according to the voice panel with the known position until the physical positions of all the voice panels and the sound equipment are determined; or alternatively, the process may be performed,
and using the television as a voice panel, determining a sound with an unknown position by using the television with the known position, and determining the voice panel with the unknown position according to the sound with the known position until the physical positions of all the voice panels and the sound are determined.
As a preferred mode of the voice device automatic networking method in the smart home scenario, the S10 includes:
s10-1, carrying out unique identification sequencing on all sound equipment and voice panels in another house of the same house;
s10-2, controlling all the sound equipment to play wake-up words at the same volume in sequence;
s10-3, collecting wake-up information received by all voice panels, wherein the wake-up information comprises unique identifiers of the voice panels, angles of sound of all the sounds relative to the voice panels and sound energy of all the sounds;
s10-4: establishing a third corresponding relation among the unique voice panel identifier, the unique sound identifier and the awakening information of the voice panel;
s10-5: and determining the physical positions of all the voice panels and the sound according to the positioning model.
The beneficial effects of the application are as follows: the application combines networking and automatic positioning of voice equipment, thereby being capable of automatically establishing a stable network. The application also automates the experimental result of the manpower in the house and then applies to the house of the same house type, thereby achieving the purpose of saving the labor cost.
Drawings
Fig. 1 is a schematic diagram of a voice device networking system in a smart home scenario according to the present application.
Fig. 2 is a diagram of connection between each module and a voice device in the device positioning software disclosed by the application.
Fig. 3 is a flowchart of a method for networking voice devices in a smart home scenario according to the present application.
Reference numerals: 1. a sound box; 2. a voice panel; 3. a television; 4. an equipment control module; 5. a positioning control module; 6. a task triggering module; 7. an input module; 8. bluetooth hub; 9. and (5) a gateway.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail with reference to the accompanying drawings, but embodiments of the present application are not limited thereto.
The application provides an automatic networking method which aims at using Bluetooth hub as a relay and Bluetooth as a connection mode in a smart home scene, promotes automatic positioning of voice equipment through automatic networking and optimizes connection according to an automatic positioning result of the voice equipment.
Example 1:
referring to fig. 1-2, a voice device networking system in a smart home scene includes a gateway 9, a bluetooth hub8, a voice device, and device positioning software disposed on a cloud or a mobile device, where the gateway 9 is in communication connection with a plurality of bluetooth hubs 8, and the voice device includes a plurality of speakers 1, a plurality of voice panels 2, and a television 3. The equipment positioning software comprises an equipment control module 4, a positioning control module 5, an input module 7 and a task trigger module 6, wherein the task trigger module 6 is connected with the positioning control module 5, the positioning control module 5 is connected with the equipment control module 4, the input module 7 is connected with the positioning control module 5, the voice panel 2, the sound equipment 1 and the television 3 are respectively in communication connection with the equipment control module 4, the positioning control module 5 comprises a positioning model, and after the voice equipment is positioned by the equipment positioning software, the voice equipment is comprehensively judged to be connected with which Bluetooth hub8 according to the physical position of the voice equipment, the stable connection quantity of the Bluetooth hubs 8 and whether the voice equipment is in the same area.
Specifically, the bluetooth hub is a hub, and the gateway 9 and the bluetooth hub8 are connected in a wired manner. Different numbers of Bluetooth hub8 point positions can be set according to house types. And connecting the voice equipment into the Bluetooth network, namely establishing the corresponding relation between the voice equipment and the Bluetooth hub 8. The sound 1 may be a normal bluetooth sound, which is only used for voice playing. The voice panel 2 is in the prior art, only receives voice, because of the plurality of sounds, if each sound 1 interacts with a user, confusion is caused, if the sound 1 far away from the user interacts with the user, no user centering is caused, after the voice panel 2 receives voice information, the voice information is transmitted to the gateway 9 through the Bluetooth hub8, and the gateway 9 transmits a command to the sound 1 closest to the user through the Bluetooth hub8 to interact with the user, so that the user is given an experience centering on the user. The television 3 may be used as both a sound (having a voice playing function) and a voice panel (having a voice receiving function), and the installation position of the television 3 in a house is known.
Specifically, the task trigger module 6 is configured to perform unique identification ordering on the voice device, and instruct the television 3 and the stereo 1, where the instruction includes unique identification information, wake-up words, and playing volume. The unique identification information of the sound can be a character string, a sound number, a MAC address or the like, and the wake-up word is used for waking up the voice panel.
The device control module 4 is configured to control the sound equipment 1 to play, and meanwhile, the device control module 4 also collects wake-up information of the voice panel 2, where the wake-up information includes a unique identifier of the voice panel, an angle of sound of each sound equipment relative to the voice panel 2, and a sound energy of each sound equipment 1.
For example, after the wake-up word is played by the first audio, the television and all the voice panels are played by the first audio, the voice panels record the wake-up word played by the first audio at this time, and the voice panels are different in installation positions, so that the sound angle and the sound energy of the first audio received are different, for example, the sound volume of the first audio is 80db in a 12-point direction relative to the voice panel, the sound volume of the first audio is 50db in a 3-point direction relative to the voice panel. At this time, the second sound plays the wake-up word with the same volume, and all other voice panels and televisions receive the sound angles and the energy from the second sound until all the sounds are played, so that the corresponding relation among the unique voice panel identifier, the unique sound identifier and the wake-up information of the voice panel is obtained.
The input module is used for inputting the physical position of each voice panel and the physical position of each sound equipment which are manually determined.
Specifically, the system manually locates all the voice panels and the sound equipment for the first time, namely manually judges the physical installation position of each voice panel and the sound equipment, then inputs the physical position information into equipment locating software, and the system knows which voice panel is close to which sound equipment at the moment, so that when a user wakes up the voice panel, the voice panel with the largest received sound energy is determined to be the voice panel closest to the user, and at the moment, the system designates the sound equipment closest to the voice panel to interact with the user, and the interaction content is completed by calling equipment control modules by the control center.
The positioning control module 5 establishes a first correspondence between the unique voice panel identifier, the unique sound identifier, and the wake-up information of the voice panel, and a second correspondence between the physical position identifier of the voice panel, the physical position identifier of the sound, and the wake-up information of the voice panel.
Specifically, the first correspondence may be embodied in the form of a first two-dimensional table, where the first two-dimensional table uses a unique identifier of the voice panel as a horizontal axis and a unique identifier of the sound as a vertical axis, and the wake-up information of the voice panel is content. And obtaining a second corresponding relation among the voice panel position physical position identification, the sound physical position identification and the voice panel awakening information according to the manually recorded information. The second correspondence may be embodied in the form of a second two-dimensional table, where the second two-dimensional table uses the physical position of the voice panel as the horizontal axis and the physical position of the sound as the vertical axis, and the wake-up information of the voice panel is the content.
The device positioning software is used for collecting data in different time periods to obtain a plurality of first two-dimensional tables. And training the positioning model according to the plurality of second corresponding relations to obtain the physical position of the voice equipment corresponding to the voice panel wake-up information.
Specifically, the positioning algorithm of the positioning model is in the prior art, the positioning algorithm is used for determining the position through a random forest artificial intelligence classification algorithm, the algorithm can determine the approximate positions of each voice panel and the sound according to the two-dimensional table information, but the approximate positions are inaccurate, and after the first time of position determination is manually completed, the system can complete the automatic positioning of other houses in the same house after training.
The gateway 9 is used to control with which bluetooth hub8 the voice device is connected, thereby establishing a stable network.
Example 2
Referring to fig. 3, an automatic networking method for voice equipment in a smart home scene includes the following steps:
s1: an initial connection is established between a gateway, a plurality of Bluetooth hubs, and a plurality of voice devices, wherein the voice devices comprise a television, a plurality of speakers and a plurality of voice panels.
Specifically, the method for establishing initial connection among the gateway, the plurality of Bluetooth hubs and the plurality of voice devices comprises the following steps:
s1-1: information of surrounding voice devices is collected through the Bluetooth hub, and the collected information is sent to the gateway, wherein the format of the information comprises the mac address of the Bluetooth hub, the mac address of the voice device and the signal RSSI intensity.
S1-2: the initial corresponding relation between the voice equipment and the Bluetooth hub is established, and the method specifically comprises the following steps:
s1-2-1: and sorting the received information from large to small according to the RSSI intensity of the signal, traversing the sorted result after de-duplication, ensuring the number of mac addresses of voice equipment to be the initial number of voice equipment of the gateway, and recording the RSSI at the moment to be a threshold value. Since one sound may be scanned by multiple bluetooth hubs, deduplication is required.
S1-2-2: and screening the information above the RSSI threshold.
S1-2-3: generating a corresponding relation between the voice equipment and the Bluetooth hub; and counting the number of Bluetooth hubs which each voice device can connect, and sequencing from small to large.
S1-2-4: distributing the number of the Bluetooth hubs which can be connected to each voice device from small to large, and binding the voice device which can only be connected to one Bluetooth hub to the corresponding Bluetooth hub; and for the voice devices capable of connecting a plurality of Bluetooth hubs, counting the number of devices which are allocated and connected by the Bluetooth hubs, and allocating the current voice device to one of the minimum number of devices which are allocated and connected by the Bluetooth hubs until the corresponding relation between all the voice devices and the Bluetooth hubs is established.
S1-2-5: the connection of the device is reestablished according to the results of S1-2-4.
The above-mentioned S1-1 to S1-2-5 are only a preliminary connection process, all voice devices are connected to the network, and there are some problems in initializing the connection, such as signal scanning is not a very stable process, the first scanning signal may be stronger, and the condition of signal negligence may occur in the use process after connection, thereby causing unstable network; for example, one bluetooth hub can be stably connected with less than 7 voice devices, but during the process of initializing connection, if the voice devices connected by the bluetooth hub are too many, the connection is unstable. Thus a procedure of locating the voice device as follows S2-S10 is required.
S2: a television in a house, which has a sound and a voice panel, and a plurality of sound and voice panels are uniquely identified and ordered.
For example, a first voice panel (a code number is only used as a unique identifier, in practice, a character string or a MAC address is often used as a unique identifier) and a first sound are installed at a bedside table of a main bedroom between templates, a second voice panel and a second sound are installed at a entrance vestibule, and a third voice panel and a third sound are installed in a kitchen. The living room is also provided with a television, and the physical position of the television can be confirmed in the house of the same house, wherein the television is provided with a sound box (for playing voice) and a voice panel (for collecting voice), and the sound box of the television is exemplified by a number four sound box, and the voice panel of the television is exemplified by a number four voice panel. In addition, the voice panel and the sound can be arranged on the places such as the next sleeping place, the study room and the like. It should be noted that although we know that a voice panel and a sound box are installed at the bedside table of the primary bedroom, we cannot directly know that the first sound box and the first sound box correspond to the bedside table of the primary bedroom, and we only know that the physical positions of the fourth sound box and the fourth sound box of the television in the network are living rooms. In practical applications, the voice panel and the sound are not installed in a one-to-one correspondence, but a plurality of voice panels may be installed near one sound or vice versa. And the task triggering module can be used for carrying out unique identification sequencing on all the sound and voice panels.
S3, controlling all the sound equipment to play wake-up words at the same volume in sequence;
specifically, the task of playing the sound in sequence is completed through the equipment control module.
S4, collecting wake-up information received by all voice panels, wherein the wake-up information comprises unique identification of the voice panels, angles of sound of all the sounds relative to the voice panels and sound energy of all the sounds.
Specifically, wake-up information received by the voice panel is collected through the equipment control module.
S5: and establishing a first corresponding relation among the unique voice panel identifier, the unique sound identifier and the awakening information of the voice panel.
Specifically, the device control module establishes a first correspondence relationship. The first corresponding relation can be a first two-dimensional table, and the first two-dimensional table uses the unique voice panel identifier as a horizontal axis, the unique sound identifier as a vertical axis and the awakening information of the voice panel as contents. The first two-dimensional table is shown in the following table:
s6: the unique identification of the sound box and the information of the corresponding physical position are recorded manually, and the unique identification of the voice panel and the information of the corresponding physical position are recorded manually.
Specifically, all sound equipment is controlled to be played in sequence, and the unique identification of the sound equipment and the information of the corresponding physical position are recorded manually; for example, the task triggering module triggers the playing of the first sound equipment, and when the first sound equipment is found at the head cabinet of the main bedridden, the binding relation between the first sound equipment and the head cabinet of the main bedridden is established. And manually speaking wake-up words to each voice panel, and judging the voice panel with the largest sound energy in all the voice panels as the voice panel which is currently waken up.
S7: repeating S3-S5 for a plurality of times in different time periods to obtain a plurality of first corresponding relations.
In order to obtain more training data and to exclude the influence of ambient noise as much as possible, S3-S5 are repeated at different time periods.
S8: and according to the manually recorded information, converting the plurality of first corresponding relations into second corresponding relations among the physical position identification of the voice panel, the physical position identification of the sound equipment and the awakening information of the voice panel.
The second corresponding relation is a second two-dimensional table, and the second two-dimensional table uses the physical position mark of the voice panel as a horizontal axis, the physical position mark of the sound equipment as a vertical axis and the awakening information of the voice panel as contents. The second two-dimensional table is shown in the following table:
s9: and training a positioning model according to the plurality of second corresponding relations.
The method for training the positioning model comprises the following steps:
the physical location of the television is known; since the television can be either audio or speech, two different schemes are possible.
According to the first scheme, a television is used as sound equipment, a voice panel with an unknown position is determined by using a television with a known position, the voice panel wake-up information is used as input by using an artificial intelligence classification algorithm such as a random forest, the position of the voice panel to be positioned is used as output, a model is trained, and the trained model only uses the position which can be accurately classified by the model as a result which can be positioned by the model. Then, the sound equipment at an unknown position is positioned by using the positioned voice panel, and the wake-up information of the positioned voice panel is taken as input, the sound equipment position needing to be positioned is taken as output by using an artificial intelligent classification algorithm such as a random forest, so that a model is trained. The trained model only uses the position of the model which can be accurately classified as the result of the positioning of the model.
The positions of all the voice panels and the sound equipment are determined step by step in a multi-wheel mode.
In the second scheme, the television is used as a voice panel, the sound with unknown positions is determined by using the television with known positions, the voice panel with unknown positions is determined according to the sound with known positions, and after a plurality of cycles, the physical positions of all the voice panels and the sound are determined.
S10: and for other houses of the same house type, determining the physical positions of all voice devices according to the positioning model.
The S10 includes:
s10-1, carrying out unique identification sequencing on all sound and voice panels in another house of the same house.
S10-2, controlling all the sound equipment to play the wake-up words at the same volume in sequence.
S10-3, collecting wake-up information received by all voice panels, wherein the wake-up information comprises unique identification of the voice panels, angles of sound of all the sounds relative to the voice panels and sound energy of all the sounds.
S10-4: and establishing a third corresponding relation among the unique voice panel identifier, the unique sound identifier and the awakening information of the voice panel.
S10-5: and determining the physical positions of all the voice panels and the sound according to the positioning model.
And taking the awakening information of the voice panel in the third corresponding relation as the trained positioning model, and obtaining and outputting corresponding physical position information. Binding of unique identification of sound and voice panel and corresponding physical position relationship can be automatically completed.
S11: and comprehensively judging which Bluetooth hub the voice equipment is connected with according to the physical position of the voice equipment, the stable connection quantity of the Bluetooth hubs and whether the voice equipment is in the same area through manual experience.
Specifically, S11 includes:
s11-1: and (3) utilizing the automatic positioning result of the voice equipment of S2-S10, and combining the stable connection quantity of the Bluetooth hub and whether the voice equipment is in the same area or not according to the artificial experience to comprehensively and re-judge, so as to establish the corresponding relation between the voice equipment and the Bluetooth hub.
S11-2: and connecting according to the new corresponding relation.
S12: and for other houses of the same house type, automatically completing connection of the voice equipment and the Bluetooth hub according to the physical positions of all the voice equipment obtained in S2 to S10 and the connection relation between the Bluetooth hub and the voice equipment determined in S11.
The application automatically tests the results of the manual work in the house and then applies the results to the house of the same house type, thereby achieving the purpose of saving the labor cost.
The above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be appreciated by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims (5)
1. The intelligent home voice equipment networking system is characterized by comprising a gateway, bluetooth hubs, voice equipment and equipment positioning software arranged on a cloud or mobile equipment, wherein the gateway is in communication connection with the Bluetooth hubs, the voice equipment comprises a plurality of sound equipment, a plurality of voice panels and a television, the equipment positioning software comprises an equipment control module, a positioning control module, an input module and a task triggering module, the task triggering module is connected with the positioning control module, the positioning control module is connected with the equipment control module, the input module is connected with the positioning control module, the voice panels, the sound equipment and the television are respectively in communication connection with the equipment control module, the positioning control module comprises a positioning model, and after the voice equipment is positioned by the equipment positioning software, the voice equipment is comprehensively judged whether the voice equipment is connected with the Bluetooth hubs or not according to the physical position of the voice equipment, the stable connection quantity of the Bluetooth hubs and whether the voice equipment is connected with the Bluetooth hubs in the same area;
the task triggering module is used for carrying out unique identification ordering on voice equipment and giving instructions to a television and sound, wherein the instructions comprise unique identification information, wake-up words and playing volume;
the equipment control module is used for controlling the sound to play, and meanwhile, the equipment control module also collects the wake-up information of the voice panel, wherein the wake-up information comprises a unique identifier of the voice panel, the angle of sound of each sound relative to the voice panel and the sound energy of each sound;
the input module is used for inputting the physical position of each voice panel and the physical position of each sound equipment which are manually determined;
the positioning control module establishes a first corresponding relation among the unique voice panel identifier, the unique sound identifier and the awakening information of the voice panel, and a second corresponding relation among the physical position identifier of the voice panel, the physical position identifier of the sound and the awakening information of the voice panel;
the equipment positioning software is used for acquiring data in different time periods to obtain a plurality of first corresponding relations, converting the first corresponding relations into a plurality of second corresponding relations, and training a positioning model according to the second corresponding relations to obtain physical positions of the voice equipment corresponding to the voice panel wake-up information;
the gateway is used for controlling which Bluetooth hub the voice device is connected with.
2. The system for networking voice devices in a smart home scenario of claim 1,
the first corresponding relation is embodied in the form of a first two-dimensional table, the first two-dimensional table takes a unique voice panel identifier as a horizontal axis and a unique sound identifier as a vertical axis, and voice panel awakening information is content;
the second corresponding relation is embodied in the form of a second two-dimensional table, wherein the second two-dimensional table takes the physical position of the voice panel as a horizontal axis and the physical position of the sound as a vertical axis, and the awakening information of the voice panel is the content.
3. An automatic networking method for voice equipment in an intelligent home scene is characterized by comprising the following steps:
s1: establishing initial connection among a gateway, a plurality of Bluetooth hubs and a plurality of voice devices, wherein the voice devices comprise a television, a plurality of sound equipment and a plurality of voice panels;
s2: a television in a house and a plurality of sound and voice panels are subjected to unique identification ordering, wherein the television is provided with a sound and voice panel;
s3, controlling all the sound equipment to play wake-up words at the same volume in sequence;
s4, collecting wake-up information received by all voice panels, wherein the wake-up information comprises unique identifications of the voice panels, angles of sound of all the sounds relative to the voice panels and sound energy of all the sounds;
s5: establishing a first corresponding relation among the unique voice panel identifier, the unique sound identifier and the awakening information of the voice panel;
s6: manually recording the unique identifier of the sound equipment and the information of the corresponding physical position, and manually recording the unique identifier of the voice panel and the information of the corresponding physical position;
s7: repeating S3-S5 for multiple times in different time periods to obtain multiple first corresponding relations;
s8: according to the manually recorded information, converting the first corresponding relations into second corresponding relations among the physical position identification of the voice panel, the physical position identification of the sound equipment and the awakening information of the voice panel;
s9: training a positioning model according to the plurality of second corresponding relations;
s10: for other houses of the same house type, determining physical positions of all voice devices according to the positioning model;
s11: according to the physical position of the voice equipment, the stable connection quantity of the Bluetooth hub and whether the voice equipment is in the same area, comprehensively judging which Bluetooth hub the voice equipment is connected with through manual experience;
s12: for other houses of the same house type, according to the physical positions of all voice devices obtained in S2 to S10 and the connection relation between the Bluetooth hub and the voice devices determined in S11, automatically completing connection between the voice devices and the Bluetooth hub;
the method for establishing the initial connection among the gateway, the Bluetooth hubs and the voice devices comprises the following steps:
s1-1: collecting information of surrounding voice equipment through the Bluetooth hub, and sending the collected information to a gateway, wherein the format of the information comprises the mac address of the Bluetooth hub, the mac address of the voice equipment and the signal RSSI intensity;
s1-2: the initial corresponding relation between the voice equipment and the Bluetooth hub is established, and the method specifically comprises the following steps:
s1-2-1: sorting the received information from large to small according to the RSSI intensity of the signals, traversing the sorted results after de-duplication, ensuring that the number of mac addresses of voice equipment is the initial number of voice equipment of a gateway, and recording the RSSI at the moment as a threshold value;
s1-2-2: screening information above an RSSI threshold;
s1-2-3: generating a corresponding relation between the voice equipment and the Bluetooth hub; counting the number of Bluetooth hubs which can be connected with each voice device, and sequencing from small to large;
s1-2-4: distributing the number of the Bluetooth hubs which can be connected to each voice device from small to large, and binding the voice device which can only be connected to one Bluetooth hub to the corresponding Bluetooth hub; for voice devices capable of connecting a plurality of Bluetooth hubs, counting the number of devices allocated to be connected by the Bluetooth hubs, and allocating the current voice device to one with the smallest number of devices allocated to be connected by the Bluetooth hubs until the corresponding relation between all voice devices and the Bluetooth hubs is established;
s1-2-5: reestablishing the connection of the equipment according to the result of S1-2-4;
the method for training the positioning model according to the plurality of second corresponding relations comprises the following steps:
using the television as sound equipment, determining a voice panel with an unknown position by using the television with a known position, and determining the sound equipment with the unknown position according to the voice panel with the known position until the physical positions of all the voice panels and the sound equipment are determined;
or alternatively, the process may be performed,
using the television as a voice panel, determining a sound with unknown position by using the television with known position, and determining the voice panel with unknown position according to the sound with known position until the physical positions of all the voice panels and the sound are determined;
the S10 includes:
s10-1, carrying out unique identification sequencing on all sound equipment and voice panels in another house of the same house;
s10-2, controlling all the sound equipment to play wake-up words at the same volume in sequence;
s10-3, collecting wake-up information received by all voice panels, wherein the wake-up information comprises unique identifiers of the voice panels, angles of sound of all the sounds relative to the voice panels and sound energy of all the sounds;
s10-4: establishing a third corresponding relation among the unique voice panel identifier, the unique sound identifier and the awakening information of the voice panel;
s10-5: and determining the physical positions of all the voice panels and the sound according to the positioning model.
4. The method for automatically networking voice devices in a smart home scenario according to claim 3, wherein the first correspondence is a first two-dimensional table, the first two-dimensional table uses a unique voice panel identifier as a horizontal axis, a unique sound identifier as a vertical axis, and voice panel wake-up information as contents;
the second corresponding relation is a second two-dimensional table, the second two-dimensional table takes the physical position of the voice panel as a horizontal axis and the physical position of the sound as a vertical axis, and the awakening information of the voice panel is the content.
5. The method for automatically networking a voice device in a smart home scenario of claim 3, wherein the method for manually recording information of a unique identification and a corresponding physical location of a sound comprises: sequentially controlling all sound equipment to play, and manually recording unique identification of the sound equipment and information of corresponding physical positions;
the method for manually recording the information of the unique identifier and the corresponding physical position of the voice panel comprises the following steps: and manually speaking wake-up words to each voice panel, and judging the voice panel with the largest sound energy in all the voice panels as the voice panel which is currently waken up.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110950844.2A CN113573292B (en) | 2021-08-18 | 2021-08-18 | Speech equipment networking system and automatic networking method in smart home scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110950844.2A CN113573292B (en) | 2021-08-18 | 2021-08-18 | Speech equipment networking system and automatic networking method in smart home scene |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113573292A CN113573292A (en) | 2021-10-29 |
| CN113573292B true CN113573292B (en) | 2023-09-15 |
Family
ID=78172146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110950844.2A Active CN113573292B (en) | 2021-08-18 | 2021-08-18 | Speech equipment networking system and automatic networking method in smart home scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113573292B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115665894A (en) * | 2022-10-20 | 2023-01-31 | 四川启睿克科技有限公司 | Whole-house distributed voice gateway system and voice control method |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3474131A1 (en) * | 2017-10-19 | 2019-04-24 | Libre Wireless Technologies, Inc. | Multiprotocol audio7voice internet-of-things devices and related systems |
| CN109743657A (en) * | 2019-02-19 | 2019-05-10 | 广州岩花科技有限公司 | A kind of intelligent sound system carrying out transfer audio based on Bluetooth transmission |
| CN110808042A (en) * | 2019-10-12 | 2020-02-18 | 云知声智能科技股份有限公司 | Voice interaction networking system and method |
| CN111276139A (en) * | 2020-01-07 | 2020-06-12 | 百度在线网络技术（北京）有限公司 | Voice wake-up method and device |
| CN111884886A (en) * | 2020-06-04 | 2020-11-03 | 烽火通信科技股份有限公司 | Intelligent household communication method and system based on telephone |
| CN112133075A (en) * | 2020-10-27 | 2020-12-25 | 安徽山巅电力科技有限公司 | Wireless bluetooth speaker system with intelligent control |
| CN112233672A (en) * | 2020-09-30 | 2021-01-15 | 成都长虹网络科技有限责任公司 | Distributed voice control method, system, computer device and readable storage medium |
| EP3800897A1 (en) * | 2019-02-21 | 2021-04-07 | Shenzhen Skyworth-RGB Electronic Co., Ltd. | Smart television interaction method, storage medium, and smart television |
| CN112735403A (en) * | 2020-12-18 | 2021-04-30 | 宁波向往智汇科技有限公司 | Intelligent home control system based on intelligent sound equipment |
| CN112866068A (en) * | 2021-01-19 | 2021-05-28 | 杭州立众数字科技有限公司 | Intelligent interaction system, interaction terminal and control platform |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI334703B (en) * | 2004-09-02 | 2010-12-11 | Inventec Multimedia & Telecom | Voice-activated remote control system |
| US9554061B1 (en) * | 2006-12-15 | 2017-01-24 | Proctor Consulting LLP | Smart hub |
-
2021
- 2021-08-18 CN CN202110950844.2A patent/CN113573292B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3474131A1 (en) * | 2017-10-19 | 2019-04-24 | Libre Wireless Technologies, Inc. | Multiprotocol audio7voice internet-of-things devices and related systems |
| CN109743657A (en) * | 2019-02-19 | 2019-05-10 | 广州岩花科技有限公司 | A kind of intelligent sound system carrying out transfer audio based on Bluetooth transmission |
| EP3800897A1 (en) * | 2019-02-21 | 2021-04-07 | Shenzhen Skyworth-RGB Electronic Co., Ltd. | Smart television interaction method, storage medium, and smart television |
| CN110808042A (en) * | 2019-10-12 | 2020-02-18 | 云知声智能科技股份有限公司 | Voice interaction networking system and method |
| CN111276139A (en) * | 2020-01-07 | 2020-06-12 | 百度在线网络技术（北京）有限公司 | Voice wake-up method and device |
| CN111884886A (en) * | 2020-06-04 | 2020-11-03 | 烽火通信科技股份有限公司 | Intelligent household communication method and system based on telephone |
| CN112233672A (en) * | 2020-09-30 | 2021-01-15 | 成都长虹网络科技有限责任公司 | Distributed voice control method, system, computer device and readable storage medium |
| CN112133075A (en) * | 2020-10-27 | 2020-12-25 | 安徽山巅电力科技有限公司 | Wireless bluetooth speaker system with intelligent control |
| CN112735403A (en) * | 2020-12-18 | 2021-04-30 | 宁波向往智汇科技有限公司 | Intelligent home control system based on intelligent sound equipment |
| CN112866068A (en) * | 2021-01-19 | 2021-05-28 | 杭州立众数字科技有限公司 | Intelligent interaction system, interaction terminal and control platform |
Non-Patent Citations (1)
| Title |
|---|
| 李剑汶.面向人机交互的麦克风阵列语音增强及系统实现.《中国优秀硕士学位论文全文数据库(电子期刊)》.2019,全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113573292A (en) | 2021-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN205563124U (en) | System for through intelligent automobile -mounted terminal remote control intelligence house | |
| CN107204903B (en) | Intelligent household system and control method thereof | |
| CN107622767A (en) | The sound control method and appliance control system of appliance system | |
| CN108989162B (en) | Household intelligent robot management system | |
| CN104154439A (en) | Intelligent LED lighting device and remote video chat system based on same | |
| CN113573292B (en) | Speech equipment networking system and automatic networking method in smart home scene | |
| CN108156497A (en) | A kind of control method, control device and control system | |
| CN113692091B (en) | Equipment control method, device, terminal equipment and storage medium | |
| CN108592349A (en) | A kind of air-conditioner control system | |
| CN106921911A (en) | Voice acquisition method and device | |
| CN108882103B (en) | Intelligent sound box, sound collection equipment and intelligent sound box system | |
| CN110632854A (en) | Voice control method and device, voice control node and system and storage medium | |
| CN110493092B (en) | Universal remote control based on far-field voice and IOT (input/output) and household appliance remote control method | |
| CN110460504A (en) | A kind of network-based intelligent housing system | |
| CN113674738A (en) | Whole-house distributed voice system and method | |
| CN105337818A (en) | Home networking method based on power network, system and equipment | |
| CN111240222A (en) | Intelligent household control system, method and device | |
| CN113608449B (en) | Speech equipment positioning system and automatic positioning method in smart home scene | |
| CN109087492A (en) | A kind of household remote system | |
| WO2016023267A1 (en) | Voice control-based family networking method, system and device | |
| CN208384371U (en) | A kind of household intelligent system and its home intelligent terminal | |
| CN110661686B (en) | Intelligent household IOT gateway signal processing method and device supporting multiple protocols | |
| CN111862969A (en) | Socket panel and socket panel system | |
| CN113031458A (en) | Household control system based on artificial intelligence | |
| CN209234048U (en) | A kind of preferred signal source carrys out the device that infrared voice communication in expansion chamber is applicable in area |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |