CN108091331B - Intelligent household system based on voice control and control method thereof - Google Patents
Intelligent household system based on voice control and control method thereof Download PDFInfo
- Publication number
- CN108091331B CN108091331B CN201711444111.1A CN201711444111A CN108091331B CN 108091331 B CN108091331 B CN 108091331B CN 201711444111 A CN201711444111 A CN 201711444111A CN 108091331 B CN108091331 B CN 108091331B
- Authority
- CN
- China
- Prior art keywords
- control
- voice
- recognition device
- voice recognition
- control instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 230000006855 networking Effects 0.000 claims abstract description 30
- 230000000875 corresponding effect Effects 0.000 claims description 20
- 238000004458 analytical method Methods 0.000 claims description 15
- 238000006243 chemical reaction Methods 0.000 claims description 15
- 238000012937 correction Methods 0.000 claims description 9
- 230000009471 action Effects 0.000 claims description 8
- 230000005236 sound signal Effects 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 6
- 238000013528 artificial neural network Methods 0.000 claims description 3
- 230000001276 controlling effect Effects 0.000 claims description 3
- 230000007246 mechanism Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 238000005406 washing Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000012856 packing Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 238000009423 ventilation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/10—Current supply arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/2821—Avoiding conflicts related to the use of home appliances
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Selective Calling Equipment (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention relates to an intelligent home system based on voice control and a control method thereof. The utility model provides an intelligent home systems based on speech control, includes consecutive speech recognition device, speech recognition device base, networking device, POE network switch, well accuse host computer and intelligent household electrical appliances. The intelligent home control method based on voice control comprises the steps of (1) obtaining human voice signals and converting the human voice signals into control instructions; (2) forwarding the control command to the networking device; (3) judging whether the control instruction is effective or not, and if the control instruction is an ineffective instruction, performing the step (4); otherwise, entering the step (5); (4) issuing information that the current instruction cannot be executed; (5) judging whether the control instruction can be executed or not, if the control instruction cannot be executed, executing the step (6), and otherwise, entering the step (7); (6) issuing information that the current instruction cannot be executed; (7) controlling the intelligent household appliance to execute relevant operations, and entering step (8) after the operation is finished; (8) and issuing the information that the current instruction is completely executed.
Description
Technical Field
The invention belongs to the field of intelligent home furnishing, and particularly relates to an intelligent home furnishing system based on voice control and a control method thereof.
Background
The intelligent home (English: smart home, home automation) is characterized in that a home is used as a platform, facilities related to home life are integrated by utilizing a comprehensive wiring technology, a network communication technology, a safety precaution technology, an automatic control technology and an audio and video technology, a high-efficiency management system of home facilities and home schedule affairs is constructed, home safety, convenience, comfortableness and artistry are improved, and an environment-friendly and energy-saving living environment is realized.
The intelligent home is embodied by Internet of things. The intelligent home connects various devices (such as audio and video devices, lighting systems, curtain control, air conditioner control, security systems, digital cinema systems, audio and video servers, video cabinet systems, network home appliances and the like) in the home together through the Internet of things technology, and provides multiple functions and means such as home appliance control, lighting control, telephone remote control, indoor and outdoor remote control, anti-theft alarm, environment monitoring, heating and ventilation control, infrared forwarding, programmable timing control and the like. Compared with the common home, the intelligent home has the traditional living function, integrates the functions of building, network communication, information household appliance and equipment automation, provides an all-around information interaction function, and even saves funds for various energy expenses.
Language is the most important means of human interaction and the most natural way of interaction. As a human-computer interaction method, the purpose of speech recognition is to make a machine "understand" human language. After decades of research, speech recognition technology has been applied to the lives of ordinary people. With the continuous improvement of living standard, the concept of the demand of people for family residences is changed.
The intelligent home provides safe, comfortable and pleasant high-grade family life by utilizing advanced computers, embedded systems and network communication technologies. However, at present, the control of the conventional smart home system is usually completed through a dedicated remote controller or a mobile phone APP, the remote controller/mobile phone APP has the characteristic that the keys and the functions are relatively fixed, so that the function expansion of the smart home system is limited, the keys of the remote controller are usually small, the remote controller is not suitable for old people and children, and error operation is easy to generate, so that a voice recognition technology is introduced into the control of the smart home, and the control of household appliances can be realized through voice commands instead of manual control and/or remote controller control. Therefore, the method has positive significance for strengthening the research on intelligent home and speech recognition and continuously improving the life of people.
Disclosure of Invention
The purpose of the invention is as follows: the invention is to solve the above problems in the prior art, that is, a first object of the invention is to provide an intelligent home system based on voice control, which collects the voice of people speaking in a house through a voice recognition module, converts the voice into a special command after recognition, and sends the special command to a central control host, and the central control host controls the on/off and response actions of various intelligent household appliances in the house. The second purpose of the invention is to disclose a control method of the smart home based on voice control.
The technical scheme is as follows: an intelligent home system based on voice control comprises
At least one voice recognition device for collecting human voice, then processing the processed human voice and converting it into corresponding control instruction, then sending out the control instruction;
the voice recognition device base is electrically connected with the voice recognition device through an RS232 serial port or a GPIO (general purpose input/output) interface, is used for supplying power to the voice recognition device, and is also used for receiving a control instruction sent by the voice recognition device and sending the control instruction through a POE (Power over Ethernet) interface;
networking device passes through the POE net twine with at least one speech recognition device base and links to each other for receive all control command that speech recognition device base sent, and divide into groups according to the time quantum all control command received, then send control command to POE network switch according to time precedence order, wherein:
if a plurality of groups of instructions are received in the same time period, selecting the control instruction with the strongest signal intensity for analysis, and sending the analyzed control instruction to the POE network switch;
the POE network switch is connected with the networking device through a POE network cable and used for providing an internal local area network environment, receiving the analyzed control instruction sent by the networking device and sending the analyzed control instruction;
the central control host is connected with the POE network switch through a POE network cable or wireless Wi-Fi and is used for receiving a control instruction sent by the POE network switch, secondarily analyzing the control instruction and then sending a corresponding action instruction to the intelligent household appliance according to the control instruction subjected to secondary analysis;
the feedback equipment is connected with the central control host and is used for feeding back the working state of the central control host;
the intelligent household appliance is connected with the central control host through an RS232 bus, an RS485 bus or a KNX bus and used for receiving the action command sent by the central control host and carrying out corresponding operation according to the action command.
Furthermore, the voice recognition device comprises a sound pick-up, an analog signal amplifier, an analog-to-digital conversion unit, a processor, a memory and a network connection device;
the output end of the sound pick-up is connected with the input end of the analog signal amplifier;
the output end of the analog signal amplifier is connected with the input end of the analog-to-digital conversion unit;
the output end of the analog-to-digital conversion unit is connected with the input end of the processor;
the processor is respectively connected with the memory and the network connection device.
Further, the base of the voice recognition device comprises an input interface, a processor, a memory, a network connection device and a POE interface;
the output end of the input interface is connected with the input end of the processor;
the output end of the processor is connected with the input end of the POE interface;
the processor is respectively connected with the memory and the network connection device, wherein:
the input interface is an RS232 serial port or a GPIO interface.
Further, the feedback device comprises a display, a sound, a buzzer and an LED indicator light
Furthermore, the intelligent household appliances comprise an intelligent lamp, an intelligent lock, an intelligent air conditioner, an intelligent refrigerator, an intelligent sound box, an intelligent washing machine, an intelligent electric fan, an intelligent door, an intelligent access control system and an intelligent curtain.
Further, the intelligent household appliance comprises a status register, and the status register is used for recording the current working state of the intelligent household appliance.
A control method of intelligent home based on voice control adopts the intelligent home system based on voice control, and comprises the following steps:
(1) acquiring a human voice signal, converting the human voice signal into a control instruction, and sending the control instruction to a voice recognition device base through a GPIO (general purpose input/output) interface or an RS232 serial port;
(2) the speech recognition device base forwards the received control instruction to the networking device, the networking device groups all the received control instructions according to a time period, and then the control instructions are sent to the central control host through the POE network switch according to a time sequence, wherein:
if a plurality of groups of instructions are received in the same time period, selecting a control instruction with the maximum voice intensity and sending the control instruction to the central control host through the POE network switch;
(3) the central control host analyzes the received control instruction and judges whether the control instruction is effective or not, if the control instruction is an ineffective instruction, the step (4) is carried out; if the control command is a valid command, entering the step (5);
(4) and returning codes which can not be executed by the control instruction to the voice recognition device and the feedback equipment, and then issuing information which can not be executed by the current instruction by the feedback equipment, wherein:
the feedback equipment comprises a display, a sound box, a buzzer and an LED indicator light;
(5) reading a state register of the intelligent household appliance which needs to be operated by the control instruction, judging whether the control instruction can be executed, if the control instruction cannot be executed, entering a step (6), and if the control instruction can be executed, entering a step (7);
(6) transmitting the code which can not be executed by the control instruction back to the voice recognition device and the feedback equipment, and then issuing information which can not be executed by the current instruction to the feedback equipment;
(7) and controlling the intelligent household appliance to execute relevant operations through the corresponding interface, and entering a step (8) after the operations are finished, wherein:
the corresponding interface is an RS232 bus interface, an RS485 bus interface or a KNX bus interface;
(8) and returning the codes with the completed control instructions to the voice recognition module and the feedback equipment, and then issuing information of finishing the execution of the current instructions by the feedback equipment.
Further, before step (1), n speech recognition devices to be used need to be calibrated, where n is a positive integer, and the specific steps are as follows:
s1 collecting standard strength sound sent by same sound source under same distance condition for n speech recognition devices one by oneRecording the signal, recording the sound intensity information collected by each speech recognition module at the moment, and recording as { a1、a2、...、an}；
S2 calculates the average ρ of all the sound intensities collected in step S1, and the calculation formula is:
s3 calculating correction factor F for each speech recognition devicexThe calculation formula is as follows:
Further, the voice intensity in step (2) is the intensity of the actually collected sound and the correction factor FxThe quotient thereof.
Further, the step (1) of acquiring a human voice signal and converting the human voice signal into a control command specifically includes the following steps:
(11) collecting sound signals by a sound collector, and then entering the step (12);
(12) converting the sound signals collected in the step (11) into voice digital signals through an analog-to-digital conversion unit;
(13) selecting a voice digital signal analysis mode, if a cloud analysis mode is adopted, entering a step (14), and if a local analysis mode is adopted, entering a step (15);
(14) uploading the voice digital signal obtained in the step (12) to a cloud end, analyzing the voice digital signal obtained in the step (12) through a cloud server, then returning the semantic meaning of the analyzed voice digital signal to the local, and entering the step (16);
(15) analyzing the voice digital signal obtained in the step (12) locally through a Fourier transform or neural network method, and entering the step (16) after the semantic meaning of the voice digital signal is analyzed;
(16) and comparing the analyzed semantics of the voice digital signal with preset keywords, if the analyzed semantics are the keywords, sending a control instruction corresponding to the keywords by the voice recognition device, and if the analyzed semantics are not the keywords, not making any reaction by the voice recognition device.
Further, the process of sending the control command to the base of the speech recognition device in the step (1) is as follows: the voice recognition device base sends a handshake signal with the voice recognition device, the voice recognition device base receives the handshake signal of the voice recognition device to establish a link, the voice recognition device base accesses an output port of the voice recognition device to inquire whether a control instruction is updated or not at fixed time intervals, and if the control instruction is updated, the voice recognition device packs the received control instruction and transmits the control instruction to the voice recognition device base.
Further, the process of sending the control command to the base of the speech recognition device in the step (1) is as follows: the voice recognition device base sends the handshake signal with the voice recognition device, and the voice recognition device base receives the voice recognition device handshake signal and establishes the link, and in case there is the instruction update in the delivery outlet of voice recognition device, initiatively will control the instruction packing and send to the voice recognition device base.
Further, the control instruction sent by the voice recognition device base in the step (2) is sequentially composed of frame header information, a voice recognition device equipment number, an instruction type, voice signal strength information, a host address IP number and a frame tail, wherein:
the voice signal sound intensity information is the quotient of the voice signal intensity information collected in the voice recognition device and the correction coefficient of the voice recognition device.
Further, the networking device in step (2) monitors the instruction information sent by all the voice recognition device bases in real time, and the information sent by each voice recognition device base is judged to be true or false by adopting a voting mechanism to ensure that the received information is correct; in the same time period, if the networking device only receives a control instruction, the control instruction is sent to the central control host computer through the POE network switch according to the TCP/IP protocol; and in the same time period, if the networking device receives the control instructions sent by the voice recognition device bases, the networking device selects the control instruction with the maximum sound intensity and sends the control instruction to the central control host.
Has the advantages that: the intelligent home system based on voice control and the control method thereof have the following beneficial effects:
1. the voice recognition device is suitable for people of all ages who can speak clearly without fixed keys;
2. the intelligent household intelligent control system can realize that personnel in a house control the opening and closing and actions of the intelligent household in the house through voice, including the opening or closing of background music, the opening or closing of house light and the like.
Drawings
FIG. 1 is a schematic diagram of an intelligent home system based on voice control according to the present disclosure;
FIG. 2a is a schematic view of a work flow of the speech recognition apparatus;
FIG. 2b is a schematic view of another operation of the speech recognition apparatus;
FIG. 3 is a flow chart of a control method for an intelligent home based on voice control according to the present invention;
FIG. 4a is a schematic view of a work flow of a base of the speech recognition apparatus;
FIG. 4b is a schematic view of another work flow of the base of the speech recognition apparatus;
FIG. 5 is a schematic diagram of the components of a control command.
FIG. 6 is a block diagram schematically illustrating the structure of a speech recognition apparatus;
fig. 7 is a block diagram schematically illustrating the structure of a base of the speech recognition apparatus.
The specific implementation mode is as follows:
the following describes in detail specific embodiments of the present invention.
Detailed description of the preferred embodiment 1
As shown in FIG. 1, an intelligent home system based on voice control comprises
At least one voice recognition device for collecting human voice, then processing the processed human voice and converting it into corresponding control instruction, then sending out the control instruction;
the voice recognition device base is electrically connected with the voice recognition device through an RS232 serial port, is used for supplying power to the voice recognition device, is also used for receiving a control instruction sent by the voice recognition device and sends the control instruction through a POE interface;
networking device passes through the POE net twine with at least one speech recognition device base and links to each other for receive all control command that speech recognition device base sent, and divide into groups according to the time quantum all control command received, then send control command to POE network switch according to time precedence order, wherein:
if a plurality of groups of instructions are received in the same time period, selecting the control instruction with the strongest signal intensity for analysis, and sending the analyzed control instruction to the POE network switch;
the POE network switch is connected with the networking device through a POE network cable and used for providing an internal local area network environment, receiving the analyzed control instruction sent by the networking device and sending the analyzed control instruction;
the central control host is connected with the POE network switch through a POE network cable and is used for receiving the control command sent by the POE network switch, secondarily analyzing the control command and then sending a corresponding action command to the intelligent household appliance according to the control command after secondary analysis;
the feedback equipment is connected with the central control host and is used for feeding back the working state of the central control host;
and the intelligent household appliance is connected with the central control host through an RS232 bus and is used for receiving the action command sent by the central control host and carrying out corresponding operation according to the action command.
Further, as shown in fig. 6, the voice recognition apparatus includes a sound pickup, an analog signal amplifier, an analog-to-digital conversion unit, a processor, a memory, and a network connection device;
the output end of the sound pick-up is connected with the input end of the analog signal amplifier;
the output end of the analog signal amplifier is connected with the input end of the analog-to-digital conversion unit;
the output end of the analog-to-digital conversion unit is connected with the input end of the processor;
the processor is respectively connected with the memory and the network connection device.
Further, as shown in fig. 7, the base of the voice recognition device includes an input interface, a processor, a memory, a network connection device, and a POE interface;
the output end of the input interface is connected with the input end of the processor;
the output end of the processor is connected with the input end of the POE interface;
the processor is respectively connected with the memory and the network connection device, wherein:
the input interface is an RS232 serial port.
Further, the feedback device comprises a display, a sound, a buzzer and an LED indicator light
Furthermore, the intelligent household appliances comprise an intelligent lamp, an intelligent lock, an intelligent air conditioner, an intelligent refrigerator, an intelligent sound box, an intelligent washing machine, an intelligent electric fan, an intelligent door, an intelligent access control system and an intelligent curtain.
Further, the intelligent household appliance comprises a status register, and the status register is used for recording the current working state of the intelligent household appliance.
Specific example 2
Substantially the same as in example 1, except that:
the voice recognition device base is electrically connected with the voice recognition device through the GPIO interface;
the central control host is connected with the POE network switch through wireless Wi-Fi;
the intelligent household electrical appliance is connected with the central control host through an RS485 bus,
specific example 3
Substantially the same as in example 1, except that:
the intelligent household appliance is connected with the central control host through a KNX bus;
the input interface of the base of the voice recognition device is a GPIO interface.
Specific example 4
As shown in fig. 3, a control method for smart home based on voice control, which uses the above smart home system based on voice control, includes the following steps:
(1) acquiring a human voice signal, converting the human voice signal into a control command, and sending the control command to a voice recognition device base through a GPIO (general purpose input/output) interface;
(2) the speech recognition device base forwards the received control instruction to the networking device, the networking device groups all the received control instructions according to a time period, and then the control instructions are sent to the central control host through the POE network switch according to a time sequence, wherein:
if a plurality of groups of instructions are received in the same time period, selecting a control instruction with the maximum voice intensity and sending the control instruction to the central control host through the POE network switch;
(3) the central control host analyzes the received control instruction and judges whether the control instruction is effective or not, if the control instruction is an ineffective instruction, the step (4) is carried out; if the control command is a valid command, entering the step (5);
(4) and returning codes which can not be executed by the control instruction to the voice recognition device and the feedback equipment, and then issuing information which can not be executed by the current instruction by the feedback equipment, wherein:
the feedback equipment comprises a display, a sound box, a buzzer and an LED indicator light;
(5) reading a state register of the intelligent household appliance which needs to be operated by the control instruction, judging whether the control instruction can be executed, if the control instruction cannot be executed, entering a step (6), and if the control instruction can be executed, entering a step (7);
(6) transmitting the code which can not be executed by the control instruction back to the voice recognition device and the feedback equipment, and then issuing information which can not be executed by the current instruction to the feedback equipment;
(7) and controlling the intelligent household appliance to execute relevant operations through the corresponding interface, and entering a step (8) after the operations are finished, wherein:
the corresponding interface is an RS232 bus interface;
(8) and returning the codes with the completed control instructions to the voice recognition module and the feedback equipment, and then issuing information of finishing the execution of the current instructions by the feedback equipment.
Further, before step (1), n speech recognition devices to be used need to be calibrated, where n is a positive integer, and the specific steps are as follows:
s1 collecting sound signals with standard intensity sent by the same sound source one by one for n speech recognition devices, recording the sound intensity information collected by each speech recognition module at the moment, and recording the information as { a }1、a2、...、an}；
S2 calculates the average ρ of all the sound intensities collected in step S1, and the calculation formula is:
s3 calculating correction factor F for each speech recognition devicexThe calculation formula is as follows:
Further, the voice intensity in step (2) is the intensity of the actually collected sound and the correction factor FxThe quotient thereof.
Further, as shown in fig. 2a and 2b, the step (1) of acquiring a human voice signal and converting the human voice signal into a control command specifically includes the following steps:
(11) collecting sound signals by a sound collector, and then entering the step (12);
(12) converting the sound signals collected in the step (11) into voice digital signals through an analog-to-digital conversion unit;
(13) selecting a voice digital signal analysis mode, if a cloud analysis mode is adopted, entering a step (14), and if a local analysis mode is adopted, entering a step (15);
(14) uploading the voice digital signal obtained in the step (12) to a cloud end, analyzing the voice digital signal obtained in the step (12) through a cloud server, then returning the semantic meaning of the analyzed voice digital signal to the local, and entering the step (16);
(15) analyzing the voice digital signal obtained in the step (12) through Fourier transform locally, and entering a step (16) after the semantic meaning of the voice digital signal is analyzed;
(16) and comparing the analyzed semantics of the voice digital signal with preset keywords, if the analyzed semantics are the keywords, sending a control instruction corresponding to the keywords by the voice recognition device, and if the analyzed semantics are not the keywords, not making any reaction by the voice recognition device.
Further, as shown in fig. 4a, the process of sending the control command to the base of the speech recognition device in step (1) is as follows: the voice recognition device base sends a handshake signal with the voice recognition device, the voice recognition device base receives the handshake signal of the voice recognition device to establish a link, the voice recognition device base accesses an output port of the voice recognition device to inquire whether a control instruction is updated or not at fixed time intervals, and if the control instruction is updated, the voice recognition device packs the received control instruction and transmits the control instruction to the voice recognition device base.
Further, as shown in fig. 4b, the process of sending the control command to the base of the speech recognition device in step (1) is as follows: the voice recognition device base sends the handshake signal with the voice recognition device, and the voice recognition device base receives the voice recognition device handshake signal and establishes the link, and in case there is the instruction update in the delivery outlet of voice recognition device, initiatively will control the instruction packing and send to the voice recognition device base.
Further, as shown in fig. 5, the control command issued by the base of the speech recognition device in step (2) sequentially consists of frame header information, equipment number of the speech recognition device, command type, speech signal strength information, host address IP number, and frame tail, where:
the voice signal sound intensity information is the quotient of the voice signal intensity information collected in the voice recognition device and the correction coefficient of the voice recognition device.
Further, the networking device in step (2) monitors the instruction information sent by all the voice recognition device bases in real time, and the information sent by each voice recognition device base is judged to be true or false by adopting a voting mechanism to ensure that the received information is correct; in the same time period, if the networking device only receives a control instruction, the control instruction is sent to the central control host computer through the POE network switch according to the TCP/IP protocol; and in the same time period, if the networking device receives the control instructions sent by the voice recognition device bases, the networking device selects the control instruction with the maximum sound intensity and sends the control instruction to the central control host.
Specific example 5
Substantially the same as in example 4, except that:
in the step (1), the control instruction is sent to a base of the voice recognition device through an RS232 serial port;
the corresponding interface in the step (7) is an RS485 bus interface;
and (15) analyzing the voice digital signal obtained in the step (12) locally through a neural network method.
Specific example 6
Substantially the same as in example 4, except that:
and (4) the corresponding interface in the step (7) is a KNX bus interface.
The embodiments of the present invention have been described in detail. However, the present invention is not limited to the above-described embodiments, and various changes can be made within the knowledge of those skilled in the art without departing from the spirit of the present invention.
Claims (14)
1. An intelligent home system based on voice control is characterized by comprising
At least one voice recognition device for collecting human voice, then processing the processed human voice and converting it into corresponding control instruction, then sending out the control instruction;
the voice recognition device comprises at least one voice recognition device base, a power supply module and a power supply module, wherein the voice recognition device base is electrically connected with the voice recognition device through an RS232 serial port or a GPIO (general purpose input/output) interface, is used for supplying power to the voice recognition device, and is also used for receiving a control instruction sent by the voice recognition device and sending the control instruction through a POE (power over Ethernet) interface;
networking device, with at least one the speech recognition device base passes through POE net twine and links to each other for receive all control command that speech recognition device base sent, and divide into groups according to the time quantum all control command received, then send control command to POE network switch according to time precedence order, wherein:
if a plurality of groups of instructions are received in the same time period, selecting the control instruction with the strongest signal intensity for analysis, and sending the analyzed control instruction to the POE network switch;
the POE network switch is connected with the networking device through a POE network cable and used for providing an internal local area network environment, receiving the analyzed control instruction sent by the networking device and sending the analyzed control instruction;
the central control host is connected with the POE network switch through a POE network cable or wireless Wi-Fi and is used for receiving a control instruction sent by the POE network switch, secondarily analyzing the control instruction and then sending a corresponding action instruction to the intelligent household appliance according to the control instruction subjected to secondary analysis;
the feedback equipment is connected with the central control host and is used for feeding back the working state of the central control host;
and the intelligent household appliance is connected with the central control host through an RS232 bus, an RS485 bus or a KNX bus and is used for receiving the action command sent by the central control host and carrying out corresponding operation according to the action command.
2. The intelligent home system based on voice control as claimed in claim 1, wherein the voice recognition device comprises a sound pickup, an analog signal amplifier, an analog-to-digital conversion unit, a processor, a memory and a network connection device;
the output end of the sound pick-up is connected with the input end of the analog signal amplifier;
the output end of the analog signal amplifier is connected with the input end of the analog-to-digital conversion unit;
the output end of the analog-to-digital conversion unit is connected with the input end of the processor;
the processor is respectively connected with the memory and the network connecting device.
3. The intelligent home system based on voice control as claimed in claim 1, wherein the voice recognition device base comprises an input interface, a processor, a memory, a network connection device and a POE interface;
the output end of the input interface is connected with the input end of the processor;
the output end of the processor is connected with the input end of the POE interface;
the processor is respectively connected with the memory and the network connection device, wherein:
the input interface is an RS232 serial port or a GPIO interface.
4. The intelligent home system based on voice control as claimed in claim 1, wherein the feedback device comprises a display, a sound, a buzzer, an LED indicator light.
5. The intelligent household system based on voice control as claimed in claim 1, wherein the intelligent household appliances comprise an intelligent lamp, an intelligent lock, an intelligent air conditioner, an intelligent refrigerator, an intelligent sound box, an intelligent washing machine, an intelligent electric fan, an intelligent door, an intelligent access control system and an intelligent curtain.
6. The intelligent home system based on voice control of claim 1, wherein the intelligent home comprises a status register for recording the current working status of the intelligent home.
7. A control method of smart home based on voice control is characterized by comprising the following steps:
(1) acquiring a human voice signal, converting the human voice signal into a control instruction, and sending the control instruction to a voice recognition device base through a GPIO (general purpose input/output) interface or an RS232 serial port;
(2) the voice recognition device base forwards the received control instruction to the networking device, the networking device groups all the received control instructions according to time periods, and then sends the control instruction to the central control host through the POE network switch according to the time sequence, wherein:
if a plurality of groups of instructions are received in the same time period, selecting a control instruction with the maximum voice intensity and sending the control instruction to the central control host through the POE network switch;
(3) the central control host analyzes the received control instruction and judges whether the control instruction is effective or not, if the control instruction is an ineffective instruction, the step (4) is carried out; if the control command is a valid command, entering the step (5);
(4) and transmitting the code which can not be executed by the control instruction back to the voice recognition device and the feedback equipment, and then the feedback equipment outwards issues the information which can not be executed by the current instruction, wherein:
the feedback equipment comprises a display, a sound box, a buzzer and an LED indicator light;
(5) reading a state register of the intelligent household appliance which needs to be operated by the control instruction, judging whether the control instruction can be executed, if the control instruction cannot be executed, entering a step (6), and if the control instruction can be executed, entering a step (7);
(6) transmitting a code which can not be executed by a control instruction back to the voice recognition device and the feedback equipment, and then issuing information which can not be executed by the current instruction by the feedback equipment;
(7) controlling the intelligent household appliance to execute relevant operations through a corresponding interface, and entering a step (8) after the operations are finished, wherein:
the corresponding interface is an RS232 bus interface, an RS485 bus interface or a KNX bus interface;
(8) and returning the code with the completed control instruction to the voice recognition module and the feedback equipment, and then issuing information of finishing the execution of the current instruction by the feedback equipment.
8. The voice-control-based smart home control method according to claim 7, wherein n voice recognition devices to be used are calibrated before step (1), wherein n is a positive integer, and the specific steps are as follows:
s1 collecting sound signals with standard intensity sent by the same sound source one by one for n speech recognition devices, recording the sound intensity information collected by each speech recognition module at the moment, and recording the information as { a }1、a2、...、an}；
S2 calculates the average ρ of all the sound intensities collected in step S1, and the calculation formula is:
s3 calculating correction factor F for each speech recognition devicexThe calculation formula is as follows:
9. The method according to claim 8, wherein the voice intensity in step (2) is the intensity of the actually collected voice and the correction factor FxThe quotient thereof.
10. The voice-control-based smart home control method according to claim 7, wherein the step (1) of obtaining a human voice signal and converting the human voice signal into a control command specifically comprises the following steps:
(11) collecting sound signals by a sound collector, and then entering the step (12);
(12) converting the sound signals collected in the step (11) into voice digital signals through an analog-to-digital conversion unit;
(13) selecting a voice digital signal analysis mode, if a cloud analysis mode is adopted, entering a step (14), and if a local analysis mode is adopted, entering a step (15);
(14) uploading the voice digital signal obtained in the step (12) to a cloud end, analyzing the voice digital signal obtained in the step (12) through a cloud server, then returning the semantic meaning of the analyzed voice digital signal to the local, and entering the step (16);
(15) analyzing the voice digital signal obtained in the step (12) locally through a Fourier transform or neural network method, and entering the step (16) after the semantic meaning of the voice digital signal is analyzed;
(16) and comparing the analyzed semantics of the voice digital signal with preset keywords, if the analyzed semantics are the keywords, sending a control instruction corresponding to the keywords by the voice recognition device, and if the analyzed semantics are not the keywords, not making any reaction by the voice recognition device.
11. The voice-control-based smart home control method according to claim 7, wherein the process of sending the control command to the voice recognition device base in the step (1) is as follows: the voice recognition device base sends a handshake signal with the voice recognition device, the voice recognition device base receives the handshake signal of the voice recognition device to establish a link, the voice recognition device base accesses an output port of the voice recognition device to inquire whether a control command is updated or not at fixed time intervals, and if the control command is updated, the voice recognition device packs the received control command and transmits the control command to the voice recognition device base.
12. The voice-control-based smart home control method according to claim 7, wherein the process of sending the control command to the voice recognition device base in the step (1) is as follows: the voice recognition device base sends a handshake signal with the voice recognition device, the voice recognition device base receives the handshake signal of the voice recognition device to establish a link, and once an instruction is updated at an output port of the voice recognition device, a control instruction is actively packaged and sent to the voice recognition device base.
13. The method according to claim 8, wherein the control command issued by the base of the speech recognition device in step (2) is composed of frame header information, speech recognition device equipment number, command type, speech signal strength information, host address IP number, and frame tail in sequence, wherein:
the voice signal sound intensity information is the voice signal intensity information collected in the voice recognition device and the correction coefficient F of the voice recognition devicexThe quotient of (a).
14. The voice-control-based intelligent home control method according to claim 7, wherein in step (2), the networking device monitors instruction information sent by all the voice recognition device bases in real time, and the information sent by each voice recognition device base is judged to be true or false by using a voting mechanism to ensure that the received information is correct; in the same time period, if the networking device only receives a control instruction, the networking device sends the control instruction to the central control host through the POE network switch according to a TCP/IP protocol; and in the same time period, if the networking device receives control instructions sent by a plurality of voice recognition device bases, the networking device selects the control instruction with the maximum sound intensity and sends the control instruction to the central control host.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711444111.1A CN108091331B (en) | 2017-12-27 | 2017-12-27 | Intelligent household system based on voice control and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711444111.1A CN108091331B (en) | 2017-12-27 | 2017-12-27 | Intelligent household system based on voice control and control method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108091331A CN108091331A (en) | 2018-05-29 |
| CN108091331B true CN108091331B (en) | 2021-05-04 |
Family
ID=62179655
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711444111.1A Active CN108091331B (en) | 2017-12-27 | 2017-12-27 | Intelligent household system based on voice control and control method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108091331B (en) |
Families Citing this family (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108899026B (en) * | 2018-07-25 | 2023-10-20 | 浙江工业大学 | Voice control method and control system for photocatalysis processing platform |
| CN109065048A (en) * | 2018-09-12 | 2018-12-21 | 深圳市卓翼科技股份有限公司 | Sound control method and device |
| CN108986816A (en) * | 2018-09-29 | 2018-12-11 | 芜湖星途机器人科技有限公司 | A kind of intelligence gate sentry |
| CN109257258A (en) * | 2018-09-30 | 2019-01-22 | 百度在线网络技术（北京）有限公司 | The method and apparatus of inside and outside Network Communication for intelligent sound box |
| CN109301939B (en) * | 2018-11-19 | 2021-01-05 | 山东乐居妙思电子技术有限公司 | Smart home basic equipment power supply and information interaction processing system and method |
| CN109541953A (en) * | 2018-11-27 | 2019-03-29 | 深圳狗尾草智能科技有限公司 | Expand ancillary equipment, expansion platform and method based on intelligent robot |
| CN111240214A (en) * | 2018-11-29 | 2020-06-05 | 青岛海尔洗衣机有限公司 | Control method for intelligent household system |
| CN109725540B (en) * | 2018-12-10 | 2022-09-09 | 深圳绿米联创科技有限公司 | Equipment control method and device, electronic equipment and storage medium |
| CN109637538A (en) * | 2018-12-29 | 2019-04-16 | 深圳市力合微电子股份有限公司 | A method of realizing voice control |
| CN109754802A (en) * | 2019-01-22 | 2019-05-14 | 南京晓庄学院 | Sound control method and device |
| CN111490915A (en) * | 2019-01-29 | 2020-08-04 | 佛山市顺德区美的电热电器制造有限公司 | Method and system for controlling intelligent household electrical appliance through voice |
| CN111522301A (en) * | 2019-02-01 | 2020-08-11 | 上海未为智能科技有限公司 | Voice control intelligent household system and method |
| CN110060673A (en) * | 2019-03-13 | 2019-07-26 | 佛山市云米电器科技有限公司 | The method and application thereof of the nearest equipment of voice networking automatic identification |
| CN110459215B (en) * | 2019-08-12 | 2024-05-14 | 腾讯科技（深圳）有限公司 | Voice control method, device, computer equipment and computer readable storage medium |
| CN110764453A (en) * | 2019-11-08 | 2020-02-07 | 广东西欧克实业有限公司 | Intelligent household control system based on voice control |
| CN111294258A (en) * | 2020-02-10 | 2020-06-16 | 成都捷顺宝信息科技有限公司 | Voice interaction system and method for controlling intelligent household equipment |
| CN112198809A (en) * | 2020-10-23 | 2021-01-08 | 青岛海尔空调器有限总公司 | Control method, control equipment and control system for multiple intelligent household appliances |
| CN114488856A (en) * | 2020-11-13 | 2022-05-13 | 深圳市奥拓电子股份有限公司 | Central control system of command center |
| CN113381864B (en) * | 2021-05-25 | 2023-09-19 | 福建星网视易信息系统有限公司 | Digital audiovisual site control method, system and storage medium |
| CN114374681B (en) * | 2021-12-09 | 2023-08-22 | 达闼机器人股份有限公司 | Task execution method, device, equipment and storage medium |
| CN114779656B (en) * | 2022-04-29 | 2023-08-11 | 四川虹美智能科技有限公司 | Intelligent household appliance control method and system |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103346939A (en) * | 2013-06-28 | 2013-10-09 | 上海希华通讯科技有限公司 | Intelligent household system terminal |
| CN105700359A (en) * | 2014-11-25 | 2016-06-22 | 上海天脉聚源文化传媒有限公司 | Method and system for controlling smart home through speech recognition |
| CN106357497A (en) * | 2016-11-10 | 2017-01-25 | 北京智能管家科技有限公司 | Control system of intelligent home network |
| CN106530657A (en) * | 2016-11-15 | 2017-03-22 | 中国矿业大学 | Smart home voice control device and method based on mobile phone client |
| CN106601247A (en) * | 2016-12-30 | 2017-04-26 | 歌尔股份有限公司 | Speech recognition system for smart home and smart home |
| CN106601248A (en) * | 2017-01-20 | 2017-04-26 | 浙江小尤鱼智能技术有限公司 | Smart home system based on distributed voice control |
| CN106683674A (en) * | 2017-01-16 | 2017-05-17 | 西安电子科技大学 | System and method for controlling intelligent home by aid of voice |
| CN106707788A (en) * | 2017-03-09 | 2017-05-24 | 上海电器科学研究院 | Intelligent and household voice control and recognition system |
| CN107155090A (en) * | 2017-04-27 | 2017-09-12 | 河南艾欧电子科技有限公司 | A kind of visible dialogue system and implementation method based on intelligence point householder's machine |
| US9767786B2 (en) * | 2015-05-29 | 2017-09-19 | Sound United, LLC | System and method for providing a quiet zone |
| CN107204903A (en) * | 2016-03-18 | 2017-09-26 | 美的集团股份有限公司 | Intelligent domestic system and its control method |
-
2017
- 2017-12-27 CN CN201711444111.1A patent/CN108091331B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103346939A (en) * | 2013-06-28 | 2013-10-09 | 上海希华通讯科技有限公司 | Intelligent household system terminal |
| CN105700359A (en) * | 2014-11-25 | 2016-06-22 | 上海天脉聚源文化传媒有限公司 | Method and system for controlling smart home through speech recognition |
| US9767786B2 (en) * | 2015-05-29 | 2017-09-19 | Sound United, LLC | System and method for providing a quiet zone |
| CN107204903A (en) * | 2016-03-18 | 2017-09-26 | 美的集团股份有限公司 | Intelligent domestic system and its control method |
| CN106357497A (en) * | 2016-11-10 | 2017-01-25 | 北京智能管家科技有限公司 | Control system of intelligent home network |
| CN106530657A (en) * | 2016-11-15 | 2017-03-22 | 中国矿业大学 | Smart home voice control device and method based on mobile phone client |
| CN106601247A (en) * | 2016-12-30 | 2017-04-26 | 歌尔股份有限公司 | Speech recognition system for smart home and smart home |
| CN106683674A (en) * | 2017-01-16 | 2017-05-17 | 西安电子科技大学 | System and method for controlling intelligent home by aid of voice |
| CN106601248A (en) * | 2017-01-20 | 2017-04-26 | 浙江小尤鱼智能技术有限公司 | Smart home system based on distributed voice control |
| CN106707788A (en) * | 2017-03-09 | 2017-05-24 | 上海电器科学研究院 | Intelligent and household voice control and recognition system |
| CN107155090A (en) * | 2017-04-27 | 2017-09-12 | 河南艾欧电子科技有限公司 | A kind of visible dialogue system and implementation method based on intelligence point householder's machine |
Non-Patent Citations (1)
| Title |
|---|
| "基于CAN总线的智能家居网关设计和实现";李世红;《中国优秀硕士论文全文数据库 信息科技辑》;20080215(第02期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108091331A (en) | 2018-05-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108091331B (en) | Intelligent household system based on voice control and control method thereof | |
| CN206388060U (en) | Pass through the wearable intelligent house control system of Voice command | |
| CN204258814U (en) | Infrared communication module system and communication transferring system | |
| CN103345232B (en) | Individualized intelligent appliance control method and system | |
| CN208834125U (en) | A kind of smart home system | |
| CN107818782B (en) | Method and system for realizing intelligent control of household appliances | |
| CN107622767A (en) | The sound control method and appliance control system of appliance system | |
| CN106879130A (en) | Can networking speech recognition lamp and its speech recognition lighting control system | |
| CN103312827A (en) | Home cloud control method and system on basis of mobile network | |
| CN205491368U (en) | But pronunciation postpone or time switch's intelligent lamp and intelligence lamp control system thereof | |
| CN103346938A (en) | Intelligent housing system based on cloud computing service | |
| CN204759076U (en) | Home network intelligence remote controller | |
| CN111970180B (en) | Networking configuration method and device for intelligent household equipment, electronic equipment and storage medium | |
| CN108989162B (en) | Household intelligent robot management system | |
| CN110161910A (en) | A kind of full room networking type intelligent appliance control system and control method | |
| CN107065588A (en) | A kind of intelligent domestic system | |
| CN107479397A (en) | Intelligent household voice control system and method based on positional information | |
| CN107995073A (en) | A kind of apparatus and method for controlling smart home device | |
| CN206402247U (en) | A kind of device of control intelligent home device | |
| CN111897234A (en) | Intelligent home control system based on 5G network | |
| CN204832808U (en) | Intelligent household control system | |
| CN207530842U (en) | A kind of smart home training system based on Internet of Things | |
| CN113674738A (en) | Whole-house distributed voice system and method | |
| CN109240116A (en) | A kind of intelligent lighting curtain Controller for smart home | |
| CN109946988A (en) | A kind of control method and system of the household electrical appliance based on Internet of Things |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210419 Address after: Room 608, 6th floor, No. 8 Building, Science and Technology Park, Henan National University, 289 West Third Ring Road, Zhengzhou High-tech Industrial Development Zone, 450000 Henan Province Applicant after: Zhengzhou Mingke Education Technology Co.,Ltd. Address before: 100011 floor four, building 21, Anhua Li five District, Chaoyang District, Beijing (An Zhensheng Ruicheng incubator No. 1121) Applicant before: BEIJING MEIKE INNOVATION GONGCHANG TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240306 Address after: Room 601, Building 8, Henan University Science and Technology Park (East Zone), No. 289 West Third Ring Road, Zhengzhou High tech Industrial Development Zone, Henan Province, 450000 Patentee after: Henan Jingcheng Electronic Technology Co.,Ltd. Country or region after: China Address before: Room 608, 6th floor, building 8, Henan National University Science Park (East District), 289 West Third Ring Road, high tech Industrial Development Zone, Zhengzhou City, Henan Province, 450000 Patentee before: Zhengzhou Mingke Education Technology Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right |