CN112908326A - Household voice control learning and application method and device - Google Patents
Household voice control learning and application method and device Download PDFInfo
- Publication number
- CN112908326A CN112908326A CN202110129042.5A CN202110129042A CN112908326A CN 112908326 A CN112908326 A CN 112908326A CN 202110129042 A CN202110129042 A CN 202110129042A CN 112908326 A CN112908326 A CN 112908326A
- Authority
- CN
- China
- Prior art keywords
- waveform
- voice
- infrared signal
- infrared
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000006870 function Effects 0.000 claims abstract description 31
- 230000001960 triggered effect Effects 0.000 claims abstract description 9
- 238000004590 computer program Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 5
- 238000004422 calculation algorithm Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 238000007781 pre-processing Methods 0.000 description 3
- 238000003825 pressing Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000013139 quantization Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
- G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2807—Exchanging configuration information on appliance services in a home automation network
- H04L12/2814—Exchanging control software or macros for controlling appliance services in a home automation network
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Acoustics & Sound (AREA)
- Human Computer Interaction (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Selective Calling Equipment (AREA)
Abstract
The invention discloses a method and a device for household voice control learning and application, wherein the method for household voice control learning comprises the following steps: responding to a voice infrared control learning function triggered by a user, and receiving a waveform of an infrared signal generated when an infrared remote controller of controlled household equipment is used by the user; judging whether the waveform of the infrared signal is legal and complete; and if the waveform of the infrared signal is legal and complete, storing the waveform of the infrared signal and the voice command which is required to be realized and corresponds to the waveform of the infrared signal. By triggering the voice infrared control learning function, the waveform of an infrared signal generated when the infrared remote controller of the controlled household equipment is used by a user is received, and the acquired voice instruction which is required to be realized and corresponds to the waveform of the infrared signal is stored, so that the learning, coding and storing of infrared remote control, the recognition and understanding of the voice instruction and the instruction corresponding relation can be realized in the device, and the device is independent of a server and a network.
Description
Technical Field
The invention belongs to the technical field of voice control, and particularly relates to a household voice control learning and application method and device.
Background
At present, a plurality of voice intelligent devices can be used for voice control of household appliances, such as intelligent sound boxes, intelligent televisions and the like. The method is characterized in that a user sends a voice instruction to the voice intelligent device, and the voice instruction is recognized by the server and then sent to the household appliance through the network. In general, a relation table between control functions and instructions is preset, so that the intelligent device can determine the control functions to be executed according to voice instructions, find corresponding instructions and control the household appliances through network protocol instructions.
At present, products and technologies do not need to adopt a mode of accessing an intelligent home protocol through a network, and instead, an infrared learning remote control mode is adopted to realize voice control on home equipment. However, the device still needs the intelligent device to access the network to send a request instruction to the server, and then waits for a result returning instruction from the server, and then controls other household devices.
By adopting the scheme provided by the embodiment of the invention, the intelligent equipment can learn the control function of the remote controller, and after receiving the voice command of the user, the intelligent equipment analyzes and stores the corresponding relation between the infrared code and the control function in the device and sends the infrared wave control command to the household equipment, thereby realizing the household control mode. The scheme that this embodiment provided promptly can acquire other house remote control functions and establish the relation table of corresponding instruction through the mode of self-learning, need not to gather in advance, need not to access to the network for smart machine can realize the scheme of other houses of speech control with multiple domestic appliance adaptation.
The most similar solutions known today: the intelligent device comprises an intelligent device and a server. The intelligent equipment has infrared receiving and infrared sending functions and is connected with the server through a network, the intelligent equipment acquires infrared waves of other household remote controllers in a learning mode, the instruction correspondence table is stored, a user voice request requests the server through the intelligent equipment, the server issues a control instruction to the intelligent equipment after voice analysis, and the intelligent equipment controls other households through the learned infrared waves.
However, household appliances are numerous in brand, voice remote control of a household can be realized only when a uniform intelligent household protocol is required to be met, and for manufacturers of intelligent equipment, the control function of each type of household appliance is required to meet the household protocol with certain difficulty; for a user, home control can be realized only if equipment meeting the intelligent home protocol is purchased. This results in non-smart home protocols or non-networked smart devices not being able to implement voice remote control.
The intelligent device still needs to depend on the network and the server, cannot be used under the condition of no network and no server, and in addition, the purchase cost and the use cost of the device are increased by the dependence on the network and the server. Especially in large-room houses, the network cannot cover every corner, and the infrared learning device does not have the wall-through capability, so that the multipoint device needs to be purchased to realize voice control, and the network-dependent device is no longer suitable or can be used only with high investment of users.
Disclosure of Invention
The embodiment of the invention provides a method and a device for controlling learning and application of home voice, which are used for solving at least one of the technical problems.
In a first aspect, an embodiment of the present invention provides a home voice control learning method, including: responding to a voice infrared control learning function triggered by a user, and receiving a waveform of an infrared signal generated when an infrared remote controller of controlled household equipment is used by the user; judging whether the waveform of the infrared signal is legal and complete; and if the waveform of the infrared signal is legal and complete, storing the waveform of the infrared signal and the voice command which is required to be realized and corresponds to the waveform of the infrared signal.
In a second aspect, an embodiment of the present invention provides a home voice control application method, including: responding to a voice instruction of a user to controlled equipment, performing voice recognition on the voice instruction and outputting a recognition result; judging whether the recognition result is matched with a pre-recorded voice command or not, wherein the waveform of an infrared signal corresponding to the pre-recorded voice command is locally stored; and if so, sending the waveform of the infrared signal to the controlled equipment.
In a third aspect, an embodiment of the present invention provides a home voice control learning apparatus, including: the receiving program module is configured to respond to the fact that a user triggers a voice infrared control learning function and receive the waveform of an infrared signal generated when the infrared remote controller of the controlled household equipment is used by the user; the first judgment program module is configured to judge whether the waveform of the infrared signal is legal and complete; and the storage program module is configured to store the infrared signal waveform and a voice instruction which needs to be realized and corresponds to the infrared signal waveform if the infrared signal waveform is legal and complete.
In a fourth aspect, an embodiment of the present invention provides a home voice control application apparatus, including: the recognition output program module is configured to respond to a voice command of a user to the controlled equipment, perform voice recognition on the voice command and output a recognition result; the second judgment program module is configured to judge whether the recognition result is matched with a pre-recorded voice instruction, wherein the waveform of the infrared signal corresponding to the pre-recorded voice instruction is locally stored; and the transmitting program module is configured to transmit the waveform of the infrared signal to the controlled equipment if the infrared signal is matched with the controlled equipment.
In a fifth aspect, an electronic device is provided, comprising: at least one processor, and a memory communicatively coupled to the at least one processor, wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the home voice control learning and applying method of any of the embodiments of the present invention.
In a sixth aspect, embodiments of the present invention further provide a computer program product, where the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, where the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes the steps of the home voice control learning and applying method according to any embodiment of the present invention.
According to the method and the device, the voice infrared control learning function is triggered, the waveform of the infrared signal generated when the infrared remote controller of the controlled household equipment is used by a user is received, the acquired voice command which needs to be realized and corresponds to the waveform of the infrared signal is stored, therefore, learning, coding and storing of infrared remote control, recognition and understanding of the voice command and the command corresponding relation can be realized in the device, and the device is independent of a server and a network.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
Fig. 1 is a flowchart of a home voice control learning method according to an embodiment of the present invention;
fig. 2 is a flowchart of a home voice control application method according to an embodiment of the present invention;
fig. 3 is a flowchart of another household voice control learning and applying method according to an embodiment of the present invention;
fig. 4 is a block diagram of a home voice control learning apparatus according to an embodiment of the present invention;
fig. 5 is a block diagram of another home voice control application apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Please refer to fig. 1, which shows a flowchart of an embodiment of a home voice control learning method according to the present application.
As shown in fig. 1, in step 101, in response to a user triggering a voice infrared control learning function, receiving a waveform of an infrared signal generated when an infrared remote controller of a controlled home device is used by the user;
in step 102, judging whether the waveform of the infrared signal is legal and complete;
in step 103, if the waveform of the infrared signal is legal and complete, the waveform of the infrared signal and the voice command to be realized corresponding to the waveform of the infrared signal are stored.
In this embodiment, for step 101, the home voice control learning and applying device responds to the user triggering the voice infrared control learning function, and receives the waveform of the infrared signal generated when the infrared remote controller of the controlled home device is used by the user, for example, the user presses a button of the voice infrared control learning function or the user controls to start the voice infrared control learning mode, and in the voice infrared control learning mode, the infrared receiving device of the device is in an infrared wave receiving state. Under the condition that the infrared signal is not received, the output end outputs high level all the time, and once the infrared signal input is received, the level signal jumps, and the signal can be captured.
Then, in step 102, the household voice control learning and applying device determines whether the waveform of the infrared signal is legal and complete, for example, after capturing the infrared signal, an interrupt processing function is entered to implement the width measurement of the pulse width. And judging that the pulse signal conforms to the rule.
Finally, in step 103, if the waveform of the infrared signal is legal and complete, the voice command to be implemented corresponding to the waveform of the infrared signal and the waveform of the infrared signal is stored, for example, the user presses a key to be learned, and if the infrared signal is received and the waveform of the infrared signal is legal and complete, the waveform of the infrared signal is stored, and the infrared key is named by the user and then stored.
According to the method, the voice infrared control learning function is triggered, the waveform of the infrared signal generated when the infrared remote controller of the controlled household equipment is used by a user is received, the acquired voice command which is required to be realized and corresponds to the waveform of the infrared signal is stored, so that the learning, coding and storing of the infrared remote control, the recognition and understanding of the voice command and the command corresponding relation can be realized in the device, and the device is independent of a server and a network.
In the method according to the foregoing embodiment, after the determining whether the waveform of the infrared signal is legal and complete, the method further includes:
and if the waveform of the infrared signal is illegal and/or incomplete, continuing to monitor.
In the method according to the above embodiment, the number of times of repeated execution corresponding to the waveform of the infrared signal, which is set by the user, is received and stored, for example, the number of times of voice addition or voice subtraction, and if the number of times of execution is not selected, the execution is performed by default once, and if the number of times of execution is selected, the voice command is executed repeatedly.
The method of the embodiment can reduce unnecessary repeated instructions by receiving and storing the repeated execution times corresponding to the waveform of the infrared signal set by the user.
Referring to fig. 2, a flowchart of a home voice control application method according to an embodiment of the present invention is shown.
As shown in fig. 2, in step 201, in response to a voice instruction of a user to a controlled device, performing voice recognition on the voice instruction and outputting a recognition result;
in step 202, judging whether the recognition result is matched with a pre-recorded voice command, wherein a waveform of an infrared signal corresponding to the pre-recorded voice command is locally stored;
in step 203, if the infrared signal is matched with the target device, the waveform of the infrared signal is sent to the controlled device.
In this embodiment, for step 201, the home voice control learning and applying apparatus, in response to the voice command of the user to the controlled device, performs voice recognition on the voice command and outputs a recognition result, for example, after detecting the voice, starts a microphone to record, collects the voice signal of the user and performs preprocessing on the voice signal of the user, for example, filtering, a/D conversion, pre-emphasis and endpoint detection (etc., preprocessing, then, after performing voice feature extraction and quantization, sends the voice signal to a voice recognition computing and analyzing unit, inputs a feature vector sequence of the voice, compares the voice recognition method based on the artificial neural network with an algorithm of a voice command training template library, and finally outputs the recognition result.
Then, in step 202, the home voice control learning and applying device determines whether the recognition result matches the pre-recorded voice command, for example, the recognition result is a little louder voice, and if the pre-recorded voice command has a little louder voice or a voice addition, the recognition result can be matched, wherein the waveform of the infrared signal corresponding to the pre-recorded voice command is stored locally.
Finally, for step 203, if the infrared signal is matched, the waveform of the infrared signal is sent to the controlled device.
According to the method, the waveform of the infrared signal corresponding to the pre-recorded voice command matched with the voice command of the user is sent to the controlled equipment, so that the household voice control application can be realized.
In the method according to the above embodiment, after determining whether the recognition result matches a pre-entered voice command, the method further includes:
and if not, terminating the execution of the voice command.
In the method according to the above embodiment, the number of times of repeatedly executing the infrared signal is locally stored, and if the infrared signal is matched with the target device, sending a waveform of the infrared signal to the controlled device includes:
and if the infrared signal waveform is matched with the voice signal waveform, sending the infrared signal waveform to the controlled device according to the repeated execution times, for example, if the voice addition needs to be repeatedly executed, sending the preset infrared signal waveform to the controlled device for multiple times.
The method of the embodiment can reduce unnecessary repeated instructions by sending the waveform of the infrared signal to the controlled device according to the repeated execution times.
It should be noted that the above method steps are not intended to limit the execution order of the steps, and in fact, some steps may be executed simultaneously or in the reverse order of the steps, which is not limited herein.
The following description is provided to enable those skilled in the art to better understand the present disclosure by describing some of the problems encountered by the inventors in implementing the present disclosure and by describing one particular embodiment of the finally identified solution.
The inventor finds that the defects in the prior art are mainly caused by the following reasons in the process of implementing the application:
these drawbacks are caused by the need to rely on intelligent devices to upload audio data to a server for speech recognition and semantic understanding. The problem that results from these drawbacks is that the intelligent device needs to rely on a server and a network to solve the voice control problem.
The inventor also finds that the practitioners in the industry of smart home control generally do not have the capabilities of voice recognition and semantic understanding technologies, let alone to realize voice recognition and understanding locally and offline (without depending on a server). The main difficulty of the scheme is that local recognition, semantic understanding algorithm and model training need to be customized and trained for a language model aiming at a home control environment, a large amount of voice data of relevant instructions need to be collected for recognition training, and local resources of the language recognition and semantic understanding model are minimized.
The scheme of the application is mainly designed and optimized from the following aspects:
the defects of the prior art are described in the above conditions, and it is found in practical application of main products and technologies that infrared control cannot penetrate through a wall, equipment for controlling home through infrared learning needs to be placed in the same room as controlled equipment, but not all rooms can be guaranteed, the price is high, the functions are multiple and complex, once the equipment networking is unstable, control cannot be achieved, the defective products can control problems, but the adaptability is low, the realization can be achieved only by high purchase and use costs, and the experience is poor in the actual experience depending on network stability. The invention aims to improve the adaptability and stability of the product, reduce the cost, really reduce the voice control reconstruction cost of old household appliances, lamp remote control equipment and the like used at home to the lowest, and has the best use effect.
The difference between the invention and the prior art is that the learning, coding and storing of infrared remote control and the recognition, understanding and instruction corresponding relation of voice instructions can be realized in the device, and the invention does not depend on a server and a network.
The intelligent device hardware comprises the following modules:
an infrared receiving module: the infrared remote control device is used for receiving infrared remote control waves of other household equipment.
A storage module: the system is used for 1, storing infrared remote control waves 2, storing an infrared remote control wave and key relation table 3, an instruction and key corresponding relation table 4, a voice recognition model 5 and a semantic understanding model.
A CPU: the method is used for equipment control calculation and operation calculation of the voice model.
An infrared emission module: the infrared remote control device is used for sending infrared remote control wave control to the household equipment.
Pickup microphone and signal processing: the method is used for audio acquisition and signal processing.
Small screen (optional): for editing control instructions.
Bluetooth (optional): and the method is used for editing the control instruction by the mobile phone connecting equipment.
Horn (optional): and the TTS is used for broadcasting the execution result.
Referring to fig. 3, a flowchart of another home voice control learning and applying method according to an embodiment of the present invention is shown.
As shown in fig. 3, the product function application describes:
infrared learning and transmission: and entering an infrared learning mode of a product, completing the receiving of infrared signals by an infrared integrated receiving tube, completely copying the infrared signal waveform sent by the original remote controller of the controlled equipment, then storing the infrared signal waveform in a nonvolatile memory, and taking out the stored waveform data during sending to restore the waveform data into the original signal.
Establishing a virtual key name for the infrared waveform: and in the learning mode, pressing a key of a remote controller of the controlled household equipment, storing the captured infrared waveform, and defining a basic key. For example: pressing a sound plus key of the remote controller, and after the capturing is successful, naming the key as sound plus by a user;
editing a voice instruction: inputting voice instructions, such as: the sound is a little bigger, 2) "sound +" is selected, and the number of times of repeated execution is selected;
and (3) user voice input: the method comprises the steps that sound is larger, after audio collected by a microphone is processed through signals, a processor sends an audio frequency spectrum into a recognition model which runs locally for calculation to obtain an original text, the original text is sent into a semantic understanding module for analysis, the semantic understanding module analyzes and matches a corresponding voice command, and a sound plus key command is triggered after the matching is successful.
And the infrared transmitter transmits the infrared waveform storing the corresponding sound + to the controlled home and executes the infrared waveform according to the specified execution times. And the controlled home realizes voice control after receiving the infrared wave.
The intelligent equipment firstly needs to learn the infrared remote controllers of other homes, and the description of the infrared learning is as follows:
step 1: the intelligent equipment is initialized after being started, and module services such as a voice recognition model, voice detection, voice recognition recording and the like are loaded.
Step 2: the intelligent equipment is triggered by a key or a mobile phone or a voice to call an infrared identification subprogram to enter an infrared learning mode, and at the moment, an infrared receiving device of the equipment is in an infrared wave receiving state. Pressing the keys to be learned of the infrared remote controller of the controlled household equipment, for example: the "sound +" key.
And step 3: the infrared receiving device monitors that the output end always outputs high level under the condition that no infrared signal is received, and once the infrared signal is input and the level signal jumps, the signal can be captured and enters an interrupt processing function to realize the width measurement of the pulse width. Judging that the pulse signal accords with a rule, storing the waveform, and prompting a user to input the name of the infrared key; if the rule is not met, the monitoring is continuously kept.
And 4, step 4: the user enters the name of the infrared key, for example: and 3, adding sound, and finishing the key learning on the controlled home remote controller in sequence by the user according to the step 3-4.
And 5: the user inputs voice instructions to be implemented, for example: if the sound is larger, the corresponding remote control key is selected to be 'sound plus', the execution times can be selected, and if the default execution is not selected, the execution times can be selected. If the voice command is selected for multiple times, the voice command is executed repeatedly. And finishing the infrared learning of the remote controller keys.
Step 6: the user inputs voice instructions, such as: the sound is a little bit louder.
And 7: the voice detection module detects voice, starts a microphone to record voice and collects voice signals of a user.
And 8: after the voice signal is collected, preprocessing such as filtering (aliasing interference prevention and power supply power frequency interference prevention), A/D conversion (digital signal conversion and quantization noise), pre-emphasis (high-frequency part amplification) and end point detection (audio starting point and end point identification) is firstly carried out.
And step 9: and after the voice signal is subjected to voice feature extraction and directional quantization, the voice signal is sent to voice recognition calculation and analysis, a feature vector sequence of the voice is input, the voice recognition method based on the artificial neural network is compared with an algorithm of a voice instruction training template library, and a recognition result is finally output.
Step 10: the recognized credible text enters semantic matching, the voice text is matched with a voice command which is input by a user in advance, and the voice command is sent to call the infrared waveform transmitter. And if not, the instruction execution is terminated.
Step 11: and after receiving the instruction, the infrared waveform transmitter calls the stored corresponding infrared model to transmit the infrared waveform to the controlled equipment, and if the instruction needs to be transmitted repeatedly, the infrared waveform transmitter transmits the infrared waveform repeatedly according to the preset times.
Step 12: and finishing the execution after the transmission is finished.
Beta version formed by the inventor in the process of implementing the invention: the offline recognition voice model and semantic understanding have high requirements on local resources of equipment, so that the offline recognition voice model and semantic understanding are important for resource optimization, a model algorithm is optimized, semantic complexity is reduced, and common household instructions are covered.
The technical points discovered by the inventor in the process of implementing the invention are as follows: because the speech recognition and understanding adopt an off-line recognition model, the method is independent of a network and has better stability. Can still be normally used in a non-network environment. Because the speech recognition and understanding adopt an off-line recognition model, the response speed is higher, the average delay of the feedback execution of the network-dependent speech instruction is 500ms-5s, and the local model recognition almost reduces the feedback execution delay to be within 50ms, which is close to real-time feedback. Because the speech recognition and understanding adopt an off-line recognition model, a user does not need to install a network, equipment does not need to be provided with a network module, the installation is not limited, the function design is more single, the equipment cost can be reduced by 20-50 yuan, and more cost can be saved if a plurality of pieces of equipment are purchased.
Referring to fig. 4, a block diagram of a home voice control learning apparatus according to an embodiment of the present invention is shown.
As shown in fig. 4, the home voice control learning device 400 includes a receiving program module 410, a first determining program module 420 and a storing program module 430.
The receiving program module 410 is configured to respond to a user triggering a voice infrared control learning function, and receive a waveform of an infrared signal generated when the infrared remote controller of the controlled home equipment is used by the user; a first determining program module 420 configured to determine whether the waveform of the infrared signal is legal and complete; and the storage program module 430 is configured to store the infrared signal waveform and the voice instruction to be realized corresponding to the infrared signal waveform if the infrared signal waveform is legal and complete.
Referring to fig. 5, a block diagram of a furniture voice control application apparatus according to an embodiment of the present invention is shown.
As shown in fig. 5, the home voice control application device 500 includes a recognition output program module 510, a second judgment program module 520, and a transmission program module 530.
The recognition output program module 510 is configured to respond to a voice instruction of a user to a controlled device, perform voice recognition on the voice instruction, and output a recognition result; a second judgment program module 520 configured to judge whether the recognition result matches a pre-recorded voice instruction, where a waveform of an infrared signal corresponding to the pre-recorded voice instruction is locally stored; and a sending program module 530 configured to send the waveform of the infrared signal to the controlled device if the waveform of the infrared signal matches the waveform of the controlled device.
It should be understood that the modules depicted in fig. 4 and 5 correspond to various steps in the methods described with reference to fig. 1 and 2. Thus, the operations and features described above for the method and the corresponding technical effects are also applicable to the modules in fig. 4 and 5, and are not described again here.
It should be noted that the modules in the embodiments of the present disclosure are not limited to the scheme of the present disclosure, for example, the receiving program module may be described as a module that receives a waveform of an infrared signal generated when the infrared remote controller of the controlled home equipment is used by the user in response to the user triggering the voice infrared control learning function. In addition, the related functional modules may also be implemented by a hardware processor, for example, the receiving program module may also be implemented by a processor, which is not described herein again.
In other embodiments, an embodiment of the present invention further provides a non-volatile computer storage medium, where the computer storage medium stores computer-executable instructions, and the computer-executable instructions may execute the home voice control learning and application method in any of the above method embodiments;
as one embodiment, a non-volatile computer storage medium of the present invention stores computer-executable instructions configured to:
responding to a voice infrared control learning function triggered by a user, and receiving a waveform of an infrared signal generated when an infrared remote controller of controlled household equipment is used by the user;
judging whether the waveform of the infrared signal is legal and complete;
and if the waveform of the infrared signal is legal and complete, storing the waveform of the infrared signal and the voice command which is required to be realized and corresponds to the waveform of the infrared signal.
As another embodiment, a non-volatile computer storage medium of the present invention stores computer-executable instructions configured to:
responding to a voice instruction of a user to controlled equipment, performing voice recognition on the voice instruction and outputting a recognition result;
judging whether the recognition result is matched with a pre-recorded voice command or not, wherein the waveform of an infrared signal corresponding to the pre-recorded voice command is locally stored;
and if so, sending the waveform of the infrared signal to the controlled equipment.
The non-volatile computer-readable storage medium may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created from use of the home voice control learning and applying apparatus, and the like. Further, the non-volatile computer-readable storage medium may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, the non-transitory computer readable storage medium optionally includes memory located remotely from the processor, which may be connected to the home voice control learning and application device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
Embodiments of the present invention further provide a computer program product, where the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, and the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes any one of the above-mentioned home voice control learning and applying methods.
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 6, the electronic device includes: one or more processors 610 and a memory 620, with one processor 610 being an example in fig. 6. The device for the household voice control learning and application method may further include: an input device 630 and an output device 640. The processor 610, the memory 620, the input device 630, and the output device 640 may be connected by a bus or other means, such as the bus connection in fig. 6. The memory 620 is a non-volatile computer-readable storage medium as described above. The processor 610 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions and modules stored in the memory 620, that is, implements the home voice control learning and application method of the above-described method embodiments. The input device 630 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the communication compensation device. The output device 640 may include a display device such as a display screen.
The product can execute the method provided by the embodiment of the invention, and has corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the method provided by the embodiment of the present invention.
As an implementation manner, the electronic device is applied to a home voice control learning and application apparatus, and is used for a client, and includes: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to:
responding to a voice infrared control learning function triggered by a user, and receiving a waveform of an infrared signal generated when an infrared remote controller of controlled household equipment is used by the user;
judging whether the waveform of the infrared signal is legal and complete;
and if the waveform of the infrared signal is legal and complete, storing the waveform of the infrared signal and the voice command which is required to be realized and corresponds to the waveform of the infrared signal.
As another embodiment, the electronic device is applied to a home voice control learning and application device, and is applied to a client, and includes: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to:
responding to a voice instruction of a user to controlled equipment, performing voice recognition on the voice instruction and outputting a recognition result;
judging whether the recognition result is matched with a pre-recorded voice command or not, wherein the waveform of an infrared signal corresponding to the pre-recorded voice command is locally stored;
and if so, sending the waveform of the infrared signal to the controlled equipment.
The electronic device of the embodiments of the present application exists in various forms, including but not limited to:
(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.
(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc., such as ipads.
(3) A portable entertainment device: such devices can display and play multimedia content. Such devices include audio and video players (e.g., ipods), handheld game consoles, electronic books, as well as smart toys and portable car navigation devices.
(4) The server is similar to a general computer architecture, but has higher requirements on processing capability, stability, reliability, safety, expandability, manageability and the like because of the need of providing highly reliable services.
(5) And other electronic devices with data interaction functions.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods of the various embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A household voice control learning method comprises the following steps:
responding to a voice infrared control learning function triggered by a user, and receiving a waveform of an infrared signal generated when an infrared remote controller of controlled household equipment is used by the user;
judging whether the waveform of the infrared signal is legal and complete;
and if the waveform of the infrared signal is legal and complete, storing the waveform of the infrared signal and the voice command which is required to be realized and corresponds to the waveform of the infrared signal.
2. The method of claim 1, wherein after said determining whether the waveform of the infrared signal is legally complete, the method further comprises:
and if the waveform of the infrared signal is illegal and/or incomplete, continuing to monitor.
3. The method of claim 1, further comprising:
and receiving and storing the repeated execution times set by the user and corresponding to the waveform of the infrared signal.
4. A furniture voice control application method comprises the following steps:
responding to a voice instruction of a user to controlled equipment, performing voice recognition on the voice instruction and outputting a recognition result;
judging whether the recognition result is matched with a pre-recorded voice command or not, wherein the waveform of an infrared signal corresponding to the pre-recorded voice command is locally stored;
and if so, sending the waveform of the infrared signal to the controlled equipment.
5. The method of claim 4, wherein after determining whether the recognition result matches a pre-entered voice instruction, the method further comprises:
and if not, terminating the execution of the voice command.
6. The method of claim 4, wherein the number of times the infrared signal is repeatedly executed is locally stored, and if the infrared signal is matched with the stored number of times, the sending the waveform of the infrared signal to the controlled device comprises:
and if so, sending the waveform of the infrared signal to the controlled equipment according to the repeated execution times.
7. A home voice control learning device, comprising:
the receiving program module is configured to respond to the fact that a user triggers a voice infrared control learning function and receive the waveform of an infrared signal generated when the infrared remote controller of the controlled household equipment is used by the user;
the first judgment program module is configured to judge whether the waveform of the infrared signal is legal and complete;
and the storage program module is configured to store the infrared signal waveform and a voice instruction which needs to be realized and corresponds to the infrared signal waveform if the infrared signal waveform is legal and complete.
8. A furniture voice control application device comprising:
the recognition output program module is configured to respond to a voice command of a user to the controlled equipment, perform voice recognition on the voice command and output a recognition result;
the second judgment program module is configured to judge whether the recognition result is matched with a pre-recorded voice instruction, wherein the waveform of the infrared signal corresponding to the pre-recorded voice instruction is locally stored;
and the transmitting program module is configured to transmit the waveform of the infrared signal to the controlled equipment if the infrared signal is matched with the controlled equipment.
9. An electronic device, comprising: at least one processor, and a memory communicatively coupled to the at least one processor, wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the method of any one of claims 1 to 6.
10. A storage medium having stored thereon a computer program, characterized in that the program, when being executed by a processor, is adapted to carry out the steps of the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110129042.5A CN112908326A (en) | 2021-01-29 | 2021-01-29 | Household voice control learning and application method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110129042.5A CN112908326A (en) | 2021-01-29 | 2021-01-29 | Household voice control learning and application method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112908326A true CN112908326A (en) | 2021-06-04 |
Family
ID=76121309
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110129042.5A Withdrawn CN112908326A (en) | 2021-01-29 | 2021-01-29 | Household voice control learning and application method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112908326A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113763935A (en) * | 2021-08-20 | 2021-12-07 | 重庆长安汽车股份有限公司 | Method and system for controlling electric appliance of vehicle body through voice outside vehicle, vehicle and storage medium |
| CN114211928A (en) * | 2021-11-10 | 2022-03-22 | 深圳市易优电气有限公司 | Parking air conditioner self-adaptive remote controller method, controller, device and storage medium |
| CN117061266A (en) * | 2023-10-13 | 2023-11-14 | 荣耀终端有限公司 | Control method and control device of intelligent household equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102254416A (en) * | 2011-05-09 | 2011-11-23 | 青岛海信移动通信技术股份有限公司 | Universal remote controller system based on intelligent touch platform and use method thereof |
| CN105869383A (en) * | 2016-04-13 | 2016-08-17 | 北京精益理想科技有限公司 | Infrared data processing method, infrared instruction calling method and infrared instruction calling system |
| CN105957332A (en) * | 2016-06-30 | 2016-09-21 | 北京海尔广科数字技术有限公司 | Method for learning and using infrared remote controller codes and learning type remote controller |
| CN106228796A (en) * | 2016-08-30 | 2016-12-14 | 深圳市友连电子科技有限公司 | The learning method of infrared remote control and device |
| CN208141599U (en) * | 2018-05-08 | 2018-11-23 | 安徽众家云物联网科技有限公司 | A kind of universal domestic electrical equipment remote controller of study |
| CN110060677A (en) * | 2019-04-04 | 2019-07-26 | 平安科技（深圳）有限公司 | Voice remote controller control method, device and computer readable storage medium |
| CN111833585A (en) * | 2019-04-17 | 2020-10-27 | 百度在线网络技术（北京）有限公司 | Method, device and equipment for intelligent equipment to learn remote control function and storage medium |
-
2021
- 2021-01-29 CN CN202110129042.5A patent/CN112908326A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102254416A (en) * | 2011-05-09 | 2011-11-23 | 青岛海信移动通信技术股份有限公司 | Universal remote controller system based on intelligent touch platform and use method thereof |
| CN105869383A (en) * | 2016-04-13 | 2016-08-17 | 北京精益理想科技有限公司 | Infrared data processing method, infrared instruction calling method and infrared instruction calling system |
| CN105957332A (en) * | 2016-06-30 | 2016-09-21 | 北京海尔广科数字技术有限公司 | Method for learning and using infrared remote controller codes and learning type remote controller |
| CN106228796A (en) * | 2016-08-30 | 2016-12-14 | 深圳市友连电子科技有限公司 | The learning method of infrared remote control and device |
| CN208141599U (en) * | 2018-05-08 | 2018-11-23 | 安徽众家云物联网科技有限公司 | A kind of universal domestic electrical equipment remote controller of study |
| CN110060677A (en) * | 2019-04-04 | 2019-07-26 | 平安科技（深圳）有限公司 | Voice remote controller control method, device and computer readable storage medium |
| CN111833585A (en) * | 2019-04-17 | 2020-10-27 | 百度在线网络技术（北京）有限公司 | Method, device and equipment for intelligent equipment to learn remote control function and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113763935A (en) * | 2021-08-20 | 2021-12-07 | 重庆长安汽车股份有限公司 | Method and system for controlling electric appliance of vehicle body through voice outside vehicle, vehicle and storage medium |
| CN114211928A (en) * | 2021-11-10 | 2022-03-22 | 深圳市易优电气有限公司 | Parking air conditioner self-adaptive remote controller method, controller, device and storage medium |
| CN117061266A (en) * | 2023-10-13 | 2023-11-14 | 荣耀终端有限公司 | Control method and control device of intelligent household equipment |
| CN117061266B (en) * | 2023-10-13 | 2024-04-02 | 荣耀终端有限公司 | Control method and control device of intelligent household equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112908326A (en) | Household voice control learning and application method and device | |
| EP3640936B1 (en) | Apparatus control device, method, and apparatus having same | |
| CN110459221B (en) | Method and device for multi-device cooperative voice interaction | |
| CN104935615B (en) | Realize the system and method for voice control household appliance | |
| US6718307B1 (en) | Speech input device with attention span | |
| US20180253961A1 (en) | Systems and methods using acoustic communication | |
| CN110808044B (en) | Voice control method and device for intelligent household equipment, electronic equipment and storage medium | |
| CN110932953A (en) | Intelligent household control method and device, computer equipment and storage medium | |
| CN105185378A (en) | Voice control method, voice control system and air conditioner capable of realizing voice control | |
| CN105187480B (en) | Profile acquisition method, apparatus and system | |
| CN108922163A (en) | A kind of learning method of infrared remote control, device, terminal and storage medium | |
| CN109660858A (en) | Transmission method, device, terminal and the server of direct broadcasting room interaction data | |
| CN108632140A (en) | A kind of sound processing system, method and server based on small routine | |
| CN111123875A (en) | Intelligent household control method and system and intelligent tea table | |
| CN111474859A (en) | Control method and device of non-intelligent device and electronic device | |
| CN113593544A (en) | Device control method and apparatus, storage medium, and electronic apparatus | |
| WO2024103926A1 (en) | Voice control methods and apparatuses, storage medium, and electronic device | |
| CN114898746A (en) | Interaction method and device, storage medium and electronic device | |
| US20060129408A1 (en) | A remote control device and method with speech control | |
| CN111353771A (en) | Method, device, equipment and medium for remotely controlling payment | |
| CN110691106A (en) | Intelligent sound box control method based on two-dimensional code link | |
| CN113284488A (en) | Control method and device for household appliance, voice box and storage medium | |
| CN108055655A (en) | Method, device and equipment for adding friend to voice equipment and storage medium | |
| CN108942926B (en) | Man-machine interaction method, device and system | |
| CN115550089A (en) | Intelligent home system, communication method and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210604 |
|
| WW01 | Invention patent application withdrawn after publication |