CN113647825A - Water dispenser water outlet automatic control method based on neural network - Google Patents
Water dispenser water outlet automatic control method based on neural network Download PDFInfo
- Publication number
- CN113647825A CN113647825A CN202110993888.3A CN202110993888A CN113647825A CN 113647825 A CN113647825 A CN 113647825A CN 202110993888 A CN202110993888 A CN 202110993888A CN 113647825 A CN113647825 A CN 113647825A
- Authority
- CN
- China
- Prior art keywords
- water
- neural network
- layer
- control method
- water dispenser
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 title claims abstract description 149
- 238000000034 method Methods 0.000 title claims abstract description 16
- 238000013528 artificial neural network Methods 0.000 title claims abstract description 13
- 238000003062 neural network model Methods 0.000 claims abstract description 24
- 238000001514 detection method Methods 0.000 claims abstract description 11
- 238000006243 chemical reaction Methods 0.000 claims description 12
- 230000009466 transformation Effects 0.000 claims description 11
- 238000013527 convolutional neural network Methods 0.000 claims description 8
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 claims description 3
- 241000190070 Sarracenia purpurea Species 0.000 description 5
- 238000005070 sampling Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000007781 pre-processing Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000037433 frameshift Effects 0.000 description 1
- 238000009432 framing Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
- A47J—KITCHEN EQUIPMENT; COFFEE MILLS; SPICE MILLS; APPARATUS FOR MAKING BEVERAGES
- A47J31/00—Apparatus for making beverages
- A47J31/44—Parts or details or accessories of beverage-making apparatus
- A47J31/52—Alarm-clock-controlled mechanisms for coffee- or tea-making apparatus ; Timers for coffee- or tea-making apparatus; Electronic control devices for coffee- or tea-making apparatus
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/16—Speech classification or search using artificial neural networks
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Food Science & Technology (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Domestic Plumbing Installations (AREA)
Abstract
The invention discloses a water dispenser water outlet automatic control method based on a neural network, and a user instruction identification model and a water level detection model are established. In the invention, the first neural network model serves as a user instruction identification model, can identify voice, liberates hands, is not limited by light, can be used in a dark environment, and the second neural network model serves as a water level detection model, can replace manual judgment of water level in cups, is better generalized on various types of cups, does not influence the accuracy of judgment due to cup type difference, and has better user experience.
Description
Technical Field
The invention relates to the technical field of water outlet of water dispensers, in particular to a water outlet automatic control method of a water dispenser based on a neural network.
Background
When the water dispenser is used for receiving water, if water with a specified water level is required to be filled in the cup, people are usually required to manually judge the water level in the cup by eyes and ears, so that when the water dispenser discharges water, people need to manually turn on the water outlet switch, pay attention to the water level in the cup constantly and judge whether the water level reaches the water level required by the people or not, the people are required to distribute attention at the water level, and the water dispenser is very inconvenient. In addition, sometimes people need to receive water in a dark environment, and the water level is difficult to judge only by hearing.
In order to solve the problem that people need to pay attention to observe the water level when the water dispenser is used for receiving water, the existing water dispenser adopts a method of flowing out the specified water quantity, and the specified water quantity flows out every time. But this method is not applicable to cups of different sizes. With the same amount of water, the water may overflow for a cup with a smaller volume and too little for a cup with a larger volume. When people receive water, people generally pay more attention to the percentage of the height of the current water level to the height of the cup. The amount of water required to fill 50% height, 70% height or full is not the same for different sized cups. If the method is used, for cups with different sizes, if a person wants to receive water with the height of 50%, water with the height of 70% or full water, or needs to distribute attention to manually control the water flow, the problem that the water level needs to be observed by the person when the water dispenser is used for receiving water still cannot be solved.
When the water dispenser is used for receiving water, sound can be generated due to the vibration of the air column in the water cup, and the sound mode can be changed along with the height of the water level in the water cup. By utilizing the characteristic, the water level detection is carried out through the sound mode during water receiving, and then the water dispenser is controlled to stop water outlet. For the detection mode of the sound mode during water receiving, if the traditional audio algorithm is used for modeling the sound during water receiving of a water cup, good effects on different types of cups are difficult to achieve, and in addition, a water outlet button is generally required to be manually pressed when a water dispenser is used at present, so that the water dispenser is not convenient enough.
Therefore, the automatic water outlet control method of the water dispenser based on the neural network is provided.
Disclosure of Invention
The invention aims to: in order to solve the problems, the invention provides a water outlet automatic control method of a water dispenser based on a neural network.
In order to achieve the purpose, the invention adopts the following technical scheme: a water dispenser water outlet automatic control method based on a neural network comprises the following steps:
building user instruction recognition model
a. Collecting a voice control instruction supported by the water dispenser;
b. and training a first neural network model by using the collected voice data of the user instruction, and modeling the voice mode of the user instruction.
(II) establishing a water level detection model
c. Collecting the sound generated when various types of cups receive water when the water dispenser discharges water;
d. and training a neural network model II by using the collected data, and modeling the sound under the condition of different water levels in the cup during water receiving.
As a further description of the above technical solution:
and c, preprocessing the collected voice before the step b.
As a further description of the above technical solution:
and the first neural network model in the step b is sequentially provided with 40 × 100 dimensional input, CNN layer 1, ReLU layer 2, CNN layer 3, ReLU layer 4, linear conversion layer 5, ReLU layer 6, linear conversion layer 7, ReLU layer 8, linear conversion layer 9, softmax layer 10 and 11 dimensional output along the output direction.
As a further description of the above technical solution:
and d, sequentially arranging 1200-dimensional input, a linear transformation layer 1, an LSTM structure 2, a linear transformation layer 3, a sigmoid function layer 4 and 1-dimensional output along the output direction of the neural network model II in the step d.
As a further description of the above technical solution:
in the steps b and d, the first neural network model and the second neural network model use an Adam optimizer, and the loss function is cross entropy.
In summary, due to the adoption of the technical scheme, the invention has the beneficial effects that:
in the invention, the first neural network model serves as a user instruction identification model, can identify voice, liberates hands, is not limited by light, can be used in a dark environment, and the second neural network model serves as a water level detection model, can replace manual judgment of water level in cups, is better generalized on various types of cups, does not influence the accuracy of judgment due to cup type difference, and has better user experience.
Drawings
FIG. 1 is a schematic diagram of a neural network model according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a neural network model II provided in an embodiment of the present invention;
fig. 3 shows a schematic diagram of an automatic water outlet flow of a water dispenser according to an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-3, the present invention provides a technical solution: a water dispenser water outlet automatic control method based on a neural network comprises the following steps:
building user instruction recognition model
a. Collecting voice control instructions supported by the water dispenser, specifically collecting voice data of more than 300 speakers, wherein the voice data comprises instructions for supporting the voice control of the water dispenser, such as terms of '50% water receiving height', '70% water receiving height', 'automatic water full', 'stop water receiving', and the like;
b. training a neural network model I by using collected user instruction voice data, modeling a voice mode of a user instruction, preprocessing the collected voice before the step b, adding some common noises in daily life to the collected command word data, and combining original recorded data to serve as training data; extracting 40-dimensional fbank characteristics of the voice by taking 25ms as a window length, and moving the window once every 10 ms;
when the user instruction recognition model is used after training is completed, an instruction word awakening threshold value needs to be set for the instruction word. When the output of the model on the dimension of a certain instruction word is larger than or equal to the instruction word awakening threshold value, the instruction is considered to be effective. For example, setting an instruction word awakening threshold value to be 0.9, setting the output of the model on the dimension corresponding to the '80% height of water receiving' to be 0.95, and if the output is greater than 0.9, considering that the '80% height of water receiving' instruction is effective, and obtaining a threshold value of 0.8 for stopping water outlet;
the first neural network model in the step b is sequentially provided with 40 × 100 dimensional input, CNN layer 1, ReLU layer 2, CNN layer 3, ReLU layer 4, linear conversion layer 5, ReLU layer 6, linear conversion layer 7, ReLU layer 8, linear conversion layer 9, softmax layer 10 and 11 dimensional output along the output direction;
specifically, the 40-dimensional fbank features are spliced into a total of 100 frames, and are output in a softmax layer 10 to obtain 11-dimensional output after passing through 64 CNN layers 1 and ReLU layers 2 with convolution kernels of 40 × 7, passing through 128 CNN layers 3 and ReLU layers 4 with convolution kernels of 64 × 7, passing through linear conversion layers 5 and ReLU layers 6, linear conversion layers 7 and ReLU layers 8, and linear conversion layers 9. Wherein, each dimension of the 11-dimensional output respectively indicates the probability (between 0 and 1) that each instruction word is recognized.
(II) establishing a water level detection model
c. Collecting the sound generated when various types of cups receive water when the water dispenser discharges water, wherein the sound data comprises the data of the whole time period from empty cup to full cup, and marking the sound moment at different water levels when collecting the data, for example, marking the water level height once every 10% till the water level reaches full water, namely 100%, when the water level height in the water cup is 30%, the water receiving audio frequency is 2s moment;
d. training a neural network model II by using the collected data, and modeling the sounds in the cup at different water levels during water receiving;
wherein, the water level detection model comprises an LSTM structure for modeling time sequence information. The output is water level. The model output layer is a sigmoid function, output is restricted between 0 and 1, and the proportion of the height of the current water level to the height of the water cup is conveniently represented.
The recorded audio is 48kHz sampled audio. And framing is carried out according to the frame length of 25ms and the frame shift of 10ms, each frame comprises 1200 sampling points, and the number of the sampling points between adjacent frames is 480 at intervals. Then every 10ms, i.e. 480 sampling points, the model inputs 25ms of audio data, i.e. 1200 sampling points;
d, sequentially arranging 1200-dimensional input, a linear transformation layer, an LSTM structure, a linear transformation layer, a sigmoid function layer and 1-dimensional output along the output direction of the neural network model II;
specifically, 1200 sample point data is input as 1200 dimensions of the model, and the 1200 dimensional input is first passed through the linear transformation layer 1 to transform the input from 1200 dimensions to 64 dimensions. The output of the linear transformation layer 1 is input into the LSTM structure 2, and the output of the LSTM structure 2 has 64 dimensions. The output of the LSTM structure 2 enters a linear transformation layer 3, the linear transformation layer 3 transforms 64-dimensional data into 1-dimensional data, the output of the linear transformation layer 3 is input into a sigmoid function layer 4, and the final result is output by the sigmoid function layer 4. The final output is 1-dimensional, a value between 0 and 1.
In steps b and d, using an Adam optimizer for the first neural network model and the second neural network model, the loss function is cross entropy.
The water receiving flow of the water dispenser is as follows:
step 1, placing the cup at a water receiving position.
And 2, the user sends a voice instruction to set a desired water level as a threshold for stopping water outlet, such as water receiving height of 80%, at the moment, the corresponding threshold is 0.8, and the water dispenser starts to discharge water after the user sends the voice instruction.
And 3, recording the sound generated when the cup receives water when the water dispenser discharges water, and transmitting the sound to the water level detection model in real time.
And 4, judging the current water level in the cup through the water level detection model, and outputting a result every 10ms, wherein the result is a numerical value between 0 and 1. 0 is the lowest water level and 1 is the highest water level. For example, a value of 0.6, the water level is considered to reach 60% of the height of the cup.
Step 5, judging once when the result is output once, and when the result is greater than or equal to the threshold value, the water outlet switch receives a closing signal, and the water dispenser automatically stops water outlet; when the water level has the highest limit value and the value reaches 0.95, the water level is close to the maximum value 1, the water is considered to be full, the water outlet switch receives a closing signal, and the water dispenser automatically stops water outlet.
In addition, at any time when the water dispenser discharges water, as long as a user gives a command of stopping water discharge, the water dispenser stops water discharge.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (5)
1. A water dispenser water outlet automatic control method based on a neural network is characterized by comprising the following steps:
building user instruction recognition model
a. Collecting a voice control instruction supported by the water dispenser;
b. and training a first neural network model by using the collected voice data of the user instruction, and modeling the voice mode of the user instruction.
(II) establishing a water level detection model
c. Collecting the sound generated when various types of cups receive water when the water dispenser discharges water;
d. and training a neural network model II by using the collected data, and modeling the sound under the condition of different water levels in the cup during water receiving.
2. The automatic water dispenser water outlet control method based on the neural network as claimed in claim 1, wherein the collected voice is preprocessed before the step b.
3. The automatic water outlet control method for the water dispenser based on the neural network as claimed in claim 2, wherein the neural network model I in the step b is sequentially provided with 40 x 100 dimensional input, CNN layer 1, ReLU layer 2, CNN layer 3, ReLU layer 4, linear conversion layer 5, ReLU layer 6, linear conversion layer 7, ReLU layer 8, linear conversion layer 9, softmax layer 10 and 11 dimensional output along the output direction.
4. The automatic water outlet control method for the water dispenser based on the neural network as claimed in claim 3, wherein the neural network model II in the step d is sequentially provided with 1200-dimensional input, a linear transformation layer 1, an LSTM structure 2, a linear transformation layer 3, a sigmoid function layer 4 and 1-dimensional output along the output direction.
5. The automatic water dispenser water outlet control method based on the neural network as claimed in claim 4, wherein in the steps b and d, Adam optimizer is used for the first neural network model and the second neural network model, and the loss function is cross entropy.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110993888.3A CN113647825A (en) | 2021-08-27 | 2021-08-27 | Water dispenser water outlet automatic control method based on neural network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110993888.3A CN113647825A (en) | 2021-08-27 | 2021-08-27 | Water dispenser water outlet automatic control method based on neural network |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113647825A true CN113647825A (en) | 2021-11-16 |
Family
ID=78493067
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110993888.3A Pending CN113647825A (en) | 2021-08-27 | 2021-08-27 | Water dispenser water outlet automatic control method based on neural network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113647825A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08120712A (en) * | 1994-10-19 | 1996-05-14 | Mitsubishi Electric Corp | Supply/distribution water equipment device |
| CN107997581A (en) * | 2016-12-23 | 2018-05-08 | 芜湖美的厨卫电器制造有限公司 | Water dispenser and its effluent control device and method |
| CN110738984A (en) * | 2019-05-13 | 2020-01-31 | 苏州闪驰数控系统集成有限公司 | Artificial intelligence CNN, LSTM neural network speech recognition system |
| CN112043161A (en) * | 2020-07-29 | 2020-12-08 | 北京理工大学 | Intelligent water dispenser system based on sound frequency spectrum feature recognition and control method |
| US20210015292A1 (en) * | 2019-07-19 | 2021-01-21 | Lg Electronics Inc. | Method and heating apparatus for estimating status of heated object |
| US20210248442A1 (en) * | 2020-02-11 | 2021-08-12 | Distech Controls Inc. | Computing device and method using a neural network to predict values of an input variable of a software |
-
2021
- 2021-08-27 CN CN202110993888.3A patent/CN113647825A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08120712A (en) * | 1994-10-19 | 1996-05-14 | Mitsubishi Electric Corp | Supply/distribution water equipment device |
| CN107997581A (en) * | 2016-12-23 | 2018-05-08 | 芜湖美的厨卫电器制造有限公司 | Water dispenser and its effluent control device and method |
| CN110738984A (en) * | 2019-05-13 | 2020-01-31 | 苏州闪驰数控系统集成有限公司 | Artificial intelligence CNN, LSTM neural network speech recognition system |
| US20210015292A1 (en) * | 2019-07-19 | 2021-01-21 | Lg Electronics Inc. | Method and heating apparatus for estimating status of heated object |
| US20210248442A1 (en) * | 2020-02-11 | 2021-08-12 | Distech Controls Inc. | Computing device and method using a neural network to predict values of an input variable of a software |
| CN112043161A (en) * | 2020-07-29 | 2020-12-08 | 北京理工大学 | Intelligent water dispenser system based on sound frequency spectrum feature recognition and control method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103026407B (en) | Bandwidth extender | |
| CN109243431A (en) | A kind of processing method, control method, recognition methods and its device and electronic equipment | |
| CN109065075A (en) | A kind of method of speech processing, device, system and computer readable storage medium | |
| CN108172242B (en) | Improved Bluetooth intelligent cloud sound box voice interaction endpoint detection method | |
| CN109448719A (en) | Establishment of Neural Model method and voice awakening method, device, medium and equipment | |
| CN1965218A (en) | Performance prediction for an interactive speech recognition system | |
| CN110347367A (en) | Volume adjusting method, terminal device, storage medium and electronic equipment | |
| CN105869626A (en) | Automatic speech rate adjusting method and terminal | |
| CN101424924A (en) | Sound control intelligent household control system | |
| CN109036412A (en) | voice awakening method and system | |
| CN107682561A (en) | volume adjusting method, device, terminal and storage medium | |
| CN108335700B (en) | Voice adjusting method and device, voice interaction equipment and storage medium | |
| CN102907077A (en) | System and method of smart audio logging for mobile devices | |
| CN107360157A (en) | A kind of user registering method, device and intelligent air conditioner | |
| CN103456305A (en) | Terminal and speech processing method based on multiple sound collecting units | |
| CN109949808A (en) | The speech recognition appliance control system and method for compatible mandarin and dialect | |
| CN110473536A (en) | A kind of awakening method, device and smart machine | |
| CN1787070B (en) | On-chip system for language learner | |
| CN201181413Y (en) | Acoustic control intelligent household control device | |
| CN111145763A (en) | GRU-based voice recognition method and system in audio | |
| CN108053023A (en) | A kind of self-action intent classifier method and device | |
| CN1312656C (en) | Speaking person standarding method and speech identifying apparatus using the same | |
| CN113160854A (en) | Voice interaction system, related method, device and equipment | |
| CN113647825A (en) | Water dispenser water outlet automatic control method based on neural network | |
| KR101145401B1 (en) | Test equipment and method for speech recognition performance of Robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20211116 |
|
| WD01 | Invention patent application deemed withdrawn after publication |