CN107123421A - Sound control method, device and home appliance - Google Patents
Sound control method, device and home appliance Download PDFInfo
- Publication number
- CN107123421A CN107123421A CN201710233667.XA CN201710233667A CN107123421A CN 107123421 A CN107123421 A CN 107123421A CN 201710233667 A CN201710233667 A CN 201710233667A CN 107123421 A CN107123421 A CN 107123421A
- Authority
- CN
- China
- Prior art keywords
- target
- voice
- control instruction
- information
- voice information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000004422 calculation algorithm Methods 0.000 claims description 15
- 238000005314 correlation function Methods 0.000 claims description 15
- 238000006243 chemical reaction Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 9
- 230000008030 elimination Effects 0.000 claims description 4
- 238000003379 elimination reaction Methods 0.000 claims description 4
- 238000003491 array Methods 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 9
- 239000011159 matrix material Substances 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000003062 neural network model Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 241001672694 Citrus reticulata Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000001143 conditioned effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The present invention proposes a kind of sound control method, device and home appliance, wherein, method includes：The voice messaging that sound source is sent is gathered based on microphone array；The voice messaging is identified, it is determined that target control corresponding with the voice messaging is instructed；Obtain positional information of the sound source relative to the microphone array；Home appliance is controlled to be run according to target control instruction and the positional information.By this method, the intelligentized control method to home appliance can be realized, user only can control home appliance by sending voice messaging, releases dependence of the user to remote control, lifts Consumer's Experience.
Description
Technical Field
The invention relates to the field of smart home, in particular to a voice control method and device and household electrical appliance equipment.
Background
Household electrical appliances such as air conditioners, electric fans and the like are increasingly present in people's daily life, and the control to household electrical appliances is mostly realized through supporting remote controller or through installation application in mobile terminal at present, and the user can't get rid of the dependence to external control equipment, experiences and feels relatively poor.
Disclosure of Invention
The present invention is directed to solving, at least to some extent, one of the technical problems in the related art.
Therefore, a first objective of the present invention is to provide a voice control method to realize intelligent control of a home appliance, so that a user can control the home appliance only by sending voice information, and the user is relieved from relying on a remote controller.
The second objective of the present invention is to provide a voice control device.
A third object of the present invention is to provide a home appliance.
A fourth object of the invention is to propose a computer program product.
A fifth object of the invention is to propose a non-transitory computer-readable storage medium.
In order to achieve the above object, an embodiment of a first aspect of the present invention provides a voice control method, including:
collecting voice information sent by a sound source based on a microphone array;
recognizing the voice information and determining a target control instruction corresponding to the voice information;
acquiring position information of the sound source relative to the microphone array;
and controlling the household appliance to operate according to the target control instruction and the position information.
According to the voice control method provided by the embodiment of the invention, the voice information sent by the sound source is collected, the voice information is identified to determine the corresponding target control instruction, the position information of the sound source relative to the microphone array is obtained, and the household appliance is controlled to operate according to the target control instruction and the position information. Therefore, intelligent control over the household appliance can be achieved, the household appliance can be controlled only by sending voice information, dependence of a user on a remote controller is eliminated, and user experience is improved.
In order to achieve the above object, a second embodiment of the present invention provides a voice control apparatus, including:
the microphone array is used for collecting voice information sent by a sound source;
the voice recognition module is used for recognizing the voice information and determining a target control instruction corresponding to the voice information;
the positioning module is used for acquiring the position information of the sound source relative to the microphone array;
and the control module is used for controlling the household appliance to operate according to the target control instruction and the position information.
According to the voice control device provided by the embodiment of the invention, the voice information sent by the sound source is collected, the voice information is identified to determine the corresponding target control instruction, the position information of the sound source relative to the microphone array is obtained, and the household appliance is controlled to operate according to the target control instruction and the position information. Therefore, intelligent control over the household appliance can be achieved, the household appliance can be controlled only by sending voice information, dependence of a user on a remote controller is eliminated, and user experience is improved.
To achieve the above object, a third aspect of the present invention provides a home appliance, including: a voice control apparatus as described above.
According to the household appliance, the voice information sent by the sound source is collected, the voice information is identified to determine the corresponding target control instruction, the position information of the sound source relative to the microphone array is obtained, and the household appliance is controlled to operate according to the target control instruction and the position information. Therefore, intelligent control over the household appliance can be achieved, the household appliance can be controlled only by sending voice information, dependence of a user on a remote controller is eliminated, and user experience is improved.
In order to achieve the above object, a fourth aspect of the present invention provides a computer program product, wherein when the instructions of the computer program product are executed by a processor, the method for controlling voice according to the first aspect is performed.
In order to achieve the above object, a fifth embodiment of the present invention provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program is capable of implementing the voice control method according to the first embodiment when the computer program is executed by a processor.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic flow chart of a voice control method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a voice control method according to another embodiment of the present invention;
FIG. 3 is a schematic flow chart of a speech control algorithm according to another embodiment of the present invention;
FIG. 4 is a schematic flow chart of a speech control algorithm according to yet another embodiment of the present invention;
FIG. 5 is a schematic diagram of a signal model and an array model;
fig. 6 is a schematic structural diagram of a voice control apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a voice control apparatus according to another embodiment of the present invention;
fig. 8 is a schematic structural diagram of a voice control apparatus according to another embodiment of the present invention;
fig. 9 is a schematic structural diagram of a voice control apparatus according to yet another embodiment of the present invention;
fig. 10 is a schematic structural diagram of a voice control apparatus according to another embodiment of the present invention; and
fig. 11 is a schematic structural diagram of a home appliance according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.
The following describes a voice control method, a voice control device and a home appliance according to an embodiment of the present invention with reference to the accompanying drawings.
Fig. 1 is a flowchart illustrating a voice control method according to an embodiment of the present invention.
As shown in fig. 1, the voice control method includes the steps of:
and S11, collecting the voice information emitted by the sound source based on the microphone array.
When a user uses the household appliance, if the user needs to control the household appliance, for example, to control the household appliance to be turned on or turned off, or to control the household appliance to change the operation mode, for example, to change the gear and the wind direction of the household appliance, the user can send voice information to the household appliance to be controlled. In this embodiment, the home devices may include, but are not limited to, air conditioners, fans, and the like.
In this embodiment, the home appliance device may collect voice information emitted from a sound source (user) based on a built-in microphone array. The microphone array is composed of a plurality of microphones which are independent from each other and have the same characteristics, all the microphones are positioned on the same straight line, the orientation of each microphone is the same, and the intervals of any two adjacent microphones are the same and are the preset distances.
S12 identifies the voice information, and specifies the target control command corresponding to the voice information.
In this embodiment, after the voice information sent by the sound source is collected by the microphone array, the voice information is identified, and the target control instruction corresponding to the voice information is determined.
In the embodiment of the invention, two ways are available for identifying the voice information to determine the corresponding target control instruction. As a possible implementation, the target control instruction may be determined by querying a speech template library. As another possible implementation, the target control instruction may be determined using a speech recognition model. The specific process of determining the target control instruction in the two ways will be given in the following content, and will not be described in detail here to avoid redundancy.
S13, position information of the sound source with respect to the microphone array is acquired.
Wherein the position information may be angle information and/or distance information of the sound source with respect to the microphone array.
In this embodiment, after the voice information emitted by the sound source is collected by the microphone array, the position information of the sound source relative to the microphone array can be acquired. As a possible implementation, a beamforming algorithm may be used to obtain the position information of the sound source.
It should be noted that, in this embodiment, the execution sequence of step S12 and step S13 is not sequential, and both steps may be executed simultaneously or sequentially, and this embodiment is only explained by taking the step S13 executed after step S12 as an example, and is not to be taken as a limitation to the present invention.
And S14, controlling the household appliance to operate according to the target control instruction and the position information.
In this embodiment, after the target control instruction corresponding to the voice information is determined and the position information of the sound source relative to the microphone array is obtained, the control system of the home appliance may control the home appliance to operate according to the target control instruction and the position information, that is, control the home appliance to execute the target control instruction toward the position where the sound source is located.
Take home appliances as an example of an air conditioner. When a user sends out voice information of 'wind power is turned down a little bit', a microphone array arranged in the air conditioner collects the voice information, and determines that a target control instruction corresponding to the voice information is 'wind power is turned down', in addition, a control system arranged in the air conditioner controls the air conditioner to blow towards the left 30-degree direction when position information of a sound source acquired by a processing device arranged in the air conditioner is at an included angle of 30 degrees relative to the left side of the air conditioner, and meanwhile, wind power of air outlet of the air conditioner is reduced.
In the voice control method of the embodiment, the voice information sent by the sound source is collected, the voice information is identified to determine the corresponding target control instruction, the position information of the sound source relative to the microphone array is obtained, and the household appliance is controlled to operate according to the target control instruction and the position information. Therefore, intelligent control over the household appliance can be achieved, the household appliance can be controlled only by sending voice information, dependence of a user on a remote controller is eliminated, and user experience is improved.
In order to determine the target control command corresponding to the voice information, the voice information needs to be recognized. As described above, there are two ways to determine the target control instruction by recognizing the voice information in the embodiment of the present invention, one of the ways is to determine the target control instruction by querying the voice template library, and the implementation process of the way specifically includes: acquiring target content of target voice information, judging whether a preset voice template library has a quasi-control instruction corresponding to the target content, and if the quasi-control instruction exists in the voice template library, taking the quasi-control instruction as the target control instruction, so that as shown in fig. 2, another voice control method provided by the embodiment of the invention can comprise the following steps:
and S21, collecting the voice information emitted by the sound source based on the microphone array.
And S22, performing analog-to-digital conversion on the voice information to obtain digital voice information.
In this embodiment, after the household electrical appliance collects the voice information sent by the sound source through the microphone array, analog-to-digital conversion may be performed on the voice information, so as to convert the analog voice information into digital voice information for subsequent voice processing. As a possible implementation manner, a high-precision analog-to-digital conversion processing chip may be used to perform high-speed analog-to-digital conversion on the multiple paths of analog voice information acquired by the microphone array to obtain digital voice information.
And S23, eliminating the interference information in the digital voice information to obtain the target voice information.
The interference information includes, but is not limited to, noise information and echo information.
In this embodiment, after performing analog-to-digital conversion on the multiple paths of voice information to obtain multiple paths of digital voice information, the obtained multiple paths of digital voice information may be further processed to eliminate interference information in the multiple paths of digital voice information, for example, noise elimination processing and echo elimination processing are performed on the multiple paths of digital voice information to obtain target voice information. As a possible implementation manner, a digital audio processing chip may be used to process the obtained multiple paths of digital voice information to eliminate interference information and obtain target voice information.
And S24, acquiring the target content of the target voice information.
In this embodiment, after the voice information acquired by the microphone array is subjected to a series of processing to obtain the target voice information, the target content in the target voice information may be further acquired. Specifically, the target content may be acquired using a related speech recognition technique.
The target content is some common control commands including but not limited to turn down, turn up, turn off, turn on, turn down, decrease, etc.
And S25, judging whether the preset voice template library has a quasi-control instruction corresponding to the target content.
The quasi-control instruction is a control instruction of which the matching degree with the target content exceeds a preset threshold value.
In order to execute the control command sent by the user, the recognizable control command may be stored in the home appliance in advance, and after the control command sent by the user is received, the control command is matched with the prestored control command to execute the matched control command, thereby implementing the control of the home appliance.
In this embodiment, a voice template library may be preset, a plurality of control instructions that can be recognized and executed by the home appliance device are stored in the voice template library, and the control effect achieved by executing each control instruction is completely different. After the target content in the target voice information is obtained, matching the target content with all the control instructions in the voice template library to judge whether quasi-control instructions corresponding to the target content exist in the voice template library.
Specifically, whether a quasi-control instruction exists or not can be judged by calculating the matching degree of the target content and the control instruction in the voice template library, and when the matching degree of the target content and the control instruction exceeds a preset threshold (for example, 90%), the control instruction is the quasi-control instruction.
It should be noted that the voice template library and the preset threshold in this embodiment may be set by a manufacturer before the home appliance leaves the factory.
In this embodiment, if it is determined that the quasi-control command corresponding to the target content exists in the voice template library, step S26 is executed; if it is determined that the quasi-control command corresponding to the target content does not exist in the speech template library, step S29 is executed.
And S26, taking the quasi control command as a target control command.
In this embodiment, when it is known that the quasi-control instruction corresponding to the target content exists in the preset voice template library, the quasi-control instruction is used as the target control instruction for controlling the home appliance.
And S27, processing the target voice information by adopting a preset beam forming algorithm to obtain position information.
In this embodiment, after the voice information acquired by the microphone array is subjected to a series of processing to obtain target voice information, the target voice information may be further processed by using a preset beam forming algorithm to obtain position information of a sound source.
The beam forming algorithm is a controllable algorithm based on maximum output power, and the basic idea is that signals collected by each array element are weighted and summed to form a beam, the beam is guided by searching possible positions of a sound source, and the weight is modified to enable the output signal power of a microphone array to be maximum. The beam forming algorithm can be used in time domain and frequency domain, and has strong applicability.
It should be noted that, the execution sequence of step S27 and steps S24 to S26 is not sequential, the step of acquiring the position information and the step of acquiring the target control command may be performed simultaneously or sequentially, and this embodiment is only explained by taking the step S27 executed after step S26 as an example, and is not to be taken as a limitation to the present invention.
And S28, controlling the household appliance to operate according to the target control instruction and the position information.
In this embodiment, after the position information of the sound source and the target control instruction corresponding to the voice information sent by the sound source are obtained, the home appliance device may be controlled to operate according to the target control instruction and the position information.
Specifically, after the target control instruction is recognized as the quasi-control instruction, the acquired position information is further output to the household appliance, so that the household appliance is controlled to operate according to the target control instruction and the position information. That is, whether or not the target control command is recognized as the quasi-control command may be conditioned on whether or not to output the location information to the home appliance. And when the target control instruction is recognized to be the quasi-control instruction, outputting the position information to the household appliance, otherwise, not performing any operation.
The position information is output to the household appliance to control the household appliance to operate according to the target control instruction and the position information when the target control instruction is recognized to be the quasi-control instruction, and no operation is performed when the target control instruction is not recognized, so that the accuracy of language control can be improved, and the influence on user experience caused by the execution of unnecessary control instructions by the household appliance is avoided.
S29, no operation is performed.
In this embodiment, when it is determined that the quasi-control instruction corresponding to the target content does not exist in the voice template library, the home appliance does not perform any operation, that is, does not respond to the voice information generated by the sound source.
According to the voice control method, the digital voice information is obtained by performing analog-to-digital conversion on the voice information acquired by the microphone array, the interference information in the digital voice information is eliminated to obtain the target voice information, the interference of the interference information on the target voice information can be eliminated, and the accuracy of subsequent processing is improved. The method comprises the steps of processing target voice information by adopting a preset beam forming algorithm to obtain position information, obtaining target content of the target voice information, judging whether a preset voice template library has a quasi-control instruction corresponding to the target content, taking the quasi-control instruction as the target control instruction when the quasi-control instruction exists, outputting the obtained position information to household appliances, controlling the household appliances to operate according to the target control instruction and the position information, and not carrying out any operation when the quasi-control instruction does not exist, so that the accuracy of language control can be improved, and the influence on user experience caused by the execution of unnecessary control instructions by the household appliances is avoided.
In the foregoing, one of two implementations of determining the target control command by recognizing the voice information according to the embodiment of the present invention is described, and the other implementation is described in detail below, that is, determining the target control command by using a voice recognition model. Thus, as shown in FIG. 3, on the basis of the embodiment shown in FIG. 2, the steps S24-S26 can be replaced by the following steps:
and S31, inputting the target voice information into the voice recognition model to judge whether the target voice information is a quasi-control command.
The voice recognition model can be obtained through training, and the control instruction which can be recognized and executed by the household appliance can be obtained through the voice recognition model. As a possible implementation manner, when training the speech recognition model, predefined control instructions issued by different people using mandarin may be recorded to obtain a recording sample as a training sample, and then the speech recognition model is obtained by training with the training sample based on the neural network model. As another possible implementation manner, when training the speech recognition model, predefined control instructions issued by people in different regions using dialects may be recorded to obtain recorded samples of different accents as training samples, and the speech recognition model is obtained by training the training samples based on the neural network model.
In this embodiment, after the voice information acquired by the microphone array is subjected to a series of processing to obtain target voice information, the target voice information is input into a pre-trained voice recognition model, and the voice recognition model analyzes the target voice information to determine whether the target voice information is a quasi-control instruction. If the target voice information is input into the voice recognition model and analyzed to obtain a control instruction which can be recognized and executed by the household appliance, the target voice information is considered as a quasi-control instruction; otherwise, the target voice information is not considered as a quasi-control instruction, and no operation is performed.
The quasi-control command is a control command corresponding to the target voice information in the control commands which can be recognized and executed by the household appliance.
And S32, if the target voice information is recognized to be the quasi-control instruction, the quasi-control instruction is used as the target control instruction.
In this embodiment, when the speech recognition model recognizes that the target speech information is the quasi-control instruction, the quasi-control instruction is used as the target control instruction.
In the voice control method of the embodiment, the target voice information is input into the voice recognition model, and when the target voice information is recognized as the quasi-control instruction by the voice recognition model, the quasi-control instruction is used as the target control instruction, so that the accuracy of language control can be improved.
In order to more clearly illustrate the implementation process of processing the target voice information by using the preset beamforming algorithm to obtain the position information, an embodiment of the present invention provides another voice control method. Fig. 4 is a schematic flow chart of a speech control algorithm according to still another embodiment of the present invention.
As shown in fig. 4, on the basis of the embodiment shown in fig. 2, the step S27 may include the following steps:
s271, obtaining the time delay value of the target voice information in each path of microphone in the microphone array relative to the reference microphone.
Wherein the reference microphone is one of the microphones in the microphone array.
When the voice information sent by the sound source reaches the microphone array, the signals received by each microphone are different due to the sound path difference. In order to ensure that the signals received by the microphones are the same, it is necessary to artificially compensate the received information. At this time, the time delay values of the received signals of the microphones can be calculated and obtained, so as to compensate and obtain the same signals as the reference microphone.
Suppose that the microphone array is composed of M microphones, which are respectively denoted as M1，m2，…，mMAnd the intervals between the adjacent microphones are equal and are all d. At least one sound source which is a narrow-band sound source or a single-frequency signal sound source exists in the space, the position of the sound source is far away from the microphone, so that sound waves generated by voice information sent by the sound source and reaching the microphone can be approximate to plane waves, and each microphone receives the sound wavesThe direction angle of the plane wave (e), i.e., the direction of arrival, is the same and is denoted as θ.
M is to be1As a reference microphone, the time of receiving the voice information by other microphones is relative to m1There is a certain delay or timeout and thus a certain phase difference is generated. The ith microphone receives the voice information relative to m1The time delay of (2) can be calculated according to the formula (1), and the formula (1) is expressed as follows:
wherein c is the sound velocity, M is the number of microphones, and d is the interval between two adjacent microphones. To avoid the condition of direction ambiguity caused by phase difference larger than pi, it is usually takenλ is the wavelength, i.e. d satisfies the "half wavelength" principle.
Therefore, in this embodiment, the time delay value of the target voice information in each path of microphone in the microphone array relative to the reference microphone may also be obtained through calculation in formula (1).
And S272, processing the target voice information of each microphone according to the time delay value and a preset weighted correlation function.
In this embodiment, after obtaining the time delay value of the target speech information in each path of microphone in the microphone array relative to the reference microphone, the target speech information of each path of microphone is processed according to the preset weighted correlation function, so as to obtain each path of processed target speech information, which may be represented as wixi(t-τi)。
Wherein, wiM is a weighted correlation function of the target speech information for each microphone, xi(t-τi) I 1, 2.. M is the target voice information after human compensation.
And S273, summing the processed target voice information of each path to form beam information of one path and output power of the beam information.
In this embodiment, under the condition that the interval between two adjacent microphones satisfies the half-wavelength principle, the processed target voice information of each path is subjected to weighted summation to obtain beam information of one path, and the calculation formula is shown in formula (2).
Based on the signal model and the array model as shown in fig. 5, the beam information may be expressed in a vector form as shown in equation (3).
y(t)＝WHx(t) (3)
Wherein x (t) is the speech information x received by the microphone arrayi(t) a matrix comprising a weighted correlation function WiAnd a delay value tauiMatrix of WHA conjugate transpose matrix representing matrix W, i ═ 1, 2. For far-field plane waves, W is equal to the array prevalence vector thereof, i.e., W ═ a (k), k is the beam corresponding to the current θ.
In this embodiment, when the output power of the beam information is calculated, a snapshot model needs to be introduced. Assuming that each microphone receives data of N snapshots, and N → ∞ time, the output power of the beam information can be obtained by calculation by equation (4).
Where x (n) is a matrix formed by the speech information received by the microphone array.
And S274, adjusting the weighted value of the reinforced correlation function to obtain the target beam signal with the maximum output power.
Because W ═ a (k), the matrix W can be changed by changing the beam k, and further the adjustment of the weighting value of the weighting correlation function is realized, different beams are formed, and the scanning of the whole space where the sound source point is located is realized.
In this embodiment, the weighted value of the enhanced correlation function is adjusted by changing the beam k, so as to obtain a beam with the maximum output power, that is, a target beam signal.
By means of W (a), (k), which is equivalent to providing a spatial filter, the whole space where the sound source point is located, that is, the space in front of the microphone array, can be subjected to mesh division, the time delay value from each mesh point to each microphone can be sequentially calculated, the beam signal of each mesh and the output power of the beam signal are obtained, so that the whole space is scanned, and finally the beam signal corresponding to the maximum output power can be determined.
And S275, searching a space point corresponding to the target beam signal, and taking the position information of the space point as the position information of the sound source.
In this embodiment, after the target beam signal with the maximum output power is obtained, the spatial point corresponding to the target beam signal is searched, and the position information of the searched spatial point is the position information of the sound source.
According to the voice control method, the time delay value of the target voice information in each path of microphone in the microphone array relative to the reference microphone is obtained, the target voice information is processed according to the time delay value and the preset weighting correlation function and then summed to form the output power of one path of beam information and the beam information, the target beam signal with the maximum output power is obtained by adjusting the weighted value of the weighting correlation function, the space point corresponding to the target beam signal is searched to serve as the position information of the sound source, and the accuracy of position information identification can be improved.
In order to implement the above embodiments, the present invention further provides a language control device.
Fig. 6 is a schematic structural diagram of a voice control apparatus according to an embodiment of the present invention.
As shown in fig. 6, the voice control device 60 includes: a microphone array 610, a speech recognition module 620, a localization module 630, and a control module 640. Wherein,
the microphone array 610 is used for collecting voice information emitted by a sound source.
And the voice recognition module 620 is configured to recognize the voice information and determine a target control instruction corresponding to the voice information.
Optionally, in a possible implementation manner of the embodiment of the present invention, as shown in fig. 7, the speech recognition module 620 may include:
a content acquiring unit 62001 for acquiring target content of the target voice information.
The determining unit 62002 is configured to determine whether a quasi-control instruction corresponding to the target content exists in the preset voice template library, where the quasi-control instruction is a control instruction whose matching degree with the target content exceeds a preset threshold.
A first setting unit 62003, configured to take the quasi control instruction as a target control instruction if the quasi control instruction exists in the voice template library.
Optionally, in a possible implementation manner of the embodiment of the present invention, as shown in fig. 8, the speech recognition module 620 may further include:
a model identifying unit 62011, configured to input the target voice information into the voice identifying model to determine whether the target voice information is a quasi-control instruction.
A second setting unit 62012, configured to, if the target voice information is identified as the quasi-control instruction, take the quasi-control instruction as the target control instruction.
A positioning module 630, configured to obtain position information of the sound source relative to the microphone array.
Specifically, the positioning module 630 is configured to process the target voice information by using a preset beam forming algorithm to obtain the position information.
Further, in a possible implementation manner of the embodiment of the present invention, as shown in fig. 9, the positioning module 630 may include:
the time delay obtaining unit 6301 is configured to obtain a time delay value of the target speech information in each path of microphone in the microphone array relative to a reference microphone, where the reference microphone is one of the microphones in the microphone array.
And the processing unit 6302 is configured to process the target voice information of each microphone by using the delay value and a preset weighted correlation function.
And the beam form unit 6303 is configured to sum the processed target voice information of each path to form a path of beam information and output power of the beam information.
The adjusting unit 6304 is configured to adjust the weighted value of the reinforced correlation function to obtain the target beam signal with the largest output power.
A searching unit 6305 is configured to search for a spatial point corresponding to the target beam signal, and use the position information of the spatial point as the position information of the sound source.
And the control module 640 is configured to control the home appliance to operate according to the target control instruction and the location information.
Specifically, the control module 640 is configured to output the location information to the home appliance device after recognizing that the target control instruction is the quasi-control instruction, so as to control the home appliance device to operate according to the target control instruction and the location information.
Optionally, in a possible implementation manner of the embodiment of the present invention, as shown in fig. 10, the voice control apparatus 60 may further include:
the conversion module 650 is configured to perform analog-to-digital conversion on the voice information to obtain digital voice information before the voice recognition module 620 recognizes the voice information and determines the control instruction corresponding to the voice information.
And the interference elimination module 660 is configured to eliminate interference information in the digital voice information to obtain the target voice information.
It should be noted that the foregoing explanation of the embodiment of the voice control method is also applicable to the voice control apparatus of the embodiment, and the implementation principle thereof is similar, and is not described herein again.
The voice control device of this embodiment identifies voice information by collecting the voice information sent by the sound source to determine a corresponding target control instruction, obtains position information of the sound source relative to the microphone array, and controls the household appliance to operate according to the target control instruction and the position information. Therefore, intelligent control over the household appliance can be achieved, the household appliance can be controlled only by sending voice information, dependence of a user on a remote controller is eliminated, and user experience is improved.
In order to implement the above embodiments, the present invention further provides a home appliance.
Fig. 11 is a schematic structural diagram of a home appliance according to an embodiment of the present invention.
As shown in fig. 11, the home device 110 includes: the voice control device 60 as described in the previous embodiments.
It should be noted that the foregoing explanation of the voice control method embodiment is also applicable to the home appliance device of this embodiment, and the implementation principle is similar, and is not described herein again.
The household appliance of the embodiment identifies the voice information by collecting the voice information sent by the sound source to determine the corresponding target control instruction, obtains the position information of the sound source relative to the microphone array, and controls the household appliance to operate according to the target control instruction and the position information. Therefore, intelligent control over the household appliance can be achieved, the household appliance can be controlled only by sending voice information, dependence of a user on a remote controller is eliminated, and user experience is improved.
In order to implement the foregoing embodiments, the present invention further provides a computer program product, wherein when the instructions in the computer program product are executed by a processor, the voice control method according to the foregoing embodiments is executed.
In order to implement the above embodiments, the present invention also proposes a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, is capable of implementing the voice control method as described in the foregoing embodiments.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (17)
1. A voice control method, comprising:
collecting voice information sent by a sound source based on a microphone array;
recognizing the voice information and determining a target control instruction corresponding to the voice information;
acquiring position information of the sound source relative to the microphone array;
and controlling the household appliance to operate according to the target control instruction and the position information.
2. The voice control method according to claim 1, wherein before the recognizing the voice information and determining the control instruction corresponding to the voice information, the method further comprises:
performing analog-to-digital conversion on the voice information to obtain digital voice information;
and eliminating interference information in the digital voice information to obtain the target voice information.
3. The voice control method according to claim 2, wherein the recognizing the voice information and determining the target control command corresponding to the voice information includes:
acquiring target content of the target voice information;
judging whether a preset voice template library has a quasi-control instruction corresponding to the target content; the quasi-control instruction is a control instruction of which the matching degree with the target content exceeds a preset threshold value;
and if the quasi-control instruction exists in the voice template library, taking the quasi-control instruction as the target control instruction.
4. The voice control method according to claim 2, wherein the recognizing the voice information and determining the target control command corresponding to the voice information includes:
inputting the target voice information into a voice recognition model to judge whether the target voice information is a quasi-control instruction;
and if the target voice information is recognized to be the quasi-control instruction, taking the quasi-control instruction as the target control instruction.
5. The voice control method according to claim 3 or 4, wherein the controlling the home device to operate according to the target control instruction and the location information comprises:
and when the target control instruction is identified to be the quasi-control instruction, outputting the position information to the household appliance to control the household appliance to operate according to the target control instruction and the position information.
6. The voice control method of claim 2, wherein the obtaining of the position information of the sound source relative to the microphone array comprises:
and processing the target voice information by adopting a preset beam forming algorithm to obtain the position information.
7. The voice control method according to claim 6, wherein the processing the target voice information by using a preset beam forming algorithm to obtain the position information comprises:
acquiring time delay values of the target voice information in each path of microphone in the microphone array relative to a reference microphone; wherein the reference microphone is one of the microphone arrays;
processing the target voice information of each microphone according to the time delay value and a preset weighted correlation function;
summing the processed target voice information of each path to form beam information of one path and output power of the beam information;
adjusting the weighted value of the reinforced correlation function to obtain a target beam signal with the maximum output power;
and searching a space point corresponding to the target beam signal, and taking the position information of the space point as the position information of the sound source.
8. A voice control apparatus, comprising:
the microphone array is used for collecting voice information sent by a sound source;
the voice recognition module is used for recognizing the voice information and determining a target control instruction corresponding to the voice information;
the positioning module is used for acquiring the position information of the sound source relative to the microphone array;
and the control module is used for controlling the household appliance to operate according to the target control instruction and the position information.
9. The voice control apparatus according to claim 8, further comprising:
the conversion module is used for carrying out analog-to-digital conversion on the voice information to obtain digital voice information before the voice recognition module recognizes the voice information and determines a control instruction corresponding to the voice information;
and the interference elimination module is used for eliminating the interference information in the digital voice information to obtain the target voice information.
10. The voice control apparatus of claim 9, wherein the voice recognition module comprises:
a content acquisition unit configured to acquire target content of the target voice information;
the judging unit is used for judging whether a preset voice template library has a quasi-control instruction corresponding to the target content; the quasi-control instruction is a control instruction of which the matching degree with the target content exceeds a preset threshold value;
and the first setting unit is used for taking the quasi control instruction as the target control instruction if the quasi control instruction exists in the voice template library.
11. The voice control apparatus of claim 9, wherein the voice recognition module comprises:
the model recognition unit is used for inputting the target voice information into a voice recognition model to judge whether the target voice information is a quasi-control instruction or not;
and the second setting unit is used for taking the quasi-control instruction as the target control instruction if the target voice information is identified as the quasi-control instruction.
12. The voice control apparatus according to claim 10 or 11, wherein the control module is specifically configured to output the location information to the home appliance device after recognizing that the target control instruction is the quasi-control instruction, so as to control the home appliance device to operate according to the target control instruction and the location information.
13. The voice control apparatus according to claim 9, wherein the positioning module is specifically configured to process the target voice information by using a preset beam forming algorithm to obtain the position information.
14. The voice-controlled apparatus according to claim 13, wherein the positioning module comprises:
the time delay acquisition unit is used for acquiring time delay values of the target voice information in each path of microphone in the microphone array relative to a reference microphone; wherein the reference microphone is one of the microphone arrays;
the processing unit is used for processing the target voice information of each microphone by using the time delay value and a preset weighted correlation function;
the beam form unit is used for summing the processed target voice information of each path to form beam information of one path and output power of the beam information;
the adjusting unit is used for adjusting the weighted value of the reinforced correlation function to obtain a target beam signal with the maximum output power;
and the searching unit is used for searching a space point corresponding to the target beam signal and taking the position information of the space point as the position information of the sound source.
15. An appliance, comprising: a voice control apparatus as claimed in any one of claims 8 to 14.
16. A computer program product, wherein instructions, when executed by a processor, perform a speech control method according to any of claims 1-7.
17. A non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, implements the speech control method according to any one of claims 1 to 7.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710233667.XA CN107123421A (en) | 2017-04-11 | 2017-04-11 | Sound control method, device and home appliance |
| PCT/CN2017/104905 WO2018188287A1 (en) | 2017-04-11 | 2017-09-30 | A voice control method and apparatus, and household appliance device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710233667.XA CN107123421A (en) | 2017-04-11 | 2017-04-11 | Sound control method, device and home appliance |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107123421A true CN107123421A (en) | 2017-09-01 |
Family
ID=59726244
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710233667.XA Pending CN107123421A (en) | 2017-04-11 | 2017-04-11 | Sound control method, device and home appliance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107123421A (en) |
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107564522A (en) * | 2017-09-18 | 2018-01-09 | 郑州云海信息技术有限公司 | A kind of intelligent control method and device |
| CN107767868A (en) * | 2017-10-23 | 2018-03-06 | 深圳北鱼信息科技有限公司 | Microphone array and speech control system |
| CN108231075A (en) * | 2017-12-29 | 2018-06-29 | 北京视觉世界科技有限公司 | Control method, device, equipment and the storage medium of cleaning equipment |
| CN108305623A (en) * | 2018-01-15 | 2018-07-20 | 珠海格力电器股份有限公司 | electric appliance control method and device |
| CN108417036A (en) * | 2018-05-07 | 2018-08-17 | 北京中电慧声科技有限公司 | Vehicle whistle sound localization method and device in intelligent transportation system |
| CN108628653A (en) * | 2018-03-30 | 2018-10-09 | 上海思愚智能科技有限公司 | Ground cushion management method and terminal |
| WO2018188287A1 (en) * | 2017-04-11 | 2018-10-18 | 广东美的制冷设备有限公司 | A voice control method and apparatus, and household appliance device |
| CN108834231A (en) * | 2018-03-30 | 2018-11-16 | 上海思愚智能科技有限公司 | Ground pad control method and smart machine |
| CN108882103A (en) * | 2018-07-18 | 2018-11-23 | 北京小米移动软件有限公司 | Intelligent sound box, sound collection equipment and intelligent sound box system |
| CN108983626A (en) * | 2018-07-24 | 2018-12-11 | 珠海格力电器股份有限公司 | Device control method, device, storage medium, and electronic apparatus |
| CN109309607A (en) * | 2018-10-15 | 2019-02-05 | 珠海格力电器股份有限公司 | Household appliance operation execution method and device, household appliance and readable storage medium |
| CN109788382A (en) * | 2019-01-25 | 2019-05-21 | 深圳大学 | A kind of distribution microphone array pickup system and method |
| CN109994124A (en) * | 2017-12-29 | 2019-07-09 | 宁波方太厨具有限公司 | A kind of voice screening technique of range hood |
| CN109994123A (en) * | 2017-12-29 | 2019-07-09 | 宁波方太厨具有限公司 | A kind of voice screening technique of range hood |
| WO2019134473A1 (en) * | 2018-01-08 | 2019-07-11 | 珠海格力电器股份有限公司 | Speech recognition system, method and apparatus |
| CN110164443A (en) * | 2019-06-28 | 2019-08-23 | 联想(北京)有限公司 | Method of speech processing, device and electronic equipment for electronic equipment |
| CN110412510A (en) * | 2018-04-26 | 2019-11-05 | 苏州触达信息技术有限公司 | Localization method and positioning system in a kind of predetermined two-dimensional space |
| CN110517703A (en) * | 2019-08-15 | 2019-11-29 | 北京小米移动软件有限公司 | A kind of sound collection method, device and medium |
| CN110708220A (en) * | 2019-09-27 | 2020-01-17 | 恒大智慧科技有限公司 | Intelligent household control method and system and computer readable storage medium |
| CN110827811A (en) * | 2018-08-13 | 2020-02-21 | 格力电器（武汉）有限公司 | Voice control method and device for household electrical appliance |
| CN110895937A (en) * | 2018-09-13 | 2020-03-20 | 珠海格力电器股份有限公司 | Method and device for acquiring voice control signaling |
| CN111103807A (en) * | 2019-12-17 | 2020-05-05 | 青岛海信智慧家居系统股份有限公司 | Control method and device for household terminal equipment |
| CN111182382A (en) * | 2019-10-22 | 2020-05-19 | 广东小天才科技有限公司 | Audio playing control method based on sound box and sound box |
| CN108305615B (en) * | 2017-10-23 | 2020-06-16 | 腾讯科技（深圳）有限公司 | Object identification method and device, storage medium and terminal thereof |
| CN111425377A (en) * | 2019-01-09 | 2020-07-17 | 广东美的环境电器制造有限公司 | Fan and control method and device thereof |
| CN111833862A (en) * | 2019-04-19 | 2020-10-27 | 佛山市顺德区美的电热电器制造有限公司 | Control method of equipment, control equipment and storage medium |
| WO2020252886A1 (en) * | 2019-06-17 | 2020-12-24 | 深圳壹秘科技有限公司 | Directional sound pickup method, recording device and storage medium |
| CN112492455A (en) * | 2020-11-27 | 2021-03-12 | 广东美的制冷设备有限公司 | Control method and operation control device of electronic equipment and electronic equipment |
| CN114446297A (en) * | 2022-01-24 | 2022-05-06 | 珠海格力电器股份有限公司 | Control method and control device for household equipment, storage medium and electronic device |
| WO2023284562A1 (en) * | 2021-07-14 | 2023-01-19 | 海信视像科技股份有限公司 | Control device, household appliance, and control method |
| CN118197315A (en) * | 2024-05-16 | 2024-06-14 | 合众新能源汽车股份有限公司 | Cabin voice interaction method, system and computer readable medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102522082A (en) * | 2011-12-27 | 2012-06-27 | 重庆大学 | Recognizing and locating method for abnormal sound in public places |
| CN102707262A (en) * | 2012-06-20 | 2012-10-03 | 太仓博天网络科技有限公司 | Sound localization system based on microphone array |
| JP2012211768A (en) * | 2011-03-30 | 2012-11-01 | Advanced Telecommunication Research Institute International | Sound source positioning apparatus |
| CN104214890A (en) * | 2014-01-20 | 2014-12-17 | 美的集团股份有限公司 | Air conditioner and method for controlling air supply thereof by voice |
| CN105467364A (en) * | 2015-11-20 | 2016-04-06 | 百度在线网络技术（北京）有限公司 | Method and apparatus for localizing target sound source |
-
2017
- 2017-04-11 CN CN201710233667.XA patent/CN107123421A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012211768A (en) * | 2011-03-30 | 2012-11-01 | Advanced Telecommunication Research Institute International | Sound source positioning apparatus |
| CN102522082A (en) * | 2011-12-27 | 2012-06-27 | 重庆大学 | Recognizing and locating method for abnormal sound in public places |
| CN102707262A (en) * | 2012-06-20 | 2012-10-03 | 太仓博天网络科技有限公司 | Sound localization system based on microphone array |
| CN104214890A (en) * | 2014-01-20 | 2014-12-17 | 美的集团股份有限公司 | Air conditioner and method for controlling air supply thereof by voice |
| CN105467364A (en) * | 2015-11-20 | 2016-04-06 | 百度在线网络技术（北京）有限公司 | Method and apparatus for localizing target sound source |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018188287A1 (en) * | 2017-04-11 | 2018-10-18 | 广东美的制冷设备有限公司 | A voice control method and apparatus, and household appliance device |
| CN107564522A (en) * | 2017-09-18 | 2018-01-09 | 郑州云海信息技术有限公司 | A kind of intelligent control method and device |
| CN107767868A (en) * | 2017-10-23 | 2018-03-06 | 深圳北鱼信息科技有限公司 | Microphone array and speech control system |
| CN108305615B (en) * | 2017-10-23 | 2020-06-16 | 腾讯科技（深圳）有限公司 | Object identification method and device, storage medium and terminal thereof |
| CN109994124A (en) * | 2017-12-29 | 2019-07-09 | 宁波方太厨具有限公司 | A kind of voice screening technique of range hood |
| CN108231075A (en) * | 2017-12-29 | 2018-06-29 | 北京视觉世界科技有限公司 | Control method, device, equipment and the storage medium of cleaning equipment |
| CN109994123A (en) * | 2017-12-29 | 2019-07-09 | 宁波方太厨具有限公司 | A kind of voice screening technique of range hood |
| WO2019134473A1 (en) * | 2018-01-08 | 2019-07-11 | 珠海格力电器股份有限公司 | Speech recognition system, method and apparatus |
| CN108305623A (en) * | 2018-01-15 | 2018-07-20 | 珠海格力电器股份有限公司 | electric appliance control method and device |
| CN108628653A (en) * | 2018-03-30 | 2018-10-09 | 上海思愚智能科技有限公司 | Ground cushion management method and terminal |
| CN108834231A (en) * | 2018-03-30 | 2018-11-16 | 上海思愚智能科技有限公司 | Ground pad control method and smart machine |
| CN110412510A (en) * | 2018-04-26 | 2019-11-05 | 苏州触达信息技术有限公司 | Localization method and positioning system in a kind of predetermined two-dimensional space |
| CN108417036A (en) * | 2018-05-07 | 2018-08-17 | 北京中电慧声科技有限公司 | Vehicle whistle sound localization method and device in intelligent transportation system |
| CN108882103B (en) * | 2018-07-18 | 2020-01-10 | 北京小米移动软件有限公司 | Intelligent sound box, sound collection equipment and intelligent sound box system |
| CN108882103A (en) * | 2018-07-18 | 2018-11-23 | 北京小米移动软件有限公司 | Intelligent sound box, sound collection equipment and intelligent sound box system |
| CN108983626A (en) * | 2018-07-24 | 2018-12-11 | 珠海格力电器股份有限公司 | Device control method, device, storage medium, and electronic apparatus |
| CN110827811A (en) * | 2018-08-13 | 2020-02-21 | 格力电器（武汉）有限公司 | Voice control method and device for household electrical appliance |
| CN110895937A (en) * | 2018-09-13 | 2020-03-20 | 珠海格力电器股份有限公司 | Method and device for acquiring voice control signaling |
| CN109309607A (en) * | 2018-10-15 | 2019-02-05 | 珠海格力电器股份有限公司 | Household appliance operation execution method and device, household appliance and readable storage medium |
| CN111425377A (en) * | 2019-01-09 | 2020-07-17 | 广东美的环境电器制造有限公司 | Fan and control method and device thereof |
| CN109788382A (en) * | 2019-01-25 | 2019-05-21 | 深圳大学 | A kind of distribution microphone array pickup system and method |
| CN111833862B (en) * | 2019-04-19 | 2023-10-20 | 佛山市顺德区美的电热电器制造有限公司 | Control method of equipment, control equipment and storage medium |
| CN111833862A (en) * | 2019-04-19 | 2020-10-27 | 佛山市顺德区美的电热电器制造有限公司 | Control method of equipment, control equipment and storage medium |
| WO2020252886A1 (en) * | 2019-06-17 | 2020-12-24 | 深圳壹秘科技有限公司 | Directional sound pickup method, recording device and storage medium |
| CN110164443A (en) * | 2019-06-28 | 2019-08-23 | 联想(北京)有限公司 | Method of speech processing, device and electronic equipment for electronic equipment |
| CN110164443B (en) * | 2019-06-28 | 2021-09-14 | 联想(北京)有限公司 | Voice processing method and device for electronic equipment and electronic equipment |
| CN110517703A (en) * | 2019-08-15 | 2019-11-29 | 北京小米移动软件有限公司 | A kind of sound collection method, device and medium |
| CN110517703B (en) * | 2019-08-15 | 2021-12-07 | 北京小米移动软件有限公司 | Sound collection method, device and medium |
| CN110708220A (en) * | 2019-09-27 | 2020-01-17 | 恒大智慧科技有限公司 | Intelligent household control method and system and computer readable storage medium |
| CN111182382A (en) * | 2019-10-22 | 2020-05-19 | 广东小天才科技有限公司 | Audio playing control method based on sound box and sound box |
| CN111103807A (en) * | 2019-12-17 | 2020-05-05 | 青岛海信智慧家居系统股份有限公司 | Control method and device for household terminal equipment |
| CN112492455A (en) * | 2020-11-27 | 2021-03-12 | 广东美的制冷设备有限公司 | Control method and operation control device of electronic equipment and electronic equipment |
| WO2023284562A1 (en) * | 2021-07-14 | 2023-01-19 | 海信视像科技股份有限公司 | Control device, household appliance, and control method |
| CN114446297A (en) * | 2022-01-24 | 2022-05-06 | 珠海格力电器股份有限公司 | Control method and control device for household equipment, storage medium and electronic device |
| CN118197315A (en) * | 2024-05-16 | 2024-06-14 | 合众新能源汽车股份有限公司 | Cabin voice interaction method, system and computer readable medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107123421A (en) | Sound control method, device and home appliance | |
| KR101688354B1 (en) | Signal source separation | |
| CN113113034A (en) | Multi-source tracking and voice activity detection for planar microphone arrays | |
| JP6240995B2 (en) | Mobile object, acoustic source map creation system, and acoustic source map creation method | |
| RU2642353C2 (en) | Device and method for providing informed probability estimation and multichannel speech presence | |
| CN110140360B (en) | Method and apparatus for audio capture using beamforming | |
| CN110140359B (en) | Audio capture using beamforming | |
| JP5952692B2 (en) | Sound source direction estimating apparatus, sound processing system, sound source direction estimating method, and sound source direction estimating program | |
| US20050234729A1 (en) | Mobile unit and method of controlling a mobile unit | |
| JP6644959B1 (en) | Audio capture using beamforming | |
| US8255209B2 (en) | Noise elimination method, apparatus and medium thereof | |
| CN106872945B (en) | Sound source positioning method and device and electronic equipment | |
| CN103181190A (en) | Systems, methods, apparatus, and computer-readable media for far-field multi-source tracking and separation | |
| CN110495185B (en) | Voice signal processing method and device | |
| CN111445920A (en) | Multi-sound-source voice signal real-time separation method and device and sound pick-up | |
| CN111798860B (en) | Audio signal processing method, device, equipment and storage medium | |
| JP6977448B2 (en) | Device control device, device control program, device control method, dialogue device, and communication system | |
| TW202147862A (en) | Robust speaker localization in presence of strong noise interference systems and methods | |
| Lim et al. | Speaker localization in noisy environments using steered response voice power | |
| CN117169812A (en) | Sound source positioning method based on deep learning and beam forming | |
| Ince et al. | Whole body motion noise cancellation of a robot for improved automatic speech recognition | |
| KR101863098B1 (en) | Apparatus and method for speech recognition | |
| WO2018188287A1 (en) | A voice control method and apparatus, and household appliance device | |
| Nguyen et al. | Sound detection and localization in windy conditions for intelligent outdoor security cameras | |
| CN113450769B (en) | Speech extraction method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170901 |
|
| RJ01 | Rejection of invention patent application after publication |