CN110610706A - Sound signal acquisition method and device, electrical equipment control method and electrical equipment - Google Patents
Sound signal acquisition method and device, electrical equipment control method and electrical equipment Download PDFInfo
- Publication number
- CN110610706A CN110610706A CN201910900278.7A CN201910900278A CN110610706A CN 110610706 A CN110610706 A CN 110610706A CN 201910900278 A CN201910900278 A CN 201910900278A CN 110610706 A CN110610706 A CN 110610706A
- Authority
- CN
- China
- Prior art keywords
- sound signal
- target object
- sound
- acquiring
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 145
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000001815 facial effect Effects 0.000 claims abstract description 34
- 230000015654 memory Effects 0.000 claims description 21
- 238000010586 diagram Methods 0.000 description 7
- 238000001514 detection method Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000007613 environmental effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008030 elimination Effects 0.000 description 2
- 238000003379 elimination reaction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011002 quantification Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/24—Speech recognition using non-acoustical features
- G10L15/25—Speech recognition using non-acoustical features using position of the lips, movement of the lips or face analysis
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L2012/2847—Home automation networks characterised by the type of home appliance used
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The invention discloses a sound signal acquisition method, a sound signal acquisition device, an electric appliance control method and electric appliance equipment, wherein the sound signal acquisition method comprises the following steps: acquiring the position of a target object; acquiring facial feature data of a target object, and judging whether the target object makes a sound or not according to the facial feature data; when the target object makes a sound, the collecting direction of the sound signal collector is adjusted according to the position of the target object, and the sound signal emitted by the target object is obtained by the sound signal collector. According to the technical scheme, before the sound signal is obtained, the method further comprises the step of judging whether the target object makes sound, the sound signal is obtained only when the target object makes sound, and the false awakening rate caused by the sound made by other equipment is eliminated.
Description
Technical Field
The invention relates to the technical field of electrical equipment, in particular to a sound signal acquisition method and device, an electrical equipment control method and electrical equipment.
Background
Nowadays, more and more household electrical appliances are provided with sound signal control functions, such as cooling and heating of an air conditioner. The voice system can control the air conditioner, and the important step is that the voice command of a controller can be obtained and recognized. The ambient sound of the air conditioner is basically collected by a microphone, the control voice of a controller is extracted from the ambient noise by using an internal filter circuit and a noise reduction algorithm, and then the specific voice command is obtained after the voice is identified and compared by other algorithms and a database.
In general, the intelligent voice system sets a specific wake-up word and a certain wake-up threshold, and when the target sound source includes the wake-up word and the sound source volume is greater than the set threshold, the air conditioner is woken up. The initial setting is to reduce the false triggering probability of other sound sources in the surrounding environment, and ensure that the sound source can be awakened only when the sound source reaches the set threshold value even if the surrounding sound source has an awakening word accidentally. However, in the use process of the air conditioner, it is found that when other devices (such as a television) in the surrounding environment send out the awakening word, as long as the volume reaches the awakening threshold, the air conditioner is also awakened, and a certain false awakening rate is still caused.
Disclosure of Invention
In view of this, embodiments of the present invention provide a sound signal collection method, a sound signal collection device, an electrical apparatus control method, and an electrical apparatus, so as to reduce a false wake-up rate.
According to a first aspect, an embodiment of the present invention provides a sound signal collecting method, including:
acquiring the position of a target object;
acquiring facial feature data of the target object, and judging whether the target object makes a sound or not according to the facial feature data;
when the target object makes a sound, the collecting direction of a sound signal collector is adjusted according to the position of the target object, and the sound signal emitted by the target object is obtained by the sound signal collector.
The sound signal acquisition method provided by the embodiment of the invention comprises the steps of firstly acquiring the position of a target object, secondly acquiring the facial feature data of the target object, and when the target object is judged to make sound according to the facial feature data, adjusting the acquisition direction of the sound signal acquisition device according to the position of the target object to acquire the sound signal made by the target object. That is, before acquiring the sound signal, the method further comprises the step of judging whether the target object emits sound, and the sound signal is acquired only when the target object emits sound, so that the false wake-up rate caused by the sound emitted by other equipment is eliminated. Meanwhile, the collecting direction of the sound signal collector is adjusted according to the position of the target object, so that the sound signal collector can be guided to mainly collect the sound emitted by the target object.
With reference to the first aspect, in a first implementation manner of the first aspect, when the sound signal collector is a microphone array, the adjusting the collecting direction of the sound signal collector according to the position of the target object includes: and adjusting the acquisition parameters of the microphone array according to the position of the target object.
With reference to the first aspect or the first implementation manner of the first aspect, in a second implementation manner of the first aspect, before acquiring the position of the target object, the method further includes:
acquiring a sound signal;
and identifying a target sound signal in the sound signals, and triggering the operation of acquiring the position of the target object when the target sound signal is not identified.
With reference to the second implementation manner of the first aspect, in a third implementation manner of the first aspect, before the acquiring the sound signal, the method further includes:
acquiring a volume signal;
and judging whether the volume signal exceeds a preset threshold value, and triggering the operation of acquiring the sound signal when the volume signal exceeds the preset threshold value.
According to a second aspect, an embodiment of the present invention provides an electrical apparatus control method, including:
acquiring a sound signal emitted by a target object by using the sound signal acquisition method of the first aspect and any embodiment of the first aspect;
and controlling the electrical equipment according to the sound signal.
According to a third aspect, an embodiment of the present invention provides a sound signal collecting apparatus, including:
the position acquisition module is used for acquiring the position of the target object;
a facial feature data acquisition module for acquiring facial feature data of the target object;
the judging module is used for judging whether the target object emits sound or not according to the facial feature data;
the adjusting module is used for adjusting the collecting direction of the sound signal collector according to the position of the target object when the target object makes a sound;
and the sound signal collector is used for obtaining the sound signal emitted by the target object.
According to a fourth aspect, an embodiment of the present invention provides an electric apparatus, including:
the sound signal collector is used for collecting sound signals;
a target position sensor for acquiring a position of a target object;
a facial feature sensor for acquiring facial feature data of the target object;
a memory and a processor, wherein the memory and the processor are connected in communication with each other, the memory stores computer instructions, and the processor executes the computer instructions to execute the electrical equipment control method according to the second aspect.
With reference to the fourth aspect, in the first embodiment of the fourth aspect, the electric apparatus is an air conditioner.
With reference to the fourth aspect and the first embodiment of the fourth aspect, in the second embodiment of the fourth aspect, the sound signal collector is a microphone array.
With reference to the fourth aspect and the first embodiment of the fourth aspect, in the third embodiment of the fourth aspect, the target sensor is a millimeter wave radar.
According to a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, where computer instructions are stored, and the computer instructions are configured to enable the computer to execute the sound signal collecting method according to any one of the first aspect and the first aspect, or the electrical apparatus control method according to the second aspect.
Drawings
The features and advantages of the present invention will be more clearly understood by reference to the accompanying drawings, which are illustrative and not to be construed as limiting the invention in any way, and in which:
fig. 1 is a schematic flow chart of a sound signal acquisition method in embodiment 1 of the present invention;
fig. 2 is a schematic diagram illustrating the division of the detection regions in embodiment 1 of the present invention;
fig. 3 is a schematic flow chart of a sound signal acquisition method according to embodiment 2 of the present invention;
fig. 4 is a schematic flowchart of an electrical device control method according to embodiment 3 of the present invention;
FIG. 5 is a schematic diagram of a radar scanning area in embodiment 3 of the present invention;
fig. 6 is a schematic structural diagram of a sound signal collecting device in embodiment 4 of the present invention;
fig. 7 is a schematic diagram of an arrangement of a millimeter wave radar and a microphone array in an air conditioner in embodiment 5 of the present invention;
fig. 8 is a schematic layout diagram of microphones in a microphone array according to embodiment 5 of the present invention;
wherein, 1, millimeter wave radar; 2. a microphone array; 3. a microphone A; 4. a microphone B; 5. a microphone C; 6. and a microphone D.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1
An embodiment 1 of the present invention provides a sound signal acquisition method, and fig. 1 is a schematic flow chart of the sound signal acquisition method in embodiment 1 of the present invention, and as shown in fig. 1, the sound signal acquisition method in embodiment 1 of the present invention includes the following steps:
s101: the position of the target object is acquired.
In embodiment 1 of the present invention, the position of the target object may be detected using a position sensor. As a specific embodiment, a millimeter wave radar is used to acquire the position of the target object. The electromagnetic wave signals transmitted by the radar system are blocked by objects on the transmission path and then reflected. By capturing the reflected signal, the radar system can determine the distance, speed and angle of the object, thereby obtaining a very specific coordinate information (spatial stereo three-dimensional coordinates). Millimeter waves are a special type of radar technology that uses short wavelength electromagnetic waves, and a special millimeter wave technology called frequency modulated continuous waves can be implemented to measure distance, as well as angle and velocity.
S102: and acquiring the facial feature data of the target object, and judging whether the target object makes a sound or not according to the facial feature data.
In embodiment 1 of the present invention, the millimeter wave radar may identify a specific position of the target object, identify facial feature data of the person, and determine whether the person speaks.
S103: when the target object makes a sound, the collecting direction of a sound signal collector is adjusted according to the position of the target object, and the sound signal emitted by the target object is obtained by the sound signal collector.
In one specific embodiment, the sound signal collector is a microphone array. When the sound signal collector is a microphone array, the collection direction of the sound signal collector is adjusted according to the position of the target object as follows: and adjusting the acquisition parameters of the microphone array according to the position of the target object. The method mainly adjusts parameters such as the direction of pickup beams, beam forming, array gain, noise elimination and the like. The main function of a general microphone array algorithm is to accomplish voice picking and enhancement in a specific direction of a specific person. Firstly, determining the direction of a target sound source, suppressing noises in other directions, and counteracting echo and reverberation, so that a pickup beam of a microphone accurately points to the target sound source, then optimizing beam forming according to the position distance of the target source, determining a signal gain amplitude, and finally performing model matching on a beam signal of the microphone, thereby completing identification.
The main parameters of a microphone array include: noise suppression, reverberation cancellation, echo cancellation, beamforming, array gain, model matching. Specifically, all sounds in the environment are collected by the microphone, and what is needed to be identified is to suppress, eliminate, cancel, and the like, and finally, the signals are subjected to model matching. To improve accuracy, optimization on suppression, elimination, cancellation, extraction, and model matching is required. Beams formed by target sources with different sounds, different directions and different positions are different, a detection area is divided according to each angle and each distance (for example, areas a, b, c and d in fig. 2 are obtained by dividing a direction of 30 degrees and a distance of 50cm as a scale), a large number of simulated target sound source acquisition training quantifications are carried out on each area, and pickup beams, beam forming and array gain under different positions are determined through comparison optimization of a large number of data. Through a large number of experiments and optimization algorithms, the millimeter wave radar accurately identifies the target source, and the microphone array rapidly identifies according to the position, so that the identification speed and accuracy are improved.
The sound signal collecting method provided in embodiment 1 of the present invention first obtains the position of the target object, then obtains the facial feature data of the target object, and adjusts the collecting direction of the sound signal collector according to the position of the target object to obtain the sound signal emitted by the target object when it is determined that the target object emits sound according to the facial feature data. That is, before acquiring the sound signal, the method further comprises the step of judging whether the target object emits sound, and the sound signal is acquired only when the target object emits sound, so that the false wake-up rate caused by the sound emitted by other equipment is eliminated. Meanwhile, the collecting direction of the sound signal collector is adjusted according to the position of the target object, so that the sound signal collector can be guided to mainly collect the sound emitted by the target object.
Example 2
In general, the intelligent voice system sets a specific wake-up word and a certain wake-up threshold, and when the target sound source includes the wake-up word and the sound source volume is greater than the set threshold, the air conditioner is woken up. The method well avoids the probability of false awakening, but the air conditioner is possibly difficult to awaken or almost impossible to awaken in a complex noise environment. The threshold level picked up by the microphone allows the wake-up to occur because of the volume required to be large enough to cover the ambient noise. Thus, the noise of the environment is suppressed more closely or louder. But either close to a point of approach or louder is somewhat impractical, too close is a way to defeat the purpose of incorporating speech recognition operations into a product to address the need for manual manipulation by the user, and the voice of human waking up cannot be infinite. Therefore, in such an environment, a new method is required to increase the wake-up probability of the air conditioner.
An embodiment 2 of the present invention provides a sound signal acquisition method, and fig. 3 is a schematic flow chart of the sound signal acquisition method in the embodiment 2 of the present invention, and as shown in fig. 3, the sound signal acquisition method in the embodiment 2 of the present invention includes the following steps:
s301: and collecting the sound signal by using a sound signal collector.
In embodiment 2 of the present invention, the sound signal collector is selected as a microphone array.
S302: a target sound signal is identified from the sound signals.
The sound signals acquired with the microphone array include an ambient sound signal and a target sound signal. When the environmental noise is small, it is easier to identify the target sound signal in the sound signal; when the environmental noise is large, it is difficult to recognize the target sound signal in the sound signal, and there is a possibility that the target sound signal cannot be recognized.
S303: when the target sound signal is not recognized, the position of the target object is acquired.
In embodiment 2 of the present invention, a millimeter wave radar is used to obtain the position of a target object.
When a single microphone is adopted, the space selectivity of beam forming is poor, when a microphone array is formed by a plurality of microphones, the space selectivity of beam forming is good, but the 3dB bandwidth of the beam is narrow, if the estimated target sound source direction has slight deviation, the influence is larger, the robustness is poor, and the recognition effect is relatively poor. In embodiment 2 of the present invention, a combination and interaction use of a microphone array and a millimeter wave radar is adopted, and the millimeter wave radar detects the position of a person first, and then determines the collecting direction of the microphone array according to the position of the person determined by the millimeter wave radar, so that the direction of a target sound source can be determined quickly and accurately, and a better speech recognition effect can be achieved.
S304: and acquiring the facial feature data of the target object, and judging whether the target object makes a sound or not according to the facial feature data.
In embodiment 2 of the present invention, a millimeter wave radar is used to acquire facial feature data of a target object.
S305: when the target object makes a sound, the collecting direction of a sound signal collector is adjusted according to the position of the target object, and the sound signal emitted by the target object is obtained by the sound signal collector.
In the sound signal collection method provided in embodiment 2 of the present invention, a sound signal collector is used to collect a sound signal, a target sound signal is identified in the sound signal, when the target sound signal is not identified, the position of a target object and facial feature data of the target object are obtained, and when the target object makes a sound, a collection direction of the sound signal collector is adjusted according to the position of the target object, so that a target sound source direction can be determined quickly and accurately under the condition of relatively high environmental noise, a better speech recognition effect is achieved, and the awakening probability of a speech system is improved.
Example 3
Embodiment 3 of the present invention provides an electrical equipment control method, and fig. 4 is a flowchart illustrating the electrical equipment control method in embodiment 3 of the present invention.
In embodiment 3 of the present invention, the trigger condition for the sound signal collector to collect the sound signal is that the volume signal exceeds a preset threshold. The specific method comprises the steps of acquiring a volume signal; and judging whether the volume signal exceeds a preset threshold value, and triggering a sound signal collector to obtain a sound signal when the volume signal exceeds the preset threshold value.
S1: the sound signal collector collects the sound signal, identifies the target sound signal in the sound signal, and when the target sound signal is identified, the step goes to step S7.
S2: and when the target sound signal is not identified, the radar system is started.
The electromagnetic wave signals transmitted by the radar system are blocked by objects on the transmission path and then reflected. By capturing the reflected signals, the radar system can determine the distance, velocity, and angle of the object. Embodiment 3 of the present invention will divide the millimeter wave radar detection into several regions according to relative distance and orientation, for example, the detection region can be divided into A, B, C, D four regions according to orientation only, as shown in fig. 4.
S3: it is determined whether each region is human, and when a human is detected, the process goes to S4.
The electrical appliance may obtain the person position information after performing step S3, and may set the position to be marked as 1 when the person is detected, and to be marked as 0 when no person is detected. For example, when a person is located in region a, a is 1, B is 0, C is 0, and D is 0; if a person is located in the B region, a is 0, B is 1, C is 0, and D is 0.
S4: a more detailed determination is made regarding the location of the person. Acquiring the facial feature data of the target object, judging whether the target object makes a sound according to the facial feature data, and turning to step S5 when detecting that the person is in a speaking state.
S5: the location of the person speaking is marked.
S6: and adjusting the microphone array parameters according to the person position of the speech obtained in the step S5.
S7: a target sound signal is acquired.
S8: a control instruction is identified in the target sound signal.
S9: and controlling the electrical equipment according to the control instruction.
Example 4
Fig. 6 is a schematic structural view of a sound signal acquisition device in embodiment 4 of the present invention, and as shown in fig. 6, the sound signal acquisition device in embodiment 4 of the present invention includes a position acquisition module 60, a facial feature data acquisition module 62, a determination module 64, an adjustment module 66, and a sound signal acquisition device 68.
Specifically, the position obtaining module 60 is configured to obtain a position of the target object.
A facial feature data acquisition module 62 for acquiring facial feature data of the target object;
a judging module 64, configured to judge whether the target object makes a sound according to the facial feature data;
the adjusting module 66 is configured to adjust the collecting direction of the sound signal collector according to the position of the target object when the target object makes a sound;
and the sound signal collector 68 is used for obtaining the sound signal emitted by the target object.
As a specific embodiment, when the sound signal collector is a microphone array, the adjusting module 66 is configured to adjust the collecting parameters of the microphone array according to the position of the target object.
As a specific implementation manner, the sound signal collecting device further includes a third obtaining module and an identifying module. The third acquisition module is used for acquiring a sound signal; the identification module is used for identifying a target sound signal in the sound signals, and triggering the operation of acquiring the position of a target object when the target sound signal is not identified.
Further, in the sound signal acquisition device, the sound signal acquisition device is further configured to acquire a volume signal before acquiring the sound signal. The determining module 64 is further configured to determine whether the volume signal exceeds a preset threshold, and when the volume signal exceeds the preset threshold, trigger an operation of acquiring a sound signal.
Example 5
The embodiment of the invention also provides the electrical equipment which can comprise a processor and a memory, wherein the processor and the memory can be connected through a bus or in other manners.
The processor may be a Central Processing Unit (CPU). The Processor may also be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, or a combination thereof.
The memory, as a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the electrical equipment control method in the embodiment of the present invention (for example, the obtaining module 50, the facial feature data obtaining module 62, the judging module 64, the adjusting module 66, and the sound signal collector 68 shown in fig. 6). The processor executes various functional applications and data processing of the processor by running the non-transitory software programs, instructions and modules stored in the memory, that is, the electrical equipment control method in the above method embodiment is realized.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created by the processor, and the like. Further, the memory may include high speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory optionally includes memory located remotely from the processor, and such remote memory may be coupled to the processor via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more modules are stored in the memory and, when executed by the processor, perform an appliance control method.
In embodiment 5 of the present invention, the electrical equipment may be an air conditioner; the sound signal collector is a microphone array; the target sensor is a millimeter wave radar. Fig. 7 is a schematic diagram of an arrangement of a millimeter wave radar and a microphone array in an air conditioner in embodiment 5 of the present invention; fig. 8 is a schematic diagram illustrating an arrangement of each microphone in a microphone array in embodiment 5 of the present invention, and as shown in fig. 8, each microphone in the microphone array is designed to be an arc, and by using such a microphone array, a better sound signal collection effect can be achieved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.
Claims (11)
1. A method for collecting a sound signal, comprising:
acquiring the position of a target object;
acquiring facial feature data of the target object, and judging whether the target object makes a sound or not according to the facial feature data;
when the target object makes a sound, the collecting direction of a sound signal collector is adjusted according to the position of the target object, and the sound signal emitted by the target object is obtained by the sound signal collector.
2. The method according to claim 1, wherein when the sound signal collector is a microphone array, the adjusting the collecting direction of the sound signal collector according to the position of the target object comprises:
and adjusting the acquisition parameters of the microphone array according to the position of the target object.
3. The sound signal collection method according to claim 1 or 2, further comprising, before acquiring the position of the target object:
acquiring a sound signal;
and identifying a target sound signal in the sound signals, and triggering the operation of acquiring the position of the target object when the target sound signal is not identified.
4. The sound signal collection method according to claim 3, further comprising, before the obtaining of the sound signal:
acquiring a volume signal;
and judging whether the volume signal exceeds a preset threshold value, and triggering the operation of acquiring the sound signal when the volume signal exceeds the preset threshold value.
5. An electrical appliance control method, characterized by comprising:
collecting a sound signal emitted by a target object by using the sound signal collecting method according to any one of claims 1 to 4;
and controlling the electrical equipment according to the sound signal.
6. An acoustic signal collection device, comprising:
the position acquisition module is used for acquiring the position of the target object;
a facial feature data acquisition module for acquiring facial feature data of the target object;
the judging module is used for judging whether the target object emits sound or not according to the facial feature data;
the adjusting module is used for adjusting the collecting direction of the sound signal collector according to the position of the target object when the target object makes a sound;
and the sound signal collector is used for obtaining the sound signal emitted by the target object.
7. An electrical device, comprising:
the sound signal collector is used for collecting sound signals;
a target position sensor for acquiring a position of a target object;
a facial feature sensor for acquiring facial feature data of the target object;
a memory and a processor, the memory and the processor being communicatively connected to each other, the memory having stored therein computer instructions, the processor executing the computer instructions to perform the electrical appliance control method of claim 6.
8. The electrical apparatus of claim 7, wherein the electrical apparatus is an air conditioner.
9. The electrical device of claim 7 or 8, wherein the sound signal collector is a microphone array.
10. The electrical device of claim 7 or 8, wherein the target sensor is a millimeter wave radar.
11. A computer-readable storage medium, characterized in that the computer-readable storage medium stores computer instructions for causing the computer to execute the sound signal collection method of any one of claims 1 to 4 or the electric appliance control method of claim 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910900278.7A CN110610706A (en) | 2019-09-23 | 2019-09-23 | Sound signal acquisition method and device, electrical equipment control method and electrical equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910900278.7A CN110610706A (en) | 2019-09-23 | 2019-09-23 | Sound signal acquisition method and device, electrical equipment control method and electrical equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110610706A true CN110610706A (en) | 2019-12-24 |
Family
ID=68891874
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910900278.7A Pending CN110610706A (en) | 2019-09-23 | 2019-09-23 | Sound signal acquisition method and device, electrical equipment control method and electrical equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110610706A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111641794A (en) * | 2020-05-25 | 2020-09-08 | 维沃移动通信有限公司 | Sound signal acquisition method and electronic equipment |
| CN113178198A (en) * | 2021-04-16 | 2021-07-27 | 杭州环木信息科技有限责任公司 | Non-contact voiceprint biometric authentication method based on millimeter wave perception |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101320566A (en) * | 2008-06-30 | 2008-12-10 | 中国人民解放军第四军医大学 | Non-air conduction speech reinforcement method based on multi-band spectrum subtraction |
| CN102819314A (en) * | 2011-06-09 | 2012-12-12 | 索尼公司 | Sound control apparatus, program, and control method |
| US20160189733A1 (en) * | 2011-07-18 | 2016-06-30 | At&T Intellectual Property I, Lp | System and method for enhancing speech activity detection using facial feature detection |
| US20160293182A1 (en) * | 2015-03-31 | 2016-10-06 | Bose Corporation | Voice Band Detection and Implementation |
| CN106572268A (en) * | 2016-11-14 | 2017-04-19 | 北京小米移动软件有限公司 | Information display method and device |
| CN109212499A (en) * | 2017-07-07 | 2019-01-15 | 英飞凌科技股份有限公司 | Use the system and method for radar sensor identification target |
| CN109644303A (en) * | 2016-08-29 | 2019-04-16 | Groove X 株式会社 | Identify the autonomous humanoid robot of behavior of Sounnd source direction |
| CN109754814A (en) * | 2017-11-08 | 2019-05-14 | 阿里巴巴集团控股有限公司 | A kind of sound processing method, interactive device |
| CN110085258A (en) * | 2019-04-02 | 2019-08-02 | 深圳Tcl新技术有限公司 | A kind of method, system and readable storage medium storing program for executing improving far field phonetic recognization rate |
| CN110223711A (en) * | 2019-06-03 | 2019-09-10 | 清华大学 | Interactive voice based on microphone signal wakes up electronic equipment, method and medium |
-
2019
- 2019-09-23 CN CN201910900278.7A patent/CN110610706A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101320566A (en) * | 2008-06-30 | 2008-12-10 | 中国人民解放军第四军医大学 | Non-air conduction speech reinforcement method based on multi-band spectrum subtraction |
| CN102819314A (en) * | 2011-06-09 | 2012-12-12 | 索尼公司 | Sound control apparatus, program, and control method |
| CN102819314B (en) * | 2011-06-09 | 2016-12-14 | 索尼公司 | Sound control equipment and control method |
| US20160189733A1 (en) * | 2011-07-18 | 2016-06-30 | At&T Intellectual Property I, Lp | System and method for enhancing speech activity detection using facial feature detection |
| US20160293182A1 (en) * | 2015-03-31 | 2016-10-06 | Bose Corporation | Voice Band Detection and Implementation |
| CN109644303A (en) * | 2016-08-29 | 2019-04-16 | Groove X 株式会社 | Identify the autonomous humanoid robot of behavior of Sounnd source direction |
| CN106572268A (en) * | 2016-11-14 | 2017-04-19 | 北京小米移动软件有限公司 | Information display method and device |
| CN109212499A (en) * | 2017-07-07 | 2019-01-15 | 英飞凌科技股份有限公司 | Use the system and method for radar sensor identification target |
| CN109754814A (en) * | 2017-11-08 | 2019-05-14 | 阿里巴巴集团控股有限公司 | A kind of sound processing method, interactive device |
| CN110085258A (en) * | 2019-04-02 | 2019-08-02 | 深圳Tcl新技术有限公司 | A kind of method, system and readable storage medium storing program for executing improving far field phonetic recognization rate |
| CN110223711A (en) * | 2019-06-03 | 2019-09-10 | 清华大学 | Interactive voice based on microphone signal wakes up electronic equipment, method and medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111641794A (en) * | 2020-05-25 | 2020-09-08 | 维沃移动通信有限公司 | Sound signal acquisition method and electronic equipment |
| CN111641794B (en) * | 2020-05-25 | 2023-03-28 | 维沃移动通信有限公司 | Sound signal acquisition method and electronic equipment |
| CN113178198A (en) * | 2021-04-16 | 2021-07-27 | 杭州环木信息科技有限责任公司 | Non-contact voiceprint biometric authentication method based on millimeter wave perception |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106910500B (en) | Method and device for voice control of device with microphone array | |
| TWI711035B (en) | Method, device, audio interaction system, and storage medium for azimuth estimation | |
| CN107577449B (en) | Wake-up voice pickup method, device, equipment and storage medium | |
| CN106898348B (en) | Dereverberation control method and device for sound production equipment | |
| CN109506568B (en) | Sound source positioning method and device based on image recognition and voice recognition | |
| CN109308908B (en) | Voice interaction method and device | |
| CN108831474B (en) | Voice recognition equipment and voice signal capturing method, device and storage medium thereof | |
| JP6450139B2 (en) | Speech recognition apparatus, speech recognition method, and speech recognition program | |
| CN107464565B (en) | Far-field voice awakening method and device | |
| WO2020048431A1 (en) | Voice processing method, electronic device and display device | |
| CN111090412B (en) | Volume adjusting method and device and audio equipment | |
| US20230333205A1 (en) | Sound source positioning method and apparatus | |
| CN110610706A (en) | Sound signal acquisition method and device, electrical equipment control method and electrical equipment | |
| CN107491101A (en) | A kind of adjusting method, device and the electronic equipment of microphone array pickup angle | |
| CN110767225A (en) | Voice interaction method, device and system | |
| JP7513070B2 (en) | Information processing device, control method, and program | |
| TWI523006B (en) | Method for using voiceprint identification to operate voice recoginition and electronic device thereof | |
| CN113593548A (en) | Awakening method and device of intelligent equipment, storage medium and electronic device | |
| WO2021021814A2 (en) | Acoustic zoning with distributed microphones | |
| CN111627456A (en) | Noise elimination method, device, equipment and readable storage medium | |
| CN113223552B (en) | Speech enhancement method, device, apparatus, storage medium, and program | |
| CN111103807A (en) | Control method and device for household terminal equipment | |
| CN111766303A (en) | Voice acquisition method, device, equipment and medium based on acoustic environment evaluation | |
| CN113409800A (en) | Processing method and device for monitoring audio, storage medium and electronic equipment | |
| CN113676593B (en) | Video recording method, video recording device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191224 |
|
| RJ01 | Rejection of invention patent application after publication |