CN109788382A - A kind of distribution microphone array pickup system and method - Google Patents
A kind of distribution microphone array pickup system and method Download PDFInfo
- Publication number
- CN109788382A CN109788382A CN201910073427.7A CN201910073427A CN109788382A CN 109788382 A CN109788382 A CN 109788382A CN 201910073427 A CN201910073427 A CN 201910073427A CN 109788382 A CN109788382 A CN 109788382A
- Authority
- CN
- China
- Prior art keywords
- microphone
- signal
- microphone array
- distributed
- sound source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/08—Mouthpieces; Microphones; Attachments therefor
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
- Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
Abstract
The invention discloses a kind of distributed microphone array pickup system and methods, equipment is controlled for picking up acoustic information, it is poor to solve existing voice assistant pickup effect, and equipment the problem of binding together with microphone pickup module and voice assistant and cause the wasting of resources, it include: distributed microphone array, for collecting acoustic information indoors；Auditory localization processing module makes a sound the sound source position of information for positioning speaker；Speech processing module, the acoustic information for being collected according to sound source position and distributed microphone array are handled；The signal that distributed microphone array emits for acquiring the signal of distributed microphone array transmitting, and is synchronized to a data collection station by microphone data acquisition module；This system pickup effect is good, and can control multiple equipment by voice messaging, without installing independent voice pickup model and voice assistant for each coordinative composition of equipments, to reduce the waste of resource.
Description
Technical field
The present invention relates to technical field of voice recognition more particularly to a kind of distributed microphone array pickup system and sides
Method.
Background technique
With the development of artificial intelligence technology, the technology that equipment is controlled by way of human-computer interaction is also more and more general
Time, and in human-computer interaction technology, it is widely used by the technology of voice control device, and answered in smart home etc.
With in scene, voice assistant is almost at the standard configuration of future development.
However, it is desirable to equipment possesses the anthropoid hearing ability of class and is not easy to, in addition to the speech recognition of rear end, semantic reason
Outside all too many levels such as solution, the first step seeks to that equipment is allowed to obtain clearly voice signal, that is, equipment is allowed to listen to become apparent from.
The voice assistant that existing equipment is equipped with, installation site, which compares, limits to only one point, picks up for longer-distance
Audio fruit is poor, and existing equipment is bound together with voice assistant, when placed multiple devices in a room,
Multiple voice assistants are just needed to configure, therefore cause the waste of resource.
Summary of the invention
The main purpose of the present invention is to provide a kind of distributed microphone array pickup system and methods, it is intended to solve existing
There is the voice assistant pickup effect in technology poor, and equipment binds together with voice assistant and causes the skill of the wasting of resources
Art problem.
To achieve the above object, first aspect present invention provides a kind of distributed microphone array pickup system, comprising: point
Cloth microphone array, for collecting acoustic information indoors；Auditory localization processing module makes a sound for positioning speaker
The sound source position of information；Speech processing module, the acoustic information for being collected according to sound source position and distributed microphone array
It is handled, obtains clean smooth voice signal；Microphone data acquisition module, for acquiring the distributed microphone array
The signal emitted after speech processing module is handled is arranged, and the signal of the distributed microphone array transmitting is synchronized to one
A data collection station, the signal that the data collection station passes through distributed microphone array transmitting control equipment.
Further, the distributed microphone array includes that the Mike installed on roof indoors and four sides wall is arranged
Wind；By adjusting the position of each microphone, so that the Mike's wind facies being arranged on the microphone and roof that are arranged on the wall
The shape of rectangular pyramid is spatially presented in interconnection line.
Further, the auditory localization processing module includes: microphone coordinate determination unit, for setting the distribution
The three-dimensional coordinate of one of reference microphone in formula microphone array, and three-dimensional sit is set according to the three-dimensional coordinate of setting
The three-dimensional coordinate of other microphones in mark system and the distributed microphone array；Time delay estimation unit, for according to microphone
The cross-correlation function of the signal received estimates time delay of each microphone relative to reference microphone；Sound source position is sat
Determination unit is marked, for reaching the time between each microphone, delay, the velocity of sound and the coordinate of each microphone according to sound source
Calculate the coordinate of sound source position.
Further, the speech processing module includes: noise reduction unit, for collecting the distributed microphone array
Acoustic information carry out noise reduction, obtain clean voice signal；It is weighted and averaged unit, for prolonging each road microphone signal
When be aligned, and then it is weighted and averaged, obtains clean smooth voice signal.
Further, the noise reduction unit includes: main microphon signal setting subelement, for setting the letter of main microphon
Number by human hair go out voice signal and noise signal form；Microphone determines subelement, for according to sound source to each microphone
Distance determine that the microphone nearest apart from sound source is main microphon, remaining microphone is secondary microphone, and is determined apart from sound source
Farthest microphone is noise signal reference microphone；Noise estimates subelement, for using noise signal reference microphone
Initial noiseless segment signal is estimated as noise, and the noise by noise estimation as the distributed microphone array is believed
Number；Spectra calculation subelement, by being set according to the main microphon signal based on subelement and noise estimation subelement
Calculate the power spectrum of the main microphon signal；The factor introduces subelement, for introducing in the spectra calculation subelement
Subtracting coefficient and spectrum lower limit compensation factor；Fourier inversion subelement draws for that will introduce the factor by Fourier inversion
The signal for entering the spectra calculation subelement of unit is transformed to time-domain signal, to obtain clean voice signal.
Further, the weighted average unit includes: time delay estimation subelement, the signal for being received according to gram wind
Cross-correlation function estimate time delay of each microphone relative to reference microphone；Delay alignment subelement, is used for root
The received voice signal of all microphones is subjected to delay alignment according to the delay time of each road signal, to have already passed through to each road
The voice signal of noise reduction process is weighted and averaged at a distance from sound source position according to it, obtains clean smooth voice signal.
Further, the microphone data acquisition module includes: data acquisition unit, for acquiring the distributed wheat
All microphones are gathered and passed through the acoustic information of speech processing module processing in gram wind array；Data transmission unit, being used for will
The acoustic information of the data acquisition unit acquisition is sent to back-end data collector；Device control cell, for connecting equipment,
And equipment is controlled according to the received acoustic information of data collector.
Second aspect of the present invention provides a kind of distributed microphone array sound pick-up method, comprising: passes through distributed microphone
Array collects acoustic information indoors；Position the sound source position of speaker；It is received according to sound source position and distributed microphone array
The acoustic information of collection is handled, and clean smooth voice signal is obtained；The signal of distributed microphone array transmitting is acquired, and
The signal of microphone transmitting each in the distributed microphone array is synchronized to a data collection station, the data are adopted
Collect terminal and equipment is controlled by the signal of the distributed microphone array transmitting.
Third aspect present invention provides a kind of electronic device, comprising: memory, processor and is stored on the memory
And the computer program that can be run on the processor, which is characterized in that when the processor executes the computer program,
Realize above-mentioned method.
Fourth aspect present invention provides a kind of computer readable storage medium, is stored thereon with computer program, feature
It is, when the computer program is executed by processor, realizes above-mentioned method.
The present invention provides a kind of distributed microphone array pickup system and method, beneficial effect are: passing through distribution
Structure carries out array layout to multiple microphones indoors, so that the indoor acquisition for thering are multiple positions to be able to carry out voice messaging,
To make user need to go near the equipment it is unnecessary to select specific equipment to carry out interactive voice and make a sound information,
To improve pickup effect；And bound by multiple equipment and microphone data acquisition module, that is, by distributed microphone
After the signal of array emitter is synchronized to a data collection station, this system is enabled to control multiple set by voice messaging
It is standby, without installing independent pickup module and voice assistant for each equipment, to reduce the waste of resource.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those skilled in the art without creative efforts, can also basis
These attached drawings obtain other attached drawings.
Fig. 1 is the structural schematic block diagram of distribution of embodiment of the present invention microphone array pickup system；
Fig. 2 is the structural representation of the auditory localization processing module of distribution of embodiment of the present invention microphone array pickup system
Block diagram；
Fig. 3 is the structural representation frame of the speech processing module of distribution of embodiment of the present invention microphone array pickup system
Figure；
Fig. 4 is the structural schematic block diagram of the noise reduction unit of distribution of embodiment of the present invention microphone array pickup system；
Fig. 5 is the structural schematic block diagram of electronic device of the embodiment of the present invention.
Specific embodiment
In order to make the invention's purpose, features and advantages of the invention more obvious and easy to understand, below in conjunction with the present invention
Attached drawing in embodiment, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described reality
Applying example is only a part of the embodiment of the present invention, and not all embodiments.Based on the embodiments of the present invention, those skilled in the art
Member's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Referring to Fig. 1, for a kind of distributed microphone array pickup system, comprising: distributed microphone array 1 is used for
Acoustic information is collected indoors；Auditory localization processing module 2 makes a sound the sound source position of information for positioning speaker；Language
Sound processing module 3, the acoustic information for being collected according to sound source position and distributed microphone array 1 are handled, are done
Net smooth voice signal；Microphone data acquisition module 4 passes through speech processes mould for acquiring distributed microphone array 1
The signal emitted after the processing of block 3, and the signal that distributed microphone array 1 emits is synchronized to a data collection station, number
Pass through the signal that distributed microphone array 1 emits according to acquisition terminal and controls equipment.
Distributed microphone array 1 includes that the microphone installed on roof indoors and four sides wall is arranged；By adjusting
The position of each microphone, so that the microphone interconnecting line being arranged on the microphone and roof that are arranged on wall is spatially in
The shape of existing rectangular pyramid.
Referring to Fig. 2, auditory localization processing module 2 includes: microphone coordinate determination unit 21, for setting distributed wheat
The three-dimensional coordinate of one of reference microphone in gram wind array 1, and according to the three-dimensional coordinate of setting set three-dimensional system of coordinate and
The three-dimensional coordinate of other microphones in distributed microphone array 1；Time delay estimation unit 22, for what is received according to microphone
The cross-correlation function of signal estimates time delay of each microphone relative to reference microphone；Sound source position coordinate determines single
Member 23, for reaching the coordinate calculating sound of the time between each microphone, delay, the velocity of sound and each microphone according to sound source
The coordinate of source position.
Specifically, setting rectangular room in three-dimensional coordinate system along the size of x-axis, y-axis and z-axis direction be respectively a,
B, c respectively forms a distributed microphone array 1 by a microphone on the four sides wall and ceiling in room, and setting is wherein
The coordinate of one microphone is (x1, y1, z1), it is denoted as the first microphone, other microphone coordinates are (xm, ym, zm), it is denoted as
M microphone, wherein m=2,3,4,5 set speaker and make a sound the sound source position coordinate of information as (x, y, z), and set
Voice signal from sound source position reach each microphone needed for the time be t1、tm, set the velocity of sound as v, then sound source position is to each
The distance of microphone is d1、dm, then it can be obtained:
d1=vt1,dm=vtm；
Therefore voice signal can be calculated from sound source position to reach the m microphone of distributed microphone array and reach the
The time delay of one microphone are as follows:
τm=tm-t1
Therefore it can be derived as follows:
vτm=v (tm-t1)=dm-d1
dm=v τm+d1
dm 2=(v τm+d1)2=v2τm 2+2vτmd1+d1 2
0=v2τm 2+2vτmd1+d1 2-dm 2
As m=2, available formula 1, formula 1 is expressed as follows:
As m=3 or m=4 or m=5, available formula 2, formula 2 is expressed as follows:
Formula 1 is subtracted using formula 2 and obtains formula 3, and formula 3 is expressed as follows:
Since the coordinate of sound source position and microphone is respectively (x, y, z), (xm, ym, zm), then sound source position to m Mike
The distance of wind can indicate are as follows:
dm 2=xm 2-2xmx+x2+ym 2-2ymy+y2+zm 2-2zmz+z2
The distance of sound source position to the first microphone can similarly be indicated are as follows:
d1 2=x1 2-2x 1x+x2+y1 2-2y 1y+y2+z1 2-2z 1z+z2
Therefore d is used1 2Subtract dm 2Available formula 4, formula 4 are expressed as follows:
d1 2-dm 2=x1 2+y1 2+z1 2-xm 2-ym 2-zm 2-2x 1x-2y 1y-2z 1z+2x mx+2y my+2z mz
The substitution formula 3 of formula 4 is obtained into formula 5 again, formula 5 is expressed as follows:
Setting four variables at this time is respectively μm、αm、βmAnd γm, and the expression formula for setting four variables is as follows:
Therefore formula 5 can be abbreviated as to formula 6, formula 6 is expressed as follows:
0=μm+αmx+βmy+γm
And for the parameter μ in formula 6m、αm、βm、γm, the parameter the v, (x that specifically includem, ym, zm m=2,3,4,5
For known quantity, and τ m (m=2,3,4,5) can then pass through the time delay based on broad sense cross-correlation (GCC-PHAT) algorithm and estimate
(TDOA) method is calculated.Since system provided by the present application uses distributed microphone array 1, Mike's wind facies therein
Spacing between mutually is larger, and the spatial resolution of array signal is very high, the delay τ estimated using GCC-PHAT algorithmm?
It is more accurate.Therefore, work as m=3, when 4,5, form a ternary linear function group using formula 6, and be expressed as follows:
Solving above-mentioned ternary linear function group can be obtained the coordinate (x, y, z) of sound source position.
Fig. 3 and Fig. 4 is please referred to, speech processing module 3 includes: noise reduction unit 31, for receiving distributed microphone array 1
The acoustic information of collection carries out noise reduction, obtains clean voice signal；Be weighted and averaged unit 32, for by each road microphone signal into
Line delay alignment, and then it is weighted and averaged, obtain clean smooth voice signal.
Noise reduction unit 31 includes: main microphon signal setting subelement 311, for setting the signal of main microphon by human hair
Voice signal and noise signal composition out；Microphone determines subelement 312, for according to sound source reach each microphone away from
The nearest microphone of sound source is main microphon with a distance from determining, remaining microphone is secondary microphone, and determination is farthest apart from sound source
Microphone be noise signal reference microphone；Noise estimates subelement 313, for using the first of noise signal reference microphone
Noiseless segment signal begin as noise estimation, and the noise signal by noise estimation as distributed microphone array；Power spectrum meter
Operator unit 314, for calculating each microphone according to main microphon signal setting subelement 311 and noise estimation subelement 313
The power spectrum of signal；The factor introduces subelement 315, for being introduced under subtracting coefficient and spectrum in spectra calculation subelement 314
Limit compensation factor；Fourier inversion subelement 316, for the function of factor introducing unit will to be introduced by Fourier inversion
The signal of rate spectrum computation subunit 314 is transformed to time-domain signal, obtains clean voice signal.
After obtaining the coordinate of sound source position, by calculating the distance between sound source position and each microphone dm, determine
The microphone nearest apart from sound source position is main microphon, other microphones are secondary microphone, and by the wheat farthest apart from sound source
Gram wind is as noise signal reference microphone.
Specifically, main microphon signal y (n)=x (n)+v (n) is set, wherein x (n) is targeted voice signal, and v (n) makes an uproar
Acoustical signal, if the initial noiseless segment signal of noise signal reference microphone is v ' (n).Since 5 microphones work at the same time,
The noise signal that all microphones receive is identical.Using the initial unvoiced segments of noise signal reference microphone come as making an uproar
Sound estimation, therefore y (n)=x (n)+v ' (n), corresponding power spectrum expression formula are as follows:
|Y(k)|2=| X (k) |2+|V′(k)|2
|X(k)|2=| Y (k) |2-|V′(k)|2
Subtract power spectrum may be caused to be negative value due to subtracting excessively during obtaining voice signal power spectrum using spectrum, because
This introduced subtracting coefficient α and spectrum lower limit compensation factor β, composed the expression formula after subtracting are as follows:
And since the sense of hearing of people is to the phase-unsensitive of voice, noise reduction is subtracted by spectrum and obtains the amplitude spectrum of voice signalThe frequency spectrum of estimated speech signal can be complex as with the phase spectrum for the original signal that microphone receives, then by Fu
Leaf inverse transformation can restore to obtain clean voice signal
Weighted average unit 32 includes: time delay estimation subelement 321, signal for being received according to microphone it is mutual
It closes function and estimates time delay of each microphone relative to reference microphone；Delay alignment subelement 322, for according to each
The received voice signal of all microphones is carried out delay alignment by the delay time of road signal, to have already passed through noise reduction to each road
The voice signal of processing is weighted and averaged at a distance from sound source position according to it, obtains clean smooth voice signal.
After above-mentioned noise reduction process, each microphone channel can obtain the clean voice signal of comparison, in order to
Enhance the voice signal on speaker direction, it is assumed that the position of speaker in a short time is constant, uses the phase of each microphone
To time delay, five road microphone signals are subjected to delay alignment, are then weighted further according to respectively apart from the distance of speaker flat
, so that it may obtain clean smooth voice signal.
Microphone data acquisition module 4 includes: data acquisition unit 41, for acquiring institute in distributed microphone array 1
There is microphone to be gathered and passed through the voice signal of the processing of speech processing module 3；Data transmission unit 42, it is single for acquiring data
The acoustic information of 41 acquisition of member is sent to back-end data collector；Device control cell 43, for connecting equipment, and according to data
The received acoustic information of collector controls equipment.
In the present embodiment, distributed microphone array 1 passes through wireless network connection with data acquisition unit 41, in Mike
The voice signal that wind receives obtains clean smooth voice signal after the processing of speech processing module 3, then passes through wireless network
Network is by transmitting voice signal to data acquisition unit 41, and data transmission unit 42 is by the received voice signal of data acquisition unit 41
It is transmitted to the data collector on backstage, device control cell 43, can be received by data collector after being connected to equipment
Voice signal controls equipment.
By the way that data acquisition unit 41 and distributed microphone array 1 by wireless network connection, are not only facilitated networking,
The flexibility in intelligent home voice control is increased, meanwhile, it is patted using unified device control cell 43 as centre
Platform can provide common hardware input interface for each intelligent sound interactive device, to enable the system to enough believe by voice
Breath control multiple equipment reduces the waste of resource without installing pickup module and voice assistant for each equipment.
The application also provides a kind of distributed microphone array sound pick-up method, comprising: is listed in by distributed microphone array
Indoor collection acoustic information；Position the sound source position of speaker；The sound collected according to sound source position and distributed microphone array
Message breath is handled, and clean smooth voice signal is obtained；The signal of distributed microphone array transmitting is acquired, and will distribution
The signal of formula microphone array microphone transmitting is synchronized to a data collection station, and data collection station passes through distributed Mike
The signal of wind array emitter controls equipment.
Distributed microphone array includes the microphone being arranged on roof and four sides wall indoors；By adjusting each wheat
The position of gram wind so that the microphone interconnecting line installed on the microphone and roof installed on wall spatially present it is tetragonous
The shape of cone.
The sound source position of positioning speaker includes: set one of reference microphone in distributed microphone array three
Coordinate is tieed up, and sets the three-dimensional of other microphones in three-dimensional system of coordinate and distributed microphone array according to the three-dimensional coordinate of setting
Coordinate；The cross-correlation function of the signal received according to microphone estimates time of each microphone relative to reference microphone
Delay；Sound source position is calculated according to the coordinate that sound source reaches time between each microphone, delay, the velocity of sound and each microphone
The coordinate set.
It is handled according to the acoustic information that sound source position and distributed microphone array are collected, obtains clean smooth language
Sound signal includes: that the acoustic information for collecting distributed microphone array carries out noise reduction, obtains clean voice signal；To distribution
The voice signal of each microphone in formula microphone array carries out delay alignment and weighted average, obtains clean smooth voice
Signal.
The acoustic information that distributed microphone array is collected carries out noise reduction, and obtaining clean voice signal includes: setting
The voice signal and noise signal that the signal of main microphon is gone out by human hair form；The distance for reaching each microphone according to sound source is true
The nearest microphone of set a distance sound source is main microphon, remaining microphone is secondary microphone, and determines the wheat farthest apart from sound source
Gram wind is noise signal reference microphone；The initial noiseless segment signal of noise signal reference microphone is used to estimate as noise,
And the noise signal by noise estimation as distributed microphone array；Subelement is set according to main microphon signal and noise is estimated
Count the power spectrum that subelement calculates main microphon signal；Subtracting coefficient was introduced during calculating the power spectrum of main microphon signal
And spectrum lower limit compensation factor；The signal of the spectra calculation subelement of factor introducing unit will be introduced by Fourier inversion
It is transformed to time-domain signal, to obtain clean voice signal.
The voice signal of each microphone in distributed microphone array is handled, clean smooth voice is obtained
Signal include: the signal received according to gram wind cross-correlation function estimate each microphone relative to reference microphone when
Between postpone；The received voice signal of all microphones is subjected to delay alignment according to the delay time of each road signal, thus to each
The voice signal that road has already passed through noise reduction process is weighted and averaged at a distance from sound source position according to it, is obtained clean smooth
Voice signal.
The signal of distributed microphone array transmitting is acquired, and the signal that distributed microphone array microphone is emitted is same
It walks to a data collection station, the signal control equipment that data collection station is emitted by distributed microphone array includes:
Acquire the acoustic information that all microphones in distributed microphone array are gathered and passed through speech processing module processing；By acquisition
Acoustic information is sent to back-end data collector after treatment；Data collector is connect with equipment, and is acquired according to data
The received acoustic information of device controls equipment.
The embodiment of the present application provides a kind of electronic device, please refers to 5, which includes: memory 601, processor
602 and it is stored in the computer program that can be run on memory 601 and on processor 602, processor 602 executes the computer
When program, realize it is aforementioned described in distribution microphone array sound pick-up method.
Further, electronic device further include: at least one input equipment 603 and at least one output equipment 604.
Above-mentioned memory 601, processor 602, input equipment 603 and output equipment 604, are connected by bus 605.
Wherein, input equipment 603 concretely camera, touch panel, physical button or mouse etc..Output equipment
604 concretely display screens.
Memory 601 can be high random access memory body (RAM, Random Access Memory) memory,
It can be non-labile memory (non-volatile memory), such as magnetic disk storage.Memory 601 is for storing one
Group executable program code, processor 602 are coupled with memory 601.
Further, the embodiment of the present application also provides a kind of computer readable storage medium, the computer-readable storages
Medium can be in the electronic device being set in the various embodiments described above, which can be above-mentioned deposit
Reservoir 601.It is stored with computer program on the computer readable storage medium, before realizing when which is executed by processor 602
State distribution microphone array sound pick-up method described in embodiment of the method.
Further, the computer can storage medium can also be USB flash disk, mobile hard disk, read-only memory 601 (ROM,
Read-Only Memory), RAM, the various media that can store program code such as magnetic or disk.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it
Its mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the module, only
Only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple module or components can be tied
Another system is closed or is desirably integrated into, or some features can be ignored or not executed.Another point, it is shown or discussed
Mutual coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or logical of device or module
Letter connection can be electrical property, mechanical or other forms.
The module as illustrated by the separation member may or may not be physically separated, aobvious as module
The component shown may or may not be physical module, it can and it is in one place, or may be distributed over multiple
On network module.Some or all of the modules therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
It, can also be in addition, each functional module in each embodiment of the present invention can integrate in a processing module
It is that modules physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.
If the integrated module is realized in the form of software function module and sells or use as independent product
When, it can store in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially
The all or part of the part that contributes to existing technology or the technical solution can be in the form of software products in other words
It embodies, which is stored in a storage medium, including some instructions are used so that a computer
Equipment (can be personal computer, server or the network equipment etc.) executes the complete of each embodiment the method for the present invention
Portion or part steps.
It should be noted that for the various method embodiments described above, describing for simplicity, therefore, it is stated as a series of
Combination of actions, but those skilled in the art should understand that, the present invention is not limited by the sequence of acts described because
According to the present invention, certain steps can use other sequences or carry out simultaneously.Secondly, those skilled in the art should also know
It knows, the embodiments described in the specification are all preferred embodiments, and related actions and modules might not all be this hair
Necessary to bright.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the associated description of other embodiments.
The above are the descriptions to a kind of distributed microphone array pickup system provided by the present invention and method, for this
The technical staff in field, thought according to an embodiment of the present invention have change in specific embodiments and applications
Place, to sum up, the contents of this specification are not to be construed as limiting the invention.
Claims (10)
1. a kind of distribution microphone array pickup system characterized by comprising
Distributed microphone array, for collecting acoustic information indoors；
Auditory localization processing module makes a sound the sound source position of information for positioning speaker；
Speech processing module, the acoustic information for being collected according to sound source position and distributed microphone array are handled, are obtained
To clean smooth voice signal；
Microphone data acquisition module emits after speech processing module is handled for acquiring the distributed microphone array
Signal, and the signal of the distributed microphone array transmitting is synchronized to a data collection station, the data acquisition
The signal that terminal passes through distributed microphone array transmitting controls equipment.
2. distribution microphone array pickup system according to claim 1, which is characterized in that
The distribution microphone array includes that the microphone installed on roof indoors and four sides wall is arranged；
By adjusting the position of each microphone, so that the Mike's wind facies being arranged on the microphone and roof that are arranged on the wall
The shape of rectangular pyramid is spatially presented in interconnection line.
3. distribution microphone array pickup system according to claim 1, which is characterized in that
The auditory localization processing module includes:
Microphone coordinate determination unit, for setting the three-dimensional of one of reference microphone in the distributed microphone array
Coordinate, and other microphones in three-dimensional system of coordinate and the distributed microphone array are set according to the three-dimensional coordinate of setting
Three-dimensional coordinate；
Time delay estimation unit, the cross-correlation function of the signal for being received according to microphone estimate each microphone relative to
The time delay of reference microphone；
Sound source position coordinate determination unit, for reaching the time between each microphone, delay, the velocity of sound and each according to sound source
The coordinate of a microphone calculates the coordinate of sound source position.
4. distribution microphone array pickup system according to claim 1, which is characterized in that
The speech processing module includes:
Noise reduction unit, the acoustic information for collecting the distributed microphone array carry out noise reduction, obtain clean voice
Signal；
It is weighted and averaged unit, for each road microphone signal to be carried out delay alignment, and then it is weighted and averaged, is done
Net smooth voice signal.
5. distribution microphone array pickup system according to claim 4, which is characterized in that
The noise reduction unit includes:
Main microphon signal sets subelement, the voice signal and noise signal gone out by human hair for setting the signal of main microphon
Composition；
Microphone determines subelement, and the distance for reaching each microphone according to sound source determines the microphone nearest apart from sound source
For main microphon, remaining microphone is secondary microphone, and determines that the microphone farthest apart from sound source is that noise signal refers to Mike
Wind；
Noise estimates subelement, for using the initial noiseless segment signal of noise signal reference microphone to estimate as noise, and
Noise signal by noise estimation as the distributed microphone array；
Spectra calculation subelement, by being set according to the main microphon signal based on subelement and noise estimation subelement
Calculate the power spectrum of each microphone signal；
The factor introduces subelement, for introducing subtracting coefficient and spectrum lower limit compensation factor in the spectra calculation subelement；
Fourier inversion subelement, for spectra calculation of factor introducing unit will to be introduced by Fourier inversion
The signal of unit is transformed to time-domain signal, to obtain clean voice signal.
6. distribution microphone array pickup system according to claim 5, which is characterized in that
The weighted average unit includes:
Time delay estimates subelement, the cross-correlation function of the signal for being received according to gram wind estimate each microphone relative to
The time delay of reference microphone；
Delay alignment subelement, for being prolonged the received voice signal of all microphones according to the delay time of each road signal
When be aligned, thus to each road have already passed through the voice signal of noise reduction process be weighted at a distance from sound source position according to it is flat
, clean smooth voice signal is obtained.
7. distribution microphone array pickup system according to claim 1, which is characterized in that
The microphone data acquisition module includes:
Data acquisition unit is gathered and passed through speech processes mould for acquiring all microphones in the distributed microphone array
The voice signal of block processing；
Data transmission unit, the acoustic information for acquiring the data acquisition unit are sent to back-end data collector；
Device control cell controls equipment for connecting equipment, and according to the received acoustic information of data collector.
8. a kind of distribution microphone array sound pick-up method characterized by comprising
Acoustic information is collected indoors by distributed microphone array；
Position the sound source position of speaker；
It is handled according to the acoustic information that sound source position and distributed microphone array are collected, obtains clean smooth voice letter
Number；
The signal of distributed microphone array transmitting is acquired, and each microphone in the distributed microphone array is emitted
Signal is synchronized to a data collection station, the signal that the data collection station passes through the distributed microphone array transmitting
Control equipment.
9. a kind of electronic device, comprising: memory, processor and be stored on the memory and can transport on the processor
Capable computer program, which is characterized in that when the processor executes the computer program, realize the institute in claim 8
State method.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
When being executed by processor, the method in claim 8 is realized.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910073427.7A CN109788382A (en) | 2019-01-25 | 2019-01-25 | A kind of distribution microphone array pickup system and method |
| PCT/CN2019/086768 WO2020151133A1 (en) | 2019-01-25 | 2019-05-14 | Sound acquisition system having distributed microphone array, and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910073427.7A CN109788382A (en) | 2019-01-25 | 2019-01-25 | A kind of distribution microphone array pickup system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109788382A true CN109788382A (en) | 2019-05-21 |
Family
ID=66501290
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910073427.7A Pending CN109788382A (en) | 2019-01-25 | 2019-01-25 | A kind of distribution microphone array pickup system and method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109788382A (en) |
| WO (1) | WO2020151133A1 (en) |
Cited By (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110234043A (en) * | 2019-05-31 | 2019-09-13 | 歌尔科技有限公司 | Audio signal processing method, device and equipment based on microphone array |
| CN110418242A (en) * | 2019-07-30 | 2019-11-05 | 西安声必捷信息科技有限公司 | Sound source direction method, apparatus and system |
| CN110519676A (en) * | 2019-08-22 | 2019-11-29 | 云知声智能科技股份有限公司 | A kind of method of the distributed microphone pickup of decentralization |
| CN111161751A (en) * | 2019-12-25 | 2020-05-15 | 声耕智能科技(西安)研究院有限公司 | Distributed microphone pickup system and method under complex scene |
| CN111246324A (en) * | 2020-02-24 | 2020-06-05 | 江苏中协智能科技有限公司 | Auxiliary device for directional pickup microphone hanging and user identity confirmation and tracking method |
| CN111544030A (en) * | 2020-05-20 | 2020-08-18 | 京东方科技集团股份有限公司 | Stethoscope, diagnosis device and diagnosis method |
| CN111768797A (en) * | 2020-09-01 | 2020-10-13 | 深圳市声扬科技有限公司 | Speech enhancement processing method, speech enhancement processing device, computer equipment and storage medium |
| WO2020252886A1 (en) * | 2019-06-17 | 2020-12-24 | 深圳壹秘科技有限公司 | Directional sound pickup method, recording device and storage medium |
| CN112565531A (en) * | 2020-12-12 | 2021-03-26 | 深圳波导智慧科技有限公司 | Recording method and device applied to multi-person voice conference |
| CN112735462A (en) * | 2020-12-30 | 2021-04-30 | 科大讯飞股份有限公司 | Noise reduction method and voice interaction method of distributed microphone array |
| CN112769599A (en) * | 2020-12-28 | 2021-05-07 | 深信服科技股份有限公司 | Automatic resource access method, system and readable storage medium |
| CN112887875A (en) * | 2021-01-22 | 2021-06-01 | 平安科技（深圳）有限公司 | Conference system voice data acquisition method and device, electronic equipment and storage medium |
| CN113068101A (en) * | 2021-03-16 | 2021-07-02 | Oppo广东移动通信有限公司 | Ring array pickup control method and device, storage medium and ring array |
| CN113092965A (en) * | 2021-04-09 | 2021-07-09 | 华北电力大学（保定） | Converter valve equipment defect partial discharge detection device based on microphone array |
| CN113141285A (en) * | 2020-01-19 | 2021-07-20 | 海信集团有限公司 | Immersive voice interaction method and system |
| CN113301461A (en) * | 2021-05-14 | 2021-08-24 | 深圳波洛斯科技有限公司 | Active noise reduction method and system based on ambient sound elimination |
| CN113311390A (en) * | 2021-04-25 | 2021-08-27 | 普联国际有限公司 | Sound source positioning method, device, equipment and storage medium based on distributed wheat array |
| CN113516981A (en) * | 2021-03-31 | 2021-10-19 | 深圳鱼亮科技有限公司 | Voice awakening decision-making system based on wireless distributed microphone array |
| CN113608167A (en) * | 2021-10-09 | 2021-11-05 | 阿里巴巴达摩院(杭州)科技有限公司 | Sound source positioning method, device and equipment |
| CN114205731A (en) * | 2021-12-08 | 2022-03-18 | 随锐科技集团股份有限公司 | Speaker area detection method, device, electronic equipment and storage medium |
| CN114268883A (en) * | 2021-11-29 | 2022-04-01 | 苏州君林智能科技有限公司 | Method and system for selecting microphone placement position |
| CN114325586A (en) * | 2021-12-31 | 2022-04-12 | 智己汽车科技有限公司 | Vehicle-mounted multimedia sound positioning system |
| CN114923136A (en) * | 2022-07-15 | 2022-08-19 | 安徽云磬科技产业发展有限公司 | Multi-array pipeline leakage positioning method and device |
| CN114974200A (en) * | 2022-07-13 | 2022-08-30 | 恩平市菲玛特电子科技有限公司 | Microphone voice interaction management system and method based on Internet of things |
| WO2023226161A1 (en) * | 2022-05-25 | 2023-11-30 | 歌尔股份有限公司 | Sound source position determination method, device, and storage medium |
| CN112735462B (en) * | 2020-12-30 | 2024-05-31 | 科大讯飞股份有限公司 | Noise reduction method and voice interaction method for distributed microphone array |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204390737U (en) * | 2014-07-29 | 2015-06-10 | 科大讯飞股份有限公司 | A kind of home voice disposal system |
| CN105866741A (en) * | 2016-06-23 | 2016-08-17 | 合肥联宝信息技术有限公司 | Home control device and home control method on basis of sound source localization |
| CN106507244A (en) * | 2016-12-23 | 2017-03-15 | 深圳先进技术研究院 | A kind of central control system |
| CN206353839U (en) * | 2016-12-13 | 2017-07-25 | 深圳创维－Rgb电子有限公司 | A kind of TV speech control system |
| CN107123421A (en) * | 2017-04-11 | 2017-09-01 | 广东美的制冷设备有限公司 | Sound control method, device and home appliance |
| CN107290723A (en) * | 2017-06-22 | 2017-10-24 | 北京地平线信息技术有限公司 | Sound localization method, device and electronic equipment |
| CN107682240A (en) * | 2017-09-27 | 2018-02-09 | 四川长虹电器股份有限公司 | A kind of distributed sound interactive system for intelligent domestic |
| CN108680902A (en) * | 2018-06-27 | 2018-10-19 | 相舆科技（上海）有限公司 | A kind of sonic location system based on multi-microphone array |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5334037B2 (en) * | 2008-07-11 | 2013-11-06 | インターナショナル・ビジネス・マシーンズ・コーポレーション | Sound source position detection method and system |
-
2019
- 2019-01-25 CN CN201910073427.7A patent/CN109788382A/en active Pending
- 2019-05-14 WO PCT/CN2019/086768 patent/WO2020151133A1/en active Application Filing
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN204390737U (en) * | 2014-07-29 | 2015-06-10 | 科大讯飞股份有限公司 | A kind of home voice disposal system |
| CN105866741A (en) * | 2016-06-23 | 2016-08-17 | 合肥联宝信息技术有限公司 | Home control device and home control method on basis of sound source localization |
| CN206353839U (en) * | 2016-12-13 | 2017-07-25 | 深圳创维－Rgb电子有限公司 | A kind of TV speech control system |
| CN106507244A (en) * | 2016-12-23 | 2017-03-15 | 深圳先进技术研究院 | A kind of central control system |
| CN107123421A (en) * | 2017-04-11 | 2017-09-01 | 广东美的制冷设备有限公司 | Sound control method, device and home appliance |
| CN107290723A (en) * | 2017-06-22 | 2017-10-24 | 北京地平线信息技术有限公司 | Sound localization method, device and electronic equipment |
| CN107682240A (en) * | 2017-09-27 | 2018-02-09 | 四川长虹电器股份有限公司 | A kind of distributed sound interactive system for intelligent domestic |
| CN108680902A (en) * | 2018-06-27 | 2018-10-19 | 相舆科技（上海）有限公司 | A kind of sonic location system based on multi-microphone array |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110234043B (en) * | 2019-05-31 | 2020-08-25 | 歌尔科技有限公司 | Sound signal processing method, device and equipment based on microphone array |
| CN110234043A (en) * | 2019-05-31 | 2019-09-13 | 歌尔科技有限公司 | Audio signal processing method, device and equipment based on microphone array |
| WO2020252886A1 (en) * | 2019-06-17 | 2020-12-24 | 深圳壹秘科技有限公司 | Directional sound pickup method, recording device and storage medium |
| CN110418242B (en) * | 2019-07-30 | 2021-02-05 | 西安声必捷信息科技有限公司 | Sound source orientation method, device and system |
| CN110418242A (en) * | 2019-07-30 | 2019-11-05 | 西安声必捷信息科技有限公司 | Sound source direction method, apparatus and system |
| CN110519676A (en) * | 2019-08-22 | 2019-11-29 | 云知声智能科技股份有限公司 | A kind of method of the distributed microphone pickup of decentralization |
| CN110519676B (en) * | 2019-08-22 | 2021-04-09 | 云知声智能科技股份有限公司 | Decentralized distributed microphone pickup method |
| CN111161751A (en) * | 2019-12-25 | 2020-05-15 | 声耕智能科技(西安)研究院有限公司 | Distributed microphone pickup system and method under complex scene |
| CN113141285B (en) * | 2020-01-19 | 2022-04-29 | 海信集团有限公司 | Immersive voice interaction method and system |
| CN113141285A (en) * | 2020-01-19 | 2021-07-20 | 海信集团有限公司 | Immersive voice interaction method and system |
| CN111246324A (en) * | 2020-02-24 | 2020-06-05 | 江苏中协智能科技有限公司 | Auxiliary device for directional pickup microphone hanging and user identity confirmation and tracking method |
| CN111544030A (en) * | 2020-05-20 | 2020-08-18 | 京东方科技集团股份有限公司 | Stethoscope, diagnosis device and diagnosis method |
| CN111768797A (en) * | 2020-09-01 | 2020-10-13 | 深圳市声扬科技有限公司 | Speech enhancement processing method, speech enhancement processing device, computer equipment and storage medium |
| CN112565531A (en) * | 2020-12-12 | 2021-03-26 | 深圳波导智慧科技有限公司 | Recording method and device applied to multi-person voice conference |
| CN112769599A (en) * | 2020-12-28 | 2021-05-07 | 深信服科技股份有限公司 | Automatic resource access method, system and readable storage medium |
| CN112735462A (en) * | 2020-12-30 | 2021-04-30 | 科大讯飞股份有限公司 | Noise reduction method and voice interaction method of distributed microphone array |
| CN112735462B (en) * | 2020-12-30 | 2024-05-31 | 科大讯飞股份有限公司 | Noise reduction method and voice interaction method for distributed microphone array |
| CN112887875A (en) * | 2021-01-22 | 2021-06-01 | 平安科技（深圳）有限公司 | Conference system voice data acquisition method and device, electronic equipment and storage medium |
| CN112887875B (en) * | 2021-01-22 | 2022-10-18 | 平安科技（深圳）有限公司 | Conference system voice data acquisition method and device, electronic equipment and storage medium |
| CN113068101A (en) * | 2021-03-16 | 2021-07-02 | Oppo广东移动通信有限公司 | Ring array pickup control method and device, storage medium and ring array |
| CN113516981A (en) * | 2021-03-31 | 2021-10-19 | 深圳鱼亮科技有限公司 | Voice awakening decision-making system based on wireless distributed microphone array |
| CN113092965A (en) * | 2021-04-09 | 2021-07-09 | 华北电力大学（保定） | Converter valve equipment defect partial discharge detection device based on microphone array |
| CN113311390A (en) * | 2021-04-25 | 2021-08-27 | 普联国际有限公司 | Sound source positioning method, device, equipment and storage medium based on distributed wheat array |
| CN113301461A (en) * | 2021-05-14 | 2021-08-24 | 深圳波洛斯科技有限公司 | Active noise reduction method and system based on ambient sound elimination |
| CN113608167B (en) * | 2021-10-09 | 2022-02-08 | 阿里巴巴达摩院(杭州)科技有限公司 | Sound source positioning method, device and equipment |
| CN113608167A (en) * | 2021-10-09 | 2021-11-05 | 阿里巴巴达摩院(杭州)科技有限公司 | Sound source positioning method, device and equipment |
| CN114268883A (en) * | 2021-11-29 | 2022-04-01 | 苏州君林智能科技有限公司 | Method and system for selecting microphone placement position |
| CN114205731A (en) * | 2021-12-08 | 2022-03-18 | 随锐科技集团股份有限公司 | Speaker area detection method, device, electronic equipment and storage medium |
| CN114205731B (en) * | 2021-12-08 | 2023-12-26 | 随锐科技集团股份有限公司 | Speaker area detection method, speaker area detection device, electronic equipment and storage medium |
| CN114325586A (en) * | 2021-12-31 | 2022-04-12 | 智己汽车科技有限公司 | Vehicle-mounted multimedia sound positioning system |
| CN114325586B (en) * | 2021-12-31 | 2024-05-14 | 智己汽车科技有限公司 | Vehicle-mounted multimedia sound positioning system |
| WO2023226161A1 (en) * | 2022-05-25 | 2023-11-30 | 歌尔股份有限公司 | Sound source position determination method, device, and storage medium |
| CN114974200B (en) * | 2022-07-13 | 2023-02-03 | 恩平市菲玛特电子科技有限公司 | Microphone voice interaction management system and method based on Internet of things |
| CN114974200A (en) * | 2022-07-13 | 2022-08-30 | 恩平市菲玛特电子科技有限公司 | Microphone voice interaction management system and method based on Internet of things |
| CN114923136A (en) * | 2022-07-15 | 2022-08-19 | 安徽云磬科技产业发展有限公司 | Multi-array pipeline leakage positioning method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020151133A1 (en) | 2020-07-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109788382A (en) | A kind of distribution microphone array pickup system and method | |
| CN105427861B (en) | The system and its control method of smart home collaboration microphone voice control | |
| CN106707788B (en) | A kind of intelligent home voice control identifying system and method | |
| Zhang et al. | Why does PHAT work well in lownoise, reverberative environments? | |
| Dorfan et al. | Tree-based recursive expectation-maximization algorithm for localization of acoustic sources | |
| CN107211225A (en) | Hearing assistant system | |
| CN107271963A (en) | The method and apparatus and air conditioner of auditory localization | |
| CN101807404B (en) | Pretreatment system for strengthening directional voice at front end of electronic cochlear implant | |
| CN110364145A (en) | A kind of method and device of the method for speech recognition, voice punctuate | |
| WO2019080551A1 (en) | Target voice detection method and apparatus | |
| CN104422922A (en) | Method and device for realizing sound source localization by utilizing mobile terminal | |
| CN109672966A (en) | A kind of voice pick-up method, device and system | |
| Zhang et al. | Maximum likelihood sound source localization for multiple directional microphones | |
| CN109769060A (en) | A kind of mobile phone active noise reducing device and method | |
| CN110072177B (en) | Space division information acquisition method and device and storage medium | |
| CN106921911A (en) | Voice acquisition method and device | |
| CN108008394B (en) | Biomimetic sonar two dimension undergoes drawing drawing method, storage medium and equipment | |
| CN106339081A (en) | Commercial equipment-based equipment carrying-free palm-positioning human-computer interaction method | |
| CN112420073A (en) | Voice signal processing method, device, electronic equipment and storage medium | |
| CN107077844A (en) | Method and device for realizing voice combined assistance and robot | |
| CN110136733A (en) | A kind of the solution reverberation method and device of audio signal | |
| CN104900237B (en) | A kind of methods, devices and systems for audio-frequency information progress noise reduction process | |
| CN111932619A (en) | Microphone tracking system and method combining image recognition and voice positioning | |
| CN103888861B (en) | Microphone array directive property adjusting method, device and electronic equipment | |
| CN207448485U (en) | A kind of service robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190521 |