CN109936798A - The method, apparatus and server of pickup are realized based on distributed MIC array - Google Patents
The method, apparatus and server of pickup are realized based on distributed MIC array Download PDFInfo
- Publication number
- CN109936798A CN109936798A CN201711375076.2A CN201711375076A CN109936798A CN 109936798 A CN109936798 A CN 109936798A CN 201711375076 A CN201711375076 A CN 201711375076A CN 109936798 A CN109936798 A CN 109936798A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- spatial orientation
- orientation information
- calibration
- mic array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Mobile Radio Communication Systems (AREA)
Abstract
The present invention provides a kind of method, apparatus and server that pickup is realized based on distributed MIC array.The described method includes: accessing multiple mobile terminals for forming distributed MIC array；Obtain the spatial orientation information of each mobile terminal after calibration；Receive the audio signal respectively picked up that the multiple mobile terminal uploads；According to the audio signal that the spatial orientation information of each mobile terminal after the calibration and the multiple mobile terminal received upload, follow audio processing is carried out using MIC array algorithm.The present invention is able to use the included MIC composition distribution MIC array of multiple mobile terminals can build distributed MIC array without investment in advance whenever and wherever possible, promote far field pickup effect.
Description
Technical field
The present invention relates to speech signal processing technologies, more particularly to a kind of distribution MIC array that is based on to realize pickup
Method, apparatus and server.
Background technique
Currently, existing pickup scheme mainly has: using single portable mobile termianl (such as mobile phone) MIC system into
Row pickup；Alternatively, multiple MIC are integrated in the same device according to unalterable rules, form MIC array；Alternatively, by dedicated MIC
It is deployed in the different location in space according to certain rule, forms distribution MIC array, such as car MIC system.
But there is certain defect in existing pickup scheme:
Pickup is carried out using single portable mobile termianl, due to not having MIC array, far field pickup effect is poor；Using
MIC array in same equipment, due to the limitation of half-wavelength theory, the size of array itself is difficult to reduce, the portability of equipment
It cannot be considered in terms of with performance；Using dedicated distribution MIC array, need to dispose and calibrate dedicated MIC in advance.
MIC array or distribution MIC array in either same equipment, require additionally to purchase special equipment, at
This is higher.
Summary of the invention
The method, apparatus and server provided by the invention that pickup is realized based on distributed MIC array, is able to use multiple
The included MIC of mobile terminal forms distribution MIC array, without investment in advance, can build whenever and wherever possible MIC gusts distributed
Column promote far field pickup effect.
In a first aspect, the present invention provides a kind of method for realizing pickup based on distributed MIC array, comprising:
Access multiple mobile terminals for forming distributed MIC array；
Obtain the spatial orientation information of each mobile terminal after calibration；
Receive the audio signal respectively picked up that the multiple mobile terminal uploads；
According to the spatial orientation information of each mobile terminal after the calibration and the multiple mobile terminal received
The audio signal of upload carries out follow audio processing using MIC array algorithm.
Optionally, the calibrating mode of the multiple mobile terminal are as follows: put each mobile terminal according to scheduled layout；
The spatial orientation information for obtaining each mobile terminal after calibration includes: that the scheduled layout is corresponding
Spatial orientation information of the spatial orientation information of each mobile terminal as each mobile terminal after calibration.
Optionally, the calibrating mode of the multiple mobile terminal are as follows: obtained between each mobile terminal by manual measurement
Real space layout, determines the spatial orientation information of each mobile terminal；
The spatial orientation information for obtaining each mobile terminal after calibration includes: reception user's input by surveying
The spatial orientation information of each mobile terminal obtained after amount.
Optionally, the calibrating mode of the multiple mobile terminal are as follows: the estimation mode based on power spectrum or signal spectrum obtains
The spatial orientation information of each mobile terminal；
The spatial orientation information for obtaining each mobile terminal after calibration includes: will be based on power spectrum or signal spectrum
Space orientation of the obtained spatial orientation information of each mobile terminal of estimation mode as each mobile terminal after calibration
Information.
Second aspect, the present invention provide a kind of device that pickup is realized based on distributed MIC array, comprising:
Access unit, for accessing multiple mobile terminals for forming distributed MIC array；
Acquiring unit, for obtaining the spatial orientation information of each mobile terminal after calibration；
Receiving unit, the audio signal respectively picked up uploaded for receiving the multiple mobile terminal；
Processing unit, for according to the spatial orientation information of each mobile terminal after the calibration and described in receiving
The audio signal that multiple mobile terminals upload carries out follow audio processing using MIC array algorithm.
Optionally, the calibrating mode of the multiple mobile terminal are as follows: put each mobile terminal according to scheduled layout；
The acquiring unit, for using the spatial orientation information of the corresponding each mobile terminal of the scheduled layout as process
The spatial orientation information of each mobile terminal after calibration.
Optionally, the calibrating mode of the multiple mobile terminal are as follows: obtained between each mobile terminal by manual measurement
Real space layout, determines the spatial orientation information of each mobile terminal；
The acquiring unit, the space orientation letter of each mobile terminal obtained after measurement for receiving user's input
Breath.
Optionally, the calibrating mode of the multiple mobile terminal are as follows: the estimation mode based on power spectrum or signal spectrum obtains
The spatial orientation information of each mobile terminal；
The acquiring unit, the space of each mobile terminal for obtaining the estimation mode based on power spectrum or signal spectrum
Spatial orientation information of the location information as each mobile terminal after calibration.
The third aspect, the present invention provide a kind of server, and the server includes above-mentioned based on the realization of distribution MIC array
The device of pickup.
The method, apparatus and server provided in an embodiment of the present invention that pickup is realized based on distributed MIC array, access are used
In multiple mobile terminals of composition distribution MIC array, the spatial orientation information of each mobile terminal after calibration is obtained, is connect
The audio signal respectively picked up that the multiple mobile terminal uploads is received, according to the space of each mobile terminal after the calibration
The audio signal that location information and the multiple mobile terminal received upload carries out subsequent sound using MIC array algorithm
Frequency is handled.Compared with prior art, the present invention is able to use the included MIC composition distribution MIC array of multiple mobile terminals, nothing
It need to put into advance, distributed MIC array can be built whenever and wherever possible, promote far field pickup effect.
Detailed description of the invention
Fig. 1 is the flow chart for the method that one embodiment of the invention realizes pickup based on distributed MIC array；
Fig. 2 is the structural schematic diagram for the device that one embodiment of the invention realizes pickup based on distributed MIC array.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is only
It is only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill
Personnel's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
The present invention provides a kind of method for realizing pickup based on distributed MIC array, as shown in Figure 1, which comprises
S11, multiple mobile terminals for forming distributed MIC array are accessed.
S12, the spatial orientation information for obtaining each mobile terminal after calibration.
S13, the audio signal respectively picked up that the multiple mobile terminal uploads is received.
S14, according to the spatial orientation information of each mobile terminal after the calibration and the multiple movement received
The audio signal that terminal uploads carries out follow audio processing using MIC array algorithm.
The method provided in an embodiment of the present invention for realizing pickup based on distributed MIC array, is accessed for forming distribution
Multiple mobile terminals of MIC array obtain the spatial orientation information of each mobile terminal after calibration, receive the multiple shifting
The audio signal respectively picked up that dynamic terminal uploads, according to the spatial orientation information of each mobile terminal after the calibration and
The audio signal that the multiple mobile terminal received uploads carries out follow audio processing using MIC array algorithm.With it is existing
Technology is compared, and the present invention is able to use the included MIC composition distribution MIC array of multiple mobile terminals, without investment in advance, i.e.,
Distributed MIC array can be built whenever and wherever possible, promote far field pickup effect.
The method for realizing pickup based on distributed MIC array to invention below is described in detail.
Firstly, multiple mobile terminals with wireless access technology is specified to be responsible for completing distributed pickup function, such as:
Mobile phone, tablet computer etc..
Then, mobile terminal specified in advance is accessed into same backstage.Here backstage can be an independent backstage
Server is also possible to a Specialised mobile terminal or the mobile terminal with pickup multiplexing.
Before starting pickup, the calibration of multiple mobile terminals is first completed.The calibration purpose is to complete multiple
The space orientation of mobile terminal.Various ways completion can be used in specific implementation, such as: the mobile phone of fixed layout is put, or
Person's manual measurement and the space layout being manually entered between mobile phone, or the estimation mode based on power spectrum or signal spectrum etc..
Then, the spatial orientation information of the mobile terminal after calibration is uniformly aggregated into backstage.
After the completion of the confirmation calibration of backstage, each mobile terminal can be notified to start pickup.
Therewith, the audio signal of pickup is aggregated into backstage by each mobile terminal.
Finally, backstage uses after the completion of MIC array algorithm according to the calibration information of prior confirmation with the audio signal summarized
Continuous audio processing.
The embodiment of the present invention also provides a kind of device that pickup is realized based on distributed MIC array, as shown in Fig. 2, described
Device includes:
Access unit 11, for accessing multiple mobile terminals for forming distributed MIC array；
Acquiring unit 12, for obtaining the spatial orientation information of each mobile terminal after calibration；
Receiving unit 13, the audio signal respectively picked up uploaded for receiving the multiple mobile terminal；
Processing unit 14, for according to the spatial orientation information of each mobile terminal after the calibration and the institute received
The audio signal that multiple mobile terminals upload is stated, carries out follow audio processing using MIC array algorithm.
The device provided in an embodiment of the present invention that pickup is realized based on distributed MIC array, is accessed for forming distribution
Multiple mobile terminals of MIC array obtain the spatial orientation information of each mobile terminal after calibration, receive the multiple shifting
The audio signal respectively picked up that dynamic terminal uploads, according to the spatial orientation information of each mobile terminal after the calibration and
The audio signal that the multiple mobile terminal received uploads carries out follow audio processing using MIC array algorithm.With it is existing
Technology is compared, and the present invention is able to use the included MIC composition distribution MIC array of multiple mobile terminals, without investment in advance, i.e.,
Distributed MIC array can be built whenever and wherever possible, promote far field pickup effect.
Optionally, the calibrating mode of the multiple mobile terminal are as follows: put each mobile terminal according to scheduled layout；
The acquiring unit 12, for using the spatial orientation information of the corresponding each mobile terminal of the scheduled layout as warp
The spatial orientation information of each mobile terminal after crossing calibration.
Optionally, the calibrating mode of the multiple mobile terminal are as follows: obtained between each mobile terminal by manual measurement
Real space layout, determines the spatial orientation information of each mobile terminal；
The acquiring unit 12, the space orientation of each mobile terminal obtained after measurement for receiving user's input
Information.
Optionally, the calibrating mode of the multiple mobile terminal are as follows: the estimation mode based on power spectrum or signal spectrum obtains
The spatial orientation information of each mobile terminal；
The acquiring unit 12, the sky of each mobile terminal for obtaining the estimation mode based on power spectrum or signal spectrum
Between location information as by calibration after each mobile terminal spatial orientation information.
The embodiment of the present invention also provides a kind of server, and the server includes above-mentioned based on the realization of distribution MIC array
The device of pickup.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the program can be stored in a computer-readable storage medium
In, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
In the technical scope disclosed by the present invention, any changes or substitutions that can be easily thought of by those familiar with the art, all answers
It is included within the scope of the present invention.Therefore, protection scope of the present invention should be subject to the protection scope in claims.
Claims (9)
1. a kind of method for realizing pickup based on distributed MIC array characterized by comprising
Access multiple mobile terminals for forming distributed MIC array；
Obtain the spatial orientation information of each mobile terminal after calibration；
Receive the audio signal respectively picked up that the multiple mobile terminal uploads；
It is uploaded according to the spatial orientation information of each mobile terminal after the calibration and the multiple mobile terminal received
Audio signal, use MIC array algorithm carry out follow audio processing.
2. the method according to claim 1, wherein the calibrating mode of the multiple mobile terminal are as follows: by each shifting
Dynamic terminal is put according to scheduled layout；
The spatial orientation information for obtaining each mobile terminal after calibration includes: by the corresponding each shifting of the scheduled layout
Spatial orientation information of the spatial orientation information of dynamic terminal as each mobile terminal after calibration.
3. the method according to claim 1, wherein the calibrating mode of the multiple mobile terminal are as follows: pass through people
Work measurement obtains the layout of the real space between each mobile terminal, determines the spatial orientation information of each mobile terminal；
The spatial orientation information for obtaining each mobile terminal after calibration includes: reception user's input after measurement
The spatial orientation information of obtained each mobile terminal.
4. the method according to claim 1, wherein the calibrating mode of the multiple mobile terminal are as follows: be based on function
The estimation mode of rate spectrum or signal spectrum obtains the spatial orientation information of each mobile terminal；
The spatial orientation information for obtaining each mobile terminal after calibration includes: by estimating based on power spectrum or signal spectrum
Spatial orientation information of the spatial orientation information for each mobile terminal that calculation mode obtains as each mobile terminal after calibration.
5. a kind of device for realizing pickup based on distributed MIC array characterized by comprising
Access unit, for accessing multiple mobile terminals for forming distributed MIC array；
Acquiring unit, for obtaining the spatial orientation information of each mobile terminal after calibration；
Receiving unit, the audio signal respectively picked up uploaded for receiving the multiple mobile terminal；
Processing unit, for according to the spatial orientation information of each mobile terminal after the calibration and receiving the multiple
The audio signal that mobile terminal uploads carries out follow audio processing using MIC array algorithm.
6. device according to claim 5, which is characterized in that the calibrating mode of the multiple mobile terminal are as follows: by each shifting
Dynamic terminal is put according to scheduled layout；
The acquiring unit, for using the spatial orientation information of the corresponding each mobile terminal of the scheduled layout as by calibrating
The spatial orientation information of each mobile terminal afterwards.
7. device according to claim 5, which is characterized in that the calibrating mode of the multiple mobile terminal are as follows: pass through people
Work measurement obtains the layout of the real space between each mobile terminal, determines the spatial orientation information of each mobile terminal；
The acquiring unit, the spatial orientation information of each mobile terminal obtained after measurement for receiving user's input.
8. device according to claim 5, which is characterized in that the calibrating mode of the multiple mobile terminal are as follows: be based on function
The estimation mode of rate spectrum or signal spectrum obtains the spatial orientation information of each mobile terminal；
The acquiring unit, the space orientation of each mobile terminal for obtaining the estimation mode based on power spectrum or signal spectrum
Spatial orientation information of the information as each mobile terminal after calibration.
9. a kind of server, which is characterized in that the server include as described in any one of claim 5 to 8 based on point
The device of cloth MIC array realization pickup.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711375076.2A CN109936798A (en) | 2017-12-19 | 2017-12-19 | The method, apparatus and server of pickup are realized based on distributed MIC array |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711375076.2A CN109936798A (en) | 2017-12-19 | 2017-12-19 | The method, apparatus and server of pickup are realized based on distributed MIC array |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109936798A true CN109936798A (en) | 2019-06-25 |
Family
ID=66983715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711375076.2A Pending CN109936798A (en) | 2017-12-19 | 2017-12-19 | The method, apparatus and server of pickup are realized based on distributed MIC array |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109936798A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005094112A (en) * | 2003-09-12 | 2005-04-07 | Fujitsu Ten Ltd | Performance monitor apparatus, control room speech unit, signal distributor, and studio speech system |
| US20100119072A1 (en) * | 2008-11-10 | 2010-05-13 | Nokia Corporation | Apparatus and method for generating a multichannel signal |
| CN102355748A (en) * | 2010-06-02 | 2012-02-15 | 索尼公司 | Method for determining a processed audio signal and a handheld device |
| US8457328B2 (en) * | 2008-04-22 | 2013-06-04 | Nokia Corporation | Method, apparatus and computer program product for utilizing spatial information for audio signal enhancement in a distributed network environment |
| US20160014490A1 (en) * | 2014-07-08 | 2016-01-14 | Vered Bar Bracha | Apparatus, method and system of communicating acoustic information of a distributed microphone array between mobile devices |
| US20160240211A1 (en) * | 2015-02-12 | 2016-08-18 | Airoha Technology Corp. | Voice enhancement method for distributed system |
| CN205987367U (en) * | 2016-07-06 | 2017-02-22 | 深圳市三诺声智联股份有限公司 | Sound pick up equipment based on distributing type microphone |
| CN106921915A (en) * | 2017-04-03 | 2017-07-04 | 张德明 | A kind of full Wireless Bluetooth stereo sound pick up equipment |
| CN107689910A (en) * | 2016-08-03 | 2018-02-13 | 阿里巴巴集团控股有限公司 | The voice acquisition method and device of multimedia conference system, multimedia conferencing |
-
2017
- 2017-12-19 CN CN201711375076.2A patent/CN109936798A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005094112A (en) * | 2003-09-12 | 2005-04-07 | Fujitsu Ten Ltd | Performance monitor apparatus, control room speech unit, signal distributor, and studio speech system |
| US8457328B2 (en) * | 2008-04-22 | 2013-06-04 | Nokia Corporation | Method, apparatus and computer program product for utilizing spatial information for audio signal enhancement in a distributed network environment |
| US20100119072A1 (en) * | 2008-11-10 | 2010-05-13 | Nokia Corporation | Apparatus and method for generating a multichannel signal |
| CN102355748A (en) * | 2010-06-02 | 2012-02-15 | 索尼公司 | Method for determining a processed audio signal and a handheld device |
| US20160014490A1 (en) * | 2014-07-08 | 2016-01-14 | Vered Bar Bracha | Apparatus, method and system of communicating acoustic information of a distributed microphone array between mobile devices |
| US20160240211A1 (en) * | 2015-02-12 | 2016-08-18 | Airoha Technology Corp. | Voice enhancement method for distributed system |
| CN205987367U (en) * | 2016-07-06 | 2017-02-22 | 深圳市三诺声智联股份有限公司 | Sound pick up equipment based on distributing type microphone |
| CN107689910A (en) * | 2016-08-03 | 2018-02-13 | 阿里巴巴集团控股有限公司 | The voice acquisition method and device of multimedia conference system, multimedia conferencing |
| CN106921915A (en) * | 2017-04-03 | 2017-07-04 | 张德明 | A kind of full Wireless Bluetooth stereo sound pick up equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10560783B2 (en) | Methods, apparatuses and computer program products for facilitating directional audio capture with multiple microphones | |
| JP5543571B2 (en) | System and method for determining head related transfer functions | |
| US9294834B2 (en) | Method and apparatus for reducing noise in voices of mobile terminal | |
| US9479876B2 (en) | Processor-readable medium, apparatus and method for updating a hearing aid | |
| CN111145339B (en) | Image processing method and device, equipment and storage medium | |
| CN103918284B (en) | voice control device, voice control method and program | |
| CN209608862U (en) | The test calibration device of TWS noise cancelling headphone | |
| CN107993672B (en) | Frequency band expanding method and device | |
| US20140108015A1 (en) | Voice converting apparatus and method for converting user voice thereof | |
| CN106611402B (en) | Image processing method and device | |
| CN107155133A (en) | Volume adjusting method, audio-frequency playing terminal and computer-readable recording medium | |
| CN103391503A (en) | Method for determining virtual geographical range | |
| CN103546617A (en) | Voice adjusting method and terminal | |
| CN107889044A (en) | The processing method and processing device of voice data | |
| CN111565410A (en) | Wireless signal quality evaluation method, electronic equipment and system | |
| CN103929692B (en) | Audio information processing method and electronic equipment | |
| CN105188008B (en) | A kind of method and device of testing audio output unit | |
| CN105338605B (en) | A kind of power regulating method and electronic equipment | |
| CN107908456A (en) | A kind of radio reception machine display panel background switching method | |
| CN109936798A (en) | The method, apparatus and server of pickup are realized based on distributed MIC array | |
| CN104571820A (en) | Speaking frame display method, equipment and system | |
| CN104506588B (en) | A kind of method and device for the mobile rehearsal for realizing band | |
| CN110211612A (en) | A kind of recording pen and the way of recording | |
| CN105244037A (en) | Voice signal processing method and device | |
| CN116193321A (en) | Sound signal processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190625 |
|
| RJ01 | Rejection of invention patent application after publication |