WO2012105844A1 - Method for enhancing audio performance by selective capturing and processing of audio from a set of microphones - Google Patents
Method for enhancing audio performance by selective capturing and processing of audio from a set of microphones Download PDFInfo
- Publication number
- WO2012105844A1 WO2012105844A1 PCT/NO2011/000044 NO2011000044W WO2012105844A1 WO 2012105844 A1 WO2012105844 A1 WO 2012105844A1 NO 2011000044 W NO2011000044 W NO 2011000044W WO 2012105844 A1 WO2012105844 A1 WO 2012105844A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- microphones
- sound
- recorded
- microphone
- position information
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2430/00—Signal processing covered by H04R, not provided for in its groups
- H04R2430/20—Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
Definitions
- the present invention relates to a method and system for recording sound. More specifically the invention is described by a method and system for enhancing audio performance of sound recorded in a room or an area. Background
- DE-4115576 An example of using several microphones for monitoring a room is shown in DE-4115576 which describes a room surveying system including at least one microphone and a sound recorder.
- the sound recorder is connected to a TV surveying system. Suspicious sound recorded from one or more microphone will trigger an event.
- the microphones are integrated and built into the room, e.g. in the floor, a wall or furniture.
- the present invention uses recordings from a set of microphones in another way, and for another purpose.
- Several microphones are used for enhancing sound recorded in a room or an area. Audio enhancement algorithms of recorded sound from at least two microphones is applied and combined with position information for each microphone. By combining this information it is possible to apply selective and controlled beam forming of the total sound recorded form all microphones in an area or room.
- the present invention describes a method for enhancing audio performance of sound recorded in an area. This is achieved by performing the following steps: - recording sounds received from several microphones comprised in microphone units with transmission means, where the sounds are transferred to a central unit, and said microphones are located at different locations within said area;
- the invention is also described by a system for performing the method described above.
- the idea of the present invention is combining and enhancing audio from a distributed aperture made up of discrete of microphones.
- the inventive method for enhancing audio performance of sound recorded in a room 100 or area is described by performing several steps.
- the first step is recording sounds received from several microphones 110 comprised in microphone units 120 with transmission means.
- these microphone units 120 can be mobile phones comprising one or more microphones 1 10. Improved results will be achieved if more the one microphone 110 in each microphone unit 120 is used.
- the microphone units 120 can be hands free sets, or a combination of mobile phones and hands free sets.
- Other examples of suitable microphone units are laptops, PDAs, and tablets.
- Both mobile phones and hands free sets have wireless means for transmitting information, including recorded sounds from their microphones 110. Recorded sound from all microphones 110 in a room 100 or area is transferred to a central unit 130 that can be located in the same room 100 or area as the microphone units 120, or at a remote location.
- One method for transferring information from said microphone units 120 to the central unit 130 can for instance be by means electromagnetic waves, e.g. WLAN and/or Bluetooth.
- Another method for transferring information from said microphone units 120 to the central unit 130 can be by means of ultrasonic -waves from speakers comprised in said microphone units 120.
- a typical speaker of a cell phone is capable of transmitting ultrasound, i.e. with frequencies above the human audible range.
- Such ultrasonic waves can in one embodiment of the invention be frequency modulated.
- the central unit 130 can be a dedicated unit suitable for the purpose, or it can be one of said mobile phone units 120 acting as a master or central unit by recording sound specific information sent from other microphone units 120, including recordings form its own microphone(s), and then apply suitable algorithms on the recorded sound for processing this and enhancing this information.
- said microphone units 120 should be located at different locations within the room 100 or area.
- the central unit 130 needs to know the position of each microphone in order to perform the inventive method. This is the second step of the method.
- Position information for each microphone unit 120 can be acquired by processing time of arrival of sound, preferably pulsed ultrasound, transmitted from said microphone units 120 equipped with transmission means, i.e. speakers.
- Position information for each microphone unit 120 can also be acquired by different positional registering sensors comprised in the said microphone units 120.
- the third and last step in the inventive method is applying audio enhancement algorithms on the recorded sound, and where this is based on analysis of recorded sound from each microphone 110, together with position information for each microphone 1 10. This information is be used for applying selective audio
- Selective beam forming of the total signal received from all microphones 1 10 is one way of improving sound recorded from a target location within a room 100 or area. If this is used it will be necessary to synchronize the different microphone units 120 in order to get a correct time stamp for the sound to be used by a beam former.
- Sound recorded from each microphone 1 10 and that is to be further processed can be adaptively switched on or of depending on which location in the room 100 or area sound is to be recorded from. In this way unwanted noise etc. at specific locations can be avoided. Recorded sound can be subjected to an adaptive algorithm for removing unwanted noise or performing controlled location specific recordings.
- microphones 1 10 with the 'best' signals can be adaptively switch on or off, or adaptive filtering can be used to attenuate weak and unwanted signals.
- a lecture hall can by placing their mobile phones at disposal contribute to a very efficient and flexible system for collecting optimized and enhanced sound depending on for instance who is speaking.
- a lecturer or coordinator can then be in charge of his or her central unit, e.g. master mobile phone equipped with necessary software for performing the inventive method for enhancing recorded sound.
- the resulting optimized sound can in turn be broadcasted on a PA system for all to hear.
- the inventive method can be applied in real-time, or it can be applied in a post processing process on the total recorded audio signals form all microphones 110 in a room 100 or area.
- the output of a system applying the inventive method is continuous and adaptively optimization for giving the best audio performance for one or more selected sound producing target(s) in a room 100 or area.
Abstract
A method for enhancing audio performance of sound recorded at different positions in a room 100 or area. Audio enhancement algorithms are applied to recorded sound based on analysis of recorded sound from several microphones 110 in the room 100 or area, together with position information of each microphone 110.
Description
Method for enhancing audio performance by selective capturing and processing of audio from a set of microphones:
Introduction
The present invention relates to a method and system for recording sound. More specifically the invention is described by a method and system for enhancing audio performance of sound recorded in a room or an area. Background
Recording of sound for gathering information related to type of sound, level of sound etc. is well known in the art.
It is also well known to use several microphones within an area or room for recording sound specific information that is used for surveillance purposes.
An example of using several microphones for monitoring a room is shown in DE-4115576 which describes a room surveying system including at least one microphone and a sound recorder. The sound recorder is connected to a TV surveying system. Suspicious sound recorded from one or more microphone will trigger an event. The microphones are integrated and built into the room, e.g. in the floor, a wall or furniture.
Another way of using and recording sound from several microphones is described in US-7,231,051B1. This publication describes detection of viewing direction of a person, preferably a person driving a vehicle. The viewing direction derived is based on recording of speech from the person by using several microphones.
The present invention uses recordings from a set of microphones in another way, and for another purpose. Several microphones are used for enhancing sound recorded in a room or an area. Audio enhancement algorithms of recorded sound from at least two microphones is applied and combined with position information for each microphone. By combining this information it is possible to apply selective and controlled beam forming of the total sound recorded form all microphones in an area or room.
Brief description of the invention
The present invention describes a method for enhancing audio performance of sound recorded in an area. This is achieved by performing the following steps:
- recording sounds received from several microphones comprised in microphone units with transmission means, where the sounds are transferred to a central unit, and said microphones are located at different locations within said area;
acquiring position information, for each of said microphones, in said central unit, and
applying audio enhancement algorithms to recorded sound based on analysis of recorded sound from each microphone, and said position information for each microphone.
Further features are defined in the accompanying dependent claims
The invention is also described by a system for performing the method described above.
Detailed description
The present invention will be described in detail with reference to Figure 1.
The idea of the present invention is combining and enhancing audio from a distributed aperture made up of discrete of microphones.
The inventive method for enhancing audio performance of sound recorded in a room 100 or area is described by performing several steps.
The first step is recording sounds received from several microphones 110 comprised in microphone units 120 with transmission means. In one embodiment these microphone units 120 can be mobile phones comprising one or more microphones 1 10. Improved results will be achieved if more the one microphone 110 in each microphone unit 120 is used. In another embodiment the microphone units 120 can be hands free sets, or a combination of mobile phones and hands free sets. Other examples of suitable microphone units are laptops, PDAs, and tablets.
Both mobile phones and hands free sets have wireless means for transmitting information, including recorded sounds from their microphones 110. Recorded sound from all microphones 110 in a room 100 or area is transferred to a central unit 130 that can be located in the same room 100 or area as the microphone units 120, or at a remote location.
One method for transferring information from said microphone units 120 to the central unit 130 can for instance be by means electromagnetic waves, e.g. WLAN and/or Bluetooth.
Another method for transferring information from said microphone units 120 to the central unit 130 can be by means of ultrasonic -waves from speakers comprised in said microphone units 120. A typical speaker of a cell phone is capable of
transmitting ultrasound, i.e. with frequencies above the human audible range. Such ultrasonic waves can in one embodiment of the invention be frequency modulated.
The central unit 130 can be a dedicated unit suitable for the purpose, or it can be one of said mobile phone units 120 acting as a master or central unit by recording sound specific information sent from other microphone units 120, including recordings form its own microphone(s), and then apply suitable algorithms on the recorded sound for processing this and enhancing this information.
In order to achieve good and improved sound recording results in a room 100 or area by use of the inventive method, said microphone units 120 should be located at different locations within the room 100 or area.
Together with sound recordings form each microphone 110, the central unit 130 needs to know the position of each microphone in order to perform the inventive method. This is the second step of the method.
Position information for each microphone unit 120 can be acquired by processing time of arrival of sound, preferably pulsed ultrasound, transmitted from said microphone units 120 equipped with transmission means, i.e. speakers.
Position information for each microphone unit 120 can also be acquired by different positional registering sensors comprised in the said microphone units 120.
Examples of such are accelerometers, gyros, and GPS based systems. The third and last step in the inventive method is applying audio enhancement algorithms on the recorded sound, and where this is based on analysis of recorded sound from each microphone 110, together with position information for each microphone 1 10. This information is be used for applying selective audio
enhancement on the total recorded sounds from the microphones 1 10.
Selective beam forming of the total signal received from all microphones 1 10 is one way of improving sound recorded from a target location within a room 100 or area. If this is used it will be necessary to synchronize the different microphone units 120 in order to get a correct time stamp for the sound to be used by a beam former.
Sound recorded from each microphone 1 10 and that is to be further processed can be adaptively switched on or of depending on which location in the room 100 or area sound is to be recorded from. In this way unwanted noise etc. at specific locations can be avoided. Recorded sound can be subjected to an adaptive algorithm for removing unwanted noise or performing controlled location specific recordings.
In a room 100 with several persons, e.g. in lecture hall, microphones 1 10 with the 'best' signals, depending on who is speaking, can be adaptively switch on or off, or adaptive filtering can be used to attenuate weak and unwanted signals.
People in for instance a lecture hall can by placing their mobile phones at disposal contribute to a very efficient and flexible system for collecting optimized and
enhanced sound depending on for instance who is speaking. A lecturer or coordinator can then be in charge of his or her central unit, e.g. master mobile phone equipped with necessary software for performing the inventive method for enhancing recorded sound. The resulting optimized sound can in turn be broadcasted on a PA system for all to hear.
The inventive method can be applied in real-time, or it can be applied in a post processing process on the total recorded audio signals form all microphones 110 in a room 100 or area.
The output of a system applying the inventive method is continuous and adaptively optimization for giving the best audio performance for one or more selected sound producing target(s) in a room 100 or area.
Claims
1. A method for enhancing audio performance of sound recorded in an area (100), where the method is characterized in the following steps:
a. recording sounds received from several microphones (110) comprised in microphone units (120) with transmission means, where the sounds are transferred to a central unit (130), and said microphones (110) are located at different locations within said area (110);
b. acquiring position information, for each of said microphones (110), in said central unit (130), and
c. applying audio enhancement algorithms to recorded sound based on analysis of recorded sound from each microphone (110), and said position information for each microphone (110).
A method according to claim 1,
characterized in that the position information is the relative position between the microphones (110).
A method according to claim 1,
characterized in that the microphones (110) are the microphones (110) of mobile phones.
A method according to claim 1,
characterized in that the microphones (110) are the microphones (110) of hands free sets.
A method according to claim 1 ,
characterized in that the microphones (110) are the microphones (110) of laptops, PDAs, and/or tablet computers.
A method according to claim 1,
characterized in that the microphones (110) are the microphones (110) in at least two of the following devices: mobile phones, hands free sets, laptops, PDAs, and/or tablets.
7. A method according to claim 1,
characterized in that the central unit (130) is one of the following devices: mobile phones, hands free sets, laptops, PDAs, or tablets.
8. A method according to claim 1,
characterized in that the sound recorded is transferred to the central unit (130) via electromagnetic waves.
9. A method according to claim 1 ,
characterized in that the sound recorded is transferred to the central unit via ultrasonic waves.
10. A method according to claim 1,
characterized in that the position information is acquired by processing time of arrival of sound transmitted from said microphone units (120) with transmission means.
11. A method according to claim 1 ,
characterized in that the position information is acquired by sensors comprised in the said microphone units (120).
12. A method according to claim 1,
characterized in that the audio enhancement applied is beam forming of the total signal received from all microphones (100).
13. A method according to claim 1 ,
characterized in that sound recorded from each microphone (110) and further processed is adaptively switched on or of depending on which location sound is to be recorded from.
14. A method according to claim 1,
characterized in that sound recorded from each microphone (11 and further processed is subjected to an adaptive algorithm to remove unwanted noise.
15. A system for performing the method according to claims 1-14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/NO2011/000044 WO2012105844A1 (en) | 2011-02-03 | 2011-02-03 | Method for enhancing audio performance by selective capturing and processing of audio from a set of microphones |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/NO2011/000044 WO2012105844A1 (en) | 2011-02-03 | 2011-02-03 | Method for enhancing audio performance by selective capturing and processing of audio from a set of microphones |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2012105844A1 true WO2012105844A1 (en) | 2012-08-09 |
Family
ID=44625246
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/NO2011/000044 WO2012105844A1 (en) | 2011-02-03 | 2011-02-03 | Method for enhancing audio performance by selective capturing and processing of audio from a set of microphones |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2012105844A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013170016A1 (en) * | 2012-05-09 | 2013-11-14 | The Regents Of The University Of California | Light-emitting diodes with low temperature dependence |
| US9823893B2 (en) | 2015-07-15 | 2017-11-21 | International Business Machines Corporation | Processing of voice conversations using network of computing devices |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE4115576A1 (en) | 1991-05-13 | 1992-11-19 | Matthias Wendtland | Room monitor for counting and treasury rooms e.g. in bank - combines TV monitoring with acoustic monitoring using microphones in room and sound records associated with them |
| US7231051B2 (en) | 2002-04-17 | 2007-06-12 | Daimlerchrysler Ag | Detection of viewing direction by microphone |
| US20080170717A1 (en) * | 2007-01-16 | 2008-07-17 | Microsoft Corporation | Energy-based sound source localization and gain normalization |
-
2011
- 2011-02-03 WO PCT/NO2011/000044 patent/WO2012105844A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE4115576A1 (en) | 1991-05-13 | 1992-11-19 | Matthias Wendtland | Room monitor for counting and treasury rooms e.g. in bank - combines TV monitoring with acoustic monitoring using microphones in room and sound records associated with them |
| US7231051B2 (en) | 2002-04-17 | 2007-06-12 | Daimlerchrysler Ag | Detection of viewing direction by microphone |
| US20080170717A1 (en) * | 2007-01-16 | 2008-07-17 | Microsoft Corporation | Energy-based sound source localization and gain normalization |
Non-Patent Citations (2)
| Title |
|---|
| BEN C. DALTON AND V. MICHAEL BOVE JR.: "Audio-Based Self-Localization for Ubiquitous Sensor Networks", 118TH CONVENTION OF THE AUDIO ENGINEERING SOCIETY, 28 May 2005 (2005-05-28) - 31 May 2005 (2005-05-31), pages 1 - 7, XP040372674 * |
| KOZINTSEV I ET AL: "Position Calibration of Microphones and Loudspeakers in Distributed Computing Platforms", IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 13, no. 1, 1 January 2005 (2005-01-01), pages 70 - 83, XP011123587, ISSN: 1063-6676, DOI: 10.1109/TSA.2004.838540 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013170016A1 (en) * | 2012-05-09 | 2013-11-14 | The Regents Of The University Of California | Light-emitting diodes with low temperature dependence |
| US9823893B2 (en) | 2015-07-15 | 2017-11-21 | International Business Machines Corporation | Processing of voice conversations using network of computing devices |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9226070B2 (en) | Directional sound source filtering apparatus using microphone array and control method thereof | |
| US9613610B2 (en) | Directional sound masking | |
| CN103733602B (en) | System and method for muting audio associated with a source | |
| US8090117B2 (en) | Microphone array and digital signal processing system | |
| US10075801B2 (en) | Information processing system and storage medium | |
| WO2014161309A1 (en) | Method and apparatus for mobile terminal to implement voice source tracking | |
| EP2882203A1 (en) | Hearing aid device for hands free communication | |
| WO2015039439A1 (en) | Audio signal processing method and device, and differential beamforming method and device | |
| CN106797512A (en) | Multi-source noise suppressed | |
| EP2835986B1 (en) | Hearing device with input transducer and wireless receiver | |
| JP2008543143A (en) | Acoustic transducer assembly, system and method | |
| JP2008543144A (en) | Acoustic signal apparatus, system, and method | |
| EP4254979A1 (en) | Active noise reduction method, device and system | |
| EP4358537A2 (en) | Directional sound modification | |
| CN107124647A (en) | A kind of panoramic video automatically generates the method and device of subtitle file when recording | |
| JP3632099B2 (en) | Robot audio-visual system | |
| JP2011077649A (en) | Sound collecting device, gain control method, and program | |
| CN115482830A (en) | Speech enhancement method and related equipment | |
| CN117480554A (en) | Voice enhancement method and related equipment | |
| JP2014206683A (en) | Silencer, and silencing method | |
| WO2012105844A1 (en) | Method for enhancing audio performance by selective capturing and processing of audio from a set of microphones | |
| WO2013170802A1 (en) | Method and device for improving call voice quality of mobile terminal | |
| EP4250765A1 (en) | A hearing system comprising a hearing aid and an external processing device | |
| CN109511070A (en) | A kind of hearing aid gain processing method | |
| CN207039828U (en) | A kind of earphone with source of sound identification and positioning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11706041 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 11706041 Country of ref document: EP Kind code of ref document: A1 |