EP2362680A1 - Dispositif électronique pour la réception et la transmission de signaux audio - Google Patents
Dispositif électronique pour la réception et la transmission de signaux audio Download PDFInfo
- Publication number
- EP2362680A1 EP2362680A1 EP10154415A EP10154415A EP2362680A1 EP 2362680 A1 EP2362680 A1 EP 2362680A1 EP 10154415 A EP10154415 A EP 10154415A EP 10154415 A EP10154415 A EP 10154415A EP 2362680 A1 EP2362680 A1 EP 2362680A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- electronic device
- audio signals
- processing unit
- receiving
- background noise
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 81
- 238000004891 communication Methods 0.000 claims abstract description 14
- 238000001914 filtration Methods 0.000 claims abstract description 9
- 238000000034 method Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000002834 transmittance Methods 0.000 description 2
- 206010011878 Deafness Diseases 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000036651 mood Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
- H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
Definitions
- the present invention relates to an electronic device for receiving and transmitting audio signals.
- Such devices are well known in the prior art.
- electronic devices can be embodied as mobile electronic devices, as mobile phones for examples.
- a mobile electronic device for example a mobile phone, comprises a microphone that detects audio signals such as voice data from the caller as well as background noises.
- a processing unit within said electronic device processes those incoming audio signals from said microphone and filters out background noises.
- the remaining audio signals, the voice signals for example, are transmitted to a communication processing unit within said electronic device. From there the remaining audio signals are transmitted to an electronic receiver device, another mobile phone for example.
- DE 100 49 738 A1 discloses an automatic mute switching system, said system using a microphone incorporated in the housing of a mobile audio device or mobile phone, for detection of background noise.
- the switching system is coupled to an electronic noise analysis device, comparing the detected noise with stored sound characteristics. Based on the comparison results a switch can be operated for activating or de-activating the mute control for the loudspeakers in the headset of said mobile device.
- US 2002/0006207 A1 relates to a method of providing a user with information on the operation of a portable device and to a portable device.
- a tone is produced that, due to a tone feature, can be distinguished from background noise.
- This feature can be tone frequency, duration, volume or moment of time.
- the device can analyse background noise automatically, and based on this, it adjusts at least one feature of the tone automatically such that the tone can be distinguished from background noise, and the background noise does not mask out the tone.
- audio processing requires a lot of processing power due to complex and extensive calculations. Furthermore, there are limits to process audio signals that have been detected by only one single microphone.
- the present invention is based on the finding that it is possible to create context related information with regard to existing background noise.
- the present invention relates to the usage of such context related information which is derived from a current audio scene representation.
- an electronic device for receiving and transmitting audio signals, said electronic device comprising a first microphone for detecting audio signals, at least one second microphone for detecting audio signals, a processing unit for receiving said audio signals from the at least two microphones, for processing said audio signals and for filtering out background noise from said audio signals and a communication processing unit for transmitting the remaining audio signals to an electronic receiver device.
- the present invention is directed to an electronic device, said device being capable of receiving and transmitting audio signals.
- audio signals which are transmitted by said electronic device shall comprise background noise.
- a background noise is any sound other than the sound being typical in the field of application of the electronic device.
- Background noise can be a form of noise pollution or interference.
- Examples of background noises are environmental noises such as traffic noise, alarms, people talking, noise from animals, mechanical noise from machines, and the like.
- the electronic device is a mobile electronic device, preferably a mobile phone, a personal digital assistant, a smart phone or the like.
- the audio signals preferably comprise voice signals as well as background noise.
- a first microphone is provided said microphone being adapted for detecting audio signals. Additionally, at least one second microphone for detecting audio signals is provided.
- the present invention is not limited to a specific number of microphones which are arranged within said electronic device.
- Those microphones detect audio signals from the outside of the electronic device.
- audio signals can comprise voice signals, which origin from the user of the mobile device as well as background noise, which origins from the environment the user of the mobile device is located at.
- the electronic device comprises a processing unit for receiving said audio signals from the at least two microphones.
- the processing unit is adapted for processing the audio signals.
- the processing unit is adapted for filtering out background noise from said audio signals.
- the processing unit which can be embodied as a chip for example, processes those incoming audio signals from said microphones and filters out background noises. Therefore, only such audio signals which are typical in the field of application of the electronic device - voice signals in the field of mobile phones for example - are further transmitted by said electronic device.
- the communication processing unit can be formed as a Communication-CPU (CCPU - C-Central Processing Unit)
- the filtered audio signals for example voice signals
- the electronic receiver device is a mobile electronic device, preferably a mobile phone, a personal digital assistant, a smart phone or the like.
- the electronic device comprises at least two microphones which detect audio signals and which transfer said audio signals to a processing unit. Within said processing unit those audio signals are processed by filtering out background noises. The remaining parts of said audio signals, voice signals for example, art transmitted to a remote electronic receiver device.
- the present invention further enables such electronic devices to create and/or use context information which is derived from the current audio scene representation and which can enable new services on top of it.
- the at least two microphones are arranged as a microphone array.
- a microphone array is any number of microphones operating in tandem that means in an arrangement, wherein one microphone is placed behind another.
- an array can consist of unidirectional microphones distributed about the perimeter of a space, said microphones being linked to the processing unit that records and interprets the results into a predetermined form. Arrays may also be formed using numbers of very closely spaced microphones.
- the present invention is not limited to this specific embodiment.
- the processing unit for receiving and processing said audio signals comprises means for analysing the filtered out background noise.
- the processing unit for receiving and processing said audio signals comprises means for analysing the filtered out background noise.
- the electronic device comprises a storage unit for storing said filtered out background noise and/or for storing any generated context information with regard to the background noises.
- the electronic device can comprise an interface to an external storage unit for storing said filtered out background noise.
- the communication processing unit comprises a baseband or the communication processing unit is formed as a baseband.
- a baseband describes a telecommunication system in which information is carried in digital form on a single non-multiplexed signal channel on the transmission medium.
- the processing unit for receiving and processing said audio signals comprises an application interface to an application processing unit.
- the application processing unit can be formed as an application central processing unit (Application-CPU).
- the electronic device according to the present invention provides an extended Interface to the processing unit for receiving and processing said audio signals. Via said application interface it is possible to create extended inquiries with regard to the audio signals and particularly to those background noises that have been detected by said microphones. For that reason, the application interface is preferably linked to an application processing unit which is described in greater detail further below.
- said application interface is formed as an intelligent interface.
- the application interface comprises a data channel.
- the electronic device comprises an application processing unit.
- This processing unit can be formed as an additional central processing unit (CPU). Via said application processing unit and said application interface it is possible for a service to provide said processing unit for receiving and processing said audio signals with specific inquiries.
- CPU central processing unit
- the application interface provides an extended interface. Via said extended interface it is possible to provide said processing unit for receiving and processing said audio signals with specific inquiries. For example, such inquiries can be generated within or by use of said application processing unit. Those inquiries are transmitted via said application interface, a data channel for example, from said application processing unit to said processing unit for receiving and processing said audio signals. For example, it is now possible to determine within said processing unit for receiving and processing said audio signals, where the noise source is located, what kind of noise source the incoming background noises origin from and the like.
- the processing unit for receiving and processing said audio signals and/or the application processing unit is formed as a digital signal processor (DSP).
- DSP digital signal processor
- a digital signal processor is a special-purpose CPU (Central Processing Unit) that provides ultra-fast instruction sequences.
- CPU Central Processing Unit
- digital signal processing is a technique that converts signals from real world sources - usually in analogue format - into digital data that can be further processed. The extension of such DSP solutions with such an application interface allows getting audio context information.
- the electronic device now is capable of removing background noise from audio data, for example from a voice call, so that the called side, the callee, will her the calling side, the caller, clearly and without any background noise.
- background noise for example from a voice call
- a huge amount of processing power is required with regard to non-stationary background noise, in order to perform such calculations in real time.
- sufficient information is available to separate the speaker(s) from the background noise thus that a clear voice can be transmitted.
- the electronic device is enabled to calculate a three-dimensional representation of the environment in real time. For example the processing unit calculates the location of a sound source relatively to the electronic device.
- the electronic device can generate a fingerprint of the environment based on the background sounds, and/or it can calculate the voice characteristics.
- the processing unit for receiving and processing said audio signals of the electronic device and/or the application processing unit comprises means for creating context related information based on the filtered out background noise.
- the electronic device comprises display means for displaying said context related information.
- the technology as implemented within the electronic device according to the present invention enables mobile devices to provide a number of useful services to the user. For example, it can act as a "third ear" for deaf people.
- the electronic device can support the user with visual information of the environment.
- the electronic device can create a warning, for example that a car is passing fast from the side that someone is knocking on the door or the like.
- fingerprinting applications get capable of reacting on the environment, e.g. if someone is near a river, within a traffic jam, in the woods, or the like. And with other voice characteristic information like male/female, angry/in good mood or the like, further personalised applications become accessible.
- the present invention relates to an electronic device for receiving and transmitting audio signals.
- said electronic device comprises a first microphone for detecting audio signals, at least one second microphone for detecting audio signals, a processing unit for receiving said audio signals from the at least two microphones, for processing said audio signals and for filtering out background noise from said audio signals and a communication processing unit for transmitting the remaining audio signals to an electronic receiver device.
- the electronic device further comprises an application interface to an application processing unit, upon which specific inquiries to the processing unit for receiving and processing said audio signals can be generated.
- the mobile device 10 which is a mobile phone, comprises at least two microphones 11, 12, which are arranged as array microphones.
- a processing unit 13 for receiving and processing audio signals in form of a Digital Signal Processor (DSP) processes those incoming signals from microphones 11, 12 and filters out background noises.
- DSP Digital Signal Processor
- the remaining voice signals are transmitted to a communication processing unit 14, a Communication-CPU (CCPU) for example, which is advantageously formed as a baseband. From there the remaining audio signals, the voice signals for example, are transmitted by use of radio transmittance 15 to an electronic receiver device 16.
- CCPU Communication-CPU
- the electronic device 10 comprises an additional application processing unit 20, an Application CPU.
- the electronic device 10 according to the present invention comprises an intelligent application interface (API) 21.
- API application interface
- the electronic device 10 according to the present invention provides an extended interface, API 21 to processing unit 13.
- Said interface 20 can be formed as a data channel.
- API 21 is preferably linked to the additional application processing unit 20.
- a service can provide processing unit 13 with specific inquiries. For example, it is now possible to determine within processing unit 13, where the noise source is located, what kind of noise source the incoming background noises origin from and the like.
Landscapes
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Quality & Reliability (AREA)
- Computational Linguistics (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Telephone Function (AREA)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP10154415A EP2362680A1 (fr) | 2010-02-23 | 2010-02-23 | Dispositif électronique pour la réception et la transmission de signaux audio |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP10154415A EP2362680A1 (fr) | 2010-02-23 | 2010-02-23 | Dispositif électronique pour la réception et la transmission de signaux audio |
Publications (1)
Publication Number | Publication Date |
---|---|
EP2362680A1 true EP2362680A1 (fr) | 2011-08-31 |
Family
ID=42224258
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10154415A Ceased EP2362680A1 (fr) | 2010-02-23 | 2010-02-23 | Dispositif électronique pour la réception et la transmission de signaux audio |
Country Status (1)
Country | Link |
---|---|
EP (1) | EP2362680A1 (fr) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103873980A (zh) * | 2012-12-10 | 2014-06-18 | 联想(北京)有限公司 | 音频处理方法、装置及电子设备 |
CN110832558A (zh) * | 2017-08-02 | 2020-02-21 | 欧姆龙株式会社 | 传感器管理单元、感测数据流通系统、感测数据评价方法和感测数据评价程序 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5727072A (en) * | 1995-02-24 | 1998-03-10 | Nynex Science & Technology | Use of noise segmentation for noise cancellation |
US20020006207A1 (en) | 2000-06-26 | 2002-01-17 | Juha Matero | Portable device and method of providing user with information on operation of portable device |
DE10049738A1 (de) | 2000-09-14 | 2002-06-06 | Mortimer Gierthmuehlen | System zum automatischen Stummschalten von Kopfhörern mobiler Abspielgeräte bzw. mobiler Telefone bei Ertönen vordefinierter Geräusche in der Umgebung |
WO2007120734A2 (fr) * | 2006-04-11 | 2007-10-25 | Noise Free Wireless, Inc. | Réduction et suppression du bruit ambiant pour téléphones cellulaires et dispositifs de communication vocale vocal via internet ou à commutation par paquets (voip) |
-
2010
- 2010-02-23 EP EP10154415A patent/EP2362680A1/fr not_active Ceased
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5727072A (en) * | 1995-02-24 | 1998-03-10 | Nynex Science & Technology | Use of noise segmentation for noise cancellation |
US20020006207A1 (en) | 2000-06-26 | 2002-01-17 | Juha Matero | Portable device and method of providing user with information on operation of portable device |
DE10049738A1 (de) | 2000-09-14 | 2002-06-06 | Mortimer Gierthmuehlen | System zum automatischen Stummschalten von Kopfhörern mobiler Abspielgeräte bzw. mobiler Telefone bei Ertönen vordefinierter Geräusche in der Umgebung |
WO2007120734A2 (fr) * | 2006-04-11 | 2007-10-25 | Noise Free Wireless, Inc. | Réduction et suppression du bruit ambiant pour téléphones cellulaires et dispositifs de communication vocale vocal via internet ou à commutation par paquets (voip) |
Non-Patent Citations (1)
Title |
---|
MICHAEL M P: "Energy awareness for mobile devices", INTERNET CITATION, 2005, XP002376727, Retrieved from the Internet <URL:http://www.cs.helsinki.fi/u/kraatika/Courses/EnergyAwareness2005/Mich ael.pdf> [retrieved on 20060412] * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103873980A (zh) * | 2012-12-10 | 2014-06-18 | 联想(北京)有限公司 | 音频处理方法、装置及电子设备 |
CN110832558A (zh) * | 2017-08-02 | 2020-02-21 | 欧姆龙株式会社 | 传感器管理单元、感测数据流通系统、感测数据评价方法和感测数据评价程序 |
CN110832558B (zh) * | 2017-08-02 | 2022-04-26 | 欧姆龙株式会社 | 传感器管理单元、感测数据流通系统、感测数据评价方法和存储介质 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10553235B2 (en) | Transparent near-end user control over far-end speech enhancement processing | |
US9756422B2 (en) | Noise estimation in a mobile device using an external acoustic microphone signal | |
KR101647974B1 (ko) | 스마트 믹싱 모듈을 갖춘 스마트 이어폰, 스마트 믹싱 모듈을 갖춘 기기, 외부음과 기기음을 혼합하는 방법 및 시스템 | |
CN108521621B (zh) | 信号处理方法、装置、终端、耳机及可读存储介质 | |
EP2278356B1 (fr) | Appareil et procédé de détection de profils d'utilisation de dispositifs mobiles | |
US8762138B2 (en) | Method of editing a noise-database and computer device | |
CN107566658A (zh) | 通话方法、装置、存储介质及移动终端 | |
EP2663059B1 (fr) | Terminal électronique et procédé d'avertissement par sonnerie du terminal électronique | |
KR20140145108A (ko) | 이동 통신 장치에서의 음성 통신 개선방법 및 시스템 | |
EP2996352B1 (fr) | Système et procédé audio utilisant un signal de haut-parleur pour la réduction des bruits de vent | |
CN114363770B (zh) | 通透模式下的滤波方法、装置、耳机以及可读存储介质 | |
CN115482830B (zh) | 语音增强方法及相关设备 | |
EP3240265B1 (fr) | Appareil de traitement de signaux audio | |
US20240096343A1 (en) | Voice quality enhancement method and related device | |
CN112037825B (zh) | 音频信号的处理方法及装置、存储介质 | |
EP2119203A1 (fr) | Commande sélective d'écran pour économiser la batterie | |
CN106685575B (zh) | 一种防止利用手机进行窃听的装置 | |
US20110206219A1 (en) | Electronic device for receiving and transmitting audio signals | |
CN113810828A (zh) | 音频信号处理方法、装置、可读存储介质及耳机 | |
EP2362680A1 (fr) | Dispositif électronique pour la réception et la transmission de signaux audio | |
US20230074554A1 (en) | Hearing aid comprising a user interface | |
WO2015030642A1 (fr) | Réduction de volume pour un dispositif électronique | |
CN113596662A (zh) | 啸叫声的抑制方法、啸叫声的抑制装置、耳机及存储介质 | |
CN116153281A (zh) | 主动降噪的方法及电子设备 | |
CN207518804U (zh) | 用于脖戴式语音交互耳机的远程通讯装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA RS |
|
17P | Request for examination filed |
Effective date: 20111130 |
|
17Q | First examination report despatched |
Effective date: 20120427 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
18R | Application refused |
Effective date: 20140114 |