WO2002003754A1 - Systeme de reseau de microphones - Google Patents

Systeme de reseau de microphones Download PDF

Info

Publication number
WO2002003754A1
WO2002003754A1 PCT/SG2000/000098 SG0000098W WO0203754A1 WO 2002003754 A1 WO2002003754 A1 WO 2002003754A1 SG 0000098 W SG0000098 W SG 0000098W WO 0203754 A1 WO0203754 A1 WO 0203754A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
microphone array
array system
acoustical
microphones
Prior art date
Application number
PCT/SG2000/000098
Other languages
English (en)
Inventor
Ming Zhang
Hanwu Sun
Changhuai You
Original Assignee
Nanyang Technological University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanyang Technological University filed Critical Nanyang Technological University
Priority to PCT/SG2000/000098 priority Critical patent/WO2002003754A1/fr
Priority to AU2000267447A priority patent/AU2000267447A1/en
Publication of WO2002003754A1 publication Critical patent/WO2002003754A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/401—2D or 3D arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/403—Linear arrays of transducers

Definitions

  • This invention relates to a microphone array system.
  • a microphone is used to acquire a sound.
  • the surrounding environment can largely affect the sound acquisition. Background noises and reverberation of the speaker's voice can degrade the acquisition performance, particularly for a distant-talking.
  • a short range microphone designed for use near the mouth of the speaker such as a headset microphone or hand microphone has been employed.
  • the microphone array system consists of a set of a plurality of microphones which are arranged at spatially different positions, where the desired speaker can be localized and tracked, and noises can be reduced by synthetic processing of outputs of these microphones.
  • the algorithms for reducing noises by microphone array include conventional delay and sum beamforming, broadband adaptive beamforming and match-filtering etc.
  • the delay and sum bearrm ⁇ rming can provide low performance
  • broadband adaptive beamforming needs a lot of computations and is sensitive to the microphone dismatch and microphone position errors
  • match-filtering needs to know the information of the transfer functions between the sound source and microphones in prior.
  • This object is solved by providing a first and a second set of microphones for receiving first and second sets of acoustical signals, an adaptive signal processor, a beamforming circuitry and a steering means.
  • Said adaptive signal processor receives a first set of digital signals resulting from said first set of acoustical signals and outputs both, a localization signal and a processed signal.
  • Said beamforming circuitry receives said localization signal and a second set of digital signals resulting from said second set of acoustical signals and outputs a result signal.
  • Said steering means is controlled by said localization signal and adjusts said second set of microphones into a direction where said first set of acoustical signals comes from.
  • a steering microphone array system which comprises a first array composed of omni- directional microphones and a second array composed of directional microphones, preamplifiers, A/D converters, a D/A converter, a video camera (optionally), a small motor to drive the rotation of the fixed directional microphone array, an adaptive signal processor and beamforming circuitry.
  • Said second array composed of directional microphones is of a fixed beam to its direct look direction or such and it is steered (for example: by rotating) by a steering means like a motor and braces according to the localization obtained from said first array composed of omni-directional microphones.
  • FIG. 1 illustrates a block diagram of the microphone array system of the present invention
  • FIG. 2 illustrates a block diagram of said first array composed of omni-directional microphones
  • FIG. 3 illustrates a block diagram of said second array composed of directional microphones
  • FIG. 4 illustrates a structure diagram of the arrangement of a j ⁇ directional microphone and said motor
  • FIG. 5 illustrates a structure diagram of another arrangement for said second array.
  • FIG. 1 illustrates the block diagram of the microphone array system of the present invention.
  • the system consists of two arrays 1, 2 of microphones.
  • Said first array 1 is composed of m omni-directional microphones OMOl, ..., OMOm and said second array 2 is composed of n directional microphones DM01 , ..., DMOn.
  • a first set of acoustical signals received by said m omni-directional microphones OMOl, ..., OMOm is sent to a first set of signal converting means comprising a first set of m preamplifiers OP01, ..., OPOm and a first set of m A/D converters OA01,..., OAOm and converting said (pre-amplified) first set of acoustical signals to a first set of digital signals xl(i), ..., xm(i).
  • An adaptive signal processor 4 receives said first set of digital signals xl(i), ..., xm(i) and outputs both, a localization signal od(i) and a processed signal oz(i) at first and second output lines 6 and 7, respectively. Said adaptive signal processor 4 determines, whether a voice signal exists, and estimates in a case, where such an acoustical signal exists, from which direction said acoustical signal comes.
  • a second set of acoustical signals (most of these signals originate from the same source ⁇ speaker ⁇ as said first set of acoustical signals) received by said n directional microphones DM01, ..., DMOn is sent to a second set of signal converting means comprising a second set of n preamplifiers DP01, ..., DPOn and a second set of n AID converters DA01, ..., DAOn converting said (preamplified) second set of acoustical signals to a second set of digital signals yl(i) yn(i).
  • a beamforming circuitry 5 receives said second set of digital signals yl(i), ..., yn(i) and said processed signal oz(i) from said second output line 7, and outputs a result signal zz(i) at an output 8. Said result signal zz(i) is then sent to an output means 11 (for instance: to a connector) through a D/A converter 10.
  • a motor 3 (being part of a steering means 2a, 3) is connected to said second array 2, for instance via a brace 2a (said brace 2a also being part of said steering means 2a, 3). Said motor 3 is used to steer a rotation of said second array 2 controlled by said localization signal od(i) from said first output line 6. Said localization signal od (i) from said first output line 6 may, additionally, be used to turn a video camera 9 to focus to the desired speaker.
  • FIG. 2 illustrates a block diagram of said first array 1 composed of said first set of m omni-directional microphones OMOl, ..., OMOm.
  • Said m omni-directional microphones OM01 , ... , OMOm receive said first set of acoustical signals and convert it to a first set of electronic signals.
  • Said first set of electronic signals is amplified by said first set of m preamplifiers OP01, ..., OPOm and then converted to said first set of digital signals xl(i), ..., xm(i) by said first set of m A/D converters OA01, ..., OAOm.
  • a time-delay based localization estimation circuit 42 receives said first set of digital signals xl(i) xm(i) and said detected signal v(i), estimates the localization of the desired speaker (i. e.: the direction, where said first set of acoustical signals comes from), creates and outputs said localization signal od(i) at said first output line 6.
  • a delay and sum beamforming circuit 43 receives said first set of digital signals xl(i), ..., xm(i) and said detected signal v(i), processes a delay and sum beamforming operation and outputs said processed signal oz(i) at said second output line 7.
  • FIG. 3 illustrates a block diagram of said second array 2 composed of said second set of n directional microphones DM01, ..., DMOn. Said n directional microphones DM01
  • DMOn receive said second set of acoustical signals and convert it to a second set of electronic signals.
  • Said second set of electronic signals is amplified by said second set of n preamplifiers DP01 , ... , DPOn and then converted to said second set of digital signals yl(i), ..., yn(i) by said second set of n AID converters, DA01 ..., DAOn.
  • Said processed signal oz(i) from said adaptive signal processor 4, associated with said first array 1 of omni-directional microphones OMOl, ..., OMOm, is delayed at a delay circuit 52 and weighted at a weight circuit 53 to generate a weighted signal ou(i).
  • a fixed look-direction beamforming circuit 51 receives said second set of digital signals yl(i) yn(i) and said weighted signal ou(i) and does beamforming at the look direction (i. e.: the direction or source, where said first set of acoustical signals comes from).
  • Said motor 3 steers said second array 2 into the direction of the desired speaker (i. e., where said first set of acoustical signals comes from) by means of, for example, said braces 2a, controlled by said localization signal od(i) from said first output line 6.
  • Said fixed look-direction beamforming circuit 5 outputs said result signal zz(i).
  • Said result signal zz(i) goes through said D/A converter 10 and then leaves the microphone array system at said output means 11 (which may be a connector) as a final result signal of the microphone array system.
  • FIG. 4 illustrates a structure diagram of the arrangement of one of said directional microphones, for instance microphone DMOj, furtheron called as "f h directional microphone", and said motor 3.
  • Said/ ⁇ directional microphone DMOj is of a directivity pattern DM0j_l which has a main beam and two nulls (in Fig. 4 only one of said nulls is labeled by the word "NULL").
  • Said motor 3 is installed in the direction of one of said nulls of said/' 1 directional microphone DMOj in order to reduce the influence due to the rotating noise of said motor 3 into said A directional microphone DMOj. Another way is to put said motor 3 at the null direction of the whole directivity pattern.
  • FIG. 5 illustrates a structure diagram of another arrangement for said second array 2.
  • said directional microphones DM01, ..., DMOn are positioned along an inner circuit. This arrangement is more suitable for near field applications such as a small room, car, computer workstation or the like.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)

Abstract

Les réseaux de microphones connus à ce jour offrent une sélectivité spatiale présentant un gain plus élevé dans certaines directions et un gain moins élevé ou même nul dans d'autres directions. Dans cette invention, un premier réseau (1) composé de microphones omnidirectionnels (OM01, ..., OM0m) est combiné avec un second réseau (2) composé de microphones directionnels (DM01, ..., DM0n). Un processeur adaptatif de signal (4) est utilisé pour permettre d'obtenir une localisation du haut-parleur souhaité et un signal traité (oz(i)) au moyen d'une opération de mise en forme de faisceaux de somme et de retard. Un moteur (3) est utilisé pour diriger le second réseau (2) vers la localisation du haut-parleur souhaité. Ensuite, un ensemble de circuits de mise en forme de faisceaux (5) est utilisé pour permettre d'obtenir un signal résultat (zz(i)) qui présente un rapport signal-bruit donné.
PCT/SG2000/000098 2000-07-03 2000-07-03 Systeme de reseau de microphones WO2002003754A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/SG2000/000098 WO2002003754A1 (fr) 2000-07-03 2000-07-03 Systeme de reseau de microphones
AU2000267447A AU2000267447A1 (en) 2000-07-03 2000-07-03 Microphone array system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SG2000/000098 WO2002003754A1 (fr) 2000-07-03 2000-07-03 Systeme de reseau de microphones

Publications (1)

Publication Number Publication Date
WO2002003754A1 true WO2002003754A1 (fr) 2002-01-10

Family

ID=20428835

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG2000/000098 WO2002003754A1 (fr) 2000-07-03 2000-07-03 Systeme de reseau de microphones

Country Status (2)

Country Link
AU (1) AU2000267447A1 (fr)
WO (1) WO2002003754A1 (fr)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1349419A2 (fr) * 2002-03-27 2003-10-01 Samsung Electronics Co., Ltd. Système en réseau circulaire et orthogonal de microphones et procédé de détection de la direction tridimensionnelle de la source sonore utilisant ce système
EP1377057A2 (fr) * 2002-06-27 2004-01-02 Microsoft Corporation Détection et poursuite du locuteur utilisant des données audiovisuelles
EP1513345A1 (fr) * 2003-09-05 2005-03-09 Sony Corporation Appareil de communication et appareil de conférence
US8098842B2 (en) 2007-03-29 2012-01-17 Microsoft Corp. Enhanced beamforming for arrays of directional microphones
GB2543276A (en) * 2015-10-12 2017-04-19 Nokia Technologies Oy Distributed audio capture and mixing
GB2543275A (en) * 2015-10-12 2017-04-19 Nokia Technologies Oy Distributed audio capture and mixing
US10051403B2 (en) 2016-02-19 2018-08-14 Nokia Technologies Oy Controlling audio rendering
CN108877828A (zh) * 2017-05-16 2018-11-23 福州瑞芯微电子股份有限公司 语音增强方法/系统、计算机可读存储介质及电子设备
WO2022120051A3 (fr) * 2020-12-03 2022-11-03 Dolby Laboratories Licensing Corporation Orchestration de signaux de modulation à spectre étalé à séquence directe acoustique pour l'estimation d'indicateurs de scène acoustique

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59149494A (ja) * 1983-02-16 1984-08-27 Matsushita Electric Ind Co Ltd マイクロホン装置
EP0820210A2 (fr) * 1997-08-20 1998-01-21 Phonak Ag Procédé électronique pour la formation de faisceaux de signaux acoustiques et dispositif détecteur acoustique
US5793875A (en) * 1996-04-22 1998-08-11 Cardinal Sound Labs, Inc. Directional hearing system
EP1018854A1 (fr) * 1999-01-05 2000-07-12 Oticon A/S Procédé et dispositif pour l' amelioration de l' intelligibilité de la parole

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59149494A (ja) * 1983-02-16 1984-08-27 Matsushita Electric Ind Co Ltd マイクロホン装置
US5793875A (en) * 1996-04-22 1998-08-11 Cardinal Sound Labs, Inc. Directional hearing system
EP0820210A2 (fr) * 1997-08-20 1998-01-21 Phonak Ag Procédé électronique pour la formation de faisceaux de signaux acoustiques et dispositif détecteur acoustique
EP1018854A1 (fr) * 1999-01-05 2000-07-12 Oticon A/S Procédé et dispositif pour l' amelioration de l' intelligibilité de la parole

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 008, no. 281 (E - 286) 21 December 1984 (1984-12-21) *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7158645B2 (en) 2002-03-27 2007-01-02 Samsung Electronics Co., Ltd. Orthogonal circular microphone array system and method for detecting three-dimensional direction of sound source using the same
EP1349419A3 (fr) * 2002-03-27 2003-11-05 Samsung Electronics Co., Ltd. Système en réseau circulaire et orthogonal de microphones et procédé de détection de la direction tridimensionnelle de la source sonore utilisant ce système
EP1349419A2 (fr) * 2002-03-27 2003-10-01 Samsung Electronics Co., Ltd. Système en réseau circulaire et orthogonal de microphones et procédé de détection de la direction tridimensionnelle de la source sonore utilisant ce système
EP1377057A2 (fr) * 2002-06-27 2004-01-02 Microsoft Corporation Détection et poursuite du locuteur utilisant des données audiovisuelles
EP1377057A3 (fr) * 2002-06-27 2004-08-11 Microsoft Corporation Détection et poursuite du locuteur utilisant des données audiovisuelles
US7227566B2 (en) 2003-09-05 2007-06-05 Sony Corporation Communication apparatus and TV conference apparatus
EP1513345A1 (fr) * 2003-09-05 2005-03-09 Sony Corporation Appareil de communication et appareil de conférence
US8098842B2 (en) 2007-03-29 2012-01-17 Microsoft Corp. Enhanced beamforming for arrays of directional microphones
GB2543276A (en) * 2015-10-12 2017-04-19 Nokia Technologies Oy Distributed audio capture and mixing
GB2543275A (en) * 2015-10-12 2017-04-19 Nokia Technologies Oy Distributed audio capture and mixing
US10051403B2 (en) 2016-02-19 2018-08-14 Nokia Technologies Oy Controlling audio rendering
CN108877828A (zh) * 2017-05-16 2018-11-23 福州瑞芯微电子股份有限公司 语音增强方法/系统、计算机可读存储介质及电子设备
CN108877828B (zh) * 2017-05-16 2020-12-08 福州瑞芯微电子股份有限公司 语音增强方法/系统、计算机可读存储介质及电子设备
WO2022120051A3 (fr) * 2020-12-03 2022-11-03 Dolby Laboratories Licensing Corporation Orchestration de signaux de modulation à spectre étalé à séquence directe acoustique pour l'estimation d'indicateurs de scène acoustique

Also Published As

Publication number Publication date
AU2000267447A1 (en) 2002-01-14

Similar Documents

Publication Publication Date Title
JP4799443B2 (ja) 受音装置及びその方法
JP3789685B2 (ja) マイクロホンアレイ装置
US20220400339A1 (en) Endfire linear array microphone
KR101715779B1 (ko) 음원 신호 처리 장치 및 그 방법
EP1116961B1 (fr) Procédé et dispositif de localisation des personnes parlants
US5715319A (en) Method and apparatus for steerable and endfire superdirective microphone arrays with reduced analog-to-digital converter and computational requirements
US8204247B2 (en) Position-independent microphone system
US6668062B1 (en) FFT-based technique for adaptive directionality of dual microphones
US6192134B1 (en) System and method for a monolithic directional microphone array
CA2498444A1 (fr) Orienteur de faisceaux haute precision base sur des diagrammes de rayonnement obtenus par mise en forme de faisceaux fixes
JP4797330B2 (ja) ロボット
JPWO2004034734A1 (ja) アレイ装置および携帯端末
US20050111674A1 (en) Sound pickup method and system with sound source tracking
US11297426B2 (en) One-dimensional array microphone with improved directivity
US10271132B2 (en) Method to dynamically change the directional speakers audio beam and level based on the end user activity
US20160165338A1 (en) Directional audio recording system
WO1999033324A1 (fr) Microphone directionnel numerique et analogique
WO2002003754A1 (fr) Systeme de reseau de microphones
CN110322892B (zh) 一种基于麦克风阵列的语音拾取系统和方法
TW202147862A (zh) 強烈雜訊干擾存在下穩健的揚聲器定位系統與方法
TW200810577A (en) Audio signal input and output apparatus
EP1357543A3 (fr) Compensation du retard d'un dispositif de formation de faisceaux pendant la reconnaissance de la parole mains libres
CN110517704B (zh) 一种基于麦克风阵列波束形成算法的语音处理系统
US20160165339A1 (en) Microphone array and audio source tracking system
JP3154468B2 (ja) 受音方法及びその装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP