WO2008041878A3 - System and procedure of hands free speech communication using a microphone array - Google Patents

System and procedure of hands free speech communication using a microphone array Download PDF

Info

Publication number
WO2008041878A3
WO2008041878A3 PCT/RS2007/000017 RS2007000017W WO2008041878A3 WO 2008041878 A3 WO2008041878 A3 WO 2008041878A3 RS 2007000017 W RS2007000017 W RS 2007000017W WO 2008041878 A3 WO2008041878 A3 WO 2008041878A3
Authority
WO
WIPO (PCT)
Prior art keywords
speaker
microphone array
procedure
room
signal
Prior art date
Application number
PCT/RS2007/000017
Other languages
French (fr)
Other versions
WO2008041878A2 (en
Inventor
Zoran Saric
Slobodan Jovicic
Vladimir Kovacevic
Nikola Teslic
Dragan Kukolj
Original Assignee
Micronas Nit
Zoran Saric
Slobodan Jovicic
Vladimir Kovacevic
Nikola Teslic
Dragan Kukolj
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Micronas Nit, Zoran Saric, Slobodan Jovicic, Vladimir Kovacevic, Nikola Teslic, Dragan Kukolj filed Critical Micronas Nit
Publication of WO2008041878A2 publication Critical patent/WO2008041878A2/en
Publication of WO2008041878A3 publication Critical patent/WO2008041878A3/en

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
    • G01S3/80—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using ultrasonic, sonic or infrasonic waves
    • G01S3/8006—Multi-channel systems specially adapted for direction-finding, i.e. having a single aerial system capable of giving simultaneous indications of the directions of different signals
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166—Microphone arrays; Beamforming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Telephone Function (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention relates to the system and procedure for hand-free voice communication in video-phone or teleconference using a microphone array, whose main purpose is to make a quality recording of speaker in room, in the situation of larger expansion, with presence noise, with acoustic echo, produced by distance speaker and TV program, room reverberation and movement of the speaker in room. System contains: digital TV receiver and digital camera for picture reproduction and shooting, respectively, stereo loudspeakers and microphone array for sound reproduction and recording, respectively, amplifier and acquisition module for audio signals and DSP for acoustic signal processing. The procedure for microphone signal processing is done in frequency domain and it contains: acoustic echo suppression made of two signals: far-end speaker signal and stereo TV signal, acoustic spatial filtering of near-end speaker in accordance with noise sources and room reverberation, based on adaptive characteristic of microphone array directivity, of speaker localization in horizontal plane, of suppression of all residual noises and adaptive gain control of transmitting signal.
PCT/RS2007/000017 2006-10-04 2007-09-19 System and procedure of hands free speech communication using a microphone array WO2008041878A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
RSP-2006/0551 2006-10-04
RSP-2006/0551A RS49875B (en) 2006-10-04 2006-10-04 System and technique for hands-free voice communication using microphone array

Publications (2)

Publication Number Publication Date
WO2008041878A2 WO2008041878A2 (en) 2008-04-10
WO2008041878A3 true WO2008041878A3 (en) 2009-02-19

Family

ID=39268910

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/RS2007/000017 WO2008041878A2 (en) 2006-10-04 2007-09-19 System and procedure of hands free speech communication using a microphone array

Country Status (2)

Country Link
RS (1) RS49875B (en)
WO (1) WO2008041878A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8981994B2 (en) 2011-09-30 2015-03-17 Skype Processing signals
US9269367B2 (en) 2011-07-05 2016-02-23 Skype Limited Processing audio signals during a communication event
CN109151370A (en) * 2018-09-21 2019-01-04 上海赛连信息科技有限公司 Intelligent video system and control of intelligent terminal

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2146519B1 (en) * 2008-07-16 2012-06-06 Nuance Communications, Inc. Beamforming pre-processing for speaker localization
JP5386936B2 (en) * 2008-11-05 2014-01-15 ヤマハ株式会社 Sound emission and collection device
US9215527B1 (en) 2009-12-14 2015-12-15 Cirrus Logic, Inc. Multi-band integrated speech separating microphone array processor with adaptive beamforming
US8861756B2 (en) 2010-09-24 2014-10-14 LI Creative Technologies, Inc. Microphone array system
US8811601B2 (en) 2011-04-04 2014-08-19 Qualcomm Incorporated Integrated echo cancellation and noise suppression
JP6064159B2 (en) * 2011-07-11 2017-01-25 パナソニックＩｐマネジメント株式会社 Echo cancellation apparatus, conference system using the same, and echo cancellation method
GB2495472B (en) 2011-09-30 2019-07-03 Skype Processing audio signals
GB2495129B (en) 2011-09-30 2017-07-19 Skype Processing signals
GB2495278A (en) 2011-09-30 2013-04-10 Skype Processing received signals from a range of receiving angles to reduce interference
GB2495128B (en) 2011-09-30 2018-04-04 Skype Processing signals
GB2495130B (en) 2011-09-30 2018-10-24 Skype Processing audio signals
CN102968999B (en) * 2011-11-18 2015-04-22 斯凯普公司 Audio signal processing
GB2496660B (en) 2011-11-18 2014-06-04 Skype Processing audio signals
GB201120392D0 (en) 2011-11-25 2012-01-11 Skype Ltd Processing signals
GB2497343B (en) 2011-12-08 2014-11-26 Skype Processing audio signals
TWI466108B (en) * 2012-07-31 2014-12-21 Acer Inc Audio processing method and audio processing device
EP2747451A1 (en) * 2012-12-21 2014-06-25 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Filter and method for informed spatial filtering using multiple instantaneous direction-of-arrivial estimates
US10567901B2 (en) * 2014-09-30 2020-02-18 Apple Inc. Method to determine loudspeaker change of placement
KR20170035504A (en) 2015-09-23 2017-03-31 삼성전자주식회사 Electronic device and method of audio processing thereof
CN110099328B (en) * 2018-01-31 2024-03-29 北京塞宾科技有限公司 Intelligent sound box
CN109147813A (en) * 2018-09-21 2019-01-04 神思电子技术股份有限公司 A kind of service robot noise-reduction method based on audio-visual location technology
CN110366017A (en) * 2019-06-06 2019-10-22 深圳康佳电子科技有限公司 A kind of smart television voice cam device and intelligent TV set
CN110223690A (en) * 2019-06-10 2019-09-10 深圳永顺智信息科技有限公司 The man-machine interaction method and device merged based on image with voice
CN110956969B (en) * 2019-11-28 2022-06-10 北京达佳互联信息技术有限公司 Live broadcast audio processing method and device, electronic equipment and storage medium
CN111161751A (en) * 2019-12-25 2020-05-15 声耕智能科技(西安)研究院有限公司 Distributed microphone pickup system and method under complex scene
CN113470682B (en) * 2021-06-16 2023-11-24 中科上声（苏州）电子有限公司 Method, device and storage medium for estimating speaker azimuth by microphone array

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5305307A (en) * 1991-01-04 1994-04-19 Picturetel Corporation Adaptive acoustic echo canceller having means for reducing or eliminating echo in a plurality of signal bandwidths
US5550924A (en) * 1993-07-07 1996-08-27 Picturetel Corporation Reduction of background noise for speech enhancement
EP0762751A2 (en) * 1995-08-24 1997-03-12 Hitachi, Ltd. Television receiver
US5715319A (en) * 1996-05-30 1998-02-03 Picturetel Corporation Method and apparatus for steerable and endfire superdirective microphone arrays with reduced analog-to-digital converter and computational requirements
US6483532B1 (en) * 1998-07-13 2002-11-19 Netergy Microelectronics, Inc. Video-assisted audio signal processing system and method
WO2003043327A1 (en) * 2001-11-13 2003-05-22 Koninklijke Philips Electronics N.V. A system and method for providing an awareness of remote people in the room during a videoconference
US6593956B1 (en) * 1998-05-15 2003-07-15 Polycom, Inc. Locating an audio source
WO2004017303A1 (en) * 2002-08-16 2004-02-26 Dspfactory Ltd. Method and system for processing subband signals using adaptive filters
US20040252850A1 (en) * 2003-04-24 2004-12-16 Lorenzo Turicchia System and method for spectral enhancement employing compression and expansion
WO2006028587A2 (en) * 2004-07-22 2006-03-16 Softmax, Inc. Headset for separation of speech signals in a noisy environment
US20060132595A1 (en) * 2004-10-15 2006-06-22 Kenoyer Michael L Speakerphone supporting video and audio features

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5305307A (en) * 1991-01-04 1994-04-19 Picturetel Corporation Adaptive acoustic echo canceller having means for reducing or eliminating echo in a plurality of signal bandwidths
US5550924A (en) * 1993-07-07 1996-08-27 Picturetel Corporation Reduction of background noise for speech enhancement
EP0762751A2 (en) * 1995-08-24 1997-03-12 Hitachi, Ltd. Television receiver
US5715319A (en) * 1996-05-30 1998-02-03 Picturetel Corporation Method and apparatus for steerable and endfire superdirective microphone arrays with reduced analog-to-digital converter and computational requirements
US6593956B1 (en) * 1998-05-15 2003-07-15 Polycom, Inc. Locating an audio source
US6483532B1 (en) * 1998-07-13 2002-11-19 Netergy Microelectronics, Inc. Video-assisted audio signal processing system and method
WO2003043327A1 (en) * 2001-11-13 2003-05-22 Koninklijke Philips Electronics N.V. A system and method for providing an awareness of remote people in the room during a videoconference
WO2004017303A1 (en) * 2002-08-16 2004-02-26 Dspfactory Ltd. Method and system for processing subband signals using adaptive filters
US20040252850A1 (en) * 2003-04-24 2004-12-16 Lorenzo Turicchia System and method for spectral enhancement employing compression and expansion
WO2006028587A2 (en) * 2004-07-22 2006-03-16 Softmax, Inc. Headset for separation of speech signals in a noisy environment
US20060132595A1 (en) * 2004-10-15 2006-06-22 Kenoyer Michael L Speakerphone supporting video and audio features

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9269367B2 (en) 2011-07-05 2016-02-23 Skype Limited Processing audio signals during a communication event
US8981994B2 (en) 2011-09-30 2015-03-17 Skype Processing signals
CN109151370A (en) * 2018-09-21 2019-01-04 上海赛连信息科技有限公司 Intelligent video system and control of intelligent terminal
CN109151370B (en) * 2018-09-21 2020-10-23 上海赛连信息科技有限公司 Intelligent video system and intelligent control terminal

Also Published As

Publication number Publication date
WO2008041878A2 (en) 2008-04-10
RS49875B (en) 2008-08-07
RS20060551A (en) 2007-06-04

Similar Documents

Publication Publication Date Title
WO2008041878A3 (en) System and procedure of hands free speech communication using a microphone array
US9226068B2 (en) Coordinated gain control in adaptive noise cancellation (ANC) for earspeakers
AU2013239736B2 (en) Pre-shaping series filter for active noise cancellation adaptive filter
JP4202640B2 (en) Short range wireless communication headset, communication system using the same, and acoustic processing method in short range wireless communication
CA2560034C (en) System for selectively extracting components of an audio input signal
US20060147063A1 (en) Echo cancellation in telephones with multiple microphones
US11373665B2 (en) Voice isolation system
NO20045702L (en) Audio System
CA2539798A1 (en) A method to reduce training time of an acoustic echo canceller in a full-duplex beamforming-based audio conferencing system
KR20100022492A (en) Sound signal processor and delay time setting method
PT1745637E (en) Conference terminal comprising echo reduction for a voice conferencing system
WO2018010375A1 (en) Method and device for realising karaoke function through earphone, and earphone
JPH09503889A (en) Voice canceling transmission system
KR20190118528A (en) Sound-processing apparatus and sound-processing method
US8923530B2 (en) Speakerphone feedback attenuation
JP5082878B2 (en) Audio conferencing equipment
US10643597B2 (en) Method and device for generating and providing an audio signal for enhancing a hearing impression at live events
JP2012151745A (en) Stereo head set
JP3314730B2 (en) Audio playback device and communication conference device
JP2003533110A (en) Audio system
Adcock et al. Practical issues in the use of a frequency‐domain delay estimator for microphone‐array applications
US11637932B2 (en) Method for optimizing speech pickup in a speakerphone system
Goldin Close talking autodirective dual microphone
CN113038315A (en) Voice signal processing method and device
Nordholm et al. Hands‐free mobile telephony by means of an adaptive microphone array

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07834923

Country of ref document: EP

Kind code of ref document: A2

122 Ep: pct application non-entry in european phase

Ref document number: 07834923

Country of ref document: EP

Kind code of ref document: A2