WO2006121896A2 - Microphone array based selective sound source listening and video game control - Google Patents

Microphone array based selective sound source listening and video game control Download PDF

Info

Publication number
WO2006121896A2
WO2006121896A2 PCT/US2006/017483 US2006017483W WO2006121896A2 WO 2006121896 A2 WO2006121896 A2 WO 2006121896A2 US 2006017483 W US2006017483 W US 2006017483W WO 2006121896 A2 WO2006121896 A2 WO 2006121896A2
Authority
WO
WIPO (PCT)
Prior art keywords
sound
listening zone
initial
listening
zone
Prior art date
Application number
PCT/US2006/017483
Other languages
English (en)
French (fr)
Other versions
WO2006121896A3 (en
Inventor
Richard L. Marks
Xiadong Mao
Gary M. Zalewski
Original Assignee
Sony Computer Entertainment Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Inc. filed Critical Sony Computer Entertainment Inc.
Priority to JP2008510282A priority Critical patent/JP4886770B2/ja
Priority to EP06752342A priority patent/EP1878013B1/de
Priority to DE602006018897T priority patent/DE602006018897D1/de
Priority to AT06752342T priority patent/ATE491503T1/de
Publication of WO2006121896A2 publication Critical patent/WO2006121896A2/en
Priority to EP07759884A priority patent/EP2012725A4/de
Priority to EP07759872A priority patent/EP2014132A4/de
Priority to PCT/US2007/065701 priority patent/WO2007130766A2/en
Priority to PCT/US2007/065686 priority patent/WO2007130765A2/en
Priority to JP2009509908A priority patent/JP4476355B2/ja
Priority to JP2009509909A priority patent/JP4866958B2/ja
Priority to CN201710222446.2A priority patent/CN107638689A/zh
Priority to CN201210037498.XA priority patent/CN102580314B/zh
Priority to CN200780025400.6A priority patent/CN101484221B/zh
Priority to KR1020087029705A priority patent/KR101020509B1/ko
Priority to PCT/US2007/067010 priority patent/WO2007130793A2/en
Priority to CN201210496712.8A priority patent/CN102989174B/zh
Priority to EP10183502A priority patent/EP2351604A3/de
Priority to PCT/US2007/067005 priority patent/WO2007130792A2/en
Priority to EP07251651A priority patent/EP1852164A3/de
Priority to EP07760947A priority patent/EP2013864A4/de
Priority to JP2009509932A priority patent/JP2009535173A/ja
Priority to PCT/US2007/067324 priority patent/WO2007130819A2/en
Priority to JP2007121964A priority patent/JP4553917B2/ja
Publication of WO2006121896A3 publication Critical patent/WO2006121896A3/en
Priority to JP2009185086A priority patent/JP5465948B2/ja
Priority to JP2010019147A priority patent/JP4833343B2/ja

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/24Constructional details thereof, e.g. game controllers with detachable joystick handles
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0272Voice signal separating
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/424Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/215Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/65Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/105Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals using inertial sensors, e.g. accelerometers, gyroscopes
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1081Input via voice recognition
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A63F2300/1093Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/6063Methods for processing data by generating or executing the game program for sound processing
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/69Involving elements of the real world in the game world, e.g. measurement in live races, real video
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166Microphone arrays; Beamforming

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Computational Linguistics (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Position Input By Displaying (AREA)
  • Stereophonic System (AREA)
  • User Interface Of Digital Computer (AREA)
  • Mechanical Control Devices (AREA)
  • Obtaining Desirable Characteristics In Audible-Bandwidth Transducers (AREA)
PCT/US2006/017483 2005-05-05 2006-05-04 Microphone array based selective sound source listening and video game control WO2006121896A2 (en)

Priority Applications (25)

Application Number Priority Date Filing Date Title
JP2008510282A JP4886770B2 (ja) 2005-05-05 2006-05-04 コンピュータ対話型処理と共に使用する選択的音源聴音
EP06752342A EP1878013B1 (de) 2005-05-05 2006-05-04 Videospielsteuerung mittels Joystick
DE602006018897T DE602006018897D1 (de) 2005-05-05 2006-05-04 Videospielsteuerung mittels Joystick
AT06752342T ATE491503T1 (de) 2005-05-05 2006-05-04 Videospielsteuerung mittels joystick
EP07759884A EP2012725A4 (de) 2006-05-04 2007-03-30 Rauschunterdrückung für eine elektronische vorrichtung mit fernfeldmikrofon auf der konsole
EP07759872A EP2014132A4 (de) 2006-05-04 2007-03-30 Echo- und rauschunterdrückung
PCT/US2007/065701 WO2007130766A2 (en) 2006-05-04 2007-03-30 Narrow band noise reduction for speech enhancement
PCT/US2007/065686 WO2007130765A2 (en) 2006-05-04 2007-03-30 Echo and noise cancellation
JP2009509908A JP4476355B2 (ja) 2006-05-04 2007-03-30 エコー及びノイズキャンセレーション
JP2009509909A JP4866958B2 (ja) 2006-05-04 2007-03-30 コンソール上にファーフィールドマイクロフォンを有する電子装置におけるノイズ除去
CN201210496712.8A CN102989174B (zh) 2006-05-04 2007-04-14 获得用于控制游戏程序的运行的输入
CN200780025400.6A CN101484221B (zh) 2006-05-04 2007-04-14 获得用于控制游戏程序的运行的输入
CN201210037498.XA CN102580314B (zh) 2006-05-04 2007-04-14 获得用于控制游戏程序的运行的输入
CN201710222446.2A CN107638689A (zh) 2006-05-04 2007-04-14 获得用于控制游戏程序的运行的输入
KR1020087029705A KR101020509B1 (ko) 2006-05-04 2007-04-14 프로그램의 실행을 제어하기 위한 입력을 획득하는 방법
PCT/US2007/067010 WO2007130793A2 (en) 2006-05-04 2007-04-14 Obtaining input for controlling execution of a game program
JP2009509932A JP2009535173A (ja) 2006-05-04 2007-04-19 3次元入力制御システム、方法、及び装置
PCT/US2007/067005 WO2007130792A2 (en) 2006-05-04 2007-04-19 System, method, and apparatus for three-dimensional input control
EP10183502A EP2351604A3 (de) 2006-05-04 2007-04-19 Gewinnung von Eingaben zur Steuerung der Ausführung eines Spielprogramms
EP07251651A EP1852164A3 (de) 2006-05-04 2007-04-19 Gewinnung von Eingaben zur Steuerung eines Spielprogramms
EP07760947A EP2013864A4 (de) 2006-05-04 2007-04-19 System, verfahren und vorrichtung zur steuerung dreidimensionaler eingaben
PCT/US2007/067324 WO2007130819A2 (en) 2006-05-04 2007-04-24 Tracking device with sound emitter for use in obtaining information for controlling game program execution
JP2007121964A JP4553917B2 (ja) 2006-05-04 2007-05-02 ゲームプログラムの実行を制御するための入力を取得する方法
JP2009185086A JP5465948B2 (ja) 2006-05-04 2009-08-07 ゲームプログラムの実行を制御するための入力を取得する方法
JP2010019147A JP4833343B2 (ja) 2006-05-04 2010-01-29 エコー及びノイズキャンセレーション

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US67841305P 2005-05-05 2005-05-05
US60/678,413 2005-05-05
US71814505P 2005-09-15 2005-09-15
US60/718,145 2005-09-15

Publications (2)

Publication Number Publication Date
WO2006121896A2 true WO2006121896A2 (en) 2006-11-16
WO2006121896A3 WO2006121896A3 (en) 2007-06-28

Family

ID=36942221

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/017483 WO2006121896A2 (en) 2005-05-05 2006-05-04 Microphone array based selective sound source listening and video game control

Country Status (5)

Country Link
EP (2) EP2352149B1 (de)
JP (1) JP4886770B2 (de)
AT (1) ATE491503T1 (de)
DE (1) DE602006018897D1 (de)
WO (1) WO2006121896A2 (de)

Cited By (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1953735A1 (de) 2007-02-02 2008-08-06 Harman Becker Automotive Systems GmbH System und Verfahren zur Sprachsteuerung
WO2009106918A1 (en) * 2008-02-27 2009-09-03 Sony Ericsson Mobile Communications Ab Electronic devices and methods that adapt filtering of a microphone signal responsive to recognition of a targeted speaker's voice
EP2118840A1 (de) * 2007-03-01 2009-11-18 Sony Computer Entertainment America, Inc. Interaktive und benutzergesteuerte avatar-animationen
US8139793B2 (en) 2003-08-27 2012-03-20 Sony Computer Entertainment Inc. Methods and apparatus for capturing audio signals based on a visual image
US8160269B2 (en) 2003-08-27 2012-04-17 Sony Computer Entertainment Inc. Methods and apparatuses for adjusting a listening area for capturing sounds
US20120115611A1 (en) * 2010-11-10 2012-05-10 Aruze Gaming America, Inc. Gaming machine running common game
US8233642B2 (en) 2003-08-27 2012-07-31 Sony Computer Entertainment Inc. Methods and apparatuses for capturing an audio signal based on a location of the signal
WO2013106133A1 (en) * 2012-01-12 2013-07-18 Qualcomm Incorporated Augmented reality with sound and geometric analysis
WO2014165032A1 (en) * 2013-03-12 2014-10-09 Aawtend, Inc. Integrated sensor-array processor
GB2533373A (en) * 2014-12-18 2016-06-22 Canon Kk Video-based sound source separation
US9530426B1 (en) 2015-06-24 2016-12-27 Microsoft Technology Licensing, Llc Filtering sounds for conferencing applications
US9682320B2 (en) 2002-07-22 2017-06-20 Sony Interactive Entertainment Inc. Inertially trackable hand-held controller
US10049685B2 (en) 2013-03-12 2018-08-14 Aaware, Inc. Integrated sensor-array processor
US10074012B2 (en) 2016-06-17 2018-09-11 Dolby Laboratories Licensing Corporation Sound and video object tracking
US10086282B2 (en) 2002-07-27 2018-10-02 Sony Interactive Entertainment Inc. Tracking device for use in obtaining information for controlling game program execution
US10107676B2 (en) 2014-03-18 2018-10-23 Robert Bosch Gmbh Adaptive acoustic intensity analyzer
US10204638B2 (en) 2013-03-12 2019-02-12 Aaware, Inc. Integrated sensor-array processor
US10220302B2 (en) 2002-07-27 2019-03-05 Sony Interactive Entertainment Inc. Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera
US10367948B2 (en) 2017-01-13 2019-07-30 Shure Acquisition Holdings, Inc. Post-mixing acoustic echo cancellation systems and methods
CN111580049A (zh) * 2020-05-20 2020-08-25 陕西金蝌蚪智能科技有限公司 动态目标声源跟踪监测方法及终端设备
USRE48417E1 (en) 2006-09-28 2021-02-02 Sony Interactive Entertainment Inc. Object direction using video input combined with tilt angle information
WO2021021075A1 (en) 2019-07-26 2021-02-04 Hewlett-Packard Development Company, L.P. Noise filtrations based on radar
US11215709B2 (en) 2017-04-21 2022-01-04 Hewlett-Packard Development Company, L.P. Audio data gather
USD940116S1 (en) 2015-04-30 2022-01-04 Shure Acquisition Holdings, Inc. Array microphone assembly
US11297426B2 (en) 2019-08-23 2022-04-05 Shure Acquisition Holdings, Inc. One-dimensional array microphone with improved directivity
US11297423B2 (en) 2018-06-15 2022-04-05 Shure Acquisition Holdings, Inc. Endfire linear array microphone
US11302347B2 (en) 2019-05-31 2022-04-12 Shure Acquisition Holdings, Inc. Low latency automixer integrated with voice and noise activity detection
US11303981B2 (en) 2019-03-21 2022-04-12 Shure Acquisition Holdings, Inc. Housings and associated design features for ceiling array microphones
US11310596B2 (en) 2018-09-20 2022-04-19 Shure Acquisition Holdings, Inc. Adjustable lobe shape for array microphones
US11438691B2 (en) 2019-03-21 2022-09-06 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition functionality
CN115022716A (zh) * 2022-05-09 2022-09-06 海信视像科技股份有限公司 显示设备、声场调整方法、存储介质和程序产品
US11445294B2 (en) 2019-05-23 2022-09-13 Shure Acquisition Holdings, Inc. Steerable speaker array, system, and method for the same
US11523212B2 (en) 2018-06-01 2022-12-06 Shure Acquisition Holdings, Inc. Pattern-forming microphone array
US11552611B2 (en) 2020-02-07 2023-01-10 Shure Acquisition Holdings, Inc. System and method for automatic adjustment of reference gain
US11558693B2 (en) 2019-03-21 2023-01-17 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition and voice activity detection functionality
US11678109B2 (en) 2015-04-30 2023-06-13 Shure Acquisition Holdings, Inc. Offset cartridge microphones
US11706562B2 (en) 2020-05-29 2023-07-18 Shure Acquisition Holdings, Inc. Transducer steering and configuration systems and methods using a local positioning system
US11785380B2 (en) 2021-01-28 2023-10-10 Shure Acquisition Holdings, Inc. Hybrid audio beamforming system

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8947347B2 (en) 2003-08-27 2015-02-03 Sony Computer Entertainment Inc. Controlling actions in a video game unit
US9393487B2 (en) 2002-07-27 2016-07-19 Sony Interactive Entertainment Inc. Method for mapping movements of a hand-held controller to game commands
US7850526B2 (en) 2002-07-27 2010-12-14 Sony Computer Entertainment America Inc. System for tracking user manipulations within an environment
US8313380B2 (en) 2002-07-27 2012-11-20 Sony Computer Entertainment America Llc Scheme for translating movements of a hand-held controller into inputs for a system
US9174119B2 (en) 2002-07-27 2015-11-03 Sony Computer Entertainement America, LLC Controller for providing inputs to control execution of a program when inputs are combined
EP1806593B1 (de) * 2006-01-09 2008-04-30 Honda Research Institute Europe GmbH Bestimmung des entsprechenden Messfensters zur Schallquellenortung in Echoumgebungen
US8781151B2 (en) 2006-09-28 2014-07-15 Sony Computer Entertainment Inc. Object detection using video input combined with tilt angle information
US8310656B2 (en) 2006-09-28 2012-11-13 Sony Computer Entertainment America Llc Mapping movements of a hand-held controller to the two-dimensional image plane of a display screen
CN102203695B (zh) * 2008-10-27 2015-09-02 索尼电脑娱乐公司 用于传送视觉信息的控制设备
JP5129794B2 (ja) * 2009-08-11 2013-01-30 日本電信電話株式会社 目的信号強調装置とその方法と、プログラム
US9210503B2 (en) * 2009-12-02 2015-12-08 Audience, Inc. Audio zoom
US9838784B2 (en) 2009-12-02 2017-12-05 Knowles Electronics, Llc Directional audio capture
US8798290B1 (en) 2010-04-21 2014-08-05 Audience, Inc. Systems and methods for adaptive signal equalization
US9558755B1 (en) 2010-05-20 2017-01-31 Knowles Electronics, Llc Noise suppression assisted automatic speech recognition
JP6179081B2 (ja) * 2011-09-15 2017-08-16 株式会社Jvcケンウッド ノイズ低減装置、音声入力装置、無線通信装置、およびノイズ低減方法
US9536540B2 (en) 2013-07-19 2017-01-03 Knowles Electronics, Llc Speech signal separation and synthesis based on auditory scene analysis and speech modeling
US9978388B2 (en) 2014-09-12 2018-05-22 Knowles Electronics, Llc Systems and methods for restoration of speech components
DE112016000545B4 (de) 2015-01-30 2019-08-22 Knowles Electronics, Llc Kontextabhängiges schalten von mikrofonen
WO2017163688A1 (en) * 2016-03-24 2017-09-28 Panasonic Intellectual Property Management Co., Ltd. Monitoring system and monitoring method
JP6664119B2 (ja) * 2016-03-24 2020-03-13 パナソニックIpマネジメント株式会社 モニタリングシステム及びモニタリング方法
US9820042B1 (en) 2016-05-02 2017-11-14 Knowles Electronics, Llc Stereo separation and directional suppression with omni-directional microphones
US10911863B2 (en) 2016-09-23 2021-02-02 Apple Inc. Illuminated user interface architecture
JP6755843B2 (ja) 2017-09-14 2020-09-16 株式会社東芝 音響処理装置、音声認識装置、音響処理方法、音声認識方法、音響処理プログラム及び音声認識プログラム
KR20190107623A (ko) * 2019-09-02 2019-09-20 엘지전자 주식회사 사이니지 장치 및 이의 동작 방법

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5335011A (en) * 1993-01-12 1994-08-02 Bell Communications Research, Inc. Sound localization system for teleconferencing using self-steering microphone arrays
EP0652686A1 (de) * 1993-11-05 1995-05-10 AT&T Corp. Adaptive Mikrophongruppierung
EP0867798A2 (de) * 1997-03-26 1998-09-30 International Business Machines Corporation Benutzerschnittstelle für ein Datenverarbeitungssystem
EP1033882A1 (de) * 1998-06-01 2000-09-06 Sony Computer Entertainment Inc. Eingabepositionsmessgerät und unterhaltungssystem
US6173059B1 (en) * 1998-04-24 2001-01-09 Gentner Communications Corporation Teleconferencing system with visual feedback
EP1074934A2 (de) * 1999-08-02 2001-02-07 Lucent Technologies Inc. Rechnereingabegerät mit sechs Freiheitsgraden zur Steuerung der Bewegung eines dreidimensionalen Objektes
US20030063065A1 (en) * 2001-09-11 2003-04-03 Samsung Electronics Co., Ltd. Pointer control method, pointing apparatus, and host apparatus therefor
EP1335338A2 (de) * 2002-02-07 2003-08-13 Microsoft Corporation System und Verfahren zur Steuerung von elektronischen Komponenten in einer Rechnerumgebung
US20030160862A1 (en) * 2002-02-27 2003-08-28 Charlier Michael L. Apparatus having cooperating wide-angle digital camera system and microphone array
US20040047464A1 (en) * 2002-09-11 2004-03-11 Zhuliang Yu Adaptive noise cancelling microphone system
EP1411461A1 (de) * 2002-10-14 2004-04-21 STMicroelectronics S.r.l. Benutzergesteuertes Gerät mit 3D-Bewegungsdetektor
US20040213419A1 (en) * 2003-04-25 2004-10-28 Microsoft Corporation Noise reduction systems and methods for voice applications
EP1489596A1 (de) * 2003-06-17 2004-12-22 Sony Ericsson Mobile Communications AB Verfahren und Vorrichtung zur Sprachaktivitätsdetektion
US20050047611A1 (en) * 2003-08-27 2005-03-03 Xiadong Mao Audio input system

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19540795C2 (de) * 1995-11-02 2003-11-20 Deutsche Telekom Ag Verfahren zur Sprecherlokalisierung mit Hilfe eines Mikrofonarrays
US5892501A (en) * 1996-01-17 1999-04-06 Lg Electronics Inc, Three dimensional wireless pointing device
JP2002007057A (ja) * 2000-06-23 2002-01-11 Shinsedai Kk プロセサ用入力装置
EP1184676B1 (de) * 2000-09-02 2004-05-06 Nokia Corporation Vorrichtung und Verfahren zur Verarbeitung eines Signales emittiert von einer Zielsignalquelle in einer geräuschvollen Umgebung
JP2002091692A (ja) * 2000-09-12 2002-03-29 Seiko Instruments Inc ポインティングシステム
JP4195267B2 (ja) * 2002-03-14 2008-12-10 インターナショナル・ビジネス・マシーンズ・コーポレーション 音声認識装置、その音声認識方法及びプログラム
US7970147B2 (en) 2004-04-07 2011-06-28 Sony Computer Entertainment Inc. Video game controller with noise canceling logic
JP2004192306A (ja) * 2002-12-11 2004-07-08 Nippon Telegr & Teleph Corp <Ntt> 表示位置変更装置、表示位置変更方法、表示位置変更プログラム及びそのプログラムを記録した記録媒体

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5335011A (en) * 1993-01-12 1994-08-02 Bell Communications Research, Inc. Sound localization system for teleconferencing using self-steering microphone arrays
EP0652686A1 (de) * 1993-11-05 1995-05-10 AT&T Corp. Adaptive Mikrophongruppierung
EP0867798A2 (de) * 1997-03-26 1998-09-30 International Business Machines Corporation Benutzerschnittstelle für ein Datenverarbeitungssystem
US6173059B1 (en) * 1998-04-24 2001-01-09 Gentner Communications Corporation Teleconferencing system with visual feedback
EP1033882A1 (de) * 1998-06-01 2000-09-06 Sony Computer Entertainment Inc. Eingabepositionsmessgerät und unterhaltungssystem
EP1074934A2 (de) * 1999-08-02 2001-02-07 Lucent Technologies Inc. Rechnereingabegerät mit sechs Freiheitsgraden zur Steuerung der Bewegung eines dreidimensionalen Objektes
US20030063065A1 (en) * 2001-09-11 2003-04-03 Samsung Electronics Co., Ltd. Pointer control method, pointing apparatus, and host apparatus therefor
EP1335338A2 (de) * 2002-02-07 2003-08-13 Microsoft Corporation System und Verfahren zur Steuerung von elektronischen Komponenten in einer Rechnerumgebung
US20030160862A1 (en) * 2002-02-27 2003-08-28 Charlier Michael L. Apparatus having cooperating wide-angle digital camera system and microphone array
US20040047464A1 (en) * 2002-09-11 2004-03-11 Zhuliang Yu Adaptive noise cancelling microphone system
EP1411461A1 (de) * 2002-10-14 2004-04-21 STMicroelectronics S.r.l. Benutzergesteuertes Gerät mit 3D-Bewegungsdetektor
US20040213419A1 (en) * 2003-04-25 2004-10-28 Microsoft Corporation Noise reduction systems and methods for voice applications
EP1489596A1 (de) * 2003-06-17 2004-12-22 Sony Ericsson Mobile Communications AB Verfahren und Vorrichtung zur Sprachaktivitätsdetektion
US20050047611A1 (en) * 2003-08-27 2005-03-03 Xiadong Mao Audio input system

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
FIALA M ET AL: "A panoramic video and acoustic beamforming sensor for videoconferencing" HAPTIC, AUDIO AND VISUAL ENVIRONMENTS AND THEIR APPLICATIONS, 2004. HAVE 2004. PROCEEDINGS. THE 3RD IEEE INTERNATIONAL WORKSHOP ON OTTAWA, ONT., CANADA 2-3 OCT. 2004, PISCATAWAY, NJ, USA,IEEE, US, 2 October 2004 (2004-10-02), pages 47-52, XP010765301 ISBN: 0-7803-8817-8 *
See also references of EP1878013A2 *
WILSON K W ET AL: "Audio-video array source localization for intelligent environments" 2002 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING. PROCEEDINGS. (ICASSP). ORLANDO, FL, MAY 13 - 17, 2002, IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), NEW YORK, NY : IEEE, US, vol. VOL. 4 OF 4, 13 May 2002 (2002-05-13), pages II-2109, XP010804318 ISBN: 0-7803-7402-9 *

Cited By (65)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9682320B2 (en) 2002-07-22 2017-06-20 Sony Interactive Entertainment Inc. Inertially trackable hand-held controller
US10086282B2 (en) 2002-07-27 2018-10-02 Sony Interactive Entertainment Inc. Tracking device for use in obtaining information for controlling game program execution
US10220302B2 (en) 2002-07-27 2019-03-05 Sony Interactive Entertainment Inc. Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera
US8139793B2 (en) 2003-08-27 2012-03-20 Sony Computer Entertainment Inc. Methods and apparatus for capturing audio signals based on a visual image
US8160269B2 (en) 2003-08-27 2012-04-17 Sony Computer Entertainment Inc. Methods and apparatuses for adjusting a listening area for capturing sounds
US8233642B2 (en) 2003-08-27 2012-07-31 Sony Computer Entertainment Inc. Methods and apparatuses for capturing an audio signal based on a location of the signal
USRE48417E1 (en) 2006-09-28 2021-02-02 Sony Interactive Entertainment Inc. Object direction using video input combined with tilt angle information
EP1953735B1 (de) * 2007-02-02 2010-01-06 Harman Becker Automotive Systems GmbH System und Verfahren zur Sprachsteuerung
EP1953735A1 (de) 2007-02-02 2008-08-06 Harman Becker Automotive Systems GmbH System und Verfahren zur Sprachsteuerung
JP2008191662A (ja) * 2007-02-02 2008-08-21 Harman Becker Automotive Systems Gmbh 音声制御システムおよび音声制御方法
US8666750B2 (en) 2007-02-02 2014-03-04 Nuance Communications, Inc. Voice control system
EP2118840A1 (de) * 2007-03-01 2009-11-18 Sony Computer Entertainment America, Inc. Interaktive und benutzergesteuerte avatar-animationen
EP2118840A4 (de) * 2007-03-01 2010-11-10 Sony Comp Entertainment Us Interaktive und benutzergesteuerte avatar-animationen
US7974841B2 (en) 2008-02-27 2011-07-05 Sony Ericsson Mobile Communications Ab Electronic devices and methods that adapt filtering of a microphone signal responsive to recognition of a targeted speaker's voice
WO2009106918A1 (en) * 2008-02-27 2009-09-03 Sony Ericsson Mobile Communications Ab Electronic devices and methods that adapt filtering of a microphone signal responsive to recognition of a targeted speaker's voice
US9607478B2 (en) * 2010-11-10 2017-03-28 Universal Entertainment Corporation Gaming machine running common game
US20120115611A1 (en) * 2010-11-10 2012-05-10 Aruze Gaming America, Inc. Gaming machine running common game
WO2013106133A1 (en) * 2012-01-12 2013-07-18 Qualcomm Incorporated Augmented reality with sound and geometric analysis
KR102078427B1 (ko) * 2012-01-12 2020-02-17 퀄컴 인코포레이티드 사운드 및 기하학적 분석을 갖는 증강 현실
US9563265B2 (en) 2012-01-12 2017-02-07 Qualcomm Incorporated Augmented reality with sound and geometric analysis
KR20140117369A (ko) * 2012-01-12 2014-10-07 퀄컴 인코포레이티드 사운드 및 기하학적 분석을 갖는 증강 현실
US9443529B2 (en) 2013-03-12 2016-09-13 Aawtend, Inc. Integrated sensor-array processor
WO2014165032A1 (en) * 2013-03-12 2014-10-09 Aawtend, Inc. Integrated sensor-array processor
US9721583B2 (en) 2013-03-12 2017-08-01 Aawtend Inc. Integrated sensor-array processor
US10049685B2 (en) 2013-03-12 2018-08-14 Aaware, Inc. Integrated sensor-array processor
US10204638B2 (en) 2013-03-12 2019-02-12 Aaware, Inc. Integrated sensor-array processor
US10107676B2 (en) 2014-03-18 2018-10-23 Robert Bosch Gmbh Adaptive acoustic intensity analyzer
GB2533373A (en) * 2014-12-18 2016-06-22 Canon Kk Video-based sound source separation
GB2533373B (en) * 2014-12-18 2018-07-04 Canon Kk Video-based sound source separation
US10078785B2 (en) 2014-12-18 2018-09-18 Canon Kabushiki Kaisha Video-based sound source separation
US11832053B2 (en) 2015-04-30 2023-11-28 Shure Acquisition Holdings, Inc. Array microphone system and method of assembling the same
US11310592B2 (en) 2015-04-30 2022-04-19 Shure Acquisition Holdings, Inc. Array microphone system and method of assembling the same
US11678109B2 (en) 2015-04-30 2023-06-13 Shure Acquisition Holdings, Inc. Offset cartridge microphones
USD940116S1 (en) 2015-04-30 2022-01-04 Shure Acquisition Holdings, Inc. Array microphone assembly
WO2016209607A1 (en) * 2015-06-24 2016-12-29 Microsoft Technology Licensing, Llc Filtering sounds for conferencing applications
US9530426B1 (en) 2015-06-24 2016-12-27 Microsoft Technology Licensing, Llc Filtering sounds for conferencing applications
US10127917B2 (en) 2015-06-24 2018-11-13 Microsoft Technology Licensing, Llc Filtering sounds for conferencing applications
US10074012B2 (en) 2016-06-17 2018-09-11 Dolby Laboratories Licensing Corporation Sound and video object tracking
US10367948B2 (en) 2017-01-13 2019-07-30 Shure Acquisition Holdings, Inc. Post-mixing acoustic echo cancellation systems and methods
US11477327B2 (en) 2017-01-13 2022-10-18 Shure Acquisition Holdings, Inc. Post-mixing acoustic echo cancellation systems and methods
US11215709B2 (en) 2017-04-21 2022-01-04 Hewlett-Packard Development Company, L.P. Audio data gather
US11800281B2 (en) 2018-06-01 2023-10-24 Shure Acquisition Holdings, Inc. Pattern-forming microphone array
US11523212B2 (en) 2018-06-01 2022-12-06 Shure Acquisition Holdings, Inc. Pattern-forming microphone array
US11297423B2 (en) 2018-06-15 2022-04-05 Shure Acquisition Holdings, Inc. Endfire linear array microphone
US11770650B2 (en) 2018-06-15 2023-09-26 Shure Acquisition Holdings, Inc. Endfire linear array microphone
US11310596B2 (en) 2018-09-20 2022-04-19 Shure Acquisition Holdings, Inc. Adjustable lobe shape for array microphones
US11438691B2 (en) 2019-03-21 2022-09-06 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition functionality
US11303981B2 (en) 2019-03-21 2022-04-12 Shure Acquisition Holdings, Inc. Housings and associated design features for ceiling array microphones
US11558693B2 (en) 2019-03-21 2023-01-17 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition and voice activity detection functionality
US11778368B2 (en) 2019-03-21 2023-10-03 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition functionality
US11445294B2 (en) 2019-05-23 2022-09-13 Shure Acquisition Holdings, Inc. Steerable speaker array, system, and method for the same
US11800280B2 (en) 2019-05-23 2023-10-24 Shure Acquisition Holdings, Inc. Steerable speaker array, system and method for the same
US11302347B2 (en) 2019-05-31 2022-04-12 Shure Acquisition Holdings, Inc. Low latency automixer integrated with voice and noise activity detection
US11688418B2 (en) 2019-05-31 2023-06-27 Shure Acquisition Holdings, Inc. Low latency automixer integrated with voice and noise activity detection
WO2021021075A1 (en) 2019-07-26 2021-02-04 Hewlett-Packard Development Company, L.P. Noise filtrations based on radar
EP4004593A4 (de) * 2019-07-26 2023-03-29 Hewlett-Packard Development Company, L.P. Rauschfiltrationen auf radarbasis
US11810587B2 (en) 2019-07-26 2023-11-07 Hewlett-Packard Development Company, L.P. Noise filtrations based on radar
US11750972B2 (en) 2019-08-23 2023-09-05 Shure Acquisition Holdings, Inc. One-dimensional array microphone with improved directivity
US11297426B2 (en) 2019-08-23 2022-04-05 Shure Acquisition Holdings, Inc. One-dimensional array microphone with improved directivity
US11552611B2 (en) 2020-02-07 2023-01-10 Shure Acquisition Holdings, Inc. System and method for automatic adjustment of reference gain
CN111580049B (zh) * 2020-05-20 2023-07-14 陕西金蝌蚪智能科技有限公司 动态目标声源跟踪监测方法及终端设备
CN111580049A (zh) * 2020-05-20 2020-08-25 陕西金蝌蚪智能科技有限公司 动态目标声源跟踪监测方法及终端设备
US11706562B2 (en) 2020-05-29 2023-07-18 Shure Acquisition Holdings, Inc. Transducer steering and configuration systems and methods using a local positioning system
US11785380B2 (en) 2021-01-28 2023-10-10 Shure Acquisition Holdings, Inc. Hybrid audio beamforming system
CN115022716A (zh) * 2022-05-09 2022-09-06 海信视像科技股份有限公司 显示设备、声场调整方法、存储介质和程序产品

Also Published As

Publication number Publication date
EP1878013B1 (de) 2010-12-15
ATE491503T1 (de) 2011-01-15
DE602006018897D1 (de) 2011-01-27
EP2352149A2 (de) 2011-08-03
EP2352149B1 (de) 2013-09-04
JP4886770B2 (ja) 2012-02-29
EP2352149A3 (de) 2012-08-29
WO2006121896A3 (en) 2007-06-28
EP1878013A2 (de) 2008-01-16
JP2008542798A (ja) 2008-11-27

Similar Documents

Publication Publication Date Title
EP2352149B1 (de) Selektives Hören von Tonquellen in Verbindung mit computerinteraktiver Verarbeitung
US8947347B2 (en) Controlling actions in a video game unit
US8073157B2 (en) Methods and apparatus for targeted sound detection and characterization
US7783061B2 (en) Methods and apparatus for the targeted sound detection
US7803050B2 (en) Tracking device with sound emitter for use in obtaining information for controlling game program execution
US20110014981A1 (en) Tracking device with sound emitter for use in obtaining information for controlling game program execution
US7760248B2 (en) Selective sound source listening in conjunction with computer interactive processing
US8303405B2 (en) Controller for providing inputs to control execution of a program when inputs are combined
US8233642B2 (en) Methods and apparatuses for capturing an audio signal based on a location of the signal
US8675915B2 (en) System for tracking user manipulations within an environment
US9682320B2 (en) Inertially trackable hand-held controller
KR100985694B1 (ko) 컴퓨터 상호 작용 프로세싱과 관련된 선택적 음원 청취
US8139793B2 (en) Methods and apparatus for capturing audio signals based on a visual image
US8686939B2 (en) System, method, and apparatus for three-dimensional input control
US9174119B2 (en) Controller for providing inputs to control execution of a program when inputs are combined
JP4897666B2 (ja) 音声妨害を検出および除去する方法および装置
WO2007130793A2 (en) Obtaining input for controlling execution of a game program
KR20090007789A (ko) 다중 입력 게임 제어 믹서
WO2007130819A2 (en) Tracking device with sound emitter for use in obtaining information for controlling game program execution
EP1852164A2 (de) Gewinnung von Eingaben zur Steuerung eines Spielprogramms
KR20090017571A (ko) 게임 프로그램의 실행을 제어하기 위한 입력을 획득하는 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2006752342

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2008510282

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: RU