TW200708328A - Selective sound source listening in conjunction with computer interactive processing - Google Patents

Selective sound source listening in conjunction with computer interactive processing

Info

Publication number
TW200708328A
TW200708328A TW095115769A TW95115769A TW200708328A TW 200708328 A TW200708328 A TW 200708328A TW 095115769 A TW095115769 A TW 095115769A TW 95115769 A TW95115769 A TW 95115769A TW 200708328 A TW200708328 A TW 200708328A
Authority
TW
Taiwan
Prior art keywords
sound
conjunction
sound source
capture unit
interactive processing
Prior art date
Application number
TW095115769A
Other languages
Chinese (zh)
Other versions
TWI308080B (en
Inventor
Richard Marks
Xia-Dong Mao
Original Assignee
Sony Computer Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Inc filed Critical Sony Computer Entertainment Inc
Publication of TW200708328A publication Critical patent/TW200708328A/en
Application granted granted Critical
Publication of TWI308080B publication Critical patent/TWI308080B/en

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00—Monitoring arrangements; Testing arrangements
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1081—Input via voice recognition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A63F2300/1093—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera using visible light
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6063—Methods for processing data by generating or executing the game program for sound processing
    • A63F2300/6072—Methods for processing data by generating or executing the game program for sound processing of an input signal, e.g. pitch and rhythm extraction, voice recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Stereophonic System (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A method and apparatus for capturing image and sound during interactivity with a computer program is provided. The apparatus includes an image capture unit that is configured to capture one or more image frames. Also provided is a sound capture unit. The sound capture unit is configured to identify one or more sound sources. The sound capture unit generates data capable of being analyzed to determine a zone of focus at which to process sound to the substantial exclusion of sounds outside of the zone of focus. In this manner, sound that is captured and processed for the zone of focus is used for interactivity with the computer program.
TW095115769A 2005-05-05 2006-05-03 Apparatus for capturing image and sound during interactivity with a computer program, method for selective sound source listening during interactivity with a computer program, and game system TWI308080B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US67841305P 2005-05-05 2005-05-05

Publications (2)

Publication Number Publication Date
TW200708328A true TW200708328A (en) 2007-03-01
TWI308080B TWI308080B (en) 2009-04-01

Family

ID=36721197

Family Applications (1)

Application Number Title Priority Date Filing Date
TW095115769A TWI308080B (en) 2005-05-05 2006-05-03 Apparatus for capturing image and sound during interactivity with a computer program, method for selective sound source listening during interactivity with a computer program, and game system

Country Status (6)

Country Link
EP (1) EP1877149A1 (en)
JP (1) JP5339900B2 (en)
KR (1) KR100985694B1 (en)
CN (1) CN101132839B (en)
TW (1) TWI308080B (en)
WO (1) WO2006121681A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8323106B2 (en) 2008-05-30 2012-12-04 Sony Computer Entertainment America Llc Determination of controller three-dimensional location using image analysis and ultrasonic communication
TWI404967B (en) * 2007-10-19 2013-08-11 Chi Mei Comm Systems Inc System and method for locating sound sources

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8947347B2 (en) 2003-08-27 2015-02-03 Sony Computer Entertainment Inc. Controlling actions in a video game unit
US7783061B2 (en) 2003-08-27 2010-08-24 Sony Computer Entertainment Inc. Methods and apparatus for the targeted sound detection
US7809145B2 (en) 2006-05-04 2010-10-05 Sony Computer Entertainment Inc. Ultra small microphone array
US8073157B2 (en) 2003-08-27 2011-12-06 Sony Computer Entertainment Inc. Methods and apparatus for targeted sound detection and characterization
US8139793B2 (en) 2003-08-27 2012-03-20 Sony Computer Entertainment Inc. Methods and apparatus for capturing audio signals based on a visual image
US7803050B2 (en) 2002-07-27 2010-09-28 Sony Computer Entertainment Inc. Tracking device with sound emitter for use in obtaining information for controlling game program execution
US9174119B2 (en) 2002-07-27 2015-11-03 Sony Computer Entertainement America, LLC Controller for providing inputs to control execution of a program when inputs are combined
WO2006037014A2 (en) 2004-09-27 2006-04-06 Nielsen Media Research, Inc. Methods and apparatus for using location information to manage spillover in an audience monitoring system
EP1880866A1 (en) 2006-07-19 2008-01-23 Sicpa Holding S.A. Oriented image coating on transparent substrate
WO2009021124A2 (en) * 2007-08-07 2009-02-12 Dna Digital Media Group System and method for a motion sensing amusement device
US8953029B2 (en) * 2009-05-08 2015-02-10 Sony Computer Entertainment America Llc Portable device interaction via motion sensitive controller
CN101819758B (en) * 2009-12-22 2013-01-16 中兴通讯股份有限公司 System of controlling screen display by voice and implementation method
US9196238B2 (en) 2009-12-24 2015-11-24 Nokia Technologies Oy Audio processing based on changed position or orientation of a portable mobile electronic apparatus
US8855101B2 (en) 2010-03-09 2014-10-07 The Nielsen Company (Us), Llc Methods, systems, and apparatus to synchronize actions of audio source monitors
US8885842B2 (en) 2010-12-14 2014-11-11 The Nielsen Company (Us), Llc Methods and apparatus to determine locations of audience members
KR101575121B1 (en) * 2011-12-19 2015-12-07 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 Pause and resume schemes for gesture-based game
US9563265B2 (en) * 2012-01-12 2017-02-07 Qualcomm Incorporated Augmented reality with sound and geometric analysis
US9087403B2 (en) * 2012-07-26 2015-07-21 Qualcomm Incorporated Maintaining continuity of augmentations
US9021516B2 (en) 2013-03-01 2015-04-28 The Nielsen Company (Us), Llc Methods and systems for reducing spillover by measuring a crest factor
US9118960B2 (en) 2013-03-08 2015-08-25 The Nielsen Company (Us), Llc Methods and systems for reducing spillover by detecting signal distortion
US9191704B2 (en) 2013-03-14 2015-11-17 The Nielsen Company (Us), Llc Methods and systems for reducing crediting errors due to spillover using audio codes and/or signatures
US9197930B2 (en) * 2013-03-15 2015-11-24 The Nielsen Company (Us), Llc Methods and apparatus to detect spillover in an audience monitoring system
US9247273B2 (en) 2013-06-25 2016-01-26 The Nielsen Company (Us), Llc Methods and apparatus to characterize households with media meter data
CN104422922A (en) * 2013-08-19 2015-03-18 中兴通讯股份有限公司 Method and device for realizing sound source localization by utilizing mobile terminal
US10163455B2 (en) 2013-12-03 2018-12-25 Lenovo (Singapore) Pte. Ltd. Detecting pause in audible input to device
US9426525B2 (en) 2013-12-31 2016-08-23 The Nielsen Company (Us), Llc. Methods and apparatus to count people in an audience
US9680583B2 (en) 2015-03-30 2017-06-13 The Nielsen Company (Us), Llc Methods and apparatus to report reference media data to multiple data collection facilities
US9924224B2 (en) 2015-04-03 2018-03-20 The Nielsen Company (Us), Llc Methods and apparatus to determine a state of a media presentation device
US9848222B2 (en) 2015-07-15 2017-12-19 The Nielsen Company (Us), Llc Methods and apparatus to detect spillover
EP3434024B1 (en) * 2016-04-21 2023-08-02 Hewlett-Packard Development Company, L.P. Electronic device microphone listening modes
CN106067301B (en) * 2016-05-26 2019-06-25 浪潮金融信息技术有限公司 A method of echo noise reduction is carried out using multidimensional technology
CN109307856A (en) * 2017-07-27 2019-02-05 深圳市冠旭电子股份有限公司 A kind of sterically defined exchange method of robot and device
CN107886965B (en) * 2017-11-28 2021-04-20 游密科技(深圳)有限公司 Echo cancellation method for game background sound
CN109168075B (en) * 2018-10-30 2021-11-30 重庆辉烨物联科技有限公司 Video information transmission method, system and server
CN110602424A (en) * 2019-08-28 2019-12-20 维沃移动通信有限公司 Video processing method and electronic equipment

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07218614A (en) * 1994-01-31 1995-08-18 Suzuki Motor Corp Method and apparatus for calculating position of sound source
US5993314A (en) * 1997-02-10 1999-11-30 Stadium Games, Ltd. Method and apparatus for interactive audience participation by audio command
US6720949B1 (en) 1997-08-22 2004-04-13 Timothy R. Pryor Man machine interfaces and applications
JPH11331827A (en) * 1998-05-12 1999-11-30 Fujitsu Ltd Television camera
JP2000163178A (en) * 1998-11-26 2000-06-16 Hitachi Ltd Interaction device with virtual character and storage medium storing program generating video of virtual character
IL134979A (en) * 2000-03-09 2004-02-19 Be4 Ltd System and method for optimization of three-dimensional audio
JP4815661B2 (en) * 2000-08-24 2011-11-16 ソニー株式会社 Signal processing apparatus and signal processing method
JP4868671B2 (en) * 2001-09-27 2012-02-01 中部電力株式会社 Sound source exploration system
US7613310B2 (en) * 2003-08-27 2009-11-03 Sony Computer Entertainment Inc. Audio input system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI404967B (en) * 2007-10-19 2013-08-11 Chi Mei Comm Systems Inc System and method for locating sound sources
US8323106B2 (en) 2008-05-30 2012-12-04 Sony Computer Entertainment America Llc Determination of controller three-dimensional location using image analysis and ultrasonic communication

Also Published As

Publication number Publication date
CN101132839B (en) 2011-09-07
CN101132839A (en) 2008-02-27
JP5339900B2 (en) 2013-11-13
KR20080009153A (en) 2008-01-24
KR100985694B1 (en) 2010-10-05
EP1877149A1 (en) 2008-01-16
TWI308080B (en) 2009-04-01
JP2008539874A (en) 2008-11-20
WO2006121681A1 (en) 2006-11-16

Similar Documents

Publication Publication Date Title
TW200708328A (en) Selective sound source listening in conjunction with computer interactive processing
EP2352149A3 (en) Selective sound source listening in conjunction with computer interactive processing
TW200718218A (en) Video apparatus, video processing system and the method thereof
TW200746786A (en) Information processing apparatus and method, and program
EP2039404A3 (en) Method and apparatus for enhancing entertainment software through haptic insertion
EP2141836A3 (en) Information processing apparatus and information processing method
TW200737125A (en) Method and apparatus for processing a audio signal
MX2009009651A (en) A method and an apparatus for processing an audio signal.
EP1940195A3 (en) Sound outputting apparatus, sound outputting method, sound output processing program and sound outputting system
GB2440444B (en) Image processing device, surveillance system, process for generating a scene reference image and also computer program
EP1748656A4 (en) Image processing apparatus, image processing method, and computer program
WO2008036185A3 (en) Methods, apparatus, and systems for insertion of overlay content into a video signal with transrating capabilities
HK1122391A1 (en) Apparatus and method for generating an ambient signal from an audio signal, apparatus and method for deriving a multi-channel audio signal from an audio signal and computer program
HK1141614A1 (en) Makeup simulation system and makeup simulation method
RU2012108872A (en) DISPLAY DEVICE AND MANAGEMENT METHOD
EP1900196A4 (en) Image capturing apparatus, image capturing method, image processing apparatus, image processing method and program
EP3791605A4 (en) An apparatus, method and computer program for audio signal processing
TW200743372A (en) Apparatus and method for reducing temporal noise
TW200722825A (en) Blemish measurement of multiple-angle inspection system and method for a flat panel display
EP4012664A4 (en) Information processing device, video generation method, and program
MY148206A (en) Image processing apparatus, image processing method, and program
EP1587058A4 (en) Image signal processing apparatus, image signal processing method, program for practicing that method, and computer-readable medium in which that program has been recorded
EP1954030A4 (en) Image pickup apparatus and image processing method
EP4183311A4 (en) Image analysis processing device, endoscopy system, operation method for image analysis processing device, and program for image analysis processing device
TW200746842A (en) Apparatus for processing media signal and method thereof