KR102319880B1 - 포커스 거리에 가까운 사운드 소스들을 강조하는 공간 오디오 처리 - Google Patents

포커스 거리에 가까운 사운드 소스들을 강조하는 공간 오디오 처리 Download PDF

Info

Publication number
KR102319880B1
KR102319880B1 KR1020187032537A KR20187032537A KR102319880B1 KR 102319880 B1 KR102319880 B1 KR 102319880B1 KR 1020187032537 A KR1020187032537 A KR 1020187032537A KR 20187032537 A KR20187032537 A KR 20187032537A KR 102319880 B1 KR102319880 B1 KR 102319880B1
Authority
KR
South Korea
Prior art keywords
audio
spatial audio
spatial
scene
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020187032537A
Other languages
English (en)
Korean (ko)
Other versions
KR20180127508A (ko
Inventor
베르네르 파울뤼스 요세퓌스 데 브레인
레온 마리아 반 데 커르크호프
Original Assignee
코닌클리케 필립스 엔.브이.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 코닌클리케 필립스 엔.브이. filed Critical 코닌클리케 필립스 엔.브이.
Publication of KR20180127508A publication Critical patent/KR20180127508A/ko
Application granted granted Critical
Publication of KR102319880B1 publication Critical patent/KR102319880B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303Tracking of listener position or orientation
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/54Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers
    • H04R3/12Circuits for transducers for distributing signals to two or more loudspeakers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00Stereophonic arrangements
    • H04R5/04Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/302Electronic adaptation of stereophonic sound system to listener position or orientation
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/6063Methods for processing data by generating or executing the game program for sound processing
    • A63F2300/6081Methods for processing data by generating or executing the game program for sound processing generating an output signal, e.g. under timing constraints, for spatialization
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082Virtual reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2420/00Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/307Frequency adjustment, e.g. tone control

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Stereophonic System (AREA)
KR1020187032537A 2016-04-12 2017-04-06 포커스 거리에 가까운 사운드 소스들을 강조하는 공간 오디오 처리 Active KR102319880B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP16164787 2016-04-12
EP16164787.0 2016-04-12
PCT/EP2017/058172 WO2017178309A1 (en) 2016-04-12 2017-04-06 Spatial audio processing emphasizing sound sources close to a focal distance

Publications (2)

Publication Number Publication Date
KR20180127508A KR20180127508A (ko) 2018-11-28
KR102319880B1 true KR102319880B1 (ko) 2021-11-02

Family

ID=55759468

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020187032537A Active KR102319880B1 (ko) 2016-04-12 2017-04-06 포커스 거리에 가까운 사운드 소스들을 강조하는 공간 오디오 처리

Country Status (7)

Country Link
US (1) US10440496B2 (https=)
EP (1) EP3443762B1 (https=)
JP (1) JP6878458B2 (https=)
KR (1) KR102319880B1 (https=)
CN (1) CN109076306B (https=)
RU (1) RU2735652C2 (https=)
WO (1) WO2017178309A1 (https=)

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10609475B2 (en) 2014-12-05 2020-03-31 Stages Llc Active noise control and customized audio system
US10945080B2 (en) 2016-11-18 2021-03-09 Stages Llc Audio analysis and processing system
EP3343349B1 (en) * 2016-12-30 2022-06-15 Nokia Technologies Oy An apparatus and associated methods in the field of virtual reality
US11096004B2 (en) * 2017-01-23 2021-08-17 Nokia Technologies Oy Spatial audio rendering point extension
JP6874842B2 (ja) * 2017-07-03 2021-05-19 日本電気株式会社 信号処理装置、信号処理方法およびプログラム
US10165388B1 (en) 2017-11-15 2018-12-25 Adobe Systems Incorporated Particle-based spatial audio visualization
EP3503102A1 (en) * 2017-12-22 2019-06-26 Nokia Technologies Oy An apparatus and associated methods for presentation of captured spatial audio content
EP3506080B1 (en) * 2017-12-27 2023-06-07 Nokia Technologies Oy Audio scene processing
EP3506661B1 (en) 2017-12-29 2024-11-13 Nokia Technologies Oy An apparatus, method and computer program for providing notifications
GB201800918D0 (en) 2018-01-19 2018-03-07 Nokia Technologies Oy Associated spatial audio playback
WO2019147064A1 (ko) * 2018-01-26 2019-08-01 엘지전자 주식회사 오디오 데이터를 송수신하는 방법 및 그 장치
EP3550860B1 (en) * 2018-04-05 2021-08-18 Nokia Technologies Oy Rendering of spatial audio content
CA3168579C (en) 2018-04-09 2026-03-31 Dolby International Ab Methods, apparatus and systems for three degrees of freedom (3dof+) extension of mpeg-h 3d audio
US11375332B2 (en) 2018-04-09 2022-06-28 Dolby International Ab Methods, apparatus and systems for three degrees of freedom (3DoF+) extension of MPEG-H 3D audio
EP3595336A1 (en) * 2018-07-09 2020-01-15 Koninklijke Philips N.V. Audio apparatus and method of operation therefor
EP3595337A1 (en) * 2018-07-09 2020-01-15 Koninklijke Philips N.V. Audio apparatus and method of audio processing
GB2591066A (en) * 2018-08-24 2021-07-21 Nokia Technologies Oy Spatial audio processing
WO2020153092A1 (ja) * 2019-01-25 2020-07-30 ソニー株式会社 情報処理装置及び情報処理方法
GB2584629A (en) 2019-05-29 2020-12-16 Nokia Technologies Oy Audio processing
GB2584838A (en) * 2019-06-11 2020-12-23 Nokia Technologies Oy Sound field related rendering
GB2584837A (en) 2019-06-11 2020-12-23 Nokia Technologies Oy Sound field related rendering
CN112489667B (zh) * 2019-08-22 2024-09-06 北京声智科技有限公司 音频信号的处理方法和装置
KR102769387B1 (ko) * 2019-10-23 2025-02-19 엘지전자 주식회사 복수 객체에 대한 자동 오디오 포커싱 방법 및 장치
GB2589082A (en) * 2019-11-11 2021-05-26 Nokia Technologies Oy Audio processing
JP2023511862A (ja) 2020-01-14 2023-03-23 フラウンホッファー-ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー.ファオ 空間的に拡張された音源(Spatially Extended Sound Source)を再生する装置及び方法、又は固定化情報を用いて空間的に拡張された音源に対する記述を生成する装置及び方法
EP3873112B1 (en) * 2020-02-28 2026-03-18 Nokia Technologies Oy Spatial audio
CN116018824A (zh) 2020-08-20 2023-04-25 松下电器(美国)知识产权公司 信息处理方法、程序和音响再现装置
JP7371595B2 (ja) * 2020-09-15 2023-10-31 横河電機株式会社 装置、システム、方法およびプログラム
GB2598960A (en) * 2020-09-22 2022-03-23 Nokia Technologies Oy Parametric spatial audio rendering with near-field effect
WO2022178194A1 (en) * 2021-02-18 2022-08-25 Dathomir Laboratories Llc Decorrelating objects based on attention
US11937070B2 (en) * 2021-07-01 2024-03-19 Tencent America LLC Layered description of space of interest
US11967335B2 (en) * 2021-09-03 2024-04-23 Google Llc Foveated beamforming for augmented reality devices and wearables
JP7844196B2 (ja) * 2022-03-07 2026-04-13 キヤノン株式会社 情報処置装置、情報処理装置の制御方法、プログラム、記録媒体、およびシステム
US12495267B2 (en) 2022-04-22 2025-12-09 Electronics And Telecommunications Research Institute Method of rendering object-based audio and electronic device for performing the method
US20220286798A1 (en) * 2022-05-27 2022-09-08 Intel Corporation Methods and apparatus to generate binaural sounds for hearing devices
KR20250025003A (ko) 2022-07-27 2025-02-20 돌비 레버러토리즈 라이쎈싱 코오포레이션 신호 레벨 및 라우드스피커 재생 한계 임계치에 적응적인 공간 오디오 렌더링
US12518772B2 (en) 2023-08-01 2026-01-06 Samsung Electronics Co., Ltd. Codec bitrate selection in audio object coding
WO2025120910A1 (ja) * 2023-12-05 2025-06-12 ソニーグループ株式会社 音響処理装置、音響処理方法および音響処理プログラム

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006074589A (ja) 2004-09-03 2006-03-16 Matsushita Electric Ind Co Ltd 音響処理装置
JP2011092302A (ja) 2009-10-27 2011-05-12 Konami Digital Entertainment Co Ltd ゲーム装置、ゲーム装置の制御方法、及びプログラム

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3258816B2 (ja) * 1994-05-19 2002-02-18 シャープ株式会社 3次元音場空間再生装置
JP3907413B2 (ja) * 2001-01-12 2007-04-18 株式会社ケンウッド 音響検出装置
EP1227392A2 (en) 2001-01-29 2002-07-31 Hewlett-Packard Company Audio user interface
US8509454B2 (en) 2007-11-01 2013-08-13 Nokia Corporation Focusing on a portion of an audio scene for an audio signal
KR101576294B1 (ko) * 2008-08-14 2015-12-11 삼성전자주식회사 가상 현실 시스템에서 사운드 처리를 수행하기 위한 장치 및 방법
WO2011095913A1 (en) * 2010-02-02 2011-08-11 Koninklijke Philips Electronics N.V. Spatial sound reproduction
JP2011188287A (ja) * 2010-03-09 2011-09-22 Sony Corp 映像音響装置
JP2013529004A (ja) * 2010-04-26 2013-07-11 ケンブリッジ メカトロニクス リミテッド 位置追跡を備えるスピーカ
EP2807833A2 (en) * 2012-01-23 2014-12-03 Koninklijke Philips N.V. Audio rendering system and method therefor
JP5825176B2 (ja) * 2012-03-29 2015-12-02 富士通株式会社 携帯端末、音源位置制御方法および音源位置制御プログラム
CN104641659B (zh) * 2013-08-19 2017-12-05 雅马哈株式会社 扬声器设备和音频信号处理方法
US9143880B2 (en) * 2013-08-23 2015-09-22 Tobii Ab Systems and methods for providing audio to a user based on gaze input

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006074589A (ja) 2004-09-03 2006-03-16 Matsushita Electric Ind Co Ltd 音響処理装置
JP2011092302A (ja) 2009-10-27 2011-05-12 Konami Digital Entertainment Co Ltd ゲーム装置、ゲーム装置の制御方法、及びプログラム

Also Published As

Publication number Publication date
CN109076306B (zh) 2021-04-13
CN109076306A (zh) 2018-12-21
EP3443762A1 (en) 2019-02-20
RU2735652C2 (ru) 2020-11-05
JP2019514293A (ja) 2019-05-30
RU2018139285A3 (https=) 2020-05-13
RU2018139285A (ru) 2020-05-12
EP3443762B1 (en) 2020-06-10
JP6878458B2 (ja) 2021-05-26
WO2017178309A1 (en) 2017-10-19
BR112018070813A2 (pt) 2019-07-16
US10440496B2 (en) 2019-10-08
US20190174246A1 (en) 2019-06-06
KR20180127508A (ko) 2018-11-28

Similar Documents

Publication Publication Date Title
KR102319880B1 (ko) 포커스 거리에 가까운 사운드 소스들을 강조하는 공간 오디오 처리
JP7631449B2 (ja) オーディオ装置及びオーディオ処理の方法
US12538089B2 (en) Spatial audio rendering point extension
JP7170069B2 (ja) オーディオ装置及びその動作方法
EP2700250A1 (en) Method and system for upmixing audio to generate 3d audio
CN114631332B (zh) 比特流中音频效果元数据的信令
CN206908863U (zh) Vr电视中的动态空间虚拟声处理系统
KR20260043123A (ko) 오디오 데이터 신호의 생성
BR112018070813B1 (pt) Aparelho de processamento de áudio espacial e método de processamento de áudio espacial

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

A201 Request for examination
PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

R18-X000 Changes to party contact information recorded

St.27 status event code: A-3-3-R10-R18-oth-X000

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

R18 Changes to party contact information recorded

Free format text: ST27 STATUS EVENT CODE: A-5-5-R10-R18-OTH-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000