RU2735652C2 - Обработка пространственного аудио - Google Patents

Обработка пространственного аудио Download PDF

Info

Publication number
RU2735652C2
RU2735652C2 RU2018139285A RU2018139285A RU2735652C2 RU 2735652 C2 RU2735652 C2 RU 2735652C2 RU 2018139285 A RU2018139285 A RU 2018139285A RU 2018139285 A RU2018139285 A RU 2018139285A RU 2735652 C2 RU2735652 C2 RU 2735652C2
Authority
RU
Russia
Prior art keywords
audio
spatial audio
scene
spatial
component
Prior art date
Application number
RU2018139285A
Other languages
English (en)
Russian (ru)
Other versions
RU2018139285A3 (https=
RU2018139285A (ru
Inventor
Вернер Паулус Йосефус ДЕ БРЮЭЙН
Леон Мария ВАН ДЕ КЕРКХОФ
Original Assignee
Конинклейке Филипс Н.В.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Конинклейке Филипс Н.В. filed Critical Конинклейке Филипс Н.В.
Publication of RU2018139285A publication Critical patent/RU2018139285A/ru
Publication of RU2018139285A3 publication Critical patent/RU2018139285A3/ru
Application granted granted Critical
Publication of RU2735652C2 publication Critical patent/RU2735652C2/ru

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers
    • H04R3/12—Circuits for transducers for distributing signals to two or more loudspeakers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00—Stereophonic arrangements
    • H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6063—Methods for processing data by generating or executing the game program for sound processing
    • A63F2300/6081—Methods for processing data by generating or executing the game program for sound processing generating an output signal, e.g. under timing constraints, for spatialization
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082—Virtual reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/13—Aspects of volume control, not necessarily automatic, in stereophonic sound systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/307—Frequency adjustment, e.g. tone control

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Otolaryngology (AREA)
  • Stereophonic System (AREA)
RU2018139285A 2016-04-12 2017-04-06 Обработка пространственного аудио RU2735652C2 (ru)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP16164787 2016-04-12
EP16164787.0 2016-04-12
PCT/EP2017/058172 WO2017178309A1 (en) 2016-04-12 2017-04-06 Spatial audio processing emphasizing sound sources close to a focal distance

Publications (3)

Publication Number Publication Date
RU2018139285A RU2018139285A (ru) 2020-05-12
RU2018139285A3 RU2018139285A3 (https=) 2020-05-13
RU2735652C2 true RU2735652C2 (ru) 2020-11-05

Family

ID=55759468

Family Applications (1)

Application Number Title Priority Date Filing Date
RU2018139285A RU2735652C2 (ru) 2016-04-12 2017-04-06 Обработка пространственного аудио

Country Status (7)

Country Link
US (1) US10440496B2 (https=)
EP (1) EP3443762B1 (https=)
JP (1) JP6878458B2 (https=)
KR (1) KR102319880B1 (https=)
CN (1) CN109076306B (https=)
RU (1) RU2735652C2 (https=)
WO (1) WO2017178309A1 (https=)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2843988C2 (ru) * 2021-05-28 2025-07-23 Долби Лэборетериз Лайсенсинг Корпорейшн Регулирование динамического диапазона пространственных аудиообъектов
US12445791B2 (en) 2022-07-27 2025-10-14 Dolby Laboratories Licensing Corporation Spatial audio rendering adaptive to signal level and loudspeaker playback limit thresholds

Families Citing this family (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10609475B2 (en) 2014-12-05 2020-03-31 Stages Llc Active noise control and customized audio system
US10945080B2 (en) 2016-11-18 2021-03-09 Stages Llc Audio analysis and processing system
EP3343349B1 (en) * 2016-12-30 2022-06-15 Nokia Technologies Oy An apparatus and associated methods in the field of virtual reality
US11096004B2 (en) * 2017-01-23 2021-08-17 Nokia Technologies Oy Spatial audio rendering point extension
JP6874842B2 (ja) * 2017-07-03 2021-05-19 日本電気株式会社 信号処理装置、信号処理方法およびプログラム
US10165388B1 (en) 2017-11-15 2018-12-25 Adobe Systems Incorporated Particle-based spatial audio visualization
EP3503102A1 (en) * 2017-12-22 2019-06-26 Nokia Technologies Oy An apparatus and associated methods for presentation of captured spatial audio content
EP3506080B1 (en) * 2017-12-27 2023-06-07 Nokia Technologies Oy Audio scene processing
EP3506661B1 (en) 2017-12-29 2024-11-13 Nokia Technologies Oy An apparatus, method and computer program for providing notifications
GB201800918D0 (en) 2018-01-19 2018-03-07 Nokia Technologies Oy Associated spatial audio playback
WO2019147064A1 (ko) * 2018-01-26 2019-08-01 엘지전자 주식회사 오디오 데이터를 송수신하는 방법 및 그 장치
EP3550860B1 (en) * 2018-04-05 2021-08-18 Nokia Technologies Oy Rendering of spatial audio content
CA3168579C (en) 2018-04-09 2026-03-31 Dolby International Ab Methods, apparatus and systems for three degrees of freedom (3dof+) extension of mpeg-h 3d audio
US11375332B2 (en) 2018-04-09 2022-06-28 Dolby International Ab Methods, apparatus and systems for three degrees of freedom (3DoF+) extension of MPEG-H 3D audio
EP3595336A1 (en) * 2018-07-09 2020-01-15 Koninklijke Philips N.V. Audio apparatus and method of operation therefor
EP3595337A1 (en) * 2018-07-09 2020-01-15 Koninklijke Philips N.V. Audio apparatus and method of audio processing
GB2591066A (en) * 2018-08-24 2021-07-21 Nokia Technologies Oy Spatial audio processing
WO2020153092A1 (ja) * 2019-01-25 2020-07-30 ソニー株式会社 情報処理装置及び情報処理方法
GB2584629A (en) 2019-05-29 2020-12-16 Nokia Technologies Oy Audio processing
GB2584838A (en) * 2019-06-11 2020-12-23 Nokia Technologies Oy Sound field related rendering
GB2584837A (en) 2019-06-11 2020-12-23 Nokia Technologies Oy Sound field related rendering
CN112489667B (zh) * 2019-08-22 2024-09-06 北京声智科技有限公司 音频信号的处理方法和装置
KR102769387B1 (ko) * 2019-10-23 2025-02-19 엘지전자 주식회사 복수 객체에 대한 자동 오디오 포커싱 방법 및 장치
GB2589082A (en) * 2019-11-11 2021-05-26 Nokia Technologies Oy Audio processing
JP2023511862A (ja) 2020-01-14 2023-03-23 フラウンホッファー－ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ 空間的に拡張された音源（Ｓｐａｔｉａｌｌｙ Ｅｘｔｅｎｄｅｄ Ｓｏｕｎｄ Ｓｏｕｒｃｅ）を再生する装置及び方法、又は固定化情報を用いて空間的に拡張された音源に対する記述を生成する装置及び方法
EP3873112B1 (en) * 2020-02-28 2026-03-18 Nokia Technologies Oy Spatial audio
CN116018824A (zh) 2020-08-20 2023-04-25 松下电器（美国）知识产权公司 信息处理方法、程序和音响再现装置
JP7371595B2 (ja) * 2020-09-15 2023-10-31 横河電機株式会社 装置、システム、方法およびプログラム
GB2598960A (en) * 2020-09-22 2022-03-23 Nokia Technologies Oy Parametric spatial audio rendering with near-field effect
WO2022178194A1 (en) * 2021-02-18 2022-08-25 Dathomir Laboratories Llc Decorrelating objects based on attention
US11937070B2 (en) * 2021-07-01 2024-03-19 Tencent America LLC Layered description of space of interest
US11967335B2 (en) * 2021-09-03 2024-04-23 Google Llc Foveated beamforming for augmented reality devices and wearables
JP7844196B2 (ja) * 2022-03-07 2026-04-13 キヤノン株式会社 情報処置装置、情報処理装置の制御方法、プログラム、記録媒体、およびシステム
US12495267B2 (en) 2022-04-22 2025-12-09 Electronics And Telecommunications Research Institute Method of rendering object-based audio and electronic device for performing the method
US20220286798A1 (en) * 2022-05-27 2022-09-08 Intel Corporation Methods and apparatus to generate binaural sounds for hearing devices
US12518772B2 (en) 2023-08-01 2026-01-06 Samsung Electronics Co., Ltd. Codec bitrate selection in audio object coding
WO2025120910A1 (ja) * 2023-12-05 2025-06-12 ソニーグループ株式会社 音響処理装置、音響処理方法および音響処理プログラム

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1227392A2 (en) * 2001-01-29 2002-07-31 Hewlett-Packard Company Audio user interface
WO2009056956A1 (en) * 2007-11-01 2009-05-07 Nokia Corporation Focusing on a portion of an audio scene for an audio signal
US20100040238A1 (en) * 2008-08-14 2010-02-18 Samsung Electronics Co., Ltd Apparatus and method for sound processing in a virtual reality system
US20150055808A1 (en) * 2013-08-23 2015-02-26 Tobii Technology Ab Systems and methods for providing audio to a user based on gaze input
RU2559713C2 (ru) * 2010-02-02 2015-08-10 Конинклейке Филипс Электроникс Н.В. Пространственное воспроизведение звука

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3258816B2 (ja) * 1994-05-19 2002-02-18 シャープ株式会社 ３次元音場空間再生装置
JP3907413B2 (ja) * 2001-01-12 2007-04-18 株式会社ケンウッド 音響検出装置
JP2006074589A (ja) * 2004-09-03 2006-03-16 Matsushita Electric Ind Co Ltd 音響処理装置
JP2011092302A (ja) * 2009-10-27 2011-05-12 Konami Digital Entertainment Co Ltd ゲーム装置、ゲーム装置の制御方法、及びプログラム
JP2011188287A (ja) * 2010-03-09 2011-09-22 Sony Corp 映像音響装置
JP2013529004A (ja) * 2010-04-26 2013-07-11 ケンブリッジ メカトロニクス リミテッド 位置追跡を備えるスピーカ
EP2807833A2 (en) * 2012-01-23 2014-12-03 Koninklijke Philips N.V. Audio rendering system and method therefor
JP5825176B2 (ja) * 2012-03-29 2015-12-02 富士通株式会社 携帯端末、音源位置制御方法および音源位置制御プログラム
CN104641659B (zh) * 2013-08-19 2017-12-05 雅马哈株式会社 扬声器设备和音频信号处理方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1227392A2 (en) * 2001-01-29 2002-07-31 Hewlett-Packard Company Audio user interface
WO2009056956A1 (en) * 2007-11-01 2009-05-07 Nokia Corporation Focusing on a portion of an audio scene for an audio signal
US20100040238A1 (en) * 2008-08-14 2010-02-18 Samsung Electronics Co., Ltd Apparatus and method for sound processing in a virtual reality system
RU2559713C2 (ru) * 2010-02-02 2015-08-10 Конинклейке Филипс Электроникс Н.В. Пространственное воспроизведение звука
US20150055808A1 (en) * 2013-08-23 2015-02-26 Tobii Technology Ab Systems and methods for providing audio to a user based on gaze input

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2843988C2 (ru) * 2021-05-28 2025-07-23 Долби Лэборетериз Лайсенсинг Корпорейшн Регулирование динамического диапазона пространственных аудиообъектов
RU2854589C2 (ru) * 2022-06-15 2026-01-14 Долби Интернэшнл Аб Способы, системы и устройства для акустического моделирования трехмерной протяженности для основанных на вокселах представлений геометрии
US12445791B2 (en) 2022-07-27 2025-10-14 Dolby Laboratories Licensing Corporation Spatial audio rendering adaptive to signal level and loudspeaker playback limit thresholds
RU2854397C2 (ru) * 2022-07-27 2025-12-30 Долби Лэборетериз Лайсенсинг Корпорейшн Пространственный рендеринг аудиоданных, адаптивный к уровню сигнала и предельным пороговым значениям воспроизведения с помощью громкоговорителей

Also Published As

Publication number Publication date
CN109076306B (zh) 2021-04-13
CN109076306A (zh) 2018-12-21
EP3443762A1 (en) 2019-02-20
JP2019514293A (ja) 2019-05-30
RU2018139285A3 (https=) 2020-05-13
RU2018139285A (ru) 2020-05-12
EP3443762B1 (en) 2020-06-10
JP6878458B2 (ja) 2021-05-26
WO2017178309A1 (en) 2017-10-19
BR112018070813A2 (pt) 2019-07-16
US10440496B2 (en) 2019-10-08
KR102319880B1 (ko) 2021-11-02
US20190174246A1 (en) 2019-06-06
KR20180127508A (ko) 2018-11-28

Similar Documents

Publication Publication Date Title
RU2735652C2 (ru) Обработка пространственного аудио
JP7631449B2 (ja) オーディオ装置及びオーディオ処理の方法
JP7826541B2 (ja) 視聴覚レンダリング装置およびその動作方法
CN114631332B (zh) 比特流中音频效果元数据的信令
RU2815621C1 (ru) Аудиоустройство и способ обработки аудио
RU2823573C1 (ru) Аудиоустройство и способ обработки аудио
RU2815366C2 (ru) Аудиоустройство и способ обработки аудио
KR20260043123A (ko) 오디오 데이터 신호의 생성
BR112018070813B1 (pt) Aparelho de processamento de áudio espacial e método de processamento de áudio espacial