CN111512371B - 用于所捕获的空间音频内容的呈现的装置和相关方法 - Google Patents

用于所捕获的空间音频内容的呈现的装置和相关方法 Download PDF

Info

Publication number
CN111512371B
CN111512371B CN201880083288.XA CN201880083288A CN111512371B CN 111512371 B CN111512371 B CN 111512371B CN 201880083288 A CN201880083288 A CN 201880083288A CN 111512371 B CN111512371 B CN 111512371B
Authority
CN
China
Prior art keywords
captured
audio
scene
spatial audio
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880083288.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN111512371A (zh
Inventor
L·拉克索南
A·勒蒂涅米
T·马基南
M·海基南
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Publication of CN111512371A publication Critical patent/CN111512371A/zh
Application granted granted Critical
Publication of CN111512371B publication Critical patent/CN111512371B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/11—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information not detectable on the record carrier
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)
  • Stereophonic System (AREA)
  • Television Signal Processing For Recording (AREA)
CN201880083288.XA 2017-12-22 2018-12-11 用于所捕获的空间音频内容的呈现的装置和相关方法 Active CN111512371B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP17209901.2 2017-12-22
EP17209901.2A EP3503102A1 (en) 2017-12-22 2017-12-22 An apparatus and associated methods for presentation of captured spatial audio content
PCT/EP2018/084321 WO2019121150A1 (en) 2017-12-22 2018-12-11 An apparatus and associated methods for presentation of captured spatial audio content

Publications (2)

Publication Number Publication Date
CN111512371A CN111512371A (zh) 2020-08-07
CN111512371B true CN111512371B (zh) 2021-10-22

Family

ID=60957033

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880083288.XA Active CN111512371B (zh) 2017-12-22 2018-12-11 用于所捕获的空间音频内容的呈现的装置和相关方法

Country Status (5)

Country Link
US (1) US11223925B2 (https=)
EP (1) EP3503102A1 (https=)
JP (1) JP7037654B2 (https=)
CN (1) CN111512371B (https=)
WO (1) WO2019121150A1 (https=)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11468904B2 (en) * 2019-12-18 2022-10-11 Audio Analytic Ltd Computer apparatus and method implementing sound detection with an image capture system
US11678111B1 (en) 2020-07-22 2023-06-13 Apple Inc. Deep-learning based beam forming synthesis for spatial audio
EP4054212A1 (en) 2021-03-04 2022-09-07 Nokia Technologies Oy Spatial audio modification
US12511849B2 (en) 2022-12-30 2025-12-30 Htc Corporation Method for improving visual quality of reality service content, host, and computer readable storage medium
CN120475317B (zh) * 2024-09-05 2026-04-17 荣耀终端股份有限公司 音频处理方法、可读存储介质、程序产品及电子设备
CN119248106B (zh) * 2024-09-12 2025-07-15 九转棱镜(北京)科技有限公司 虚拟现实交互方法及视听设备

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7559026B2 (en) 2003-06-20 2009-07-07 Apple Inc. Video conferencing system having focus control
US9015051B2 (en) * 2007-03-21 2015-04-21 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Reconstruction of audio channels with direction parameters indicating direction of origin
US8170222B2 (en) 2008-04-18 2012-05-01 Sony Mobile Communications Ab Augmented reality enhanced audio
EP2205007B1 (en) 2008-12-30 2019-01-09 Dolby International AB Method and apparatus for three-dimensional acoustic field encoding and optimal reconstruction
US10326978B2 (en) * 2010-06-30 2019-06-18 Warner Bros. Entertainment Inc. Method and apparatus for generating virtual or augmented reality presentations with 3D audio positioning
JP5893129B2 (ja) * 2011-04-18 2016-03-23 ドルビー ラボラトリーズ ライセンシング コーポレイション オーディオをアップミックスして３ｄオーディオを生成する方法とシステム
US9632683B2 (en) * 2012-11-08 2017-04-25 Nokia Technologies Oy Methods, apparatuses and computer program products for manipulating characteristics of audio objects by using directional gestures
US8854447B2 (en) 2012-12-21 2014-10-07 United Video Properties, Inc. Systems and methods for automatically adjusting audio based on gaze point
US9892743B2 (en) * 2012-12-27 2018-02-13 Avaya Inc. Security surveillance via three-dimensional audio space presentation
US20160088417A1 (en) 2013-04-30 2016-03-24 Intellectual Discovery Co., Ltd. Head mounted display and method for providing audio content by using same
GB2516056B (en) 2013-07-09 2021-06-30 Nokia Technologies Oy Audio processing apparatus
US9596437B2 (en) 2013-08-21 2017-03-14 Microsoft Technology Licensing, Llc Audio focusing via multiple microphones
US9367939B2 (en) 2013-10-22 2016-06-14 Nokia Technologies Oy Relevance based visual media item modification
JP6256156B2 (ja) 2014-03-31 2018-01-10 住友化学株式会社 熱可塑性エラストマー組成物
US9693009B2 (en) * 2014-09-12 2017-06-27 International Business Machines Corporation Sound source selection for aural interest
EP3112986B1 (en) 2015-07-03 2020-02-26 Nokia Technologies Oy Content browsing
WO2017045077A1 (en) * 2015-09-16 2017-03-23 Rising Sun Productions Limited System and method for reproducing three-dimensional audio with a selectable perspective
EP3151535A1 (en) * 2015-09-29 2017-04-05 Thomson Licensing Plenoptic camera having an array of sensors for generating digital images and method of capturing an image using a plenoptic camera
EP3174005A1 (en) * 2015-11-30 2017-05-31 Nokia Technologies Oy Apparatus and method for controlling audio mixing in virtual reality environments
US10440496B2 (en) * 2016-04-12 2019-10-08 Koninklijke Philips N.V. Spatial audio processing emphasizing sound sources close to a focal distance
EP3236345A1 (en) * 2016-04-22 2017-10-25 Nokia Technologies Oy An apparatus and associated methods
JP6711118B2 (ja) 2016-05-02 2020-06-17 株式会社リコー 画像管理システム、プログラム及び情報端末
EP3264222B1 (en) 2016-06-27 2019-04-10 Nokia Technologies Oy An apparatus and associated methods

Also Published As

Publication number Publication date
WO2019121150A1 (en) 2019-06-27
JP2021508193A (ja) 2021-02-25
US20200389755A1 (en) 2020-12-10
EP3503102A1 (en) 2019-06-26
CN111512371A (zh) 2020-08-07
US11223925B2 (en) 2022-01-11
JP7037654B2 (ja) 2022-03-16

Similar Documents

Publication Publication Date Title
CN111512371B (zh) 用于所捕获的空间音频内容的呈现的装置和相关方法
CN110121695B (zh) 虚拟现实领域中的装置及相关联的方法
US10798518B2 (en) Apparatus and associated methods
CN111052770B (zh) 空间音频下混频的方法及系统
US10993066B2 (en) Apparatus and associated methods for presentation of first and second virtual-or-augmented reality content
EP3236346A1 (en) An apparatus and associated methods
US20190180509A1 (en) Apparatus and associated methods for presentation of first and second virtual-or-augmented reality content
CN110036416B (zh) 用于空间音频的装置和相关方法
JP2021508193A5 (https=)
JP6670361B2 (ja) レンダリングする音響オブジェクトをユーザが選択するためのユーザインタフェース、および／またはレンダリングする音響オブジェクトをユーザが選択するためのユーザインタフェースをレンダリングする方法
US12231866B2 (en) Apparatus and associated methods for capture of spatial audio
US10993067B2 (en) Apparatus and associated methods
WO2019057530A1 (en) APPARATUS AND ASSOCIATED METHODS FOR PRESENTING AUDIO IN THE FORM OF SPACE AUDIO
US20180275861A1 (en) Apparatus and Associated Methods
EP3321795A1 (en) An apparatus and associated methods

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant