CN111712875B - 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构 - Google Patents

用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构 Download PDF

Info

Publication number
CN111712875B
CN111712875B CN201980013440.1A CN201980013440A CN111712875B CN 111712875 B CN111712875 B CN 111712875B CN 201980013440 A CN201980013440 A CN 201980013440A CN 111712875 B CN111712875 B CN 111712875B
Authority
CN
China
Prior art keywords
audio
bitstream
3dof
rendering
6dof
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201980013440.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN111712875A (zh
Inventor
利昂·特连蒂夫
克里斯托弗·费尔施
丹尼尔·费希尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dolby International AB
Original Assignee
Dolby International AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dolby International AB filed Critical Dolby International AB
Priority to CN202411189985.7A priority Critical patent/CN118824260A/zh
Priority to CN202411189983.8A priority patent/CN118824259A/zh
Priority to CN202411189981.9A priority patent/CN118824258A/zh
Publication of CN111712875A publication Critical patent/CN111712875A/zh
Application granted granted Critical
Publication of CN111712875B publication Critical patent/CN111712875B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/167—Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Stereophonic System (AREA)
CN201980013440.1A 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构 Active CN111712875B (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202411189985.7A CN118824260A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN202411189983.8A CN118824259A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN202411189981.9A CN118824258A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862655990P 2018-04-11 2018-04-11
US62/655,990 2018-04-11
PCT/EP2019/058955 WO2019197404A1 (en) 2018-04-11 2019-04-09 Methods, apparatus and systems for 6dof audio rendering and data representations and bitstream structures for 6dof audio rendering

Related Child Applications (3)

Application Number Title Priority Date Filing Date
CN202411189981.9A Division CN118824258A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN202411189983.8A Division CN118824259A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN202411189985.7A Division CN118824260A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构

Publications (2)

Publication Number Publication Date
CN111712875A CN111712875A (zh) 2020-09-25
CN111712875B true CN111712875B (zh) 2024-09-06

Family

ID=66165970

Family Applications (4)

Application Number Title Priority Date Filing Date
CN201980013440.1A Active CN111712875B (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN202411189985.7A Pending CN118824260A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN202411189981.9A Pending CN118824258A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN202411189983.8A Pending CN118824259A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构

Family Applications After (3)

Application Number Title Priority Date Filing Date
CN202411189985.7A Pending CN118824260A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN202411189981.9A Pending CN118824258A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
CN202411189983.8A Pending CN118824259A (zh) 2018-04-11 2019-04-09 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构

Country Status (7)

Country Link
US (3) US11432099B2 (enExample)
EP (3) EP4123644B1 (enExample)
JP (3) JP7093841B2 (enExample)
KR (2) KR20240155983A (enExample)
CN (4) CN111712875B (enExample)
BR (1) BR112020015835A2 (enExample)
WO (1) WO2019197404A1 (enExample)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2563635A (en) * 2017-06-21 2018-12-26 Nokia Technologies Oy Recording and rendering audio signals
US10405126B2 (en) 2017-06-30 2019-09-03 Qualcomm Incorporated Mixed-order ambisonics (MOA) audio data for computer-mediated reality systems
CN111712875B (zh) * 2018-04-11 2024-09-06 杜比国际公司 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
EP3782152A2 (en) * 2018-04-16 2021-02-24 Dolby Laboratories Licensing Corporation Methods, apparatus and systems for encoding and decoding of directional sound sources
US11356793B2 (en) * 2019-10-01 2022-06-07 Qualcomm Incorporated Controlling rendering of audio data
KR102741553B1 (ko) * 2019-12-04 2024-12-12 한국전자통신연구원 렌더링 최적화를 위한 오디오 데이터 전송 방법 및 오디오 데이터 재생 방법, 오디오 데이터 전송 장치 및 오디오 데이터 재생 장치
CN114762041B (zh) * 2020-01-10 2025-11-04 索尼集团公司 编码设备和方法、解码设备和方法、以及程序
US11967329B2 (en) * 2020-02-20 2024-04-23 Qualcomm Incorporated Signaling for rendering tools
CN114067810B (zh) * 2020-07-31 2025-12-12 华为技术有限公司 音频信号渲染方法和装置
US11750998B2 (en) 2020-09-30 2023-09-05 Qualcomm Incorporated Controlling rendering of audio data
US11750745B2 (en) 2020-11-18 2023-09-05 Kelly Properties, Llc Processing and distribution of audio signals in a multi-party conferencing environment
US11743670B2 (en) 2020-12-18 2023-08-29 Qualcomm Incorporated Correlation-based rendering with multiple distributed streams accounting for an occlusion for six degree of freedom applications
JP2024518850A (ja) * 2021-05-27 2024-05-07 フラウンホーファー-ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン 音響環境の符号化および復号
US11956409B2 (en) * 2021-08-23 2024-04-09 Tencent America LLC Immersive media interoperability
CN117941378A (zh) * 2021-08-24 2024-04-26 北京字跳网络技术有限公司 音频信号的处理方法和装置
WO2023083788A1 (en) * 2021-11-09 2023-05-19 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Late reverberation distance attenuation
KR20240122446A (ko) * 2021-11-09 2024-08-12 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. 렌더링 시나리오의 시간적 진화를 정의하는 하나 이상의 장면 구성 패킷들을 포함하고 타임스탬프 정보를 포함하는 복수의 패킷들을 이용하는, 오디오 디코더, 오디오 인코더, 디코딩 방법, 인코딩 방법 및 비트스트림
GB202118094D0 (en) * 2021-12-14 2022-01-26 Nokia Technologies Oy A method and apparatus for AR scene modification
WO2024014711A1 (ko) * 2022-07-11 2024-01-18 한국전자통신연구원 녹음 거리 파라미터 기반 오디오 렌더링 방법 및 이를 수행하는 장치
AU2024205312A1 (en) 2022-12-07 2025-07-10 Dolby International Ab Binarual rendering
WO2024212118A1 (zh) * 2023-04-11 2024-10-17 北京小米移动软件有限公司 音频码流信号处理方法、装置、电子设备和存储介质
KR102837322B1 (ko) * 2023-04-19 2025-07-23 한국전자통신연구원 공간음향 렌더링을 위한 비트스트림 재구성 방법 및 장치
WO2025054331A1 (en) * 2023-09-05 2025-03-13 Virtuel Works Llc Spatial audio scene description and rendering
WO2026139208A1 (en) * 2024-12-24 2026-07-02 Nokia Technologies Oy A method and apparatus for 6dof rendering

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ATE456261T1 (de) 2006-02-21 2010-02-15 Koninkl Philips Electronics Nv Audiokodierung und audiodekodierung
US20100324915A1 (en) * 2009-06-23 2010-12-23 Electronic And Telecommunications Research Institute Encoding and decoding apparatuses for high quality multi-channel audio codec
AU2010321013B2 (en) * 2009-11-20 2014-05-29 Dolby International Ab Apparatus for providing an upmix signal representation on the basis of the downmix signal representation, apparatus for providing a bitstream representing a multi-channel audio signal, methods, computer programs and bitstream representing a multi-channel audio signal using a linear combination parameter
WO2014124377A2 (en) * 2013-02-11 2014-08-14 Dolby Laboratories Licensing Corporation Audio bitstreams with supplementary data and encoding and decoding of such bitstreams
US9479886B2 (en) * 2012-07-20 2016-10-25 Qualcomm Incorporated Scalable downmix design with feedback for object-based surround codec
KR101660004B1 (ko) 2012-08-03 2016-09-27 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. 멀티채널 다운믹스/업믹스 케이스들에 대해 매개변수 개념을 이용한 멀티-인스턴스 공간-오디오-오브젝트-코딩을 위한 디코더 및 방법
US20140320629A1 (en) * 2013-01-24 2014-10-30 University Of Washington Through Its Center For Commericialization Haptically-Enabled Co-Robotics for Underwater Tasks
US9609452B2 (en) * 2013-02-08 2017-03-28 Qualcomm Incorporated Obtaining sparseness information for higher order ambisonic audio renderers
US10178489B2 (en) * 2013-02-08 2019-01-08 Qualcomm Incorporated Signaling audio rendering information in a bitstream
CN105247894B (zh) 2013-05-16 2017-11-07 皇家飞利浦有限公司 音频装置及其方法
CN105191354B (zh) * 2013-05-16 2018-07-24 皇家飞利浦有限公司 音频处理装置及其方法
US9502044B2 (en) 2013-05-29 2016-11-22 Qualcomm Incorporated Compression of decomposed representations of a sound field
US9384741B2 (en) * 2013-05-29 2016-07-05 Qualcomm Incorporated Binauralization of rotated higher order ambisonics
PT3022949T (pt) * 2013-07-22 2018-01-23 Fraunhofer Ges Forschung Descodificador de áudio multicanal, codificador de áudio de multicanal, métodos, programa de computador e representação de áudio codificada usando uma descorrelação dos sinais de áudio renderizados
JP6374980B2 (ja) 2014-03-26 2018-08-15 パナソニック株式会社 サラウンドオーディオ信号処理のための装置及び方法
CN106463125B (zh) * 2014-04-25 2020-09-15 杜比实验室特许公司 基于空间元数据的音频分割
US9847088B2 (en) 2014-08-29 2017-12-19 Qualcomm Incorporated Intermediate compression for higher order ambisonic audio data
US9875745B2 (en) 2014-10-07 2018-01-23 Qualcomm Incorporated Normalization of ambient higher order ambisonic audio data
US9984693B2 (en) 2014-10-10 2018-05-29 Qualcomm Incorporated Signaling channels for scalable coding of higher order ambisonic audio data
WO2016060101A1 (ja) 2014-10-16 2016-04-21 ソニー株式会社 送信装置、送信方法、受信装置および受信方法
KR102856247B1 (ko) 2015-06-17 2025-09-04 삼성전자주식회사 저연산 포맷 변환을 위한 인터널 채널 처리 방법 및 장치
US9959880B2 (en) 2015-10-14 2018-05-01 Qualcomm Incorporated Coding higher-order ambisonic coefficients during multiple transitions
CN108701463B (zh) 2016-02-03 2020-03-10 杜比国际公司 音频译码中的高效格式转换
US20170339469A1 (en) * 2016-05-23 2017-11-23 Arjun Trikannad Efficient distribution of real-time and live streaming 360 spherical video
WO2017218973A1 (en) 2016-06-17 2017-12-21 Edward Stein Distance panning using near / far-field rendering
US10262665B2 (en) * 2016-08-30 2019-04-16 Gaudio Lab, Inc. Method and apparatus for processing audio signals using ambisonic signals
US10650590B1 (en) * 2016-09-07 2020-05-12 Fastvdo Llc Method and system for fully immersive virtual reality
AU2017328161B2 (en) * 2016-09-13 2022-02-17 Magic Leap, Inc. Sensory eyewear
US20180124540A1 (en) * 2016-10-31 2018-05-03 Google Llc Projection-based audio coding
CN111149155B (zh) 2017-07-14 2023-10-10 弗劳恩霍夫应用研究促进协会 使用多点声场描述生成经增强的声场描述的装置及方法
GB2567172A (en) * 2017-10-04 2019-04-10 Nokia Technologies Oy Grouping and transport of audio objects
US10469968B2 (en) * 2017-10-12 2019-11-05 Qualcomm Incorporated Rendering for computer-mediated reality systems
US10559126B2 (en) * 2017-10-13 2020-02-11 Samsung Electronics Co., Ltd. 6DoF media consumption architecture using 2D video decoder
KR102390208B1 (ko) * 2017-10-17 2022-04-25 삼성전자주식회사 멀티미디어 데이터를 전송하는 방법 및 장치
US11567627B2 (en) * 2018-01-30 2023-01-31 Magic Leap, Inc. Eclipse cursor for virtual content in mixed reality displays
US10540941B2 (en) * 2018-01-30 2020-01-21 Magic Leap, Inc. Eclipse cursor for mixed reality displays
US20210112287A1 (en) * 2018-04-11 2021-04-15 Lg Electronics Inc. Method and apparatus for transmitting or receiving metadata of audio in wireless communication system
CN111712875B (zh) * 2018-04-11 2024-09-06 杜比国际公司 用于6dof音频渲染的方法、设备和系统及用于6dof音频渲染的数据表示和位流结构
US11128976B2 (en) * 2018-10-02 2021-09-21 Qualcomm Incorporated Representing occlusion when rendering for computer-mediated reality systems
US11232643B1 (en) * 2020-12-22 2022-01-25 Facebook Technologies, Llc Collapsing of 3D objects to 2D images in an artificial reality environment

Also Published As

Publication number Publication date
EP4513483A1 (en) 2025-02-26
JP7704330B2 (ja) 2025-07-08
CN111712875A (zh) 2020-09-25
BR112020015835A2 (pt) 2020-12-15
US11432099B2 (en) 2022-08-30
RU2020127372A (ru) 2022-02-17
KR102721752B1 (ko) 2024-10-25
US12126985B2 (en) 2024-10-22
JP2024024085A (ja) 2024-02-21
JP7418500B2 (ja) 2024-01-19
US20250063318A1 (en) 2025-02-20
JP7093841B2 (ja) 2022-06-30
EP4123644A1 (en) 2023-01-25
JP2022120190A (ja) 2022-08-17
EP4123644B1 (en) 2024-08-21
US20210168550A1 (en) 2021-06-03
EP3776543B1 (en) 2022-08-31
EP4513483B1 (en) 2026-07-01
JP2021517987A (ja) 2021-07-29
EP3776543A1 (en) 2021-02-17
CN118824260A (zh) 2024-10-22
US20230065644A1 (en) 2023-03-02
WO2019197404A1 (en) 2019-10-17
CN118824258A (zh) 2024-10-22
KR20200141438A (ko) 2020-12-18
CN118824259A (zh) 2024-10-22
KR20240155983A (ko) 2024-10-29

Similar Documents

Publication Publication Date Title
JP7704330B2 (ja) 6dofオーディオ・レンダリングのための方法、装置およびシステムならびに6dofオーディオ・レンダリングのためのデータ表現およびビットストリーム構造
JP6939883B2 (ja) 自由視点映像ストリーミング用の復号器を中心とするuvコーデック
CN115039404B (zh) 容积视觉媒体处理方法和装置
JP7614168B2 (ja) ボリュメトリックビデオコンテンツを配信するための方法および装置
US8687686B2 (en) 3D contents data encoding/decoding apparatus and method
KR20240156412A (ko) 오디오 렌더링을 위해 오디오 장면들을 처리하기 위한 방법들, 장치 및 시스템들
CN119278627A (zh) 高效的映射坐标创建和传输
HK40031045A (en) Methods, apparatus and systems for 6dof audio rendering and data representations and bitstream structures for 6dof audio rendering
HK40110893A (en) Methods, apparatus and systems for 6dof audio rendering and data representations and bitstream structures for 6dof audio rendering
HK40110902A (en) Methods, apparatus and systems for 6dof audio rendering and data representations and bitstream structures for 6dof audio rendering
HK40110894A (en) Methods, apparatus and systems for 6dof audio rendering and data representations and bitstream structures for 6dof audio rendering
RU2782344C2 (ru) Способы, устройство и системы формирования звука 6dof, и представление данных, и структуры битовых потоков для формирования звука 6dof
HK40031045B (en) Methods, apparatus and systems for 6dof audio rendering and data representations and bitstream structures for 6dof audio rendering
CN115733576B (zh) 点云媒体文件的封装与解封装方法、装置及存储介质
KR20250056122A (ko) 그룹으로 분할되어 생성된 이머시브(Immersive) 비디오를 송수신하는 방법 및 장치
JP2026505661A (ja) オーディオ・レンダリングのためにオーディオ・シーンを処理するための方法、装置、およびシステム
JP2006072662A (ja) 画像符号化装置
KR20260023046A (ko) 오디오 장면 정보를 처리하기 위한 방법들, 장치들, 및 시스템들
CN121420553A (zh) 可伸缩编码

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40031045

Country of ref document: HK

SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TG01 Patent term adjustment

Free format text: NEW EXPIRY DATE: 20390502

TG01 Patent term adjustment