SG11201607953TA - Apparatus and method for screen related audio object remapping - Google Patents

Apparatus and method for screen related audio object remapping

Info

Publication number
SG11201607953TA
SG11201607953TA SG11201607953TA SG11201607953TA SG11201607953TA SG 11201607953T A SG11201607953T A SG 11201607953TA SG 11201607953T A SG11201607953T A SG 11201607953TA SG 11201607953T A SG11201607953T A SG 11201607953TA SG 11201607953T A SG11201607953T A SG 11201607953TA
Authority
SG
Singapore
Prior art keywords
audio object
screen related
related audio
object remapping
remapping
Prior art date
Application number
SG11201607953TA
Other languages
English (en)
Inventor
Simone Füg
Jan Plogsties
Sascha Dick
Johannes Hilpert
Julien Robilliard
Achim Kuntz
Andreas Hölzer
Original Assignee
Fraunhofer Ges Forschung
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Ges Forschung filed Critical Fraunhofer Ges Forschung
Publication of SG11201607953TA publication Critical patent/SG11201607953TA/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16Vocoder architecture
    • G10L19/18Vocoders using multiple modes
    • G10L19/20Vocoders using multiple modes using sound class specific coding, hybrid encoders or object based coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client data or end-user data
    • H04N21/4516Management of client data or end-user data involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8106Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84Generation or processing of descriptive data, e.g. content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S3/00Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/308Electronic adaptation dependent on speaker or headphone connection
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16Vocoder architecture
    • G10L19/167Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10General applications
    • H04R2499/15Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S2400/00Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11Positioning of individual sound objects, e.g. moving airplane, within a sound field

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • Databases & Information Systems (AREA)
  • Stereophonic System (AREA)
SG11201607953TA 2014-03-26 2015-03-25 Apparatus and method for screen related audio object remapping SG11201607953TA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP14161819 2014-03-26
EP14196769.5A EP2928216A1 (de) 2014-03-26 2014-12-08 Vorrichtung und verfahren für bildschirmbezogene audioobjekt-neuabbildung
PCT/EP2015/056417 WO2015144766A1 (en) 2014-03-26 2015-03-25 Apparatus and method for screen related audio object remapping

Publications (1)

Publication Number Publication Date
SG11201607953TA true SG11201607953TA (en) 2016-10-28

Family

ID=52015948

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201607953TA SG11201607953TA (en) 2014-03-26 2015-03-25 Apparatus and method for screen related audio object remapping

Country Status (19)

Country Link
US (4) US10192563B2 (de)
EP (4) EP2928216A1 (de)
JP (4) JP6422995B2 (de)
KR (1) KR101920356B1 (de)
CN (2) CN111276153B (de)
AR (1) AR099835A1 (de)
AU (1) AU2015238354B2 (de)
BR (1) BR112016022045B1 (de)
CA (1) CA2943570C (de)
ES (2) ES2723965T3 (de)
FI (1) FI3487189T3 (de)
MX (1) MX355455B (de)
MY (1) MY184715A (de)
PL (2) PL3487189T3 (de)
PT (2) PT3123741T (de)
RU (1) RU2683380C2 (de)
SG (1) SG11201607953TA (de)
TW (1) TWI595785B (de)
WO (1) WO2015144766A1 (de)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2830051A3 (de) 2013-07-22 2015-03-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audiocodierer, Audiodecodierer, Verfahren und Computerprogramm mit gemeinsamen codierten Restsignalen
EP2928216A1 (de) 2014-03-26 2015-10-07 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und verfahren für bildschirmbezogene audioobjekt-neuabbildung
JP6565922B2 (ja) 2014-10-10 2019-08-28 ソニー株式会社 符号化装置および方法、再生装置および方法、並びにプログラム
US9940937B2 (en) * 2014-10-10 2018-04-10 Qualcomm Incorporated Screen related adaptation of HOA content
CN106303897A (zh) * 2015-06-01 2017-01-04 杜比实验室特许公司 处理基于对象的音频信号
CN113242448B (zh) * 2015-06-02 2023-07-14 索尼公司 发送装置和方法、媒体处理装置和方法以及接收装置
SG11201710889UA (en) * 2015-07-16 2018-02-27 Sony Corp Information processing apparatus, information processing method, and program
DE102015220595A1 (de) * 2015-10-22 2017-04-27 Robert Bosch Gmbh Batteriezelle mit teilweise flexibel formbarer Wandung
EP3378240B1 (de) * 2015-11-20 2019-12-11 Dolby Laboratories Licensing Corporation System und verfahren zum rendering eines audioprogramms
US9854375B2 (en) * 2015-12-01 2017-12-26 Qualcomm Incorporated Selection of coded next generation audio data for transport
EP3453190A4 (de) 2016-05-06 2020-01-15 DTS, Inc. Systeme zur immersiven audiowiedergabe
WO2017208820A1 (ja) * 2016-05-30 2017-12-07 ソニー株式会社 映像音響処理装置および方法、並びにプログラム
US10979844B2 (en) 2017-03-08 2021-04-13 Dts, Inc. Distributed audio virtualization systems
BR112019020887A2 (pt) * 2017-04-13 2020-04-28 Sony Corp aparelho e método de processamento de sinal, e, programa.
CN110537373B (zh) * 2017-04-25 2021-09-28 索尼公司 信号处理装置和方法以及存储介质
US10986457B2 (en) * 2017-07-09 2021-04-20 Lg Electronics Inc. Method and device for outputting audio linked with video screen zoom
WO2019064719A1 (ja) * 2017-09-28 2019-04-04 株式会社ソシオネクスト 音響信号処理装置および音響信号処理方法
WO2019149337A1 (en) * 2018-01-30 2019-08-08 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatuses for converting an object position of an audio object, audio stream provider, audio content production system, audio playback apparatus, methods and computer programs
US20210006930A1 (en) * 2018-03-08 2021-01-07 Sony Corporation Information processing apparatus, information processing method, information processing system and program
WO2019199040A1 (ko) * 2018-04-10 2019-10-17 가우디오랩 주식회사 메타데이터를 이용하는 오디오 신호 처리 방법 및 장치
WO2020008890A1 (ja) * 2018-07-04 2020-01-09 ソニー株式会社 情報処理装置および方法、並びにプログラム
GB2577698A (en) * 2018-10-02 2020-04-08 Nokia Technologies Oy Selection of quantisation schemes for spatial audio parameter encoding
WO2021186104A1 (en) * 2020-03-16 2021-09-23 Nokia Technologies Oy Rendering encoded 6dof audio bitstream and late updates
US11743670B2 (en) * 2020-12-18 2023-08-29 Qualcomm Incorporated Correlation-based rendering with multiple distributed streams accounting for an occlusion for six degree of freedom applications
GB202118094D0 (en) * 2021-12-14 2022-01-26 Nokia Technologies Oy A method and apparatus for AR scene modification

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030007648A1 (en) * 2001-04-27 2003-01-09 Christopher Currell Virtual audio system and techniques
DE10154932B4 (de) 2001-11-08 2008-01-03 Grundig Multimedia B.V. Verfahren zur Audiocodierung
US7606372B2 (en) * 2003-02-12 2009-10-20 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Device and method for determining a reproduction position
DE10305820B4 (de) 2003-02-12 2006-06-01 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Bestimmen einer Wiedergabeposition
US7548657B2 (en) * 2005-06-25 2009-06-16 General Electric Company Adaptive video compression of graphical user interfaces using application metadata
JP5174527B2 (ja) * 2008-05-14 2013-04-03 日本放送協会 音像定位音響メタ情報を付加した音響信号多重伝送システム、制作装置及び再生装置
JP5258967B2 (ja) 2008-07-15 2013-08-07 エルジー エレクトロニクス インコーポレイティド オーディオ信号の処理方法及び装置
KR101387902B1 (ko) * 2009-06-10 2014-04-22 한국전자통신연구원 다객체 오디오 신호를 부호화하는 방법 및 부호화 장치, 복호화 방법 및 복호화 장치, 그리고 트랜스코딩 방법 및 트랜스코더
US8396576B2 (en) * 2009-08-14 2013-03-12 Dts Llc System for adaptively streaming audio objects
PL3093843T3 (pl) 2009-09-29 2021-06-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Dekoder sygnału audio MPEG-SAOC, koder sygnału audio MPEG-SAOC, sposób dostarczania reprezentacji sygnału upmixu z wykorzystaniem dekodowania MPEG-SAOC, sposób dostarczania reprezentacji sygnału downmixu z wykorzystaniem dekodowania MPEG-SAOC oraz program komputerowy wykorzystujący wspólną wartość parametru korelacji międzyobiektowej zależną od czasu/częstotliwości
EP2550809B8 (de) * 2010-03-23 2016-12-14 Dolby Laboratories Licensing Corporation Verfahren für lokalisiertes perzeptuelles audio
EP2450880A1 (de) * 2010-11-05 2012-05-09 Thomson Licensing Datenstruktur für Higher Order Ambisonics-Audiodaten
WO2012126891A1 (en) * 2011-03-18 2012-09-27 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Frame element positioning in frames of a bitstream representing audio content
TW202339510A (zh) * 2011-07-01 2023-10-01 美商杜比實驗室特許公司 用於適應性音頻信號的產生、譯碼與呈現之系統與方法
KR102548756B1 (ko) * 2011-07-01 2023-06-29 돌비 레버러토리즈 라이쎈싱 코오포레이션 향상된 3d 오디오 오서링과 렌더링을 위한 시스템 및 툴들
EP2637427A1 (de) * 2012-03-06 2013-09-11 Thomson Licensing Verfahren und Vorrichtung zur Wiedergabe eines Ambisonic-Audiosignals höherer Ordnung
EP2637327A1 (de) 2012-03-09 2013-09-11 Harman International Industries Ltd. Audiomischkonsole mit Beleuchtungssteuerung und Verfahren zum Mischen mithilfe der Mischkonsole
US9190065B2 (en) * 2012-07-15 2015-11-17 Qualcomm Incorporated Systems, methods, apparatus, and computer-readable media for three-dimensional audio coding using basis function coefficients
US9479886B2 (en) * 2012-07-20 2016-10-25 Qualcomm Incorporated Scalable downmix design with feedback for object-based surround codec
WO2014032709A1 (en) * 2012-08-29 2014-03-06 Huawei Technologies Co., Ltd. Audio rendering system
EP2928216A1 (de) * 2014-03-26 2015-10-07 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und verfahren für bildschirmbezogene audioobjekt-neuabbildung

Also Published As

Publication number Publication date
PL3123741T3 (pl) 2019-08-30
BR112016022045A2 (de) 2017-08-22
CN106463128B (zh) 2020-02-21
JP6734343B2 (ja) 2020-08-05
MX2016012286A (es) 2016-11-30
BR112016022045B1 (pt) 2022-09-27
CN111276153A (zh) 2020-06-12
US20170011751A1 (en) 2017-01-12
MY184715A (en) 2021-04-19
ES2953685T3 (es) 2023-11-15
US20190139562A1 (en) 2019-05-09
PT3487189T (pt) 2023-08-29
ES2723965T3 (es) 2019-09-04
EP3123741A1 (de) 2017-02-01
US20210065729A1 (en) 2021-03-04
MX355455B (es) 2018-04-18
RU2683380C2 (ru) 2019-03-28
CN106463128A (zh) 2017-02-22
AU2015238354B2 (en) 2018-11-08
CN111276153B (zh) 2024-03-29
TW201603584A (zh) 2016-01-16
US20230162749A1 (en) 2023-05-25
JP2019036987A (ja) 2019-03-07
EP4254988A3 (de) 2023-11-01
US10854213B2 (en) 2020-12-01
JP2023175947A (ja) 2023-12-12
CA2943570C (en) 2019-12-17
RU2016141642A3 (de) 2018-04-26
EP3123741B1 (de) 2019-02-20
JP2017513390A (ja) 2017-05-25
EP3487189B1 (de) 2023-05-24
EP3487189A1 (de) 2019-05-22
PT3123741T (pt) 2019-06-04
JP6422995B2 (ja) 2018-11-14
FI3487189T3 (fi) 2023-08-11
US11900955B2 (en) 2024-02-13
AU2015238354A1 (en) 2016-11-10
EP2928216A1 (de) 2015-10-07
AR099835A1 (es) 2016-08-24
KR20160140784A (ko) 2016-12-07
EP4254988A2 (de) 2023-10-04
WO2015144766A1 (en) 2015-10-01
KR101920356B1 (ko) 2018-11-21
TWI595785B (zh) 2017-08-11
JP2020182227A (ja) 2020-11-05
RU2016141642A (ru) 2018-04-26
US10192563B2 (en) 2019-01-29
CA2943570A1 (en) 2015-10-01
PL3487189T3 (pl) 2023-09-18
US11527254B2 (en) 2022-12-13

Similar Documents

Publication Publication Date Title
SG11201607953TA (en) Apparatus and method for screen related audio object remapping
EP3180922A4 (de) Verfahren und vorrichtung zur bearbeitung eines videos
EP3092572A4 (de) Verfahren und vorrichtung zur gemeinsamen bildschirmnutzung
EP3163849A4 (de) Verfahren und vorrichtung zur auswahl eines hauptmikrofons
GB201407872D0 (en) Screening apparatus and method
GB201420553D0 (en) Dynamic control apparatus and related method
EP3195603A4 (de) Messverfahren und messvorrichtung für fernsehpublikum
HK1216446A1 (zh) 圖像處理的方法及裝置
HK1216560A1 (zh) 種圖片處理方法和裝置
IL268543B (en) Method and device for audio coding
PL3668125T3 (pl) Sposób i urządzenie do renderowania sygnału akustycznego
GB2529182B (en) Method and apparatus for dynamic image content manipulation
EP3224703A4 (de) Elektronische vorrichtung und verfahren zur anzeige von grafikobjekten davon
GB2525041B (en) Sound capture method and apparatus
HUE054555T2 (hu) Audió kódoló eljárás és berendezés
IL246131A0 (en) Purification device and method
EP3198389C0 (de) Vorrichtung und verfahren zur identifizierung eines objekts
HK1220543A1 (zh) 種語音頻信號的處理方法和裝置
IL248575B (en) A method for encoding audio and an accompanying device
HK1218480A1 (zh) 種視頻顯示方法和裝置
HK1214336A1 (zh) 檢查裝置和檢查方法
GB201513866D0 (en) Method and apparatus for electrocagulation
SG11201609043PA (en) Audio coding method and related apparatus
GB201408412D0 (en) An apparatus and method for providing an image
HK1220542A1 (zh) 音頻編碼方法和裝置