EP3741138A4 - Zugeordnete räumliche audiowiedergabe - Google Patents

Zugeordnete räumliche audiowiedergabe Download PDF

Info

Publication number
EP3741138A4
EP3741138A4 EP19740861.0A EP19740861A EP3741138A4 EP 3741138 A4 EP3741138 A4 EP 3741138A4 EP 19740861 A EP19740861 A EP 19740861A EP 3741138 A4 EP3741138 A4 EP 3741138A4
Authority
EP
European Patent Office
Prior art keywords
audio playback
spatial audio
associated spatial
playback
spatial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19740861.0A
Other languages
English (en)
French (fr)
Other versions
EP3741138A1 (de
Inventor
Lasse Laaksonen
Antti Eronen
Sujeet Shyamsundar Mate
Arto Lehtiniemi
Kari Järvinen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Technologies Oy
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Publication of EP3741138A1 publication Critical patent/EP3741138A1/de
Publication of EP3741138A4 publication Critical patent/EP3741138A4/de
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H04S7/304—For headphones
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4852—End-user interface for client configuration for modifying audio parameters, e.g. switching between mono and stereo
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/20—Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/15—Aspects of sound capture and related signal processing for recording or reproduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Computer Hardware Design (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Social Psychology (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Stereophonic System (AREA)
EP19740861.0A 2018-01-19 2019-01-14 Zugeordnete räumliche audiowiedergabe Pending EP3741138A4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GBGB1800918.3A GB201800918D0 (en) 2018-01-19 2018-01-19 Associated spatial audio playback
PCT/FI2019/050024 WO2019141899A1 (en) 2018-01-19 2019-01-14 Associated spatial audio playback

Publications (2)

Publication Number Publication Date
EP3741138A1 EP3741138A1 (de) 2020-11-25
EP3741138A4 true EP3741138A4 (de) 2021-09-29

Family

ID=61283717

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19740861.0A Pending EP3741138A4 (de) 2018-01-19 2019-01-14 Zugeordnete räumliche audiowiedergabe

Country Status (5)

Country Link
US (2) US11363401B2 (de)
EP (1) EP3741138A4 (de)
CN (2) CN114860188A (de)
GB (1) GB201800918D0 (de)
WO (1) WO2019141899A1 (de)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110537373B (zh) * 2017-04-25 2021-09-28 索尼公司 信号处理装置和方法以及存储介质
EP3780628A1 (de) * 2018-03-29 2021-02-17 Sony Corporation Informationsverarbeitungsvorrichtung, informationsverarbeitungsverfahren und programm
KR102458962B1 (ko) * 2018-10-02 2022-10-26 한국전자통신연구원 가상 현실에서 음향 확대 효과 적용을 위한 음향 신호 제어 방법 및 장치
CN112449210A (zh) * 2019-08-28 2021-03-05 北京字节跳动网络技术有限公司 声音处理方法、装置、电子设备及计算机可读存储介质
CN115299079A (zh) * 2020-03-19 2022-11-04 松下电器（美国）知识产权公司 音响再现方法、计算机程序及音响再现装置
US20230215102A1 (en) * 2020-05-25 2023-07-06 Sony Group Corporation Media distribution device, media distribution method, and program
EP4054212A1 (de) * 2021-03-04 2022-09-07 Nokia Technologies Oy Räumliche audiomodifikation
GB2614254A (en) * 2021-12-22 2023-07-05 Nokia Technologies Oy Apparatus, methods and computer programs for generating spatial audio output

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080298597A1 (en) * 2007-05-30 2008-12-04 Nokia Corporation Spatial Sound Zooming
WO2017037032A1 (en) * 2015-09-04 2017-03-09 Koninklijke Philips N.V. Method and apparatus for processing an audio signal associated with a video image
US20180007489A1 (en) * 2016-06-30 2018-01-04 Nokia Technologies Oy Audio Volume Handling

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030160862A1 (en) * 2002-02-27 2003-08-28 Charlier Michael L. Apparatus having cooperating wide-angle digital camera system and microphone array
JP4692550B2 (ja) 2008-01-21 2011-06-01 ソニー株式会社 画像処理装置、その処理方法およびプログラム
US9930310B2 (en) * 2009-09-09 2018-03-27 Apple Inc. Audio alteration techniques
EP2508011B1 (de) 2009-11-30 2014-07-30 Nokia Corporation Audiozoomverfahren in einer audioszene
US9210503B2 (en) * 2009-12-02 2015-12-08 Audience, Inc. Audio zoom
EP2346028A1 (de) * 2009-12-17 2011-07-20 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Vorrichtung und Verfahren zur Umwandlung eines ersten parametrisch beabstandeten Audiosignals in ein zweites parametrisch beabstandetes Audiosignal
US9338394B2 (en) 2010-11-15 2016-05-10 Cisco Technology, Inc. System and method for providing enhanced audio in a video environment
US9100633B2 (en) * 2010-11-18 2015-08-04 Lg Electronics Inc. Electronic device generating stereo sound synchronized with stereographic moving picture
US20130249947A1 (en) * 2011-08-26 2013-09-26 Reincloud Corporation Communication using augmented reality
US9716943B2 (en) * 2011-12-21 2017-07-25 Nokia Technologies Oy Audio lens
EP2680616A1 (de) 2012-06-25 2014-01-01 LG Electronics Inc. Mobiles Endgerät und Audiozoomverfahren dafür
US9781507B2 (en) * 2013-04-08 2017-10-03 Nokia Technologies Oy Audio apparatus
EP2842529A1 (de) 2013-08-30 2015-03-04 GN Store Nord A/S Audiowiedergabesystem zur Kategorisierung von raumbezogenen Objekten
KR102262853B1 (ko) * 2014-09-01 2021-06-10 삼성전자주식회사 복수의 마이크를 포함하는 전자 장치 및 이의 운용 방법
US9602946B2 (en) * 2014-12-19 2017-03-21 Nokia Technologies Oy Method and apparatus for providing virtual audio reproduction
EP3151534A1 (de) * 2015-09-29 2017-04-05 Thomson Licensing Verfahren zur neufokussierung von aufgenommenen bildern einer plenoptischen kamera und auf audio basierendes neufokussierungsbildsystem
CN114189793B (zh) 2016-02-04 2024-03-19 奇跃公司 增强现实系统中定向音频的技术
CN109076306B (zh) * 2016-04-12 2021-04-13 皇家飞利浦有限公司 强调靠近焦距的声音源的空间音频处理
US9820042B1 (en) * 2016-05-02 2017-11-14 Knowles Electronics, Llc Stereo separation and directional suppression with omni-directional microphones
EP3301951A1 (de) * 2016-09-30 2018-04-04 Koninklijke KPN N.V. Audioobjektverarbeitung auf basis von räumlichen zuhörerinformationen
EP3340614A1 (de) * 2016-12-21 2018-06-27 Thomson Licensing Verfahren und vorrichtung zur synchronisierung von audio und video bei der aufzeichnung unter verwendung einer zoom-funktion
CN110998566B (zh) * 2017-06-30 2024-04-12 交互数字Vc控股公司 基于眼睛跟踪和生理测量而生成和显示360度视频的方法和装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080298597A1 (en) * 2007-05-30 2008-12-04 Nokia Corporation Spatial Sound Zooming
WO2017037032A1 (en) * 2015-09-04 2017-03-09 Koninklijke Philips N.V. Method and apparatus for processing an audio signal associated with a video image
US20180007489A1 (en) * 2016-06-30 2018-01-04 Nokia Technologies Oy Audio Volume Handling

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Virtual Reality (VR) media services over 3GPP (Release 15)", 3GPP STANDARD; TECHNICAL REPORT; 3GPP TR 26.918, 3RD GENERATION PARTNERSHIP PROJECT (3GPP), MOBILE COMPETENCE CENTRE ; 650, ROUTE DES LUCIOLES ; F-06921 SOPHIA-ANTIPOLIS CEDEX ; FRANCE, vol. SA WG4, no. V15.1.0, 9 January 2018 (2018-01-09), pages 1 - 119, XP051392540 *
See also references of WO2019141899A1 *
SIMONE FÜG (FRAUNHOFER) ET AL: "Proposal for processing of 3D Audio for 360° video content", no. m37202, 14 October 2015 (2015-10-14), XP030065570, Retrieved from the Internet <URL:http://phenix.int-evry.fr/mpeg/doc_end_user/documents/113_Geneva/wg11/m37202-v1-m37202.zip m37202_(Proposal_for processing_for_360_deg_video_content).docx> [retrieved on 20151014] *

Also Published As

Publication number Publication date
US11363401B2 (en) 2022-06-14
GB201800918D0 (en) 2018-03-07
CN111630878B (zh) 2022-05-31
US20220279306A1 (en) 2022-09-01
CN114860188A (zh) 2022-08-05
US12028700B2 (en) 2024-07-02
EP3741138A1 (de) 2020-11-25
US20200344564A1 (en) 2020-10-29
WO2019141899A1 (en) 2019-07-25
CN111630878A (zh) 2020-09-04

Similar Documents

Publication Publication Date Title
EP3808108A4 (de) Räumlicher ton für interaktive tonumgebungen
EP3420736A4 (de) Wiedergabe von audioantworten
EP3803858A4 (de) Räumliche audioparameterzusammenführung
EP3776544A4 (de) Parameter von räumlichem audio und zugehörige wiedergabe von räumlichem audio
EP3625977A4 (de) Vr-audio-superzoom
EP3453190A4 (de) Systeme zur immersiven audiowiedergabe
EP3741138A4 (de) Zugeordnete räumliche audiowiedergabe
EP3311593A4 (de) Binaurale audiowiedergabe
EP3809718A4 (de) Lautsprecher
EP3741139A4 (de) Zugeordnete räumliche audiowiedergabe
EP3739895A4 (de) Medienplayback
EP3554057B8 (de) Audiokopfhörersystem
EP3841763A4 (de) Räumliche audioverarbeitung
EP3777241A4 (de) Räumliche schallwiedergabe
EP3861767A4 (de) Nahfeldaudiowiedergabe
EP3809720A4 (de) Lautsprecher
EP3777235A4 (de) Räumliche audioaufnahme
EP3688753A4 (de) Aufzeichnung und wiedergabe von räumlichen audiosignalen
EP3613221A4 (de) Verbesserung der lautsprecherwiedergabe unter verwendung eines im räumlichen ausmass verarbeiteten audiosignals
EP3695616A4 (de) Tonsignalwiedergabe
EP3803860A4 (de) Räumliche audioparameter
EP3881566A4 (de) Audioverarbeitung
EP3897386A4 (de) Audioentzerrungsmetadaten
EP3902282A4 (de) Klangwiedergabevorrichtung
EP3777242A4 (de) Räumliche schallwiedergabe

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200819

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20210830

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/01 20060101ALI20210824BHEP

Ipc: G06F 3/16 20060101ALI20210824BHEP

Ipc: G06F 1/16 20060101ALI20210824BHEP

Ipc: G06T 19/00 20110101ALI20210824BHEP

Ipc: H04N 21/485 20110101ALI20210824BHEP

Ipc: H04N 21/439 20110101ALI20210824BHEP

Ipc: H04R 3/00 20060101ALI20210824BHEP

Ipc: H04S 7/00 20060101AFI20210824BHEP