EP4336497A3 - Multisignal encoder, multisignal decoder, and related methods using signal whitening or signal post processing - Google Patents

Multisignal encoder, multisignal decoder, and related methods using signal whitening or signal post processing Download PDF

Info

Publication number
EP4336497A3
EP4336497A3 EP24153258.9A EP24153258A EP4336497A3 EP 4336497 A3 EP4336497 A3 EP 4336497A3 EP 24153258 A EP24153258 A EP 24153258A EP 4336497 A3 EP4336497 A3 EP 4336497A3
Authority
EP
European Patent Office
Prior art keywords
signal
multisignal
encoder
signals
preprocessing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP24153258.9A
Other languages
German (de)
French (fr)
Other versions
EP4336497A2 (en
Inventor
Eleni FOTOPOULOU
Markus Multrus
Sascha Dick
Goran MARKOVIC
Pallavi MABEN
Srikanth KORSE
Stefan Bayer
Sascha Disch
Jürgen HERRE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Original Assignee
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV filed Critical Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Publication of EP4336497A2 publication Critical patent/EP4336497A2/en
Publication of EP4336497A3 publication Critical patent/EP4336497A3/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/03—Spectral prediction for preventing pre-echo; Temporary noise shaping [TNS], e.g. in MPEG2 or MPEG4

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Mathematical Physics (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Stereophonic System (AREA)

Abstract

A multisignal encoder for encoding at least three audio signals, comprises: a signal preprocessor (100) for individually preprocessing each audio signal to obtain at least three preprocessed audio signals, wherein the preprocessing is performed so that a preprocessed audio signal is whitened with respect to the signal before preprocessing; an adaptive joint signal processor (200) for performing a processing of the at least three preprocessed audio signals to obtain at least three jointly processed signals or at least two jointly processed signals and an unprocessed signal; a signal encoder (300) for encoding each signal to obtain one or more encoded signals; and an output interface (400) for transmitting or storing an encoded multisignal audio signal comprising the one or more encoded signals, side information relating to the preprocessing and side information relating to the processing.
EP24153258.9A 2018-07-04 2019-06-27 Multisignal encoder, multisignal decoder, and related methods using signal whitening or signal post processing Pending EP4336497A3 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP18181767 2018-07-04
EP19732704.2A EP3818520B1 (en) 2018-07-04 2019-06-27 Multisignal audio coding using signal whitening as preprocessing
PCT/EP2019/067256 WO2020007719A1 (en) 2018-07-04 2019-06-27 Multisignal audio coding using signal whitening as preprocessing

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
EP19732704.2A Division EP3818520B1 (en) 2018-07-04 2019-06-27 Multisignal audio coding using signal whitening as preprocessing

Publications (2)

Publication Number Publication Date
EP4336497A2 EP4336497A2 (en) 2024-03-13
EP4336497A3 true EP4336497A3 (en) 2024-03-20

Family

ID=62985884

Family Applications (2)

Application Number Title Priority Date Filing Date
EP24153258.9A Pending EP4336497A3 (en) 2018-07-04 2019-06-27 Multisignal encoder, multisignal decoder, and related methods using signal whitening or signal post processing
EP19732704.2A Active EP3818520B1 (en) 2018-07-04 2019-06-27 Multisignal audio coding using signal whitening as preprocessing

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP19732704.2A Active EP3818520B1 (en) 2018-07-04 2019-06-27 Multisignal audio coding using signal whitening as preprocessing

Country Status (15)

Country Link
US (1) US20210104249A1 (en)
EP (2) EP4336497A3 (en)
JP (2) JP7384893B2 (en)
KR (1) KR102606259B1 (en)
CN (1) CN112639967A (en)
AR (1) AR116665A1 (en)
AU (2) AU2019298307A1 (en)
BR (1) BR112020026967A2 (en)
CA (1) CA3105508C (en)
MX (1) MX2020014077A (en)
RU (1) RU2769788C1 (en)
SG (1) SG11202012936VA (en)
TW (1) TWI720530B (en)
WO (1) WO2020007719A1 (en)
ZA (1) ZA202100719B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11664037B2 (en) * 2020-05-22 2023-05-30 Electronics And Telecommunications Research Institute Methods of encoding and decoding speech signal using neural network model recognizing sound sources, and encoding and decoding apparatuses for performing the same
CN113948095A (en) * 2020-07-17 2022-01-18 华为技术有限公司 Coding and decoding method and device for multi-channel audio signal
CN113948097A (en) * 2020-07-17 2022-01-18 华为技术有限公司 Multi-channel audio signal coding method and device
CN113948096A (en) * 2020-07-17 2022-01-18 华为技术有限公司 Method and device for coding and decoding multi-channel audio signal
CN114023338A (en) * 2020-07-17 2022-02-08 华为技术有限公司 Method and apparatus for encoding multi-channel audio signal
KR20220151953A (en) * 2021-05-07 2022-11-15 한국전자통신연구원 Methods of Encoding and Decoding an Audio Signal Using Side Information, and an Encoder and Decoder Performing the Method
CN115472171A (en) * 2021-06-11 2022-12-13 华为技术有限公司 Encoding and decoding method, apparatus, device, storage medium, and computer program
WO2023113490A1 (en) * 2021-12-15 2023-06-22 한국전자통신연구원 Audio processing method using complex number data, and apparatus for performing same
WO2023153228A1 (en) * 2022-02-08 2023-08-17 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Encoding device and encoding method
GB2624890A (en) * 2022-11-29 2024-06-05 Nokia Technologies Oy Parametric spatial audio encoding

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2830054A1 (en) * 2013-07-22 2015-01-28 Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder, audio decoder and related methods using two-channel processing within an intelligent gap filling framework
WO2017125544A1 (en) * 2016-01-22 2017-07-27 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for mdct m/s stereo with global ild with improved mid/side decision

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2676266A (en) 1951-03-10 1954-04-20 California Inst Res Found Cloud chamber
US7761289B2 (en) * 2005-10-24 2010-07-20 Lg Electronics Inc. Removing time delays in signal paths
US7831434B2 (en) * 2006-01-20 2010-11-09 Microsoft Corporation Complex-transform channel coding with extended-band frequency coding
CN101115051B (en) * 2006-07-25 2011-08-10 华为技术有限公司 Audio signal processing method, system and audio signal transmitting/receiving device
ATE500588T1 (en) * 2008-01-04 2011-03-15 Dolby Sweden Ab AUDIO ENCODERS AND DECODERS
EP2469741A1 (en) * 2010-12-21 2012-06-27 Thomson Licensing Method and apparatus for encoding and decoding successive frames of an ambisonics representation of a 2- or 3-dimensional sound field
PL2676266T3 (en) 2011-02-14 2015-08-31 Fraunhofer Ges Forschung Linear prediction based coding scheme using spectral domain noise shaping
TWI590234B (en) * 2012-07-19 2017-07-01 杜比國際公司 Method and apparatus for encoding audio data, and method and apparatus for decoding encoded audio data
US9401153B2 (en) * 2012-10-15 2016-07-26 Digimarc Corporation Multi-mode audio recognition and auxiliary data encoding and decoding
JP2015011076A (en) * 2013-06-26 2015-01-19 日本放送協会 Acoustic signal encoder, acoustic signal encoding method, and acoustic signal decoder
RU2665917C2 (en) * 2013-07-22 2018-09-04 Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. Multi-channel audio decoder, multi-channel audio encoder, methods, computer program and encoded audio representation using a decorrelation rendered audio signals
EP2830053A1 (en) * 2013-07-22 2015-01-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Multi-channel audio decoder, multi-channel audio encoder, methods and computer program using a residual-signal-based adjustment of a contribution of a decorrelated signal
TW202322101A (en) * 2013-09-12 2023-06-01 瑞典商杜比國際公司 Decoding method, and decoding device in multichannel audio system, computer program product comprising a non-transitory computer-readable medium with instructions for performing decoding method, audio system comprising decoding device
CN110473560B (en) * 2013-09-12 2023-01-06 杜比国际公司 Encoding of multi-channel audio content
EP2980794A1 (en) * 2014-07-28 2016-02-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder and decoder using a frequency domain processor and a time domain processor
EP3067887A1 (en) * 2015-03-09 2016-09-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder for encoding a multichannel signal and audio decoder for decoding an encoded audio signal
EP3067885A1 (en) * 2015-03-09 2016-09-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for encoding or decoding a multi-channel signal
EP3067889A1 (en) * 2015-03-09 2016-09-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and apparatus for signal-adaptive transform kernel switching in audio coding
JP6721977B2 (en) * 2015-12-15 2020-07-15 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ Audio-acoustic signal encoding device, audio-acoustic signal decoding device, audio-acoustic signal encoding method, and audio-acoustic signal decoding method
US10622003B2 (en) 2018-07-12 2020-04-14 Intel IP Corporation Joint beamforming and echo cancellation for reduction of noise and non-linear echo

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2830054A1 (en) * 2013-07-22 2015-01-28 Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder, audio decoder and related methods using two-channel processing within an intelligent gap filling framework
WO2017125544A1 (en) * 2016-01-22 2017-07-27 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for mdct m/s stereo with global ild with improved mid/side decision

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SCHUH FLORIAN ET AL: "Efficient Multichannel Audio Transform Coding with Low Delay and Complexity", AES CONVENTION 141; SEPTEMBER 2016, AES, 60 EAST 42ND STREET, ROOM 2520 NEW YORK 10165-2520, USA, 20 September 2016 (2016-09-20), XP040680994 *

Also Published As

Publication number Publication date
EP3818520B1 (en) 2024-01-24
JP2021529354A (en) 2021-10-28
AU2019298307A1 (en) 2021-02-25
TWI720530B (en) 2021-03-01
CA3105508A1 (en) 2020-01-09
KR20210040974A (en) 2021-04-14
AU2022235537A1 (en) 2022-10-13
BR112020026967A2 (en) 2021-03-30
RU2769788C1 (en) 2022-04-06
TW202016924A (en) 2020-05-01
US20210104249A1 (en) 2021-04-08
WO2020007719A1 (en) 2020-01-09
JP7384893B2 (en) 2023-11-21
EP3818520C0 (en) 2024-01-24
AR116665A1 (en) 2021-06-02
SG11202012936VA (en) 2021-01-28
MX2020014077A (en) 2021-03-09
ZA202100719B (en) 2022-08-31
CN112639967A (en) 2021-04-09
CA3105508C (en) 2024-03-26
EP4336497A2 (en) 2024-03-13
KR102606259B1 (en) 2023-11-29
JP2024010207A (en) 2024-01-23
EP3818520A1 (en) 2021-05-12

Similar Documents

Publication Publication Date Title
EP4336497A3 (en) Multisignal encoder, multisignal decoder, and related methods using signal whitening or signal post processing
PL1989920T3 (en) Audio encoding and decoding
DK0720811T3 (en) Noise reduction system for use in a binaural hearing aid
TW376611B (en) Transmission system with improved speech encoder
WO2007028250A3 (en) Method and device for binaural signal enhancement
EP1006510A3 (en) Signal encoding and decoding system
MX2017011495A (en) Apparatus and method for encoding or decoding a multi-channel signal.
WO2014020182A3 (en) Decoder and method for a generalized spatial-audio-object-coding parametric concept for multichannel downmix/upmix cases
MX2020007820A (en) Audio scene encoder, audio scene decoder and related methods using hybrid encoder/decoder spatial analysis.
ATE251376T1 (en) METHOD AND DEVICE FOR PROCESSING A STEREO AUDIO SIGNAL
MX2022002188A (en) Coding mode determination based on color format.
EP3686622A3 (en) Vehicle driving control apparatus including sound sensor and vehicle driving control method using the vehicle driving control apparatus
WO2021225472A3 (en) Joint objects image signal processing in temporal domain
CA3045847C (en) Downmixer and method for downmixing at least two channels and multichannel encoder and multichannel decoder
BR112022000230A2 (en) Encoding and decoding IVA bitstreams
MX2021010094A (en) Terminal and transmission method.
EP4365896A3 (en) Determination of spatial audio parameter encoding and associated decoding
SE0302110L (en) Stereo sound treatment method, device and system
WO2020136285A8 (en) Encoder and decoder, encoding method and decoding method with complexity handling for flexibly sized picture partitions
WO2021239255A9 (en) Method and apparatus for processing an initial audio signal
NZ727567A (en) Method for processing speech/audio signal and apparatus
EP4235663A3 (en) Audio encoder with a signal-dependent number and precision control, audio decoder, and related methods and computer programs
ES2076928T3 (en) PROCEDURE TO TRANSMIT A VIDEO SIGNAL.
CL2021003533A1 (en) Methods, devices and systems for the representation, encoding and decoding of discrete directivity data.
MX2022002279A (en) Encoding device, decoding device, encoding method, and decoding method.

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G10L0019030000

Ipc: G10L0019008000

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AC Divisional application: reference to earlier application

Ref document number: 3818520

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 19/03 20130101ALN20240215BHEP

Ipc: G10L 19/008 20130101AFI20240215BHEP