TWI317932B - Audio source classifier and method for separating audio sources from a monophonic audio signal - Google Patents

Audio source classifier and method for separating audio sources from a monophonic audio signal

Info

Publication number
TWI317932B
TWI317932B TW095137147A TW95137147A TWI317932B TW I317932 B TWI317932 B TW I317932B TW 095137147 A TW095137147 A TW 095137147A TW 95137147 A TW95137147 A TW 95137147A TW I317932 B TWI317932 B TW I317932B
Authority
TW
Taiwan
Prior art keywords
audio
separating
monophonic
sources
source classifier
Prior art date
Application number
TW095137147A
Other languages
English (en)
Other versions
TW200739517A (en
Inventor
Dmitri V Shmunk
Original Assignee
Dts Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dts Inc filed Critical Dts Inc
Publication of TW200739517A publication Critical patent/TW200739517A/zh
Application granted granted Critical
Publication of TWI317932B publication Critical patent/TWI317932B/zh

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0272—Voice signal separating
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/27—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique
    • G10L25/30—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the analysis technique using neural networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Auxiliary Devices For Music (AREA)
  • Stereophonic System (AREA)
  • Cable Transmission Systems, Equalization Of Radio And Reduction Of Echo (AREA)
  • Burglar Alarm Systems (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
TW095137147A 2005-10-06 2006-10-05 Audio source classifier and method for separating audio sources from a monophonic audio signal TWI317932B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US11/244,554 US20070083365A1 (en) 2005-10-06 2005-10-06 Neural network classifier for separating audio sources from a monophonic audio signal

Publications (2)

Publication Number Publication Date
TW200739517A TW200739517A (en) 2007-10-16
TWI317932B true TWI317932B (en) 2009-12-01

Family

ID=37911912

Family Applications (1)

Application Number Title Priority Date Filing Date
TW095137147A TWI317932B (en) 2005-10-06 2006-10-05 Audio source classifier and method for separating audio sources from a monophonic audio signal

Country Status (13)

Country Link
US (1) US20070083365A1 (zh)
EP (1) EP1941494A4 (zh)
JP (1) JP2009511954A (zh)
KR (1) KR101269296B1 (zh)
CN (1) CN101366078A (zh)
AU (1) AU2006302549A1 (zh)
BR (1) BRPI0616903A2 (zh)
CA (1) CA2625378A1 (zh)
IL (1) IL190445A0 (zh)
NZ (1) NZ566782A (zh)
RU (1) RU2418321C2 (zh)
TW (1) TWI317932B (zh)
WO (1) WO2007044377A2 (zh)

Families Citing this family (92)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1605437B1 (en) * 2004-06-04 2007-08-29 Honda Research Institute Europe GmbH Determination of the common origin of two harmonic components
EP1605439B1 (en) * 2004-06-04 2007-06-27 Honda Research Institute Europe GmbH Unified treatment of resolved and unresolved harmonics
EP1686561B1 (en) 2005-01-28 2012-01-04 Honda Research Institute Europe GmbH Determination of a common fundamental frequency of harmonic signals
ATE527833T1 (de) * 2006-05-04 2011-10-15 Lg Electronics Inc Verbesserung von stereo-audiosignalen mittels neuabmischung
US20100040135A1 (en) * 2006-09-29 2010-02-18 Lg Electronics Inc. Apparatus for processing mix signal and method thereof
EP2084901B1 (en) 2006-10-12 2015-12-09 LG Electronics Inc. Apparatus for processing a mix signal and method thereof
KR100891665B1 (ko) 2006-10-13 2009-04-02 엘지전자 주식회사 믹스 신호의 처리 방법 및 장치
EP2092516A4 (en) * 2006-11-15 2010-01-13 Lg Electronics Inc METHOD AND APPARATUS FOR AUDIO SIGNAL DECODING
KR101111520B1 (ko) * 2006-12-07 2012-05-24 엘지전자 주식회사 오디오 처리 방법 및 장치
US8265941B2 (en) 2006-12-07 2012-09-11 Lg Electronics Inc. Method and an apparatus for decoding an audio signal
US20100121470A1 (en) * 2007-02-13 2010-05-13 Lg Electronics Inc. Method and an apparatus for processing an audio signal
KR20090115200A (ko) * 2007-02-13 2009-11-04 엘지전자 주식회사 오디오 신호 처리 방법 및 장치
TWI356399B (en) * 2007-12-14 2012-01-11 Ind Tech Res Inst Speech recognition system and method with cepstral
JP5277887B2 (ja) * 2008-11-14 2013-08-28 ヤマハ株式会社 信号処理装置およびプログラム
US8200489B1 (en) * 2009-01-29 2012-06-12 The United States Of America As Represented By The Secretary Of The Navy Multi-resolution hidden markov model using class specific features
US20110301946A1 (en) * 2009-02-27 2011-12-08 Panasonic Corporation Tone determination device and tone determination method
JP5375400B2 (ja) * 2009-07-22 2013-12-25 ソニー株式会社 音声処理装置、音声処理方法およびプログラム
US8682669B2 (en) * 2009-08-21 2014-03-25 Synchronoss Technologies, Inc. System and method for building optimal state-dependent statistical utterance classifiers in spoken dialog systems
UA102347C2 (ru) 2010-01-19 2013-06-25 Долби Интернешнл Аб Усовершенствованное гармоническое преобразование на основе блока поддиапазонов
EP2529370B1 (en) * 2010-01-29 2017-12-27 University of Maryland, College Park Systems and methods for speech extraction
CN102446504B (zh) * 2010-10-08 2013-10-09 华为技术有限公司 语音/音乐识别方法及装置
US8762154B1 (en) * 2011-08-15 2014-06-24 West Corporation Method and apparatus of estimating optimum dialog state timeout settings in a spoken dialog system
US9210506B1 (en) * 2011-09-12 2015-12-08 Audyssey Laboratories, Inc. FFT bin based signal limiting
KR20130133541A (ko) * 2012-05-29 2013-12-09 삼성전자주식회사 오디오 신호 처리 방법 및 장치
KR20150032614A (ko) * 2012-06-04 2015-03-27 삼성전자주식회사 오디오 부호화방법 및 장치, 오디오 복호화방법 및 장치, 및 이를 채용하는 멀티미디어 기기
US9147157B2 (en) 2012-11-06 2015-09-29 Qualcomm Incorporated Methods and apparatus for identifying spectral peaks in neuronal spiking representation of a signal
CN103839551A (zh) * 2012-11-22 2014-06-04 鸿富锦精密工业（深圳）有限公司 音频处理系统与音频处理方法
CN103854644B (zh) * 2012-12-05 2016-09-28 中国传媒大学 单声道多音音乐信号的自动转录方法及装置
US9892743B2 (en) * 2012-12-27 2018-02-13 Avaya Inc. Security surveillance via three-dimensional audio space presentation
US10203839B2 (en) 2012-12-27 2019-02-12 Avaya Inc. Three-dimensional generalized space
CN104078050A (zh) * 2013-03-26 2014-10-01 杜比实验室特许公司 用于音频分类和音频处理的设备和方法
CN104347067B (zh) 2013-08-06 2017-04-12 华为技术有限公司 一种音频信号分类方法和装置
CN104575507B (zh) * 2013-10-23 2018-06-01 中国移动通信集团公司 语音通信方法及装置
US10564923B2 (en) * 2014-03-31 2020-02-18 Sony Corporation Method, system and artificial neural network
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US10801491B2 (en) 2014-07-23 2020-10-13 Schlumberger Technology Corporation Cepstrum analysis of oilfield pumping equipment health
EP3192012A4 (en) 2014-09-12 2018-01-17 Microsoft Technology Licensing, LLC Learning student dnn via output distribution
US20160162473A1 (en) * 2014-12-08 2016-06-09 Microsoft Technology Licensing, Llc Localization complexity of arbitrary language assets and resources
CN104464727B (zh) * 2014-12-11 2018-02-09 福州大学 一种基于深度信念网络的单通道音乐的歌声分离方法
US9407989B1 (en) 2015-06-30 2016-08-02 Arthur Woodrow Closed audio circuit
US11062228B2 (en) 2015-07-06 2021-07-13 Microsoft Technoiogy Licensing, LLC Transfer learning techniques for disparate label sets
CN105070301B (zh) * 2015-07-14 2018-11-27 福州大学 单通道音乐人声分离中的多种特定乐器强化分离方法
US10678828B2 (en) 2016-01-03 2020-06-09 Gracenote, Inc. Model-based media classification service using sensed media noise characteristics
US9886949B2 (en) 2016-03-23 2018-02-06 Google Inc. Adaptive audio enhancement for multichannel speech recognition
US10249305B2 (en) 2016-05-19 2019-04-02 Microsoft Technology Licensing, Llc Permutation invariant training for talker-independent multi-talker speech separation
EP3469584B1 (en) * 2016-06-14 2023-04-19 The Trustees of Columbia University in the City of New York Neural decoding of attentional selection in multi-speaker environments
US11373672B2 (en) 2016-06-14 2022-06-28 The Trustees Of Columbia University In The City Of New York Systems and methods for speech separation and neural decoding of attentional selection in multi-speaker environments
CN106847302B (zh) * 2017-02-17 2020-04-14 大连理工大学 基于卷积神经网络的单通道混合语音时域分离方法
US10614827B1 (en) * 2017-02-21 2020-04-07 Oben, Inc. System and method for speech enhancement using dynamic noise profile estimation
US10825445B2 (en) 2017-03-23 2020-11-03 Samsung Electronics Co., Ltd. Method and apparatus for training acoustic model
KR20180111271A (ko) * 2017-03-31 2018-10-11 삼성전자주식회사 신경망 모델을 이용하여 노이즈를 제거하는 방법 및 장치
KR102395472B1 (ko) * 2017-06-08 2022-05-10 한국전자통신연구원 가변 윈도우 사이즈 기반의 음원 분리 방법 및 장치
CN107507621B (zh) * 2017-07-28 2021-06-22 维沃移动通信有限公司 一种噪声抑制方法及移动终端
US11755949B2 (en) 2017-08-10 2023-09-12 Allstate Insurance Company Multi-platform machine learning systems
US10878144B2 (en) 2017-08-10 2020-12-29 Allstate Insurance Company Multi-platform model processing and execution management engine
US10885900B2 (en) 2017-08-11 2021-01-05 Microsoft Technology Licensing, Llc Domain adaptation in speech recognition via teacher-student learning
CN107680611B (zh) * 2017-09-13 2020-06-16 电子科技大学 基于卷积神经网络的单通道声音分离方法
CN107749299B (zh) * 2017-09-28 2021-07-09 瑞芯微电子股份有限公司 一种多音频输出方法和装置
KR102128153B1 (ko) * 2017-12-28 2020-06-29 한양대학교 산학협력단 기계 학습을 이용한 음악 소스 검색 장치 및 그 방법
WO2019133765A1 (en) * 2017-12-28 2019-07-04 Knowles Electronics, Llc Direction of arrival estimation for multiple audio content streams
WO2019133732A1 (en) * 2017-12-28 2019-07-04 Knowles Electronics, Llc Content-based audio stream separation
CN108229659A (zh) * 2017-12-29 2018-06-29 陕西科技大学 基于深度学习的钢琴单键音识别方法
US10283140B1 (en) 2018-01-12 2019-05-07 Alibaba Group Holding Limited Enhancing audio signals using sub-band deep neural networks
JP6725185B2 (ja) * 2018-01-15 2020-07-15 三菱電機株式会社 音響信号分離装置および音響信号分離方法
FR3079706B1 (fr) * 2018-03-29 2021-06-04 Inst Mines Telecom Procede et systeme de diffusion d'un flux audio multicanal a des terminaux de spectateurs assistant a un evenement sportif
US10957337B2 (en) 2018-04-11 2021-03-23 Microsoft Technology Licensing, Llc Multi-microphone speech separation
EP3576088A1 (en) 2018-05-30 2019-12-04 Fraunhofer Gesellschaft zur Förderung der Angewand Audio similarity evaluator, audio encoder, methods and computer program
EP3807878B1 (en) 2018-06-14 2023-12-13 Pindrop Security, Inc. Deep neural network based speech enhancement
CN108922517A (zh) * 2018-07-03 2018-11-30 百度在线网络技术（北京）有限公司 训练盲源分离模型的方法、装置及存储介质
CN108922556B (zh) * 2018-07-16 2019-08-27 百度在线网络技术（北京）有限公司 声音处理方法、装置及设备
CN109166593B (zh) * 2018-08-17 2021-03-16 腾讯音乐娱乐科技（深圳）有限公司 音频数据处理方法、装置及存储介质
CN109272987A (zh) * 2018-09-25 2019-01-25 河南理工大学 一种分选煤和矸石的声音识别方法
KR102691543B1 (ko) * 2018-11-16 2024-08-02 삼성전자주식회사 오디오 장면을 인식하는 전자 장치 및 그 방법
DE102019200954A1 (de) * 2019-01-25 2020-07-30 Sonova Ag Signalverarbeitungseinrichtung, System und Verfahren zur Verarbeitung von Audiosignalen
DE102019200956A1 (de) * 2019-01-25 2020-07-30 Sonova Ag Signalverarbeitungseinrichtung, System und Verfahren zur Verarbeitung von Audiosignalen
US11017774B2 (en) 2019-02-04 2021-05-25 International Business Machines Corporation Cognitive audio classifier
RU2720359C1 (ru) * 2019-04-16 2020-04-29 Хуавэй Текнолоджиз Ко., Лтд. Способ и оборудование распознавания эмоций в речи
US11315585B2 (en) 2019-05-22 2022-04-26 Spotify Ab Determining musical style using a variational autoencoder
US11355137B2 (en) 2019-10-08 2022-06-07 Spotify Ab Systems and methods for jointly estimating sound sources and frequencies from audio
CN110782915A (zh) * 2019-10-31 2020-02-11 广州艾颂智能科技有限公司 一种基于深度学习的波形音乐成分分离方法
US11366851B2 (en) 2019-12-18 2022-06-21 Spotify Ab Karaoke query processing system
US12033649B2 (en) * 2020-01-21 2024-07-09 Dolby International Ab Noise floor estimation and noise reduction
CN111370023A (zh) * 2020-02-17 2020-07-03 厦门快商通科技股份有限公司 一种基于gru的乐器识别方法及系统
CN111370019B (zh) * 2020-03-02 2023-08-29 字节跳动有限公司 声源分离方法及装置、神经网络的模型训练方法及装置
US11558699B2 (en) 2020-03-11 2023-01-17 Sonova Ag Hearing device component, hearing device, computer-readable medium and method for processing an audio-signal for a hearing device
CN111787462B (zh) * 2020-09-04 2021-01-26 蘑菇车联信息科技有限公司 音频流处理方法及系统、设备、介质
CN112115821B (zh) * 2020-09-04 2022-03-11 西北工业大学 一种基于小波近似系数熵的多信号智能调制模式识别方法
US11839815B2 (en) 2020-12-23 2023-12-12 Advanced Micro Devices, Inc. Adaptive audio mixing
CN112488092B (zh) * 2021-02-05 2021-08-24 中国人民解放军国防科技大学 基于深度神经网络的导航频段信号类型识别方法及系统
CN113674756B (zh) * 2021-10-22 2022-01-25 青岛科技大学 基于短时傅里叶变换和bp神经网络的频域盲源分离方法
CN114792529B (zh) * 2022-02-24 2024-09-27 中国电子科技集团公司第五十四研究所 一种基于hog+svm的短波通信话音检测方法
CN116828385A (zh) * 2023-08-31 2023-09-29 深圳市广和通无线通信软件有限公司 一种基于人工智能分析的音频数据处理方法及相关装置

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2807457B2 (ja) * 1987-07-17 1998-10-08 株式会社リコー 音声区間検出方式
JP3521844B2 (ja) 1992-03-30 2004-04-26 セイコーエプソン株式会社 ニューラルネットワークを用いた認識装置
US5960391A (en) * 1995-12-13 1999-09-28 Denso Corporation Signal extraction system, system and method for speech restoration, learning method for neural network model, constructing method of neural network model, and signal processing system
US6542866B1 (en) * 1999-09-22 2003-04-01 Microsoft Corporation Speech recognition method and apparatus utilizing multiple feature streams
US7295977B2 (en) * 2001-08-27 2007-11-13 Nec Laboratories America, Inc. Extracting classifying data in music from an audio bitstream
US7243060B2 (en) * 2002-04-02 2007-07-10 University Of Washington Single channel sound separation
FR2842014B1 (fr) * 2002-07-08 2006-05-05 Lyon Ecole Centrale Procede et appareil pour affecter une classe sonore a un signal sonore
EP1592282B1 (en) * 2003-02-07 2007-06-13 Nippon Telegraph and Telephone Corporation Teleconferencing method and system
US7091409B2 (en) * 2003-02-14 2006-08-15 University Of Rochester Music feature extraction using wavelet coefficient histograms
DE10313875B3 (de) * 2003-03-21 2004-10-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Analysieren eines Informationssignals
KR100486736B1 (ko) * 2003-03-31 2005-05-03 삼성전자주식회사 두개의 센서를 이용한 목적원별 신호 분리방법 및 장치
US20040260550A1 (en) * 2003-06-20 2004-12-23 Burges Chris J.C. Audio processing system and method for classifying speakers in audio data
US7232948B2 (en) * 2003-07-24 2007-06-19 Hewlett-Packard Development Company, L.P. System and method for automatic classification of music
US7340398B2 (en) * 2003-08-21 2008-03-04 Hewlett-Packard Development Company, L.P. Selective sampling for sound signal classification
EP1662485B1 (en) * 2003-09-02 2009-07-22 Nippon Telegraph and Telephone Corporation Signal separation method, signal separation device, signal separation program, and recording medium
US7295607B2 (en) * 2004-05-07 2007-11-13 Broadcom Corporation Method and system for receiving pulse width keyed signals

Also Published As

Publication number Publication date
US20070083365A1 (en) 2007-04-12
KR101269296B1 (ko) 2013-05-29
WO2007044377A3 (en) 2008-10-02
WO2007044377B1 (en) 2008-11-27
IL190445A0 (en) 2008-11-03
EP1941494A4 (en) 2011-08-10
RU2008118004A (ru) 2009-11-20
CN101366078A (zh) 2009-02-11
KR20080059246A (ko) 2008-06-26
TW200739517A (en) 2007-10-16
NZ566782A (en) 2010-07-30
RU2418321C2 (ru) 2011-05-10
WO2007044377A2 (en) 2007-04-19
EP1941494A2 (en) 2008-07-09
AU2006302549A1 (en) 2007-04-19
JP2009511954A (ja) 2009-03-19
CA2625378A1 (en) 2007-04-19
BRPI0616903A2 (pt) 2011-07-05

Similar Documents

Publication Publication Date Title
TWI317932B (en) Audio source classifier and method for separating audio sources from a monophonic audio signal
EP1915756A4 (en) METHOD FOR PRODUCING A CODED AUDIO SIGNAL AND METHOD FOR PROCESSING AN AUDIO SIGNAL
HK1126071A1 (en) Method and apparatus for processing audio signal
PL1938661T3 (pl) System i sposób przetwarzania dźwięku
PL2198632T3 (pl) Sposób i urządzenie do generowania dwuusznego sygnału audio
HK1102036A1 (en) A module and a method for processing audio signals
EP1899958A4 (en) METHOD AND DEVICE FOR DECODING AN AUDIO SIGNAL
EP4325723C0 (en) AUDIO SIGNAL PROCESSING METHODS
EP1881489A4 (en) DEVICE FOR SEPARATING MIXED AUDIO SIGNALS
HK1124424A1 (en) Apparatus and method for combining multiple parametrically coded audio sources
HK1120669A1 (en) Method and system for processing audio signal
HK1126306A1 (en) Method and apparatus for decoding an audio signal
GB0523946D0 (en) Audio signal processing method and system
EP2138813A4 (en) DEVICE FOR SEPARATING SOUND SOURCES AND METHOD FOR SEPARATING SOUND SOURCES
GB0718683D0 (en) Method and apparatus for generating and audio signal from multiple microphones
HK1121851A1 (en) A method and system for audio signal processing
HK1124682A1 (en) A method and apparatus for decoding an audio signal
HK1119823A1 (en) Method and apparatus for decoding an audio signal
EP1932147A4 (en) AUDIO SIGNAL DECODING METHOD
GB2441287B (en) A method and system for reproducing an audio signal
EP1774656A4 (en) METHOD AND DEVICE FOR SEPARATING AUDIO ELEMENTS FROM A COMBINED AUDIO POWER
GB2423000B (en) Audio signal processing apparatus
GB0717695D0 (en) System and method for processing audio data for narrow geometry speakers
EP1889239A4 (en) Method and apparatus for decoding an audio signal
TWI315830B (en) An audio processing system and method

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees