CN110797036B - 选择分组丢失隐藏过程的方法、设备和计算机可读装置 - Google Patents
选择分组丢失隐藏过程的方法、设备和计算机可读装置 Download PDFInfo
- Publication number
- CN110797036B CN110797036B CN201911216946.0A CN201911216946A CN110797036B CN 110797036 B CN110797036 B CN 110797036B CN 201911216946 A CN201911216946 A CN 201911216946A CN 110797036 B CN110797036 B CN 110797036B
- Authority
- CN
- China
- Prior art keywords
- audio
- host device
- received
- frame
- audio frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 105
- 230000003595 spectral effect Effects 0.000 claims abstract description 53
- 238000005259 measurement Methods 0.000 claims description 38
- 238000004590 computer program Methods 0.000 claims description 22
- 238000001228 spectrum Methods 0.000 claims description 19
- 230000004044 response Effects 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 6
- 230000005236 sound signal Effects 0.000 abstract description 25
- 238000010586 diagram Methods 0.000 description 10
- 238000004458 analytical method Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 230000001413 cellular effect Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000007774 longterm Effects 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 230000000737 periodic effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- ZYXYTGQFPZEUFX-UHFFFAOYSA-N benzpyrimoxan Chemical compound O1C(OCCC1)C=1C(=NC=NC=1)OCC1=CC=C(C=C1)C(F)(F)F ZYXYTGQFPZEUFX-UHFFFAOYSA-N 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000002085 persistent effect Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000002459 sustained effect Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 241000760358 Enodes Species 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000005562 fading Methods 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/40—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/005—Correction of errors induced by the transmission channel, if related to the coding algorithm
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0823—Errors, e.g. transmission errors
- H04L43/0829—Packet loss
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
- G10L25/18—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being spectral information of each sub-band
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Acoustics & Sound (AREA)
- Computer Security & Cryptography (AREA)
- Environmental & Geological Engineering (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephonic Communication Services (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911216946.0A CN110797036B (zh) | 2014-05-15 | 2015-05-12 | 选择分组丢失隐藏过程的方法、设备和计算机可读装置 |
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201461993814P | 2014-05-15 | 2014-05-15 | |
| US61/993,814 | 2014-05-15 | ||
| CN201911216946.0A CN110797036B (zh) | 2014-05-15 | 2015-05-12 | 选择分组丢失隐藏过程的方法、设备和计算机可读装置 |
| CN201580026185.6A CN106464683B (zh) | 2014-05-15 | 2015-05-12 | 选择分组丢失隐藏过程 |
| PCT/SE2015/050530 WO2015174911A1 (en) | 2014-05-15 | 2015-05-12 | Selecting a packet loss concealment procedure |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201580026185.6A Division CN106464683B (zh) | 2014-05-15 | 2015-05-12 | 选择分组丢失隐藏过程 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110797036A CN110797036A (zh) | 2020-02-14 |
| CN110797036B true CN110797036B (zh) | 2024-01-09 |
Family
ID=53385914
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911216946.0A Active CN110797036B (zh) | 2014-05-15 | 2015-05-12 | 选择分组丢失隐藏过程的方法、设备和计算机可读装置 |
| CN201911211452.3A Active CN110797035B (zh) | 2014-05-15 | 2015-05-12 | 选择分组丢失隐藏过程的方法、设备和计算机可读装置 |
| CN201580026185.6A Active CN106464683B (zh) | 2014-05-15 | 2015-05-12 | 选择分组丢失隐藏过程 |
Family Applications After (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911211452.3A Active CN110797035B (zh) | 2014-05-15 | 2015-05-12 | 选择分组丢失隐藏过程的方法、设备和计算机可读装置 |
| CN201580026185.6A Active CN106464683B (zh) | 2014-05-15 | 2015-05-12 | 选择分组丢失隐藏过程 |
Country Status (11)
| Country | Link |
|---|---|
| US (5) | US9712414B2 (enExample) |
| EP (3) | EP3258674B1 (enExample) |
| CN (3) | CN110797036B (enExample) |
| BR (1) | BR112016026655B1 (enExample) |
| DK (1) | DK3258674T3 (enExample) |
| ES (3) | ES2703437T3 (enExample) |
| IL (3) | IL248168A (enExample) |
| NO (1) | NO2780522T3 (enExample) |
| PL (3) | PL3422678T3 (enExample) |
| RU (3) | RU2704747C2 (enExample) |
| WO (1) | WO2015174911A1 (enExample) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| NO2780522T3 (enExample) | 2014-05-15 | 2018-06-09 | ||
| CA3016837C (en) * | 2016-03-07 | 2021-09-28 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Hybrid concealment method: combination of frequency and time domain packet loss concealment in audio codecs |
| EP3483884A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Signal filtering |
| WO2019091576A1 (en) | 2017-11-10 | 2019-05-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio encoders, audio decoders, methods and computer programs adapting an encoding and decoding of least significant bits |
| EP3483883A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio coding and decoding with selective postfiltering |
| EP3483882A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Controlling bandwidth in encoders and/or decoders |
| WO2019091573A1 (en) | 2017-11-10 | 2019-05-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for encoding and decoding an audio signal using downsampling or interpolation of scale parameters |
| EP3483880A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Temporal noise shaping |
| EP3483878A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio decoder supporting a set of different loss concealment tools |
| EP3483879A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Analysis/synthesis windowing function for modulated lapped transformation |
| EP3483886A1 (en) | 2017-11-10 | 2019-05-15 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Selecting pitch lag |
| WO2020164752A1 (en) | 2019-02-13 | 2020-08-20 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Audio transmitter processor, audio receiver processor and related methods and computer programs |
| CN113439302B (zh) * | 2019-02-21 | 2025-06-24 | 瑞典爱立信有限公司 | 用于频域分组丢失隐藏的方法及相关解码器 |
| CN115691563A (zh) * | 2022-10-27 | 2023-02-03 | 北京欧珀通信有限公司 | 语音数据处理方法、装置、终端设备及存储介质 |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1589550A (zh) * | 2001-11-15 | 2005-03-02 | 松下电器产业株式会社 | 错误隐蔽装置和方法 |
| CN101071568A (zh) * | 2005-11-23 | 2007-11-14 | 美国博通公司 | 音频解码的方法及系统 |
| CN101155140A (zh) * | 2006-10-01 | 2008-04-02 | 华为技术有限公司 | 音频流错误隐藏的方法、装置和系统 |
| CN103620672A (zh) * | 2011-02-14 | 2014-03-05 | 弗兰霍菲尔运输应用研究公司 | 用于低延迟联合语音及音频编码(usac)中的错误隐藏的装置和方法 |
| CN103688306A (zh) * | 2011-05-16 | 2014-03-26 | 谷歌公司 | 音频编解码器的丢包隐藏技术 |
| CN103714821A (zh) * | 2012-09-28 | 2014-04-09 | 杜比实验室特许公司 | 基于位置的混合域数据包丢失隐藏 |
| CN104969290A (zh) * | 2013-02-05 | 2015-10-07 | 瑞典爱立信有限公司 | 用于对音频帧丢失隐藏进行控制的方法和设备 |
| CN104995675A (zh) * | 2013-02-05 | 2015-10-21 | 瑞典爱立信有限公司 | 音频帧丢失隐藏 |
Family Cites Families (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FI963870A7 (fi) * | 1996-09-27 | 1998-03-28 | Nokia Oy Ab | Virheiden piilottaminen digitaalisessa audiovastaanottimessa |
| US6456719B1 (en) * | 1998-01-16 | 2002-09-24 | Winbond Electronics Corp. | Compressed audio error concealment apparatus and method |
| US7117156B1 (en) | 1999-04-19 | 2006-10-03 | At&T Corp. | Method and apparatus for performing packet loss or frame erasure concealment |
| EP1199709A1 (en) * | 2000-10-20 | 2002-04-24 | Telefonaktiebolaget Lm Ericsson | Error Concealment in relation to decoding of encoded acoustic signals |
| US7590525B2 (en) * | 2001-08-17 | 2009-09-15 | Broadcom Corporation | Frame erasure concealment for predictive speech coding based on extrapolation of speech waveform |
| US7061912B1 (en) | 2002-01-17 | 2006-06-13 | Microtune (San Diego) , Inc. | Method and apparatus of packet loss concealment for CVSD coders |
| CA2388439A1 (en) * | 2002-05-31 | 2003-11-30 | Voiceage Corporation | A method and device for efficient frame erasure concealment in linear predictive based speech codecs |
| SE527669C2 (sv) | 2003-12-19 | 2006-05-09 | Ericsson Telefon Ab L M | Förbättrad felmaskering i frekvensdomänen |
| CN101120399B (zh) * | 2005-01-31 | 2011-07-06 | 斯凯普有限公司 | 加权叠加方法 |
| US8015000B2 (en) * | 2006-08-03 | 2011-09-06 | Broadcom Corporation | Classification-based frame loss concealment for audio signals |
| EP2054880B1 (en) * | 2006-08-15 | 2011-04-20 | Broadcom Corporation | Time-warping of decoded audio signal after packet loss |
| CN101361113B (zh) * | 2006-08-15 | 2011-11-30 | 美国博通公司 | 丢包后的约束和受控解码 |
| FR2907586A1 (fr) * | 2006-10-20 | 2008-04-25 | France Telecom | Synthese de blocs perdus d'un signal audionumerique,avec correction de periode de pitch. |
| US8688437B2 (en) * | 2006-12-26 | 2014-04-01 | Huawei Technologies Co., Ltd. | Packet loss concealment for speech coding |
| GB0705324D0 (en) * | 2007-03-20 | 2007-04-25 | Skype Ltd | Method of transmitting data in a communication system |
| FR2929466A1 (fr) * | 2008-03-28 | 2009-10-02 | France Telecom | Dissimulation d'erreur de transmission dans un signal numerique dans une structure de decodage hierarchique |
| US8578247B2 (en) * | 2008-05-08 | 2013-11-05 | Broadcom Corporation | Bit error management methods for wireless audio communication channels |
| WO2010031003A1 (en) * | 2008-09-15 | 2010-03-18 | Huawei Technologies Co., Ltd. | Adding second enhancement layer to celp based core layer |
| US8676573B2 (en) * | 2009-03-30 | 2014-03-18 | Cambridge Silicon Radio Limited | Error concealment |
| JP5529635B2 (ja) * | 2010-06-10 | 2014-06-25 | キヤノン株式会社 | 音声信号処理装置および音声信号処理方法 |
| CN102810313B (zh) | 2011-06-02 | 2014-01-01 | 华为终端有限公司 | 音频解码方法及装置 |
| US9047863B2 (en) * | 2012-01-12 | 2015-06-02 | Qualcomm Incorporated | Systems, methods, apparatus, and computer-readable media for criticality threshold control |
| US9082398B2 (en) * | 2012-02-28 | 2015-07-14 | Huawei Technologies Co., Ltd. | System and method for post excitation enhancement for low bit rate speech coding |
| US20130282373A1 (en) * | 2012-04-23 | 2013-10-24 | Qualcomm Incorporated | Systems and methods for audio signal processing |
| US9338551B2 (en) * | 2013-03-15 | 2016-05-10 | Broadcom Corporation | Multi-microphone source tracking and noise suppression |
| KR102354331B1 (ko) * | 2014-02-24 | 2022-01-21 | 삼성전자주식회사 | 신호 분류 방법 및 장치, 및 이를 이용한 오디오 부호화방법 및 장치 |
| EP2922054A1 (en) * | 2014-03-19 | 2015-09-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus, method and corresponding computer program for generating an error concealment signal using an adaptive noise estimation |
| NO2780522T3 (enExample) | 2014-05-15 | 2018-06-09 |
-
2012
- 2012-11-14 NO NO12795678A patent/NO2780522T3/no unknown
-
2015
- 2015-05-12 CN CN201911216946.0A patent/CN110797036B/zh active Active
- 2015-05-12 EP EP17185288.2A patent/EP3258674B1/en active Active
- 2015-05-12 CN CN201911211452.3A patent/CN110797035B/zh active Active
- 2015-05-12 RU RU2018128779A patent/RU2704747C2/ru active
- 2015-05-12 US US15/034,126 patent/US9712414B2/en active Active
- 2015-05-12 EP EP15728656.8A patent/EP3111624B1/en active Active
- 2015-05-12 PL PL18189691T patent/PL3422678T3/pl unknown
- 2015-05-12 PL PL17185288T patent/PL3258674T3/pl unknown
- 2015-05-12 EP EP18189691.1A patent/EP3422678B1/en active Active
- 2015-05-12 BR BR112016026655-2A patent/BR112016026655B1/pt active IP Right Grant
- 2015-05-12 ES ES17185288T patent/ES2703437T3/es active Active
- 2015-05-12 ES ES18189691T patent/ES2780000T3/es active Active
- 2015-05-12 WO PCT/SE2015/050530 patent/WO2015174911A1/en not_active Ceased
- 2015-05-12 DK DK17185288.2T patent/DK3258674T3/en active
- 2015-05-12 ES ES15728656.8T patent/ES2650787T3/es active Active
- 2015-05-12 RU RU2016149098A patent/RU2665889C2/ru active
- 2015-05-12 PL PL15728656T patent/PL3111624T3/pl unknown
- 2015-05-12 CN CN201580026185.6A patent/CN106464683B/zh active Active
-
2016
- 2016-10-02 IL IL248168A patent/IL248168A/en active IP Right Grant
-
2017
- 2017-06-21 US US15/629,426 patent/US10103958B2/en active Active
- 2017-07-02 IL IL253262A patent/IL253262B/en active IP Right Grant
-
2018
- 2018-09-12 US US16/129,211 patent/US10476769B2/en not_active Expired - Fee Related
-
2019
- 2019-10-01 US US16/589,535 patent/US11038787B2/en active Active
- 2019-10-14 RU RU2019132422A patent/RU2019132422A/ru unknown
-
2020
- 2020-06-09 IL IL275257A patent/IL275257B/en active IP Right Grant
-
2021
- 2021-05-11 US US17/317,283 patent/US11729079B2/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1589550A (zh) * | 2001-11-15 | 2005-03-02 | 松下电器产业株式会社 | 错误隐蔽装置和方法 |
| CN101071568A (zh) * | 2005-11-23 | 2007-11-14 | 美国博通公司 | 音频解码的方法及系统 |
| CN101155140A (zh) * | 2006-10-01 | 2008-04-02 | 华为技术有限公司 | 音频流错误隐藏的方法、装置和系统 |
| CN103620672A (zh) * | 2011-02-14 | 2014-03-05 | 弗兰霍菲尔运输应用研究公司 | 用于低延迟联合语音及音频编码(usac)中的错误隐藏的装置和方法 |
| CN103688306A (zh) * | 2011-05-16 | 2014-03-26 | 谷歌公司 | 音频编解码器的丢包隐藏技术 |
| CN103714821A (zh) * | 2012-09-28 | 2014-04-09 | 杜比实验室特许公司 | 基于位置的混合域数据包丢失隐藏 |
| CN104969290A (zh) * | 2013-02-05 | 2015-10-07 | 瑞典爱立信有限公司 | 用于对音频帧丢失隐藏进行控制的方法和设备 |
| CN104995675A (zh) * | 2013-02-05 | 2015-10-21 | 瑞典爱立信有限公司 | 音频帧丢失隐藏 |
Also Published As
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11729079B2 (en) | Selecting a packet loss concealment procedure | |
| JP6377862B2 (ja) | エンコーダ選択 | |
| US10297264B2 (en) | Audio signal classification and coding | |
| US9972334B2 (en) | Decoder audio classification |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |