EP2760020B1 - Maintien de stabilité spatiale au moyen d'un coefficient de gain commun - Google Patents

Maintien de stabilité spatiale au moyen d'un coefficient de gain commun Download PDF

Info

Publication number
EP2760020B1
EP2760020B1 EP13153062.8A EP13153062A EP2760020B1 EP 2760020 B1 EP2760020 B1 EP 2760020B1 EP 13153062 A EP13153062 A EP 13153062A EP 2760020 B1 EP2760020 B1 EP 2760020B1
Authority
EP
European Patent Office
Prior art keywords
gain coefficient
audio signal
maintaining
sound field
spatial stability
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP13153062.8A
Other languages
German (de)
English (en)
Other versions
EP2760020A1 (fr
Inventor
Phillip Alan Hetherington
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
2236008 Ontario Inc
Original Assignee
2236008 Ontario Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 2236008 Ontario Inc filed Critical 2236008 Ontario Inc
Priority to EP13153062.8A priority Critical patent/EP2760020B1/fr
Priority to CA2840730A priority patent/CA2840730C/fr
Publication of EP2760020A1 publication Critical patent/EP2760020A1/fr
Application granted granted Critical
Publication of EP2760020B1 publication Critical patent/EP2760020B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering

Definitions

  • the present disclosure relates to the field of processing sound fields.
  • a system and method for maintaining the spatial stability of a sound field utilizing a common gain coefficient are known in the art.
  • Stereo and multichannel audio configurations may be used for processing a sound field that is a spatial representation of an audible environment.
  • the processed sound field may be used to reproduce the audible environment using audio transducers.
  • Many computing devices may have multiple integrated microphones used for recording an audible environment associated with the computing device and communicating with other users.
  • Computing devices typically use multiple microphones to improve noise performance with noise suppression processes.
  • the noise suppression processes may result in the reduction or loss of spatial information.
  • the noise suppression processing may result in a single, or mono, output signal that has no spatial information.
  • WO 2009/096958 discloses a noise suppressor system and method. It is an object of the invention to overcome the shortcomings in the prior art. This object of the invention is solved by the independent claims. Specific embodiments are defined in the dependent claims.
  • a background noise estimate may be estimated for each of a first audio signal and a second audio signal.
  • a first gain coefficient may be calculated responsive to the first audio signal and the background noise estimate of the first audio signal.
  • Gain coefficients may be calculated using a gain coefficient calculator that may include one or more of an automatic gain controller, a noise suppressor and an echo canceller.
  • a second gain coefficient may be calculated responsive to the second audio signal and the background noise estimate of the second audio signal. The second gain coefficient may be calculated with one or more gain coefficient calculations similar to those applied to the first signal.
  • a common gain coefficient may be selected from one of the first gain coefficient and the second gain coefficient. Selecting a common gain coefficient may comprise selecting a gain coefficient from the first gain coefficient and the second gain coefficient that will result in a least amount of audio signal modification. The selected common gain coefficient may be applied to each of the first audio signal and the second audio signal.
  • Figure 1 is a schematic representation of a system for maintaining the spatial stability of a sound field.
  • Two or more inputs 102, or audio inputs 102 may receive the sound field.
  • Stereo and multichannel input configurations may be utilized for processing the sound field that is a spatial representation of an audible environment associated.
  • the audible environment may be associated with microphones on a local computing device or a remote computing device.
  • the remote computing device may transmit audio signals 120 to the local computing device that may utilize the received audio signals 120 as inputs 102.
  • Many audible environments associated with the inputs 102 may include undesirable content that may be mitigated by processing the received sound field.
  • Microphones that are arranged in a far field configuration typically receive more undesirable content (a.k.a. noise) than microphones in a near field configuration.
  • Far field configurations may include, for example, a hands free phone, a conference phone and microphones embedded into an automobile.
  • Far field configurations are capable of receiving a sound field that represents the spatial environment associated with the microphones.
  • Near field configurations typically place the microphone in close proximity to a user. Undesirable content may be mitigated in both near and far field configurations by processing the received sound field.
  • Processing that may mitigate undesirable content received in the sound field may include a gain coefficient calculator 106.
  • the gain coefficient calculator 106 may comprise one or more of a noise suppressor 110 and an echo canceller 112.
  • the echo canceller 112, noise suppressor 110 and other audio processing processes may calculate one or more gain coefficients. Each respective gain coefficient may be applied individually or a composite gain coefficient may be applied to process the sound field using a gain coefficient applier 118.
  • the echo canceller 112 mitigates echoes caused by signal feedback between two or more communication devices.
  • Signal feedback occurs when an audio transducer on a first communication device reproduces the signal received from a second communication device and subsequently the microphones on the first communication device recapture the reproduced signal.
  • the recaptured signal may be transmitted to the second communication device where the recaptured signal may be perceived as an echo of the previously transmitted signal.
  • the echo canceller 112 may detect when the signal has been recaptured and attempt to suppress the recaptured signal.
  • Many different types of echo cancellers 112 may mitigate echoes by calculating one or more gain coefficients that, when applied to the signals received by the microphone, suppress the echoes.
  • the echo suppressor 112 may calculate gain coefficients using a coherence calculation between near and far signals disclosed in U.S. Patent No. 8,036,879 .
  • the echo canceller 112 may determine that a large amount of suppression may mitigate the signal produced by the audio transducer from dominating, or coupling with, the microphone.
  • the echo canceller 112 may calculated large gain coefficients to mitigate the coupling.
  • the large gain coefficients may result in a gating effect where the communication device effectively supports only half duplex communication.
  • Half duplex communication may occur when the communication channel allows for reliable communication from alternatively either the far side or near side but not both simultaneously.
  • the large gain coefficients may suppress the coupling but may also suppress all content, including desired voice content resulting in half duplex communication.
  • Background noise is another type of undesirable signal content that may be mitigated by processing the input 102.
  • Many different types of noise suppressor 110 techniques may mitigate background noise.
  • An exemplary noise suppressor 110 is a recursive Wiener filter.
  • a background noise estimator 104 may estimate the background noise estimate.
  • the background noise estimate, or signal values may be calculated using the background noise estimation techniques disclosed in U.S. Patent No. 7,844 ,453 .
  • alternative background noise estimation techniques may be used, such as, for example, a noise power estimation technique based on minimum statistics.
  • An automatic gain controller 108 may calculate gain coefficients that may mitigate changing energy levels of the desired signal content. For example, the energy level of a user speaking into the microphone may change over time as the microphone may change position relative to the user. The gain coefficients calculated by the automatic gain controller 108 may mitigate the perception of the microphone changing position when applied to the input 102. In one example implementation, the automatic gain controller 108 may calculate gain coefficients using the gain controller techniques disclosed in U.S. Patent No. 8,116,485 .
  • the gain coefficient calculators 106 including the automatic gain controller 108, the noise suppressor 110 and the echo canceller 112 described above may be responsive to a background noise estimate generated by the background noise estimator 104.
  • the automatic gain controller 108 may utilize the background noise estimate to calculate gain coefficients that may be adjusted when signal energy exceeds the background noise estimate resulting in less background noise being amplified.
  • the echo canceller 112 may utilize the background noise estimate to calculate gain coefficients when the echoes exceed the background noise estimate by a threshold.
  • the background noise estimator 104 may calculate a background noise estimate for each input 102.
  • the background noise estimator 104 and the gain coefficient calculator 106 may calculate different background noise estimates and gain coefficients. Differences between the first gain coefficients applied to the first input 102 and second gain coefficients applied to the second input 102 may cause a distortion in the spatial image when reproduced in the output 116. Different gain coefficients applied to the first input 102 and the second input 102 may result in a shifting spatial image that may be distracting to a listener.
  • a common gain coefficient selector 114 may mitigate some distortion in the spatial image by selecting a first gain coefficient or a second gain coefficient that may be applied to both the first input 102 and the second input 102. Applying the same gain coefficient to all inputs 102 may mitigate distortions in the spatial image. The largest or the smallest gain coefficient may be selected. Alternatively, a combination of the gain coefficients may be calculated. For example, when the first input 102 contains a larger echo than the second input 102, an average gain coefficient may be calculated to perceptibly remove the larger echo. In another alternative, the common gain coefficient selector 114 may select the gain coefficient that will result in a least amount of audio signal modification.
  • the echo canceller 112 may calculate a first gain coefficient for application to the first input 102 that is larger than a second gain coefficient for application to the second input 102.
  • the larger gain coefficient may result in a lower energy signal to reduce the amount of echo in the first input 102.
  • the common gain coefficient selector 114 may select the smaller gain coefficient for application to both the first input 102 and the second input 102 resulting in less echo suppression while mitigating distortions in the spatial image.
  • the common gain coefficient selector 114 may utilize two or more inputs 102 where the selected gain coefficient is applied to the two or more input 102.
  • the common gain coefficient selector 114 in addition to the first input 102 and the second input 102 may process a third input 102 and their respective calculated gain coefficients.
  • the common gain coefficient selector 114 may not apply to all types of gain coefficient calculators 106. For example, some types of noise reduction processes may require additional processing to mitigate distortions in the spatial image. A first input 102 that contains significant wind noise may have wind noise reduction applied while the second input 102 has no wind noise reduction applied. The common gain coefficient selector 114 may not mitigate the wind noise that may be more distorting than a shift in the spatial image. In one implementation, wind noise suppression gains (a.k.a. gain coefficients) may be calculated using the system for suppressing wind noise disclosed in U.S. Patent No. 7,885,420 .
  • the common gain coefficient selector 114 may not be utilized because the audible artifacts associated with the coupling are perceptibly more distracting than distorting the spatial image.
  • a subband filter may process the received input 102 to extract frequency information.
  • the subband filter may be accomplished by various methods, such as a Fast Fourier Transform (FFT), critical filter bank, octave filter band, or one-third octave filter bank.
  • the subband analysis may include a time-based filter bank.
  • the time-based filter bank may be composed of a bank of overlapping bandpass filters, where the center frequencies have non-linear spacing such as octave, 3 rd octave, bark, mel, or other spacing techniques.
  • the one or more gain coefficients may be calculated for each frequency bin or band of the subband filter.
  • the gain coefficients and the selected gain coefficients may be filtered, or smoothed, over time and/or frequency.
  • Figure 3 is flow diagram representing a method for maintaining the spatial stability of the sound field.
  • the method 300 may be, for example, implemented using the systems 100 and 200 described herein with reference to Figures 1 and 2 .
  • the method 300 may include the following acts. Estimating a background noise estimate for each of a first audio signal and a second audio signal 302. Calculating a first gain coefficient responsive to the first audio signal and the background noise estimate of the first audio signal 304.
  • the gain coefficients may be calculated using a gain coefficient calculator that may include one or more of an automatic gain controller, a noise suppressor and an echo canceller. Calculating a second gain coefficient responsive to the second audio signal and the background noise estimate of the second audio signal 306.
  • the second gain coefficient may be calculated with one or more of the same gain coefficient calculations similar to those applied to the first signal. Selecting a common gain coefficient from one of the first gain coefficient and the second gain coefficient 308. Selecting the common gain coefficient may comprise selecting a gain coefficient from the first gain coefficient and the second gain coefficient that will result in a least amount of audio signal modification. Applying the selected common gain coefficient to each of the first audio signal and the second audio signal 310.
  • FIG. 2 is a further schematic representation of a system for maintaining the spatial stability of a sound field.
  • the system 200 comprises a processor 202, memory 204 (the contents of which are accessible by the processor 202) and an I/O interface 206.
  • the memory 204 may store instructions which when executed using the processor 202 may cause the system 200 to render the functionality associated with the system for maintaining the spatial stability of the sound field as described herein.
  • the memory 204 may store instructions which when executed using the processor 202 may cause the system 200 to render the functionality associated with the background noise estimator 104, the gain coefficient calculator 106, the automatic gain controller 108, the noise suppressor 110, the echo canceller 112, the common gain coefficient selector 114 and the gain coefficient applier 118 described herein.
  • data structure, temporary variables and other information may be stored in data storage 208.
  • the processor 202 may comprise a single processor or multiple processors that may be disposed on a single chip, on multiple devices or distributed over more that one system.
  • the processor 202 may be hardware that executes computer executable instructions or computer code embodied in the memory 204 or in other memory to perform one or more features of the system.
  • the processor 202 may include a general purpose processor, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a digital signal processor (DSP), a field programmable gate array (FPGA), a digital circuit, an analog circuit, a microcontroller, any other type of processor, or any combination thereof.
  • the memory 204 may comprise a device for storing and retrieving data, processor executable instructions, or any combination thereof.
  • the memory 204 may include non-volatile and/or volatile memory, such as a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or a flash memory.
  • RAM random access memory
  • ROM read-only memory
  • EPROM erasable programmable read-only memory
  • flash memory a flash memory.
  • the memory 204 may comprise a single device or multiple devices that may be disposed on one or more dedicated memory devices or on a processor or other similar device.
  • the memory 204 may include an optical, magnetic (hard-drive) or any other form of data storage device.
  • the memory 204 may store computer code, such as the background noise estimator 104, the gain coefficient calculator 106, the automatic gain controller 108, the noise suppressor 110, the echo canceller 112, the common gain coefficient selector 114 and the gain coefficient applier 118 as described herein.
  • the computer code may include instructions executable with the processor 202.
  • the computer code may be written in any computer language, such as C, C++, assembly language, channel program code, and/or any combination of computer languages.
  • the memory 204 may store information in data structures including, for example, the gain coefficients.
  • the I/O interface 206 may be used to connect devices such as, for example, the input 102 and output 116 to other components of the system 200.
  • the systems 100 and 200 may include more, fewer, or different components than illustrated in Figures 1 and 2 . Furthermore, each one of the components of systems 100 and 200 may include more, fewer, or different elements than is illustrated in Figures 1 and 2 .
  • Flags, data, databases, tables, entities, and other data structures may be separately stored and managed, may be incorporated into a single memory or database, may be distributed, or may be logically and physically organized in many different ways.
  • the components may operate independently or be part of a same program or hardware.
  • the components may be resident on separate hardware, such as separate removable circuit boards, or share common hardware, such as a same memory and processor for implementing instructions from the memory. Programs may be parts of a single program, separate programs, or distributed across several memories and processors.
  • the functions, acts or tasks illustrated in the figures or described may be executed in response to one or more sets of logic or instructions stored in or on computer readable media.
  • the functions, acts or tasks are independent of the particular type of instructions set, storage media, processor or processing strategy and may be performed by software, hardware, integrated circuits, firmware, micro code and the like, operating alone or in combination.
  • processing strategies may include multiprocessing, multitasking, parallel processing, distributed processing, and/or any other type of processing.
  • the instructions are stored on a removable media device for reading by local or remote systems.
  • the logic or instructions are stored in a remote location for transfer through a computer network or over telephone lines.
  • the logic or instructions may be stored within a given computer such as, for example, a CPU.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Quality & Reliability (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Circuit For Audible Band Transducer (AREA)

Claims (10)

  1. Procédé mis en oeuvre par ordinateur pour maintenir la stabilité spatiale d'un champ acoustique, comprenant les étapes consistant à :
    réaliser une estimation (302) de bruit de fond pour chacun d'un premier signal audio (120) provenant d'un premier microphone (102) et d'un deuxième signal audio (120) provenant d'un deuxième microphone (102) ;
    calculer (304) un premier coefficient de gain en réponse au premier signal audio (120) et à l'estimation de bruit de fond du premier signal audio (120) ;
    calculer (306) un deuxième coefficient de gain en réponse au deuxième signal audio (120) et à l'estimation de bruit de fond du deuxième signal audio (120) ;
    sélectionner (308) un coefficient de gain commun parmi le premier coefficient de gain et le deuxième coefficient de gain ; et
    appliquer (310) le coefficient de gain commun sélectionné à chacun du premier signal audio (120) et du deuxième signal audio (120).
  2. Procédé permettant de maintenir la stabilité spatiale d'un champ acoustique, selon la revendication 1, dans lequel la sélection du coefficient de gain commun comprend la sélection d'un coefficient de gain, parmi le premier coefficient de gain et le deuxième coefficient de gain, qui donnera lieu à la plus faible grandeur de modification de signaux audio (120).
  3. Procédé permettant de maintenir la stabilité spatiale d'un champ acoustique, selon la revendication 1 et 2, dans lequel la sélection du coefficient de gain commun comprend la sélection d'un coefficient de gain, parmi le premier coefficient de gain et le deuxième coefficient de gain, qui donnera lieu à la plus forte grandeur de modification de signaux audio (120).
  4. Procédé permettant de maintenir la stabilité spatiale d'un champ acoustique, selon les revendications 1 à 3, dans lequel la sélection du coefficient de gain commun comprend le moyennage d'un coefficient de gain, à partir du premier coefficient de gain et du deuxième coefficient de gain, qui donnera lieu à une grandeur moyenne combinée de modification de signaux audio (120).
  5. Procédé permettant de maintenir la stabilité spatiale d'un champ acoustique, selon les revendications 1 à 4, comprenant en outre les étapes consistant à :
    réaliser une estimation de bruit de fond pour un troisième signal audio (120) ;
    calculer un troisième coefficient de gain en réponse au troisième signal audio (120) et à l'estimation de bruit de fond du troisième signal audio (120) ;
    sélectionner le coefficient de gain commun parmi le premier coefficient de gain, le deuxième coefficient de gain et le troisième coefficient de gain ; et
    appliquer le coefficient de gain commun sélectionné à chacun du premier signal audio (120), du deuxième signal audio (120) et du troisième signal audio (120).
  6. Procédé permettant de maintenir la stabilité spatiale d'un champ acoustique, selon les revendications 1 à 5, dans lequel le calcul de chacun du premier coefficient de gain et du deuxième coefficient de gain inclut un ou plusieurs d'un calcul de suppression de bruit, d'un calcul d'annulation d'écho et d'un calcul de commande automatique de gain.
  7. Procédé permettant de maintenir la stabilité spatiale d'un champ acoustique, selon les revendications 1 à 6, comprenant en outre la génération d'un ensemble de sous-bandes pour chacun du premier signal audio (120) et du deuxième signal audio (120) à l'aide d'un filtre de sous-bandes ou d'une transformée de Fourier rapide.
  8. Procédé permettant de maintenir la stabilité spatiale d'un champ acoustique, selon les revendications 1 à 7, comprenant en outre la génération d'un ensemble de sous-bandes pour chacun du premier signal audio (120) et du deuxième signal audio (120) selon une technique d'espacement de bande critique, de bande d'une octave, d'un mel ou d'un bark.
  9. Système permettant de maintenir la stabilité spatiale d'un champ acoustique, le système comprenant :
    un processeur (202) ; et
    une mémoire (204) couplée au processeur (202), contenant des instructions, exécutables par le processeur (202), destinées à appliquer les instructions exécutant les étapes selon l'une quelconque des revendications de procédé 1 à 8.
  10. Support lisible par ordinateur, comprenant des instructions exécutables par ordinateur qui, lorsqu'elles sont exécutées par un processeur, mettent en oeuvre le procédé selon l'une quelconque des revendications 1 à 8.
EP13153062.8A 2013-01-29 2013-01-29 Maintien de stabilité spatiale au moyen d'un coefficient de gain commun Active EP2760020B1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP13153062.8A EP2760020B1 (fr) 2013-01-29 2013-01-29 Maintien de stabilité spatiale au moyen d'un coefficient de gain commun
CA2840730A CA2840730C (fr) 2013-01-29 2014-01-24 Maintien de la stabilite spatiale a l'aide d'un coefficient de gain commun

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP13153062.8A EP2760020B1 (fr) 2013-01-29 2013-01-29 Maintien de stabilité spatiale au moyen d'un coefficient de gain commun

Publications (2)

Publication Number Publication Date
EP2760020A1 EP2760020A1 (fr) 2014-07-30
EP2760020B1 true EP2760020B1 (fr) 2019-09-04

Family

ID=47713882

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13153062.8A Active EP2760020B1 (fr) 2013-01-29 2013-01-29 Maintien de stabilité spatiale au moyen d'un coefficient de gain commun

Country Status (1)

Country Link
EP (1) EP2760020B1 (fr)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7885420B2 (en) 2003-02-21 2011-02-08 Qnx Software Systems Co. Wind noise suppression system
US8116485B2 (en) 2005-05-16 2012-02-14 Qnx Software Systems Co Adaptive gain control system
US7844453B2 (en) 2006-05-12 2010-11-30 Qnx Software Systems Co. Robust noise estimation
US8036879B2 (en) 2007-05-07 2011-10-11 Qnx Software Systems Co. Fast acoustic cancellation
WO2009096958A1 (fr) * 2008-01-30 2009-08-06 Agere Systems Inc. Système et procédé de limitation de parasites

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
EP2760020A1 (fr) 2014-07-30

Similar Documents

Publication Publication Date Title
US9756440B2 (en) Maintaining spatial stability utilizing common gain coefficient
CN111341336B (zh) 一种回声消除方法、装置、终端设备及介质
US9106196B2 (en) Sound field spatial stabilizer with echo spectral coherence compensation
US9437180B2 (en) Adaptive noise reduction using level cues
EP2905779B1 (fr) Système et procédé de mise en forme de bruit résiduel dynamique
CN111128210B (zh) 具有声学回声消除的音频信号处理的方法和系统
US9949034B2 (en) Sound field spatial stabilizer
US20150189431A1 (en) Method And Device For Reducing Voice Reverberation Based On Double Microphones
KR20160076059A (ko) 디스플레이장치 및 그 반향 제거방법
CN111756906B (zh) 一种语音信号的回声抑制方法、装置和计算机可读介质
CN109215672B (zh) 一种声音信息的处理方法、装置及设备
US9099973B2 (en) Sound field spatial stabilizer with structured noise compensation
US9743179B2 (en) Sound field spatial stabilizer with structured noise compensation
CA2840730C (fr) Maintien de la stabilite spatiale a l'aide d'un coefficient de gain commun
US9210507B2 (en) Microphone hiss mitigation
EP2760020B1 (fr) Maintien de stabilité spatiale au moyen d'un coefficient de gain commun
EP2816818B1 (fr) Stabilisateur spatial du champ sonore avec compensation de cohérence spectrale d'écho
EP2816817B1 (fr) Stabilisateur spatial du champ sonore avec compensation de cohérence spectrale
EP2760021B1 (fr) Stabilisateur spatial de champ sonore
EP2760221A1 (fr) Atténuation de sifflements perceptibles de microphone
CA2835991C (fr) Stabilisateur spatial de champ acoustique
KR102685400B1 (ko) 에코 제거 방법、 장치 및 전자 장비
EP2816816B1 (fr) Stabilisateur spatial du champ sonore avec compensation de bruit structurée
CN115547355A (zh) 信号处理方法、装置及系统

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20130129

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: 2236008 ONTARIO INC.

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180201

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190318

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1176491

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190915

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013059931

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190904

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191204

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191205

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1176491

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190904

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200106

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200224

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013059931

Country of ref document: DE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R082

Ref document number: 602013059931

Country of ref document: DE

Representative=s name: MERH-IP MATIAS ERNY REICHL HOFFMANN PATENTANWA, DE

Ref country code: DE

Ref legal event code: R081

Ref document number: 602013059931

Country of ref document: DE

Owner name: BLACKBERRY LIMITED, WATERLOO, CA

Free format text: FORMER OWNER: 2236008 ONTARIO INC., WATERLOO, ONTARIO, CA

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG2D Information on lapse in contracting state deleted

Ref country code: IS

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200105

26N No opposition filed

Effective date: 20200605

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20200730 AND 20200805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200131

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200131

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200131

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200129

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190904

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230518

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240129

Year of fee payment: 12

Ref country code: GB

Payment date: 20240129

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20240125

Year of fee payment: 12