EP1387514A2 - Procédé et dispositif de comparaison de signaux - Google Patents

Procédé et dispositif de comparaison de signaux Download PDF

Info

Publication number
EP1387514A2
EP1387514A2 EP03254607A EP03254607A EP1387514A2 EP 1387514 A2 EP1387514 A2 EP 1387514A2 EP 03254607 A EP03254607 A EP 03254607A EP 03254607 A EP03254607 A EP 03254607A EP 1387514 A2 EP1387514 A2 EP 1387514A2
Authority
EP
European Patent Office
Prior art keywords
signal
representation
audio
section
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP03254607A
Other languages
German (de)
English (en)
Other versions
EP1387514A3 (fr
Inventor
Yuan-Xing British Broadcasting Corp. Zheng
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
British Broadcasting Corp
Original Assignee
British Broadcasting Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by British Broadcasting Corp filed Critical British Broadcasting Corp
Publication of EP1387514A2 publication Critical patent/EP1387514A2/fr
Publication of EP1387514A3 publication Critical patent/EP1387514A3/fr
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/12—Arrangements for observation, testing or troubleshooting
    • H04H20/14—Arrangements for observation, testing or troubleshooting for monitoring programmes
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/58—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of audio
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/121—Musical libraries, i.e. musical databases indexed by musical parameters, wavetables, indexing schemes using musical parameters, musical rule bases or knowledge bases, e.g. for automatic composing methods
    • G10H2240/131—Library retrieval, i.e. searching a database or selecting a specific musical piece, segment, pattern, rule or parameter set
    • G10H2240/141—Library retrieval matching, i.e. any of the steps of matching an inputted segment or phrase with musical database contents, e.g. query by humming, singing or playing; the steps may include, e.g. musical analysis of the input, musical feature extraction, query formulation, or details of the retrieval process
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2250/00—Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
    • G10H2250/025—Envelope processing of music signals in, e.g. time domain, transform domain or cepstrum domain
    • G10H2250/031—Spectrum envelope processing

Definitions

  • the invention provides a method and apparatus for determining the relative time difference or delay between first and second audio signals that represent substantially the same audio content.
  • the invention also provides a method and an apparatus for determining whether two audio signals contain the same audio content.
  • the preferred system processes the data block by extracting the dominant frequency from each frame using a Fast Fourier Transform (FFT).
  • FFT Fast Fourier Transform
  • the results of the sampling step S30 is to produce an audio signature of the type illustrated in Figure 4.
  • the wave form contains a large number of unrelated and sporadic peaks, none of which could reliably be taken to indicate the presence of a match.
  • This diagram illustrates the need to count the number of peaks for a given sample size in order to determine the quality of the plot.
  • step S70 The results of the correlation are output in step S70 indicating whether a match was found or not. If a match was found, the relative delay between the two signals may also be output. This could be used in a synchronising method for example, where one of the signals is a master or timing signal and the other is the signal to be synchronised. Using the relative delay calculated for one signal to the other, synchronisation could be achieved by calculating the phase shift or time shift required to align the two signal in time and applying this to the signal that is to be synchronised.
  • the previous signature for the second signal that is the signal from the programme originator, is also discarded, and a new source signature representing the next portion or region of the second audio signal is received for comparison.
  • This new portion may be that part of the signal following on directly in time from the previous signal section.
  • the comparison is then performed again based on the next sections of the two signals, and a match can be expected to occur at a position in the first audio signature given by one length of the second signature.
  • Figure 10 shows a schematic illustration of the preferred system in an implementation for monitoring broadcast signals at a programme originator and at a destination transmitter.
  • the input audio source of the programme originator is first received at an input terminal 102, connected to a server or computer processor 104 at the programme originator's location 106, and also to an audio network 108.
  • the signal is passed to the computer processor 104 which generates the audio signature of the master or original signal and transmits it on IT network 110 to the location 112 of the destination transmitter.
  • the audio source signal is transmitted on the private circuits of audio network 108 to the same destination 112.
  • a correlator 114 At the destination transmitter location 112, are a correlator 114 and a processor or client computer 116.
  • the processor 116 generates an audio signature of the signal received on the audio network and passes this to the correlator 114.
  • the correlator 114 receives the generated audio signature from the IT network 110, as well as the signature generated by the processor 116 and performs the comparison method illustrated in Figure 1. The results are output to output terminal 118, and may be routed back to the programme originator or used at the destination transmitter.
  • the destination processor 116 receives the audio source signal over the audio network 108 and generates an audio signature representing the received signal. This signature is then transmitted back to the programme originator's location 106 for comparison on correlator 120.
  • the correlator 120 also receives representation of the audio signal generated by processor 104. The correlator 120 compares the audio representation received from the transmitter location 112 with audio signature it received from the processor 104 and the results are output to output 122 at the programme originator's location.
  • the signal being transmitted at a regional broadcasting centre will in most cases differ from the original signal transmitted from the programme originator. This is because any local content to be added to the received signal will be added at the regional centre. As a result, it is preferable that during broadcasting of local content the preferred system is deactivated. Otherwise, the system will report repeated occurrence of signals that do not match.
  • Figure 12 shows an arrangement in which the comparison is done locally within a single computer. Providing the computer has means to capture two audio signals, such as two audio capture cards connected to audio inputs, the single computer can prepare both of the audio signatures and perform the comparison.
  • the comparison may be performed by a third party computer, which is adapted to receive inputs from first and second computers which perform the audio capture.
  • 'capture' should also be understood to mean receive, as the signal could be captured by any means known in the art and the transmitted to the computer for comparison. In this case, the computer merely needs a receiver in order to receive the already captured signal.
  • the preferred system provides an audio content monitoring system that is able to work in real time on continuous signals, and that is able to match audio content in the presence of delays even when the system has no previous knowledge of which signal will arrive first.
  • the system can react quickly and reliably to indicate any incorrect audio content, and can regain the lock between the two signals once the incorrect audio content has been corrected.
  • the system is able to resist impairments to the audio signal such as noise, coding/decoding artefacts while requiring no external or internal synchronisation to operate.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Synchronisation In Digital Transmission Systems (AREA)
EP03254607A 2002-07-31 2003-07-24 Procédé et dispositif de comparaison de signaux Withdrawn EP1387514A3 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0217772 2002-07-31
GB0217772A GB2391322B (en) 2002-07-31 2002-07-31 Signal comparison method and apparatus

Publications (2)

Publication Number Publication Date
EP1387514A2 true EP1387514A2 (fr) 2004-02-04
EP1387514A3 EP1387514A3 (fr) 2008-12-10

Family

ID=9941474

Family Applications (1)

Application Number Title Priority Date Filing Date
EP03254607A Withdrawn EP1387514A3 (fr) 2002-07-31 2003-07-24 Procédé et dispositif de comparaison de signaux

Country Status (2)

Country Link
EP (1) EP1387514A3 (fr)
GB (1) GB2391322B (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2685450A4 (fr) * 2012-05-23 2015-11-11 Enswers Co Ltd Dispositif et procédé de reconnaissance d'un contenu à l'aide de signaux audio
EP2774391A4 (fr) * 2011-10-31 2016-01-20 Nokia Technologies Oy Rendu de scène audio via un alignement de séries de données caractéristiques qui varient en fonction du temps

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050080576A1 (en) * 2003-10-10 2005-04-14 Dickerson Robert T. Method and system for frequency domain time correlation
CN110718237B (zh) * 2018-07-12 2023-08-18 阿里巴巴集团控股有限公司 串音数据检测方法和电子设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2226718A (en) * 1988-11-17 1990-07-04 British Broadcasting Corp Aligning two audio signals
WO2000079709A1 (fr) * 1999-06-18 2000-12-28 Apel Steven G Systeme de sondage d'audience, et systemes et procedes de compression et de correlation de signaux audio
WO2001004870A1 (fr) * 1999-07-08 2001-01-18 Constantin Papaodysseus Procede de reconnaissance automatique de compositions musicales et de signaux sonores
CA2310769A1 (fr) * 1999-10-27 2001-04-27 Nielsen Media Research, Inc. Extraction et correlation de signature audio

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5099456A (en) * 1990-06-13 1992-03-24 Hughes Aircraft Company Passive locating system
DE4243831A1 (de) * 1992-12-23 1994-06-30 Daimler Benz Ag Verfahren zur Laufzeitschätzung an gestörten Sprachkanälen

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2226718A (en) * 1988-11-17 1990-07-04 British Broadcasting Corp Aligning two audio signals
WO2000079709A1 (fr) * 1999-06-18 2000-12-28 Apel Steven G Systeme de sondage d'audience, et systemes et procedes de compression et de correlation de signaux audio
WO2001004870A1 (fr) * 1999-07-08 2001-01-18 Constantin Papaodysseus Procede de reconnaissance automatique de compositions musicales et de signaux sonores
CA2310769A1 (fr) * 1999-10-27 2001-04-27 Nielsen Media Research, Inc. Extraction et correlation de signature audio

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2774391A4 (fr) * 2011-10-31 2016-01-20 Nokia Technologies Oy Rendu de scène audio via un alignement de séries de données caractéristiques qui varient en fonction du temps
EP2685450A4 (fr) * 2012-05-23 2015-11-11 Enswers Co Ltd Dispositif et procédé de reconnaissance d'un contenu à l'aide de signaux audio

Also Published As

Publication number Publication date
GB0217772D0 (en) 2002-09-11
EP1387514A3 (fr) 2008-12-10
GB2391322A (en) 2004-02-04
GB2391322B (en) 2005-12-14

Similar Documents

Publication Publication Date Title
EP2327213B1 (fr) Calcul d'erreurs de synchronisation audio video base sur des caracteristiques audio-visuelles
US9715626B2 (en) Method and apparatus for automatically recognizing input audio and/or video streams
EP3011691B1 (fr) Système et procédé d'aide à la synchronisation de restitution répartie de contenu
JP5514992B2 (ja) コンテンツマッチングシステムにおける同時放送の解決
CN102084416B (zh) 音视频签名、导出签名的方法以及比较音视频数据的方法
US9111580B2 (en) Time alignment of recorded audio signals
EP2408126A1 (fr) Procédé et appareil d'identification d'une source de diffusion
MXPA03004846A (es) Aparato y metodo para medir la sintonizacion de un receptor de difusion digital.
US20090234649A1 (en) Audio matching
JP4697371B2 (ja) コマーシャル検出方法及び装置
CA2875352A1 (fr) Procedes et systemes de correction d'horloge et/ou synchronisation pour systemes de mesure de supports audio
CN104853244A (zh) 用于管理音视频、音频或视频内容的方法和装置
US8780209B2 (en) Systems and methods for comparing media signals
EP2315455B1 (fr) Mesure du délai AV et correction à l'aide de courbes de signature
US11222209B2 (en) Comparing video sequences using fingerprints
EP1387514A2 (fr) Procédé et dispositif de comparaison de signaux
US6549757B1 (en) Method and system for assessing, at reception level, the quality of a digital signal, such as a digital audio/video signal
CN109413469A (zh) 一种直播连麦延迟控制方法、装置、电子设备及存储介质
US8754947B2 (en) Systems and methods for comparing media signals
US20050113953A1 (en) Method for synchronizing signals acquired from unsynchronized sensors
KR100763598B1 (ko) Ｄｖｂ 전송 시스템에서 위상 차등정보를 이용한 프레임동기 장치 및 그 방법
US20180122425A1 (en) Method for synchronising and rendering multimedia streams
US7587015B2 (en) Asynchronous digital data capture
JP3222103B2 (ja) 放送確認方法及びその装置
Mosharafa et al. A novel algorithm for synchronizing audio and video streams in MPEG-2 system layer

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

17P Request for examination filed

Effective date: 20090610

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

17Q First examination report despatched

Effective date: 20091029

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20150203