EP2081188A1 - Method and apparatus for determining whether or not a reference pattern is present in a received and possibly watermarked signal - Google Patents
Method and apparatus for determining whether or not a reference pattern is present in a received and possibly watermarked signal Download PDFInfo
- Publication number
- EP2081188A1 EP2081188A1 EP09150033A EP09150033A EP2081188A1 EP 2081188 A1 EP2081188 A1 EP 2081188A1 EP 09150033 A EP09150033 A EP 09150033A EP 09150033 A EP09150033 A EP 09150033A EP 2081188 A1 EP2081188 A1 EP 2081188A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- correlation result
- values
- value
- thr
- absolute value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/018—Audio watermarking, i.e. embedding inaudible data in the audio signal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0021—Image watermarking
- G06T1/005—Robust watermarking, e.g. average attack or collusion attack resistant
- G06T1/0078—Robust watermarking, e.g. average attack or collusion attack resistant using multiple thresholds
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
- H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
- H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
- H04N1/32149—Methods relating to embedding, encoding, decoding, detection or retrieval operations
- H04N1/32154—Transform domain methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2201/00—General purpose image data processing
- G06T2201/005—Image watermarking
- G06T2201/0065—Extraction of an embedded watermark; Reliable detection
Definitions
- the invention relates to a method and to an apparatus for determining whether or not a reference pattern is present in a received and possibly watermarked signal, using correlation and correlation result peak detection.
- a watermark in an audio or video signal can be detected at receiving or decoder side using correlation, as described for example in WO 2007/031423 , WO 97/33391 ( US 6584138 B1 ) or US 6061793 .
- Each embedded reference pattern may represent a single bit of the embedded message.
- a watermark detector decides, depending on the size of the correlation result values, whether or not a given pseudo-random sequence was embedded.
- a problem to be solved by the invention is to improve the robustness with respect to echoes and reverberation of correlation-based watermark detection systems. This problem is solved by the method disclosed in claim 1. An apparatus that utilises this method is disclosed in claim 2.
- the watermark detection result is improved by distinguishing between noise and echoes and integrating the correlation values resulting from echoes into the main correlation peak.
- the correlation result amplitude values located within a predetermined neighbourhood of a correlation result peak amplitude value and exceeding a predetermined magnitude are summarised.
- every embedded reference pattern r represents a single bit only, or two or more bits only, of the embedded message.
- the reference patterns r are orthogonal to each other.
- the inventive method is suited for determining whether or not a reference pattern is present in a received and possibly watermarked signal, wherein at least one candidate reference pattern possibly matching said reference pattern is correlated with said received watermarked signal and corresponding correlation result amplitude peaks are checked, said method including the following steps:
- the inventive apparatus is suited for determining whether or not a reference pattern is present in a received and possibly watermarked signal, wherein at least one candidate reference pattern possibly matching said reference pattern is correlated with said received watermarked signal and corresponding correlation result amplitude peaks are checked, said apparatus including:
- a correlation based detection which means that several pseudo-random sequences representing a bit or word value are generated, or selected from a memory, at encoder side and one or more of them are embedded inside the content or signal (e.g. an audio or video signal), depending on the message (e.g. watermark bits) to be embedded.
- the same pseudo-random sequences are generated, or selected from a memory, at decoder side.
- To decode the embedded message it is necessary to discover which pseudo-random sequences were embedded inside the received content or signal. This is performed by correlating the known pseudo-random sequences with the possibly pre-processed content or signal.
- the decoder or receiver detector thereafter decides, depending on the size of the correlation result amplitude values, whether or not a given sequence was embedded.
- the corresponding offset ⁇ between the signal x and a given reference sequence r is calculated by finding the value ⁇ that maximises C ( ⁇ ).
- the horizontal axis shows sample positions and the vertical axis shows the amplitudes of the correlation results.
- a clear high-amplitude peak related to horizontal position '0' can be determined.
- the cumulated peak sum sum max , k for a correlation is calculated as follows, wherein m is an index for a correlation peak group:
- the value peak_sum k ( y ) is defined below.
- the maximum sum sum-max,k is the cumulated peak sum mentioned above for candidate reference pattern k. There may be further maximum sums for the other candidate reference patterns k. If the largest one of these maximum sums exceed a predetermined or variable threshold thr 0 , it is decided that a corresponding watermark or reference pattern (or pseudo-random reference sequence) k is assumed to be present in the received signal. Threshold thr 0 is greater than threshold thr 1 .
- every embedded reference pattern represents e.g. a single bit only of the embedded message and the distances of the reference patterns are known at receiver/decoder side, it is necessary to determine the true position ⁇ (inside the received signal x) of the pseudo-random reference sequence k that was selected at encoder side, to determine the following portion of the possibly watermarked content for decoding the next single or two or more bits of the embedded message.
- the peak sum peak_sum k at location y may be calculated as follows:
- threshold thr 1 is used for searching the dominant or biggest peak 51, 54 for each group m.
- Groups m 1 and m 2 are depicted, whereby the dominant peak 51 of group m 1 is located at ⁇ 1 and the dominant peak 54 of group m 2 is located at ⁇ 2 .
- Threshold thr 2 is smaller than threshold thr 1 and is used for searching smaller but still significant peaks 52, 53, 55, 56 (which may result e.g. from echoes) in the vicinity of the dominant peak.
- Thresholds thr 3 and thr 4 are related to the noise level. thr 4 represents an offset that is caused by the noise.
- the C k ( y ) values within y-t 3 ⁇ y ⁇ y + t 3 and adjacent to C k ( y ) can be used to increase the peak sum value so that the cumulated peak sum value distinguishes more from 'noise peaks'.
- the amplitude thresholds thr 0 , thr 1 , thr 2 , thr 3 , thr 4 , and the sample ranges t 1 , t 2 , t 3 and t 4 can be adapted depending on echoes and reverberation parameters of the application.
- the symmetric range ⁇ t 3 can also be non-symmetric (- t 3 ... + t 4 ) or (- t 4 ... + t 3 ).
- the C k ( y ) values within y - t 3or4 ⁇ y ⁇ y + t 3or4 can be cumulated only in case their amplitude is not smaller than a predetermined amplitude distance from the amplitude of the corresponding peak.
- the received encoded signal x is acquired in step or stage 31.
- a pre-processing like spectral shaping or whitening can be carried out in step or stage 32.
- the resulting output signal is correlated with pseudo-random reference pattern or patterns r in step or stage 33.
- the cumulated maximum peak sum is calculated in step or stage 34 as described before. Thereafter it is decided in step or stage 35 which one of the pseudo-random reference patterns r has been embedded into signal x at encoder side, and the corresponding watermark data symbol is output.
- the first step 41 may be a peak search initialisation.
- the peaks are searched and the intermediate peak sum is calculated in steps 42 and 43, respectively.
- the maximum of all intermediate peak sums is determined in step 44, and the maximum peak sum sum max , k is output.
- the invention is applicable to all technologies where a correlation may be disturbed by something similar to echoes and reverberation, for example watermarked video that has been encoded perceptually.
Abstract
Description
- The invention relates to a method and to an apparatus for determining whether or not a reference pattern is present in a received and possibly watermarked signal, using correlation and correlation result peak detection.
- A watermark in an audio or video signal can be detected at receiving or decoder side using correlation, as described for example in
WO 2007/031423 ,WO 97/33391 US 6584138 B1 ) orUS 6061793 . - Many watermarking systems make use of correlation for calculating a detection metric, which means that several pseudo-random sequences or reference patterns are generated at encoder side and one or more of them are embedded inside the content (e.g. an audio or video signal), dependent on the message to be embedded. The same pseudo-random sequences are generated at decoder side. Frequency transform may be used to encode and decode the embedded message. To decode the embedded message, it is necessary to discover which pseudo-random sequence or sequences were embedded at encoder side. This is determined in these systems by correlating the known pseudo-random sequences with the possibly watermarked content, whereby the correlation may operate on a pre-processed version of the content, and that pre-processing may include inverse frequency transform, spectral shaping and/or whitening.
- Each embedded reference pattern may represent a single bit of the embedded message. There are watermarking systems in which each embedded reference pattern is representing two or more bits of the embedded message.
- In
WO2005/078658 clusters of correlation results are evaluated, a cluster including correlation results in the vicinity of a correlation peak and exceeding a detection threshold. - A watermark detector decides, depending on the size of the correlation result values, whether or not a given pseudo-random sequence was embedded.
- A related improved decision processing is described in
PCT/US2007/014037 , where the calculation of relative correlation result values decreases the false positive rate, i.e. the probability to classify a non-watermarked content as watermarked. It is believed that this processing works very well even if the watermarked content is altered for example by perceptual coding (like mp3, AAC, WMA, AC-3, MPEG). - However, that kind of decision processing does not provide correct decisions if for example watermarked audio is emitted by a loudspeaker and then captured with a microphone. This happens e.g. in pirated copies recorded in a cinema or in a program audience measurement application where a fixed or mobile watermarking detector is used. The recorded content includes echoes and reverberation, with which kind of signal disturbances known watermark detection processings cannot cope in the right manner.
- A problem to be solved by the invention is to improve the robustness with respect to echoes and reverberation of correlation-based watermark detection systems. This problem is solved by the method disclosed in
claim 1. An apparatus that utilises this method is disclosed inclaim 2. - According to the invention, it is taken advantage of the received signal echoes instead of treating them as noise. The watermark detection result is improved by distinguishing between noise and echoes and integrating the correlation values resulting from echoes into the main correlation peak. Basically, the correlation result amplitude values located within a predetermined neighbourhood of a correlation result peak amplitude value and exceeding a predetermined magnitude are summarised.
- In the invention, every embedded reference pattern r represents a single bit only, or two or more bits only, of the embedded message. The reference patterns r are orthogonal to each other.
- Advantages of the invention are:
- the robustness of the embedded watermark (detection) is increased without compromising the quality of the watermarked audio signal;
- known watermarking processings can be optimised without impact on the workflow on the watermark encoding side;
- because the invention is related to the watermark detection only but not to the watermark embedding, existing watermarking systems can be improved without need for remarking already marked content;
- the inventive optimisation can be applied to all watermarking system using correlation as their detection metric.
- In principle, the inventive method is suited for determining whether or not a reference pattern is present in a received and possibly watermarked signal, wherein at least one candidate reference pattern possibly matching said reference pattern is correlated with said received watermarked signal and corresponding correlation result amplitude peaks are checked, said method including the following steps:
- calculating for a current section of said received signal the correlations with each one of said reference patterns;
- finding within the correlation result amplitude values groups of values in which the absolute value of a current correlation result amplitude value - denoted main peak - is greater than a first threshold and that absolute value of said main peak is also greater than the absolute value of its left neighbour correlation result amplitude value and is also greater than the absolute value of its right neighbour correlation result amplitude value;
- finding, within a predetermined vicinity of each one of said main peaks, further peaks for each of which the absolute value of a current correlation result amplitude value is greater than a second threshold smaller than said first threshold and for each of which further peaks its absolute value is also greater than the absolute value of its left neighbour correlation result amplitude value and is also greater than the absolute value of its right neighbour correlation result amplitude value;
- combining, for each one of said groups of values, the absolute values of said main peak and said further peaks, thereby forming a sum value per group;
- for each one of said reference patterns, determining the maximum one of said group sum values wherein, if the largest one of these maximum values exceeds a predetermined or variable threshold, deciding that a corresponding reference pattern is assumed to be present in the received signal.
- In principle the inventive apparatus is suited for determining whether or not a reference pattern is present in a received and possibly watermarked signal, wherein at least one candidate reference pattern possibly matching said reference pattern is correlated with said received watermarked signal and corresponding correlation result amplitude peaks are checked, said apparatus including:
- means being adapted for calculating for a current section of said received signal the correlations with each one of said reference patterns;
- means being adapted for finding within the correlation result amplitude values groups of values in which the absolute value of a current correlation result amplitude value - denoted main peak - is greater than a first threshold and that absolute value of said main peak is also greater than the absolute value of its left neighbour correlation result amplitude value and is also greater than the absolute value of its right neighbour correlation result amplitude value;
and for finding, within a predetermined vicinity of each one of said main peaks, further peaks for each of which the absolute value of a current correlation result amplitude value is greater than a second threshold smaller than said first threshold and for each of which further peaks its absolute value is also greater than the absolute value of its left neighbour correlation result amplitude value and is also greater than the absolute value of its right neighbour correlation result amplitude value; - means being adapted for combining, for each one of said groups of values, the absolute values of said main peak and said further peaks, thereby forming a sum value per group;
- means being adapted for determining, for each one of said reference patterns, the maximum one of said group sum values, and for deciding, if the largest one of these maximum values exceeds a predetermined or variable threshold, that a corresponding reference pattern is assumed to be present in the received signal.
- Advantageous additional embodiments of the invention are disclosed in the respective dependent claims.
- Exemplary embodiments of the invention are described with reference to the accompanying drawings, which show in:
- Fig. 1
- correlation result values calculated at decoder side for a received signal with mildly disturbed content;
- Fig. 2
- correlation result values calculated at decoder side for a received signal that was transmitted by a loudspeaker and recorded with a microphone;
- Fig. 3
- flow chart for the inventive processing;
- Fig. 4
- flow chart for the calculation of the peak sum maximum;
- Fig. 5
- inventive processing depicted in the correlation result amplitude vs. τ domain.
- As mentioned above, many watermarking systems use a correlation based detection, which means that several pseudo-random sequences representing a bit or word value are generated, or selected from a memory, at encoder side and one or more of them are embedded inside the content or signal (e.g. an audio or video signal), depending on the message (e.g. watermark bits) to be embedded. The same pseudo-random sequences are generated, or selected from a memory, at decoder side. To decode the embedded message, it is necessary to discover which pseudo-random sequences were embedded inside the received content or signal. This is performed by correlating the known pseudo-random sequences with the possibly pre-processed content or signal. The decoder or receiver detector thereafter decides, depending on the size of the correlation result amplitude values, whether or not a given sequence was embedded.
- The signal or sequence x of length N is defined as x = (x(1),x(2),x(3),...,x(N)) where x(n) is the n-th sample of the signal or sequence x. If the signal x and the pseudo-random reference pattern r are already synchronised, the normalised correlation value C can be calculated as:
wherein Sum(i=1..N) means - The greater the absolute value of C, the higher is the probability that current reference pattern r is embedded in x. A negative value of C indicates that the pattern r has been negated between the embedding and the detection stage.
-
- For this kind of calculation, fast algorithms using FFTs (fast Fourier transforms) are available.
- The corresponding offset τ between the signal x and a given reference sequence r is calculated by finding the value τ that maximises C(τ).
-
Fig. 1 shows correlation result values C(τ=0) calculated at decoder side for a received signal x with mildly disturbed content. The horizontal axis shows sample positions and the vertical axis shows the amplitudes of the correlation results. A clear high-amplitude peak related to horizontal position '0' can be determined. - In
PCT/US2007/014037 it is proposed to use the difference or the ratio between the largest and the second largest normalised correlation values to make the watermark detection more robust. - However, just finding the maximum of C(τ)) does not work anymore if the received signal or content has undergone an acoustic path transmission, the corresponding decoder correlation results of which are depicted in
Fig. 2 . The very obvious amplitude peak inFig. 1 is now much smaller and distributed in time due to echoes and reverberation. It even happens that the peak, which indicates the presence and offset of the reference signal r, is smaller than peaks resulting from noise in the received signal. - The inventive processing works as follows, wherein k is the index of the current pseudo-random reference pattern or sequence r:
- a) Calculate for a current section of the received signal x the correlations Ck (τ) for each reference signal rk as described above, possibly after enhancing the audio signal or the reference signal with signal processing like e.g. filtering and/or whitening.
- b) For each Ck (τ) find the largest cumulated peak sum (of peak groups).
- c) Use the cumulated peak sum directly as correlation value, or divide the largest peak sum by the second largest peak sum and use the resulting value as a measure of the detection strength, as described in
PCT/US2007/014037 . - d) Decide that a watermark or reference pattern is assumed to be present if one of the k cumulated peak sums exceeds a predetermined or variable threshold, and move to the following section of the received signal x (the distances of the reference patterns are known at receiver/decoder side).
-
- The value peak_sumk (y) is defined below. The maximum sum sum-max,k is the cumulated peak sum mentioned above for candidate reference pattern k. There may be further maximum sums for the other candidate reference patterns k. If the largest one of these maximum sums exceed a predetermined or variable threshold thr 0 , it is decided that a corresponding watermark or reference pattern (or pseudo-random reference sequence) k is assumed to be present in the received signal. Threshold thr 0 is greater than threshold thr 1 .
- Because every embedded reference pattern represents e.g. a single bit only of the embedded message and the distances of the reference patterns are known at receiver/decoder side, it is necessary to determine the true position τ (inside the received signal x) of the pseudo-random reference sequence k that was selected at encoder side, to determine the following portion of the possibly watermarked content for decoding the next single or two or more bits of the embedded message.
-
- As shown in
Fig. 5 in the correlation result amplitude vs. τ domain, threshold thr 1 is used for searching the dominant orbiggest peak dominant peak 51 of group m1 is located at τ 1 and thedominant peak 54 of group m2 is located at τ 2 . Threshold thr 2 is smaller than threshold thr 1 and is used for searching smaller but stillsignificant peaks - Advantageously, the Ck (y) values within y-t 3 < y < y+t 3 and adjacent to Ck (y) can be used to increase the peak sum value so that the cumulated peak sum value distinguishes more from 'noise peaks'.
- The amplitude thresholds thr 0 , thr 1 , thr 2 , thr 3 , thr 4 , and the sample ranges t 1, t 2, t 3 and t 4 can be adapted depending on echoes and reverberation parameters of the application. The symmetric range ±t 3 can also be non-symmetric (-t 3 ... +t 4) or (-t 4 ... +t 3). Further, the Ck (y) values within y-t 3or4 < y < y+t 3or4 can be cumulated only in case their amplitude is not smaller than a predetermined amplitude distance from the amplitude of the corresponding peak.
- In the watermark decoder in
Fig. 3 , the received encoded signal x is acquired in step orstage 31. A pre-processing like spectral shaping or whitening can be carried out in step orstage 32. The resulting output signal is correlated with pseudo-random reference pattern or patterns r in step orstage 33. The cumulated maximum peak sum is calculated in step orstage 34 as described before. Thereafter it is decided in step orstage 35 which one of the pseudo-random reference patterns r has been embedded into signal x at encoder side, and the corresponding watermark data symbol is output. - In
Fig. 4 the maximum peak sum calculation, carried out in step/stage 34 and described above, is depicted in more detail. Thefirst step 41 may be a peak search initialisation. In the following loop, the peaks are searched and the intermediate peak sum is calculated insteps - Before, upon the largest one of the maximum sums exceeding threshold thr 0 , issuing the final decision that corresponding reference patterns are assumed to be present in the received signal, several decoded bits of the embedded message can pass through an error correction processing.
- The invention is applicable to all technologies where a correlation may be disturbed by something similar to echoes and reverberation, for example watermarked video that has been encoded perceptually.
Claims (7)
- Method for determining (35) whether or not a reference pattern (r) is present in a received and possibly watermarked signal (x), wherein at least one candidate reference pattern (rk ) possibly matching said reference pattern is correlated (33) with said received watermarked signal and corresponding correlation result amplitude peaks (C(τ), 51, 54) are checked, said method including the following steps:- calculating (33) for a current section of said received signal (x) the correlations (Ck ) with each one of said reference patterns (rk ),characterised by:- finding (42) within the correlation result amplitude values groups of values (m, 51, 54) in which the absolute value of a current correlation result amplitude value (Ck (τ m )) - denoted main peak - is greater than a first threshold (thr 1) and that absolute value of said main peak is also greater than the absolute value of its left neighbour correlation result amplitude value (Ck (τ m -1)) and is also greater than the absolute value of its right neighbour correlation result amplitude value (Ck (τ m +1));- finding, within a predetermined vicinity (τ m,k-t 1 , τ m,k +t2 ) of each one of said main peaks, further peaks (52, 53; 55, 56) for each of which the absolute value of a current correlation result amplitude value (Ck (y)) is greater than a second threshold (thr 2) smaller than said first threshold (thr 1) and for each of which further peaks its absolute value is also greater than the absolute value of its left neighbour correlation result amplitude value (Ck (y-1)) and is also greater than the absolute value of its right neighbour correlation result amplitude value (Ck (y+1));- combining (34), for each one of said groups (m) of values, the absolute values of said main peak and said further peaks, thereby forming a sum value (sumk (m)) per group;- for each one of said reference patterns (rk ), determining (44) the maximum one (summax,k ) of said group sum values (sumk (m)) wherein, if the largest one of these maximum values exceed a predetermined or variable threshold (thr 0), deciding (35) that a corresponding reference pattern (k) is assumed to be present in the received signal (x).
- Apparatus for determining whether or not a reference pattern (r) is present in a received and possibly watermarked signal (x), wherein at least one candidate reference pattern (rk ) possibly matching said reference pattern is correlated with said received watermarked signal and corresponding correlation result amplitude peaks (C(τ), 51, 54) are checked, said apparatus including:- means being adapted for calculating (33) for a current section of said received signal (x) the correlations (Ck ) with each one of said reference patterns (rk ),characterised by:- means (42) being adapted for finding within the correlation result amplitude values groups of values (m, 51, 54) in which the absolute value of a current correlation result amplitude value (Ck (τ m )) - denoted main peak - is greater than a first threshold (thr 1) and that absolute value of said main peak is also greater than the absolute value of its left neighbour correlation result amplitude value (Ck (τ m -1)) and is also greater than the absolute value of its right neighbour correlation result amplitude value (Ck (τ m +1));
and for finding, within a predetermined vicinity (τ m,k -t 1, τ m,k +t 2) of each one of said main peaks, further peaks (52, 53; 55, 56) for each of which the absolute value of a current correlation result amplitude value (Ck (y)) is greater than a second threshold (thr 2) smaller than said first threshold (thr 1) and for each of which further peaks its absolute value is also greater than the absolute value of its left neighbour correlation result amplitude value (Ck (y-1)) and is also greater than the absolute value of its right neighbour correlation result amplitude value (Ck (y+1));- means (34) being adapted for combining, for each one of said groups (m) of values, the absolute values of said main peak and said further peaks, thereby forming a sum value (sumk (m)) per group;- means (44, 35) being adapted for determining, for each one of said reference patterns (rk ), the maximum one (summax,k ) of said group sum values (sumk (m)), and for deciding, if the largest one of these maximum values exceed a predetermined or variable threshold (thr 0), that a corresponding reference pattern (k) is assumed to be present in the received signal (x). - Method according to claim 1, or apparatus according to claim 2 wherein, instead of correlation result amplitude values, normalised correlation result amplitude values are used for determining the peak values.
- Method according to claim 1 or 3, or apparatus according to claim 2 or 3, wherein in said combining (34) in addition such absolute values of correlation result amplitudes that are located within a predetermined neighbour range (±t 3) to the left and to the right of main and further peaks and which exceed a third threshold value (thr 3) are involved, and wherein the corresponding absolute values of correlation result amplitudes following subtraction of a fourth threshold value (thr 4) representing noise are combined, and wherein said third threshold value is greater than said fourth threshold value.
- Method according to one of claims 1, 3 and 4, or apparatus according to one of claims 2 to 4, wherein said predetermined vicinity (τ m,k -t 1, τ m,k +t 2) is non-symmetric and extends t 1 samples to the left and t 2 samples to the right, and/or wherein said predetermined neighbour range extends t 3 samples to the left and t 3 samples to the right, and/or wherein said predetermined neighbour range is non-symmetric and extends t 3 or t 4 samples to the left and t 3 or t 4 samples to the right.
- Method or apparatus according to claim 5, wherein one or more of said threshold (thr 0) and said first to fourth thresholds (thr 1, thr 2, thr 3, thr 4) and said sample values t 1 to t 4 are predetermined, or are adapted during the processing depending on echoes and reverberation parameters in the received signal (x).
- Method according to one of claims 1 and 3 to 6, or apparatus according to one of claims 2 to 6 wherein, before said correlations are calculated, the received signal (x) is spectrally shaped and/or is whitened.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP09150033A EP2081188B1 (en) | 2008-01-21 | 2009-01-05 | Method and apparatus for determining whether or not a reference pattern is present in a received and possibly watermarked signal |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP08100694A EP2081187A1 (en) | 2008-01-21 | 2008-01-21 | Method and apparatus for determining whether or not a reference pattern is present in a received and possibly water-marked signal |
EP09150033A EP2081188B1 (en) | 2008-01-21 | 2009-01-05 | Method and apparatus for determining whether or not a reference pattern is present in a received and possibly watermarked signal |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2081188A1 true EP2081188A1 (en) | 2009-07-22 |
EP2081188B1 EP2081188B1 (en) | 2012-03-14 |
Family
ID=39311516
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP08100694A Withdrawn EP2081187A1 (en) | 2008-01-21 | 2008-01-21 | Method and apparatus for determining whether or not a reference pattern is present in a received and possibly water-marked signal |
EP09150033A Not-in-force EP2081188B1 (en) | 2008-01-21 | 2009-01-05 | Method and apparatus for determining whether or not a reference pattern is present in a received and possibly watermarked signal |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP08100694A Withdrawn EP2081187A1 (en) | 2008-01-21 | 2008-01-21 | Method and apparatus for determining whether or not a reference pattern is present in a received and possibly water-marked signal |
Country Status (7)
Country | Link |
---|---|
US (1) | US8281137B2 (en) |
EP (2) | EP2081187A1 (en) |
JP (1) | JP5232668B2 (en) |
CN (1) | CN101494053B (en) |
AT (1) | ATE549713T1 (en) |
BR (1) | BRPI0900063A2 (en) |
RU (1) | RU2482553C2 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2387033A1 (en) * | 2010-05-11 | 2011-11-16 | Thomson Licensing | Method and apparatus for detecting which one of symbols of watermark data is embedded in a received signal |
EP2787504A1 (en) * | 2013-04-02 | 2014-10-08 | Thomson Licensing | Method and Apparatus for determining watermark symbols in a received audio signal that can contain echoes, reverberation and/or noise |
EP2899987A1 (en) * | 2014-01-22 | 2015-07-29 | Thomson Licensing | Synchronising a reproduction of audio or audio and video content |
EP2930717A1 (en) | 2014-04-07 | 2015-10-14 | Thomson Licensing | Method and apparatus for determining in a 2nd screen device whether the presentation of watermarked audio content received via an acoustic path from a 1st screen device has been stopped |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2083418A1 (en) * | 2008-01-24 | 2009-07-29 | Deutsche Thomson OHG | Method and Apparatus for determining and using the sampling frequency for decoding watermark information embedded in a received signal sampled with an original sampling frequency at encoder side |
US9269363B2 (en) | 2012-11-02 | 2016-02-23 | Dolby Laboratories Licensing Corporation | Audio data hiding based on perceptual masking and detection based on code multiplexing |
CN106601261A (en) * | 2015-10-15 | 2017-04-26 | 中国电信股份有限公司 | Digital watermark based echo inhibition method and system |
RU2767183C1 (en) * | 2021-08-27 | 2022-03-16 | Федеральное государственное автономное образовательное учреждение высшего образования «Санкт-Петербургский государственный университет аэрокосмического приборостроения» | Method for automatic detection of narrowband signals |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1997033391A1 (en) | 1996-03-07 | 1997-09-12 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Coding process for inserting an inaudible data signal into an audio signal, decoding process, coder and decoder |
US6061793A (en) | 1996-08-30 | 2000-05-09 | Regents Of The University Of Minnesota | Method and apparatus for embedding data, including watermarks, in human perceptible sounds |
EP1542227A1 (en) * | 2003-12-11 | 2005-06-15 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for transmitting watermark data bits using a spread spectrum, and for regaining watermark data bits embedded in a spread spectrum |
WO2005078658A1 (en) | 2004-02-14 | 2005-08-25 | Koninklijke Philips Electronics N.V. | Watermark detection |
WO2007031423A1 (en) | 2005-09-16 | 2007-03-22 | Thomson Licensing | Blind watermarking of audio signals by using phase modifications |
WO2008153526A1 (en) | 2007-06-14 | 2008-12-18 | Thomson Licensing | Method and apparatus for setting a detection threshold given a desired false probability |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7171016B1 (en) * | 1993-11-18 | 2007-01-30 | Digimarc Corporation | Method for monitoring internet dissemination of image, video and/or audio files |
JP3691415B2 (en) * | 2000-09-01 | 2005-09-07 | 松下電器産業株式会社 | REPRODUCTION DEVICE, REPRODUCTION DEVICE SPECIFICING DEVICE, AND METHOD THEREOF |
KR20030010694A (en) * | 2001-04-12 | 2003-02-05 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Watermark embedding |
GB2376826A (en) * | 2001-06-19 | 2002-12-24 | Sony Uk Ltd | Detecting data by accumulating pixel values in several versions of a datablock |
GB2377109B (en) * | 2001-06-28 | 2003-12-03 | Motorola Inc | Video/image communication with watermarking |
EP1542226A1 (en) * | 2003-12-11 | 2005-06-15 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for transmitting watermark data bits using a spread spectrum, and for regaining watermark data bits embedded in a spread spectrum |
CN1306453C (en) * | 2003-12-30 | 2007-03-21 | 中国人民解放军第一军医大学 | Image water print embedding and detecting method of strong antiimpact performance in discrete conversion region |
EP1729285A1 (en) * | 2005-06-02 | 2006-12-06 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for watermarking an audio or video signal with watermark data using a spread spectrum |
WO2007006623A1 (en) * | 2005-07-11 | 2007-01-18 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for detecting correlation between a received signal and a candidate spreading sequence |
CN100547609C (en) * | 2005-11-22 | 2009-10-07 | 北京华旗数码影像技术研究院有限责任公司 | A kind of bittorrent Robust digital figure watermark embedding and detection method and device |
CN101038771A (en) * | 2006-03-18 | 2007-09-19 | 辽宁师范大学 | Novel method of digital watermarking for protecting literary property of music works |
-
2008
- 2008-01-21 EP EP08100694A patent/EP2081187A1/en not_active Withdrawn
-
2009
- 2009-01-05 EP EP09150033A patent/EP2081188B1/en not_active Not-in-force
- 2009-01-05 AT AT09150033T patent/ATE549713T1/en active
- 2009-01-15 US US12/321,071 patent/US8281137B2/en not_active Expired - Fee Related
- 2009-01-19 BR BRPI0900063-1A patent/BRPI0900063A2/en not_active IP Right Cessation
- 2009-01-20 CN CN2009100059343A patent/CN101494053B/en not_active Expired - Fee Related
- 2009-01-20 RU RU2009101724/08A patent/RU2482553C2/en not_active IP Right Cessation
- 2009-01-20 JP JP2009009775A patent/JP5232668B2/en not_active Expired - Fee Related
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1997033391A1 (en) | 1996-03-07 | 1997-09-12 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Coding process for inserting an inaudible data signal into an audio signal, decoding process, coder and decoder |
US6584138B1 (en) | 1996-03-07 | 2003-06-24 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Coding process for inserting an inaudible data signal into an audio signal, decoding process, coder and decoder |
US6061793A (en) | 1996-08-30 | 2000-05-09 | Regents Of The University Of Minnesota | Method and apparatus for embedding data, including watermarks, in human perceptible sounds |
EP1542227A1 (en) * | 2003-12-11 | 2005-06-15 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for transmitting watermark data bits using a spread spectrum, and for regaining watermark data bits embedded in a spread spectrum |
WO2005078658A1 (en) | 2004-02-14 | 2005-08-25 | Koninklijke Philips Electronics N.V. | Watermark detection |
WO2007031423A1 (en) | 2005-09-16 | 2007-03-22 | Thomson Licensing | Blind watermarking of audio signals by using phase modifications |
WO2008153526A1 (en) | 2007-06-14 | 2008-12-18 | Thomson Licensing | Method and apparatus for setting a detection threshold given a desired false probability |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2387033A1 (en) * | 2010-05-11 | 2011-11-16 | Thomson Licensing | Method and apparatus for detecting which one of symbols of watermark data is embedded in a received signal |
WO2011141292A1 (en) * | 2010-05-11 | 2011-11-17 | Thomson Licensing | Method and apparatus for detecting which one of symbols of watermark data is embedded in a received signal |
US9147402B2 (en) | 2010-05-11 | 2015-09-29 | Thomson Licensing | Method and apparatus for detecting which one of symbols of watermark data is embedded in a received signal |
EP2787504A1 (en) * | 2013-04-02 | 2014-10-08 | Thomson Licensing | Method and Apparatus for determining watermark symbols in a received audio signal that can contain echoes, reverberation and/or noise |
WO2014161785A1 (en) * | 2013-04-02 | 2014-10-09 | Thomson Licensing | Method and apparatus for determining watermark symbols in a received audio signal that can contain echoes, reverberation and/or noise |
US9607623B2 (en) | 2013-04-02 | 2017-03-28 | Thomson Licensing | Method and apparatus for determining watermark symbols in a received audio signal that can contain echoes, reverberation and/or noise |
EP2899987A1 (en) * | 2014-01-22 | 2015-07-29 | Thomson Licensing | Synchronising a reproduction of audio or audio and video content |
EP2930717A1 (en) | 2014-04-07 | 2015-10-14 | Thomson Licensing | Method and apparatus for determining in a 2nd screen device whether the presentation of watermarked audio content received via an acoustic path from a 1st screen device has been stopped |
Also Published As
Publication number | Publication date |
---|---|
BRPI0900063A2 (en) | 2009-09-15 |
US8281137B2 (en) | 2012-10-02 |
RU2482553C2 (en) | 2013-05-20 |
CN101494053B (en) | 2012-10-24 |
JP2009175737A (en) | 2009-08-06 |
ATE549713T1 (en) | 2012-03-15 |
EP2081188B1 (en) | 2012-03-14 |
US20090187765A1 (en) | 2009-07-23 |
EP2081187A1 (en) | 2009-07-22 |
RU2009101724A (en) | 2010-07-27 |
JP5232668B2 (en) | 2013-07-10 |
CN101494053A (en) | 2009-07-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2081188B1 (en) | Method and apparatus for determining whether or not a reference pattern is present in a received and possibly watermarked signal | |
EP2175444B1 (en) | Method and apparatus for regaining watermark data that were embedded in an original signal by modifying sections of said original signal in relation to at least two different reference data sequences | |
US6516079B1 (en) | Digital watermark screening and detecting strategies | |
Xiang et al. | Histogram-based audio watermarking against time-scale modification and cropping attacks | |
KR100492743B1 (en) | Method for inserting and detecting watermark by a quantization of a characteristic value of a signal | |
US20120300975A1 (en) | System and method for detecting the watermark using decision fusion | |
EP2083419B1 (en) | Method and apparatus for determining and using the sampling frequency for decoding watermark information embedded in a received signal sampled with an original sampling frequency at encoder side | |
US20140156285A1 (en) | Method and apparatus for quantisation index modulation for watermarking an input signal | |
US8041073B2 (en) | Decoding watermark information items of a watermarked audio or video signal using correlation | |
Ngo et al. | Robust and reliable audio watermarking based on phase coding | |
EP1695337B1 (en) | Method and apparatus for detecting a watermark in a signal | |
Karnjana et al. | Audio watermarking scheme based on singular spectrum analysis and psychoacoustic model with self-synchronization | |
Cvejic et al. | Improving audio watermarking scheme using psychoacoustic watermark filtering | |
EP2709102A1 (en) | Method and apparatus for determining an optimum frequency range within a full frequency range of a watermarked input signal | |
Xu et al. | A robust digital audio watermarking technique | |
Chen et al. | An adaptive and secure audio watermarking algorithm robust to MP3 compression | |
KR100455062B1 (en) | Apparatus and method of embedding and detecting layered watermark | |
Myint et al. | An Efficient Tampering Detection and Localization Method for Speech Signals | |
CN113874937A (en) | Multi-channel audio encoder, decoder, methods and computer programs for switching between a parametric multi-channel operation and an individual channel operation | |
Junjarwad et al. | Audio Watermarking using Doubly Iterative Empirical Mode Decomposition | |
Arnold | Digital audio watermarking |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA RS |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: THOMSON LICENSING |
|
17P | Request for examination filed |
Effective date: 20100122 |
|
17Q | First examination report despatched |
Effective date: 20100218 |
|
AKX | Designation fees paid |
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06T 1/00 20060101ALI20110831BHEP Ipc: G10L 19/00 20060101AFI20110831BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 549713 Country of ref document: AT Kind code of ref document: T Effective date: 20120315 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: 746 Effective date: 20120322 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602009005836 Country of ref document: DE Effective date: 20120510 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R084 Ref document number: 602009005836 Country of ref document: DE Effective date: 20120316 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20120314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120614 |
|
LTIE | Lt: invalidation of european patent or patent extension |
Effective date: 20120314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120615 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 549713 Country of ref document: AT Kind code of ref document: T Effective date: 20120314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120714 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120716 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 |
|
26N | No opposition filed |
Effective date: 20121217 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602009005836 Country of ref document: DE Effective date: 20121217 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120625 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120614 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130131 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130131 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130131 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130105 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20090105 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130105 Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120314 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 8 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R082 Ref document number: 602009005836 Country of ref document: DE Representative=s name: KASTEL PATENTANWAELTE, DE Ref country code: DE Ref legal event code: R082 Ref document number: 602009005836 Country of ref document: DE Representative=s name: HOFSTETTER, SCHURACK & PARTNER PATENT- UND REC, DE |
|
REG | Reference to a national code |
Ref country code: DE Representative=s name: HOFSTETTER, SCHURACK & PARTNER PATENT- UND REC, DE Ref legal event code: R082 Ref document number: 602009005836 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 9 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20180129 Year of fee payment: 10 Ref country code: GB Payment date: 20180130 Year of fee payment: 10 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20180119 Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602009005836 Country of ref document: DE |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20190105 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190801 Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190131 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190105 |