EP1741215B1 - Wasserzeicheneinbettung - Google Patents

Wasserzeicheneinbettung Download PDF

Info

Publication number
EP1741215B1
EP1741215B1 EP05715993.1A EP05715993A EP1741215B1 EP 1741215 B1 EP1741215 B1 EP 1741215B1 EP 05715993 A EP05715993 A EP 05715993A EP 1741215 B1 EP1741215 B1 EP 1741215B1
Authority
EP
European Patent Office
Prior art keywords
spectral
values
sequence
modulation
modified
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP05715993.1A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP1741215A1 (de
Inventor
Juergen Herre
Ralph Kulessa
Sascha Disch
Karsten Linzmeier
Christian Neubauer
Frank Siebenhaar
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Original Assignee
Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV filed Critical Fraunhofer Gesellschaft zur Forderung der Angewandten Forschung eV
Priority to PL05715993T priority Critical patent/PL1741215T3/pl
Publication of EP1741215A1 publication Critical patent/EP1741215A1/de
Application granted granted Critical
Publication of EP1741215B1 publication Critical patent/EP1741215B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/018—Audio watermarking, i.e. embedding inaudible data in the audio signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
    • H04H20/28—Arrangements for simultaneous broadcast of plural pieces of information
    • H04H20/30—Arrangements for simultaneous broadcast of plural pieces of information by a single channel
    • H04H20/31—Arrangements for simultaneous broadcast of plural pieces of information by a single channel using in-band signals, e.g. subsonic or cue signal
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
    • G10L19/022—Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring

Definitions

  • the present invention relates to a scheme for incorporating a watermark into an information signal, such as e.g. an audio signal.
  • the provider When music tracks are legitimately acquired over the Internet by a music provider, the provider typically generates a header or data block attached to the music piece in which copyright information and, for example, a customer number are incorporated, the customer number being unique to the current one indicates to the buyer. It is also known to insert copy permission information into this header which signals the various kinds of copy rights, such as copying the current piece is completely prohibited, copying the current piece is allowed only once, copying the current piece is completely free, etc.
  • the customer has a decoder or management software, which reads the header and in compliance with the For example, allowed actions only allow a single copy and refuse further copies, or the like.
  • a coding method for introducing a non-audible data signal into an audio signal is known.
  • the audio signal into which the inaudible data signal, here called watermark, is to be introduced is converted into the frequency domain in order to determine the masking threshold of the audio signal by means of a psychoacoustic model.
  • the data signal to be input to the audio signal is modulated with a pseudo noise signal to provide a frequency spread data signal.
  • the frequency spread data signal is then weighted with the psychoacoustic masking threshold such that the energy of the frequency spread data signal is always below the masking threshold.
  • the weighted data signal is superimposed on the audio signal, thereby generating an audio signal into which the data signal is inaudible.
  • the data signal can be used to add information to the audio signal author and alternatively
  • the data signal can be used to identify audio signals in order to easily identify pirated copies, since each sound carrier, for example in the form of a CompactDisk, is provided with an individual identifier at the factory.
  • audio signals are often already present as compressed audio data streams, for example, have undergone processing according to one of the MPEG audio method. If one wished to use one of the preceding watermark embedding techniques to watermark pieces of music prior to delivery to a customer, they would have to be completely decompressed prior to watermarking to again obtain a sequence of time-domain audio values. However, in addition to a high computational overhead due to the additional decoding prior to watermark embedding, this also meant that re-encoding would run the risk of tandem encoder effects when these watermarked audio signals are re-encoded.
  • Another improved way of incorporating a watermark into audio signals relates to those schemes that perform embedding during compression of a still uncompressed audio signal.
  • Embedding schemes of this type have, inter alia, the advantage of lower computational complexity, since the contraction of watermark embedding and encoding requires certain operations, such as the calculation of the masking model and the transfer of the audio signal into the spectral range, to be performed only once.
  • Further advantages include higher audio quality, since the quantization noise and watermark sound can be closely matched, high robustness because the watermark is not "weakened" by a subsequent audio encoder, and the possibility of proper choice of spread spectrum parameters to provide compatibility To achieve PCM watermarking.
  • watermarks for coded and uncoded audio signals are known in various variants. With the help of watermarks, additional data can be transmitted robustly and inaudibly within an audio signal.
  • watermark embedding methods that differ in the domain of embedding, such as the time domain, the frequency domain, etc., and the type of embedding such as the quantization, the extinction of individual values, and so forth. Summary descriptions of existing methods can be found in M. van der Veen, F.
  • the object of the present invention is therefore to provide a completely new and therefore safer scheme for introducing a watermark into an information signal.
  • the information signal is first converted from a time representation into a spectral / modulation spectral representation.
  • the information signal is then manipulated in the spectral / modulation spectral representation depending on the watermark to be introduced to obtain a modified spectral / modulation spectral representation and then a watermarked information signal is formed based on the modified spectral / modulation spectral representation.
  • the watermarked information signal is converted from a time representation to a spectral / modulation spectral representation, whereupon the watermark is derived based on the spectral / modulation spectral representation.
  • One advantage of the present invention is that, in accordance with the present invention, the watermark is imbedded in the spectral / modulation spectral representation domain, traditional correlation attacks used in spread spectrum modulation based watermarking schemes are not readily targeted to lead.
  • the embedding of the watermark according to the invention in the spectral / modulation spectral domain or in the 2-dimensional modulation spectral / spectral plane entails substantially more variations of the embedding parameters, e.g. at which "places" in this level the embedding is located, as was previously the case. If necessary, the selection of the corresponding places can also be time-varying.
  • the watermark By embedding the watermark in the spectral / modulation spectral domain, it may also be possible in the case of an audio signal as the information signal, without the elaborate computation of conventional psychoacoustic parameters, e.g. the MitROCschwelle to make an inaudible embedding of a watermark, so as to ensure with less effort nevertheless the inaudibility of the watermark.
  • the modification of the modulation values can in this case be carried out, for example, by utilizing masking effects in the modulation spectral range.
  • a scheme for embedding a watermark into an audio signal, in which first an incoming audio signal or an audio input signal present in a time domain or a time representation, block by block in a time / frequency representation and from there into a frequency / modulation frequency representation is transferred.
  • the watermark is then introduced into the audio signal by modifying modulation values of the frequency / modulation frequency domain representation as a function of the watermark. In this way, the audio signal is then changed back into the time / frequency domain and from there back to the time domain.
  • Watermark embedding according to the scheme of Fig. 1-3 is due to the device Fig. 1 carried out, which is also referred to below as a watermark embedder and is indicated by the reference numeral 10.
  • the embedder 10 comprises an input 12 for receiving the audio input signal into which the watermark to be introduced is to be introduced.
  • the watermark such as a customer number, is obtained by the embedder 10 at an input 14.
  • the embedder 10 comprises an output 16 for outputting the watermarked or watermarked output signal.
  • the embedder 10 comprises a fenestration device 18 and a first filter bank 20, which are connected in series behind the input 12 and are responsible for converting the audio signal at the input 12 by block-wise processing from the time domain 22 into the time / frequency domain 24.
  • the output of the filter bank 20 is followed by an amount / phase detection device 26 in order to divide the time / frequency domain representation of the audio signal in magnitude and phase.
  • a second filter bank 28 is connected to the detection means 26 to obtain the magnitude portion of the time / frequency domain representation, and converts the magnitude component into the frequency / modulation frequency domain 30, thus producing a frequency / modulation frequency representation of the audio signal 12.
  • the blocks 18, 20, 26, 28 thus constitute an analysis part of the embedder 10, which achieves the transfer of the audio signal into the frequency / modulation frequency representation.
  • a watermark embedding device 32 is connected to the second filter bank 28 for receiving therefrom the frequency / modulation frequency representation of the audio signal 12. Another input of the watermark embedding device 32 is connected to the input 14 of the embedding 10. The watermark embedding device 32 generates a modified frequency / modulation frequency representation.
  • An output of the watermark embedding device 32 is connected to an input of a filter bank 34, which is inverse to the second filter bank 28 and is responsible for the return to the time / frequency range 24.
  • a phase processing device 36 is connected to the detection device 26 in order to obtain the phase portion of the time / frequency domain representation 24 of the audio signal and forward in manipulated form, as will be described below, to a recombiner 38, which also has an output of the inverse filter bank 34 is connected to obtain the modified amount portion of the time / frequency representation of the audio signal.
  • the recombiner 38 combines the phase component modified by the phase processing 36 with the amount of time / frequency domain representation of the audio signal modified by the watermark and outputs the result, namely the time / frequency representation of the watermarked audio signal, to a filter bank 40 inverse to the first filter bank 20. Between the output of the inverse filter bank 40 and the output 16, a fenestration device 42 is connected.
  • the part of the components 34, 38, 40, 42 can be considered as a synthesis part of the embedder 10 since it is responsible for generating the watermarked audio signal in time representation from the modified frequency / modulation frequency representation.
  • the embedding begins with the transfer of the audio signal at the input 12 from the time representation to the time / frequency representation by the means 18 and 20 assuming that the audio input signal at the input 12 in a manner sampled at a predetermined sampling frequency, namely as a sequence of sample and audio values, respectively. If the audio signal is not yet present in such a scanned form, a corresponding A / D converter can be used as a scanning device for this purpose.
  • the windowing device 18 receives the audio signal and extracts therefrom a sequence of blocks of audio values. For this purpose, the windowing device 18 combines a predetermined number of successive audio values of the audio signal at the input 12 into time blocks, and multiplies these time blocks, which in fact represent a time segment from the audio signal 12, by a windowing or weighting function, e.g. a sine window, a KBD window or the like. This process is referred to as fenestration, and is performed, for example, such that the individual time blocks relate to time segments of the audio signal which overlap one another, such as e.g. by half so that each audio value is assigned to two time blocks.
  • a windowing or weighting function e.g. a sine window, a KBD window or the like.
  • Fig. 2 illustrates with an arrow 50 the sequence of audio values in their time sequence of their arrival at the input 12. They represent the audio signal 12 in the time domain 22.
  • the index n in Fig. 2 should indicate an index of the audio values increasing in the direction of the arrow.
  • 52 indicates the window functions which the windowing device 18 applies to the time blocks.
  • the first two window functions for the first two time blocks are in Fig. 2 overwritten with the index 2m or 2m + 1.
  • the time block 2m and the subsequent time block overlap 2m + 1 by half and 50%, respectively, and thus each have half their audio values together.
  • the blocks generated by the device 18 and forwarded to the filter bank 20 correspond to one Weighting of the audio block belonging to a time block with the window function 52 or a multiplication between them.
  • the filter bank 20 receives the blocks of windowed audio values, as shown in FIG Fig. 2 indicated by arrows 54, and converted by a time / frequency transformation 56 blockwise in a spectral representation.
  • the filter bank undertakes a predetermined decomposition of the spectral range into predetermined frequency bands or spectral components.
  • the spectral representation includes, for example frequency adjacent spectral values from the frequency zero to the maximum audio frequency on which the audio signal is based, for example, 44.1 kHz.
  • Fig. 2 is exemplified the case of a spectral decomposition in ten subbands.
  • the block overpass is in Fig. 2 indicated by a plurality of arrows 58.
  • Each arrow corresponds to the transfer of a time block into the frequency domain.
  • the time block 2m is transferred to a block 60 of spectral values 62 as shown in FIG Fig. 2 indicated by a column of boxes.
  • the spectral values each relate to a different frequency component or a different frequency band, wherein Fig. 2 should be indicated by the axis 64, the direction along which the frequency k runs.
  • axis 64 the direction along which the frequency k runs.
  • spectral values 62 Since the filter bank 20 generates a block 60 of spectral values 62 per time block, several sequences of spectral values 62 result, namely one per spectral component k or subband k, over time.
  • Fig. 2 These temporal sequences run in the row direction as they pass through the Arrow 66 is shown.
  • the arrow 66 thus represents the time axis of the time / frequency representation, while the arrow 64 represents the frequency axis of this representation.
  • the "sampling frequency" or the repetition interval of the spectral values within the individual subbands corresponds to the frequency or the repetition interval of the time blocks from the audio signal.
  • the time block repetition rate again corresponds to twice the sampling frequency of the audio signal divided by the number of audio values per time block.
  • the arrow 66 thus corresponds to a time dimension insofar as it embodies the time sequence of the time blocks.
  • a matrix 68 of spectral values 62 which represents a time / frequency domain representation 24 of the audio signal over the time duration of these time blocks, thus arises over a certain number, here by way of example 8, of consecutive time blocks.
  • the time / frequency transformation 56 performed block by block at the time blocks by the filter bank 20 is, for example, a DFT, DCT, MDCT or the like.
  • the individual spectral values within a block 60 are divided into specific subbands. For each subband, each block 60 may have more than one spectral value 62.
  • a sequence of spectral values is thus produced which reproduce the time profile of the respective subband and Fig. 2 in the row direction 84.
  • the filter bank 20 forwards the blocks 60 of spectral values 62 to the magnitude / phase detection device 26 in blocks.
  • the latter processes the complex spectral values and merely passes the amounts to the filter bank 28.
  • the phases of the spectral values 62 pass them on to the phase processing device 36.
  • the filterbank 28 processes the subsequences 70 of amounts of spectral values 62 similar to the filter bank 20, namely by blockwise transforming these sequences block by block into the spectral representation and the modulation frequency representation, respectively, using preferably windowed and mutually overlapping blocks , wherein the underlying blocks of all subbands are preferably aligned with respect to each other in time.
  • the filter bank 28 processes N spectral blocks 60 of spectral value amounts simultaneously.
  • the N spectral blocks 60 of spectral value sums form a matrix 68 of spectral value sums. For example, if there are M subbands, the filter bank 28 processes the spectral value sums in matrices for each N * M spectral value sums.
  • the filter bank 28 After receiving the absolute value N of successive spectral blocks or the matrix 68, the filter bank 28 transforms the blocks of spectral value sums of the respective subbands, that is to say the rows in the matrix 68, from the time domain 66 into a frequency representation, separated as before for each subband mentions the spectral value amounts may be windowed to avoid aliasing effects.
  • the filter bank 28 converts each of these spectral value amount blocks from the sequences 70 representing the temporal progression of a respective subband into a spectral representation and thus generates a block of modulation values per subband which are stored in a spectral representation Fig. 2 are displayed with 74.
  • Each block 74 contains a plurality of modulation values, which in Fig.
  • Each of these modulation values within a block 74 is associated with a different modulation frequency, which in Fig. 2 along the axis 76 shall run, thus representing the modulation frequency axis of the frequency / modulation frequency representation.
  • a matrix 80 of modulation values which represents a frequency / modulation frequency domain representation of the audio signal at the input 12 in the time segment allocated to the matrix 68.
  • the filter bank 28 or the device 26 may have an internal window device (not shown) which converts the transformation blocks, ie the lines of the matrix 68, from spectral values per subband before their respective time / modulation frequency transformation 80 Filter bank 28 in the modulation frequency range 30 to obtain the blocks 74, a windowing with a window function 82 undergoes.
  • a sequence of matrices 80 are overlapped that overlap in the above-mentioned exemplary 50% overlap windowing - by 50% in time.
  • the filter bank 28 forms the matrix 80 for consecutive N time blocks such that the matrices 80 each relate to N time blocks that intersect in half, as shown in FIG Fig. 2 is to be indicated by a dashed window function 84, which represent the fenestration for the next matrix.
  • the modulation values of the frequency / modulation frequency domain representation 30 as output from the filter bank 28 reach the watermark embedding means 32.
  • the watermark embedding means 32 now modifies the modulation matrix 80 or one or more of the modulation values of the modulation matrices 80 of the audio signal 12 Modification can be accomplished, for example, by a multiplicative weighting of individual modulation frequency / frequency segments of the modulation subband spectrum or frequency / modulation frequency domain representation, ie by weighting the modulation values within a particular range of the frequency / modulation frequency space subtended by the axes 76 and 78.
  • the modification could include setting individual segments or modulation values to specific values.
  • the multiplicative weighting or values would depend in a predetermined manner on the watermark obtained at the input 14.
  • the setting of individual modulation values or segments of modulation values to certain values could be signal adaptive, i. additionally depending on the audio signal 12 per se.
  • the individual segments of the 2-dimensional modulation subband spectrum can be obtained by subdividing the acoustic frequency axis 78 into frequency groups; on the other hand, further segmentation can be carried out by subdividing the modulation frequency axis 76 into modulation frequency groups.
  • Fig. 1 is an example of a segmentation of the frequency axis in 5 and the modulation frequency axis in 4 groups indicated, resulting in 20 segments.
  • the dark segments indicate, by way of example, the locations at which the device 32 modifies the modulation matrix 80, wherein, as mentioned above, the locations used for the modification may vary over time.
  • the positions are preferably selected such that the changes to the audio signal in the frequency / modulation frequency representation are not or hardly audible due to masking effects.
  • the device 32 modifies the modulation matrix 80, it sends the modified modulation values of the modulation matrix 80 to the inverse filter bank 34.
  • This transforms by means of a transformation, the to that of the filterbank 28, ie, an IDFT, IFFT, IDCT, IMDCT, or the like, the modulation matrix 80 returns block 74-wise, ie, separated by subband, along the modulation frequency axis 76 to the time / frequency domain representation 24, thereby modifying To obtain absolute value spectral values.
  • the inverse filterbank 34 transforms each block of modified modulation values 74 associated with a particular subband with a transform inverse to the transform 86 into a sequence of magnitude fraction spectral values per subband, which, in the previous embodiment, is a matrix of N x M magnitude fraction spectral values results.
  • the absolute value spectral values from the inverse filter bank 34 thus always refer to two-dimensional blocks or matrices from the stream of sequences of spectral values, of course in the form modified form the watermark. According to the exemplary embodiment, these blocks overlap by 50%.
  • a device (not shown) provided, for example, in the device 34 now compensates for the windowing in this exemplary 50% overlap case by adding the overlapping recombined spectral values of successive matrices of spectral values obtained by inverse transformation of successive modulation matrices.
  • streams or sequences of modified spectral values, namely one per subband arise from the individual matrices of modified spectral values. These sequences correspond only to the magnitude portion of the unmodified sequences 70 of spectral values as output from the device 20.
  • the recombiner 38 combines the sum-of-part spectral values merged into sub-band streams from the inverse filter bank 34 with the phase components of the spectral values 62 as produced by the detection means 26 immediately after the transformation 56 by the first filterbank 20, but in a modified form by the phase processing 36.
  • the phase processing means 36 modifies the phase portions in a manner separate from the watermark embedding by the means 32 but possibly dependent on this embedding such that the detectability of the watermark will be referred to later on Fig. 3 explained detector or decoder system is better detectable and / or the acoustic masking of the watermark signal in later output at the output 16 watermarked output signal and thus the inaudibility of the watermark is improved.
  • the recombination can make the recombination device 38 matrix-wise per matrix 68 or continuously over the sequences of modified absolute-value spectral values per subband.
  • the optional dependence of the manipulation of the phase component of the time / frequency representation of the audio signal at the input 12 on the manipulation of the frequency / modulation frequency representation by the manipulation device 32 is shown in FIG Fig. 1 illustrated by a dashed arrow 88.
  • the recombination is performed, for example, by adding the phase of a spectral value to the phase portion of the corresponding modified spectral value as output from the filter bank 34.
  • the device 38 thus generates sequences of spectral values per subband, such as the one obtained after the filter bank 20 directly from the unmodified audio signal, namely the sequences 70, but in changed form around the watermark, so that the device 38 output recombined spectral values modified in terms of the magnitude proportion represent a time / frequency representation of the watermarked audio signal.
  • the inverse filter bank 40 thus again receives sequences of modified spectral values, namely one per subband.
  • the inverse filter bank receives 40 per Cycle a block of modified spectral values, ie a frequency representation of the watermarked audio signal with respect to a period of time of the same.
  • the filter bank 40 performs inverse transformation to the transform 56 of the filter bank 20 on each such block of spectral values, ie, spectral values arranged along the frequency axis 70, to obtain as a result modified windowed time blocks of windowed modified audio values.
  • Subsequent windowing means 42 compensates for the fenestration introduced by windowing means 18 by adding corresponding audio values within the overlapping areas, thereby yielding at output 16 the watermarked output in time domain representation 22.
  • Fig. 3 describes a device capable of successfully analyzing a watermarked output signal produced by the embedder 10 to reconstruct the watermark therefrom which, in the watermarked output signal, preferably contains inaudibly together with the useful audio information for human hearing is.
  • the watermark decoder of Fig. 3 generally indicated at 100 includes an audio signal input 112 for receiving the watermarked audio signal and an output 114 for outputting the watermark extracted from the watermarked audio signal.
  • an audio signal input 112 for receiving the watermarked audio signal
  • an output 114 for outputting the watermark extracted from the watermarked audio signal.
  • the watermarked audio signal at the input 112 is passed from the time domain 122 into the time domain 124 by the window means 118 and the filterbank 120, from where the detection means 126 and the second filterbank 128 transfer the audio signal at the input 112 into the Frequency / modulation frequency range 130 takes place.
  • the watermarked audio signal is thus subjected to the same processing by the means 118, 120, 126 and 128 as to refer to the original audio signal Fig. 2 have been described.
  • the resulting modulation matrices do not fully correspond to those output in the embedder 10 from the water embedder 32 because the phase recombinations of the recombiner 38 change some of the modulation components relative to the modified modulation matrices output from the device 32 and thus reflected in somewhat altered form in the watermarked output signal. Also, the windowing cancellation or OLA changes the modulation components until the new modulation spectral analysis in the decoder 100.
  • a watermark decoder 132 connected to the filter bank 128 for obtaining the frequency / modulation range representation of the watermarked input signal and the modulation matrices, respectively, is provided to extract the watermark originally introduced by the embedder 10 from the output and output 114 issue. The extraction is performed at predetermined locations of the modulation matrices corresponding to those used by the embedder 10. The conformity of the selection of bodies is ensured, for example, by appropriate standardization.
  • the modulation matrices as applied to the watermark decoder 132 may also be due to the fact that the watermarked input signal between its output at the output 16 and the detection by the detector 100 and the reception at the input 112 has been degraded in some way , such as by a coarser quantization of the audio values or the like.
  • the embodiment described above may be used to embed a watermark in an audio signal to prove authorship of an audio signal.
  • the original audio signal arriving at input 12 is, for example, a piece of music.
  • the embedder 10 in the audio signal, whereby the watermarked audio signal is produced at the output 16.
  • a third party claims to be the author of the corresponding piece of music or music title can the proof of the actual authorship be guided by means of the watermark, which can be extracted from the watermarked audio signal by means of the detector 100 again and otherwise inaudible during normal play.
  • watermark embedding Another potential use of watermark embedding shown above is to use watermarks for logging the broadcast program of TV and radio stations. Broadcasting programs are usually divided into different sections, e.g. individual music titles, radio plays, commercials or the like. The author of an audio signal, or at least the one who may and wants to earn a particular song or commercial, can now watermark his audio signal with the embedder 10, and send the watermarked audio signal to the broadcaster. Music titles or commercials can be charged in this way with a unique watermark.
  • For logging the broadcast program can now be e.g. a computer is used, which examines the broadcast signal for a watermark and logs found watermarks. Based on the list of discovered watermark can be easily generate a transmission list for the appropriate broadcaster, which facilitates the billing or fee payment.
  • Another application is to use watermarks to detect illegal copies.
  • the use of watermarks is worthwhile, especially for music distribution over the Internet.
  • a buyer buys a song
  • a unique customer number is embedded in the data with the help of a watermark during the transmission of the music data to the buyer.
  • the result is music titles in which the watermark is embedded inaudibly. If, at a later date, a song is found in an unauthorized place on the Internet, such as a swap, this piece may point to the watermark towards by means of a decoder Fig. 3 examined and identified by the watermark the original buyer.
  • the latter application could also play an important role in the current DRM (Digital Rights Management) solutions.
  • the watermark in the watermarked audio signals could serve here as a kind of "second line of defense", which still allows conclusions to the original buyer, if the cryptographic protection of a watermarked audio signal has already been bypassed.
  • the embedder of Fig. 4 which is generally indicated at 210, includes as well as the embedder of Fig. 1 an audio signal input 12, a watermark input 14 and an output 16 for outputting the watermarked audio signal.
  • the fenestration device 18 and the first filter bank 20 close to the Block audio into blocks 60 of spectral values 62 (FIG. Fig. 2 ), wherein the sequence of blocks of spectral values, which thereby arises at the output of the filter bank 20, represents the time / frequency domain representation 24 of the audio signal.
  • the complex spectral values 62 are not divided into magnitude and phase, but the complex spectral values are fully processed further to convert the audio signal in the frequency / modulation frequency range.
  • each sequence 70 of successive spectral values of a subband are therefore converted into a spectral representation in blocks, taking account of magnitude and phase.
  • each subband spectral value sequence 70 is still subjected to demodulation. Namely, each sequence 70, ie the sequence of spectral values which result in successive time blocks for transfer into the spectral range for a specific subband, is multiplied by a mixer 212 with the complex conjugate of a modulation carrier component, which is emitted by a carrier frequency determiner 214 the spectral values and in particular the phase portion of these spectral values of the time / frequency domain representation of the audio signal is determined.
  • the means 212 and 214 serve to compensate for the fact that the repetition distance of the time blocks is not necessarily matched to the period of the carrier frequency component of the audio signal, ie the audible frequency representing on average the carrier frequency of the audio signal.
  • consecutive time blocks are shifted by a different phase offset from the carrier frequency of the audio signal.
  • each block 60 of spectral values as output from the filter bank 20 having a linear phase rise due to the time block individual phase offset, ie its slope and intercept, depending on the phase offset of the respective time block to the carrier frequency in the phase component depends on the phase offset. Because the phase offset between consecutive time blocks, the slope of the phase offset due to the phase offset increases for each block 60 of spectral values 62, until the phase offset returns to zero, and so on.
  • the carrier frequency determiner 214 therefore fits and closes a plane into the unwrapped or phase-phased phases of the spectral values 62 of the matrix 68 by suitable methods, such as a least-squares algorithm this is due to the phase rise due to the phase offset of the time blocks which occurs in the sequences 70 of spectral values for the individual subbands within the matrix 68. Overall, this results in a derived phase increase per subband, which corresponds to the desired modulation carrier component.
  • the carrier frequency determiner 214 may also perform one-dimensional fits of a line into the phase traces of the individual sequences 70 of spectral values 62 within the matrices 68 to obtain the individual phase slope due to the phase offset of the time blocks.
  • the phase portion of the spectral values of matrix 68 is "flattened", and only varies on average by zero in phase due to the shape of the audio signal itself.
  • the thus modified spectral values 62 are forwarded to the mixer 212 by the mixer 212, which filters the same in matrix manner (matrix 68 in FIG Fig. 2 ) into the frequency / modulation frequency range. Similar to the embodiment of Fig. 1-3 Consequently, a matrix of modulation values is obtained in which, however, this time both phase and magnitude of the time / frequency domain representation 24 have been taken into account. As with the example of Fig. 1 For example, fenestration with 50% overlap or the like may be provided.
  • the successive modulation matrices thus generated are forwarded to a watermark embedding device 216, which receives the watermark 14 at another input.
  • the watermark embedding device 216 operates in a manner similar to the embedding device 32 of the embedding device 10 of FIG Fig. 1 ,
  • the embedding locations within the frequency / modulation frequency domain representation 30 are optionally selected using rules that take into account other masking effects than is the case with the embedding means 32.
  • the locations of the embedding should be selected, as in the case of the device 32, such that the modulation values modified there are inaudible to the watermarked audio signal as later output at the output of the embedder 210.
  • modified modulation values or the changed or modified modulation matrices are forwarded to the inverse filter bank 34, resulting in the modified modulation matrices of modified spectral values.
  • modified spectral values the phase correction which has been brought about by the demodulation by means of the mixer 212 must be reversed.
  • the blocks of modified spectral values output by the inverse filter bank 34 per subband are mixed by means of a mixer 218 with a demodulation carrier component complexed to that prior to demodulation by the mixer 212 for transfer to the frequency / modulation frequency domain this subband has been used, that is to say a multiplication of these blocks by e j (w * m + ⁇ ) , where again w indicates the particular carrier for the respective subband, m is the index for the modified spectral values and ⁇ is a phase offset of the certain carrier to the considered time excerpt of the N time blocks for the respective sub-band.
  • the respective modulator for the respective subband which indeed refers to the content of a particular subband block or has been applied after the block division by the modulation 212, 214, inverted again before the subsequent block merge.
  • the spectral values thus obtained are still in the form of blocks, namely in each case one block of modified spectral value blocks per subband, and are optionally also subjected to an OLA or combination for reversing the windowing, as for example to the reference to FIG Fig. 1 described way.
  • the resulting unfolded spectral values are then available as streams of modified spectral values per subband and represent the time / frequency domain representation of the watermarked one
  • the output of the mixer 218 is followed by the inverse filter bank 40 and the windowing device 42, which take over the transfer of the time / frequency domain representation of the watermarked audio signal in the time domain 22, resulting in the output 16, a sequence of audio values, the represent watermarked audio signal.
  • An advantage of the procedure after Fig. 4 regarding the procedure Fig. 1 is that by using the phase and magnitude together to transition into the frequency / modulation frequency range, no reintroduction of modulation components in the recombination of phase and modified magnitude component is caused.
  • a watermark decoder capable of processing the watermarked audio signal as outputted from the embedder 210 to extract the watermark therefrom is disclosed in U.S. Pat Fig. 5 shown.
  • the decoder indicated generally at 310, includes an input 312 for receiving the watermarked audio signal and an output 314 for outputting the extracted watermark.
  • To the input 312 of the decoder 310 are connected in series and in the order mentioned below, a fenestration device 318, a filter bank 320, a mixer 412 and a filter bank 328, wherein another input of the mixer 412 is connected to a Output of a carrier frequency determining means 414 is connected, having an input connected to the output of the filter bank 320.
  • the components 318, 320, 412, 328, and 414 serve the same purpose and operate in the same manner as the components 18, 20, 212, 28, and 214 of the embedder 210.
  • the watermarked input signal in the decoder 310 becomes time domain 322 via the time frequency range 324 into the frequency / modulation frequency range 330, where a watermark decoding device 332 receives and processes the frequency / modulation frequency domain representation of the watermarked audio signal to extract the watermark and output at the input 314 of the decoder 310.
  • the modulation matrices supplied to the decoder 332 in the decoder 310 differ less than those supplied to the decoder 132 from those supplied to the embedding means 216 in the embodiment of FIG Fig. 1-3 since the recombination between phase fraction and modified amount fraction in the embedment system of Fig. 4 eliminated.
  • the previous embodiments thus related to a heretofore unprecedented connection of subband modulation spectral analysis and digital watermarking to an overall system for watermarking with a potting system on one side and a detector system on the other side.
  • the embedding system is used to introduce the watermark. It consists of a subband modulation spectral analysis, an embedder stage that modifies the signal representation obtained by the analysis, and a synthesis of the modified representation signal.
  • the detector system serves to detect an existing watermark in a watermarked audio signal. It consists of a subband modulation spectral analysis and a detection stage that detects and evaluates the watermark using the signal representation obtained by the analysis.
  • the preceding embodiments are merely exemplary possibilities to be able to provide audio recordings with inaudible and anti-manipulation additional information, and in doing so make the watermark insertion in the so-called subband modulation spectral range and to perform the detection in the subband modulation spectral range.
  • various variations can be made to these embodiments.
  • the fenestration devices mentioned above could only serve for blocking, ie the multiplication or weighting with the window functions could also be omitted.
  • one could also use other window functions than the above-mentioned amounts of trigonometric functions.
  • the 50% block overlap could be omitted or executed differently.
  • the block overlap on the side of the synthesis could also involve operations other than a mere addition of related audio values in successive time blocks.
  • the windowings in the second transformation stage could also be varied in a corresponding manner.
  • the audio signal input does not necessarily have to be returned from the time domain to the frequency / modulation frequency domain representation and from there again - after the modification - to the time domain representation. It would also be possible to modify the previous two embodiments to merge the values output from the recombiner 38 and the mixer 218, respectively, into a watermarked audio signal in a bitstream to be in a time / frequency domain ,
  • the demodulation used in the second embodiment could also be performed differently, e.g. by changing the phase curves of the spectral value blocks within the matrices 68 by other means than by pure multiplication with a solid complex carrier.
  • the present watermark embedding scheme is also applicable to other information signals, such as e.g. to control signals, measurement signals, video signals or the like, for example, to check their authenticity.
  • the scheme proposed herein makes it possible to embedding information so as not to interfere with the usual use of the information signal in the watermarked form, e.g. the analysis of the measurement results or the visual impression of the video or the like, which is why even in these cases, the additional data to be embedded are referred to as watermarks.
  • the inventive scheme can also be implemented in software.
  • the implementation may be on a digital storage medium, in particular a floppy disk or a CD with electronically readable control signals, which may cooperate with a programmable computer system such that the corresponding method is executed.
  • the invention thus also consists in a computer program product with program code stored on a machine-readable carrier for carrying out the method according to the invention when the computer program product runs on a computer.
  • the invention can thus be realized as a computer program with a program code for carrying out the method when the computer program runs on a computer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Editing Of Facsimile Originals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Image Processing (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)
  • Compositions Of Macromolecular Compounds (AREA)
  • Paper (AREA)
EP05715993.1A 2004-04-30 2005-03-11 Wasserzeicheneinbettung Active EP1741215B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PL05715993T PL1741215T3 (pl) 2004-04-30 2005-03-11 Osadzanie znaku wodnego

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102004021404A DE102004021404B4 (de) 2004-04-30 2004-04-30 Wasserzeicheneinbettung
PCT/EP2005/002636 WO2005109702A1 (de) 2004-04-30 2005-03-11 Wasserzeicheneinbettung

Publications (2)

Publication Number Publication Date
EP1741215A1 EP1741215A1 (de) 2007-01-10
EP1741215B1 true EP1741215B1 (de) 2013-12-25

Family

ID=34961950

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05715993.1A Active EP1741215B1 (de) 2004-04-30 2005-03-11 Wasserzeicheneinbettung

Country Status (17)

Country Link
US (1) US7676336B2 (ru)
EP (1) EP1741215B1 (ru)
JP (1) JP5048478B2 (ru)
KR (3) KR20080081098A (ru)
CN (1) CN1969487B (ru)
AU (1) AU2005241609B2 (ru)
BR (1) BRPI0509819B1 (ru)
CA (1) CA2564981C (ru)
DE (1) DE102004021404B4 (ru)
ES (1) ES2449043T3 (ru)
HK (1) HK1103320A1 (ru)
IL (1) IL178929A (ru)
MX (1) MXPA06012550A (ru)
NO (1) NO338923B1 (ru)
PL (1) PL1741215T3 (ru)
RU (1) RU2376708C2 (ru)
WO (1) WO2005109702A1 (ru)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8306811B2 (en) * 1996-08-30 2012-11-06 Digimarc Corporation Embedding data in audio and detecting embedded data in audio
DE19947877C2 (de) * 1999-10-05 2001-09-13 Fraunhofer Ges Forschung Verfahren und Vorrichtung zum Einbringen von Informationen in einen Datenstrom sowie Verfahren und Vorrichtung zum Codieren eines Audiosignals
DE102004023436B4 (de) * 2004-05-10 2006-06-14 M2Any Gmbh Vorrichtung und Verfahren zum Analysieren eines Informationssignals
CN101185122A (zh) * 2005-06-03 2008-05-21 皇家飞利浦电子股份有限公司 用于安全水印的同态加密
EP1764780A1 (en) * 2005-09-16 2007-03-21 Deutsche Thomson-Brandt Gmbh Blind watermarking of audio signals by using phase modifications
WO2008028200A2 (en) * 2006-08-29 2008-03-06 Benjamin Filmalter Grobler Digital data licensing system
EP2015293A1 (en) * 2007-06-14 2009-01-14 Deutsche Thomson OHG Method and apparatus for encoding and decoding an audio signal using adaptively switched temporal resolution in the spectral domain
US8099285B2 (en) * 2007-12-13 2012-01-17 Dts, Inc. Temporally accurate watermarking system and method of operation
US20090265366A1 (en) * 2008-04-22 2009-10-22 Qualcomm Incorporated Opportunistic opinion score collection on a mobile device
CN101271690B (zh) * 2008-05-09 2010-12-22 中国人民解放军重庆通信学院 保护音频数据的音频扩频水印处理方法
JP5338170B2 (ja) * 2008-07-18 2013-11-13 ヤマハ株式会社 電子透かし情報の埋め込みおよび抽出を行う装置、方法およびプログラム
JP5582508B2 (ja) * 2008-08-14 2014-09-03 エスケーテレコム株式会社 データ送信装置、データ受信装置、データ送信方法、及びデータ受信方法
JP2011145541A (ja) * 2010-01-15 2011-07-28 Yamaha Corp 再生装置、楽音信号出力装置、再生システム及びプログラム
EP2362382A1 (en) * 2010-02-26 2011-08-31 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Watermark signal provider and method for providing a watermark signal
EP2362386A1 (en) * 2010-02-26 2011-08-31 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Watermark generator, watermark decoder, method for providing a watermark signal in dependence on binary message data, method for providing binary message data in dependence on a watermarked signal and computer program using a two-dimensional bit spreading
EP2362387A1 (en) * 2010-02-26 2011-08-31 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Watermark generator, watermark decoder, method for providing a watermark signal in dependence on binary message data, method for providing binary message data in dependence on a watermarked signal and computer program using a differential encoding
JP5459069B2 (ja) * 2010-05-24 2014-04-02 ヤマハ株式会社 音声信号に埋め込まれた電子透かし情報を除去する装置、および音声信号に電子透かし情報を埋め込む装置
EP2431970A1 (en) * 2010-09-21 2012-03-21 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Watermark generator, watermark decoder, method for providing a watermarked signal based on discrete valued data and method for providing discrete valued data in dependence on a watermarked signal
EP2565667A1 (en) 2011-08-31 2013-03-06 Friedrich-Alexander-Universität Erlangen-Nürnberg Direction of arrival estimation using watermarked audio signals and microphone arrays
TWI457852B (zh) * 2011-11-22 2014-10-21 Univ Nat Taiwan Normal 文件複印後呈現內容意義改變之浮水印製作方法
US9401153B2 (en) 2012-10-15 2016-07-26 Digimarc Corporation Multi-mode audio recognition and auxiliary data encoding and decoding
US9305559B2 (en) 2012-10-15 2016-04-05 Digimarc Corporation Audio watermark encoding with reversing polarity and pairwise embedding
US9380383B2 (en) 2013-09-06 2016-06-28 Gracenote, Inc. Modifying playback of content using pre-processed profile information
US9990928B2 (en) * 2014-05-01 2018-06-05 Digital Voice Systems, Inc. Audio watermarking via phase modification
EP2963649A1 (en) * 2014-07-01 2016-01-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio processor and method for processing an audio signal using horizontal phase correction
US10262118B2 (en) * 2015-01-06 2019-04-16 Robert Antonius Adrianus Van Overbruggen Systems and methods for authenticating digital content
WO2016115483A2 (en) * 2015-01-15 2016-07-21 Hardwick John C Audio watermarking via phase modification
EP3534618A4 (en) * 2016-10-27 2020-06-03 Evixar Inc. CONTENT REPRODUCING PROGRAM AND CONTENT REPRODUCING APPARATUS
CN107375810A (zh) * 2017-08-03 2017-11-24 广河县盛和中医医院 一种专治男科阳痿早泄的组合物
CN109166570B (zh) * 2018-07-24 2019-11-26 百度在线网络技术（北京）有限公司 一种语音切分的方法、装置、设备和计算机存储介质
US11244692B2 (en) 2018-10-04 2022-02-08 Digital Voice Systems, Inc. Audio watermarking via correlation modification using an amplitude and a magnitude modification based on watermark data and to reduce distortion
CN111341329B (zh) * 2020-02-04 2022-01-21 北京达佳互联信息技术有限公司 水印信息添加方法、提取方法、装置、设备及介质

Family Cites Families (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0519782A (ja) * 1991-05-02 1993-01-29 Ricoh Co Ltd 音声特徴抽出装置
US5173923A (en) * 1991-11-22 1992-12-22 Bell Communications Research, Inc. Spread-time code division multiple access technique with arbitrary spectral shaping
US5321497A (en) * 1992-03-09 1994-06-14 Wyko Corporation Interferometric integration technique and apparatus to confine 2π discontinuity
US5671168A (en) 1995-07-06 1997-09-23 Technion Research & Development Foundation Ltd. Digital frequency-domain implementation of arrays
EP0766468B1 (en) 1995-09-28 2006-05-03 Nec Corporation Method and system for inserting a spread spectrum watermark into multimedia data
US6584138B1 (en) 1996-03-07 2003-06-24 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Coding process for inserting an inaudible data signal into an audio signal, decoding process, coder and decoder
DE19640825C2 (de) * 1996-03-07 1998-07-23 Fraunhofer Ges Forschung Codierer zur Einbringung eines nicht hörbaren Datensignals in ein Audiosignal und Decodierer zum decodieren eines nicht hörbar in einem Audiosignal enthaltenen Datensignals
US5724270A (en) 1996-08-26 1998-03-03 He Holdings, Inc. Wave-number-frequency adaptive beamforming
US5915027A (en) * 1996-11-05 1999-06-22 Nec Research Institute Digital watermarking
PT1020077E (pt) 1997-10-08 2002-12-31 Digimarc Corp Processo e aparelho para uma marca de agua de copia unica para uma gravacao de video
US6330672B1 (en) * 1997-12-03 2001-12-11 At&T Corp. Method and apparatus for watermarking digital bitstreams
TW440819B (en) * 1998-03-18 2001-06-16 Koninkl Philips Electronics Nv Copy protection schemes for copy protected digital material
US6064764A (en) 1998-03-30 2000-05-16 Seiko Epson Corporation Fragile watermarks for detecting tampering in images
CN1178511C (zh) 1998-05-20 2004-12-01 麦克罗维西恩公司 用于特殊定标和任意移动的水印检测方法及装置
US6073153A (en) * 1998-06-03 2000-06-06 Microsoft Corporation Fast system and method for computing modulated lapped transforms
US6725371B1 (en) * 1999-06-30 2004-04-20 Intel Corporation Secure packet processor
BR0006884A (pt) * 1999-07-02 2001-10-30 Koninkl Philips Electronics Nv Processo e sistema para embutir dadossuplementares em um sinal codificado e gravardito sinal codificado em um portador de gravação,portador de gravação e sistema para reproduzirdados gravados em um portador de gravação
DE19947877C2 (de) 1999-10-05 2001-09-13 Fraunhofer Ges Forschung Verfahren und Vorrichtung zum Einbringen von Informationen in einen Datenstrom sowie Verfahren und Vorrichtung zum Codieren eines Audiosignals
US6725372B1 (en) 1999-12-02 2004-04-20 Verizon Laboratories Inc. Digital watermarking
JP3507743B2 (ja) * 1999-12-22 2004-03-15 インターナショナル・ビジネス・マシーンズ・コーポレーション 圧縮オーディオデータへの電子透かし方法およびそのシステム
WO2001054053A1 (en) 2000-01-24 2001-07-26 Ecole Polytechnique Federale De Lausanne Transform domain allocation for multimedia watermarking
JP3659321B2 (ja) * 2000-06-29 2005-06-15 インターナショナル・ビジネス・マシーンズ・コーポレーション 電子透かし方法およびそのシステム
AU2001275712A1 (en) * 2000-07-27 2002-02-13 Activated Content Corporation, Inc. Stegotext encoder and decoder
CA2418722C (en) * 2000-08-16 2012-02-07 Dolby Laboratories Licensing Corporation Modulating one or more parameters of an audio or video perceptual coding system in response to supplemental information
US20020168082A1 (en) * 2001-03-07 2002-11-14 Ravi Razdan Real-time, distributed, transactional, hybrid watermarking method to provide trace-ability and copyright protection of digital content in peer-to-peer networks
US7136418B2 (en) * 2001-05-03 2006-11-14 University Of Washington Scalable and perceptually ranked signal coding and decoding
US7006452B2 (en) 2001-05-22 2006-02-28 Intel Corporation Matching DSL data link layer protocol detection
DE10129239C1 (de) * 2001-06-18 2002-10-31 Fraunhofer Ges Forschung Vorrichtung und Verfahren zum Einbetten eines Wasserzeichens in ein Audiosignal
JP2003044067A (ja) * 2001-08-03 2003-02-14 Univ Tohoku 位相の周期偏移によるディジタルデータの埋めこみ・検出装置
US6963842B2 (en) * 2001-09-05 2005-11-08 Creative Technology Ltd. Efficient system and method for converting between different transform-domain signal representations
FR2834363B1 (fr) * 2001-12-27 2004-02-27 France Telecom Procede de caracterisation d'un signal sonore
US7243060B2 (en) 2002-04-02 2007-07-10 University Of Washington Single channel sound separation
US20050177738A1 (en) 2002-05-10 2005-08-11 Koninklijke Philips Electronics N.V. Watermark embedding and retrieval
US7254500B2 (en) 2003-03-31 2007-08-07 The Salk Institute For Biological Studies Monitoring and representing complex signals

Also Published As

Publication number Publication date
AU2005241609A1 (en) 2005-11-17
DE102004021404A1 (de) 2005-11-24
BRPI0509819B1 (pt) 2023-10-03
ES2449043T3 (es) 2014-03-18
PL1741215T3 (pl) 2014-05-30
AU2005241609B2 (en) 2008-01-10
KR20080094851A (ko) 2008-10-24
NO20065424L (no) 2007-01-31
HK1103320A1 (en) 2007-12-14
JP2007535699A (ja) 2007-12-06
RU2376708C2 (ru) 2009-12-20
CN1969487A (zh) 2007-05-23
IL178929A0 (en) 2007-03-08
WO2005109702A1 (de) 2005-11-17
NO338923B1 (no) 2016-10-31
US20080027729A1 (en) 2008-01-31
KR100902910B1 (ko) 2009-06-15
CA2564981A1 (en) 2005-11-17
DE102004021404B4 (de) 2007-05-10
KR20070015182A (ko) 2007-02-01
RU2006142304A (ru) 2008-06-10
JP5048478B2 (ja) 2012-10-17
CN1969487B (zh) 2011-08-17
MXPA06012550A (es) 2006-12-15
CA2564981C (en) 2011-12-06
BRPI0509819A (pt) 2007-09-18
EP1741215A1 (de) 2007-01-10
IL178929A (en) 2011-03-31
US7676336B2 (en) 2010-03-09
KR20080081098A (ko) 2008-09-05

Similar Documents

Publication Publication Date Title
EP1741215B1 (de) Wasserzeicheneinbettung
EP2240929B1 (de) Vorrichtung und verfahren zum synchronisieren von mehrkanalerweiterungsdaten mit einem audiosignal und zum verarbeiten des audiosignals
EP2240928B1 (de) Vorrichtung und verfahren zum berechnen eines fingerabdrucks eines audiosignals, vorrichtung und verfahren zum synchronisieren und vorrichtung und verfahren zum charakterisieren eines testaudiosignals
EP1741039B1 (de) Informationssignalverarbeitung durch modifikation in der spektral-/modulationsspektralbereichsdarstellung
EP1212857B1 (de) Verfahren und vorrichtung zum einbringen von informationen in einen datenstrom sowie verfahren und vorrichtung zum codieren eines audiosignals
DE602004005197T2 (de) Vorrichtung und verfahren zum kodieren eines audiosignals und vorrichtung und verfahren zum dekodieren eines kodierten audiosignals
DE60213394T2 (de) Audiokodierung mit partieller enkryption
EP1495445B1 (de) Verfahren und vorrichtung zum einbetten und extrahieren von wasserzeicheninformationen
EP1016319B1 (de) Verfahren und vorrichtung zum codieren eines zeitdiskreten stereosignals
DE10200653A1 (de) Skalierbarer Codierer und Decodierer für einen skalierten Datenstrom
DE602004009926T2 (de) Vorrichtung und verfahren zum einbetten eines wasserzeichens unter verwendung von subbandfilterung
EP1604527B1 (de) Vorrichtung und verfahren zum einbetten einer binären nutzinformation in ein trägersignal
DE60210668T2 (de) Quantisierungs-index-moduliertes (qim) einbetten eines digitalen wasserzeichens in ein multimedia-signal
DE69931932T2 (de) Verfahren und Vorrichtung zum Dekodieren und Einfügen eines Wasserzeichens in einen Datenstrom
WO2008037727A2 (de) Verfahren und vorrichtung zum erstellen eines kodierschlüssels, sowie verwendung des verfahrens und verarbeitungsmittel zur verwendung des kodierschlüssels
WO2002080415A2 (de) Verfahren und vorrichtung zum ermitteln von in ein audiosignal eingebrachten informationen und verfahren und vorrichtung zum einbringen von informationen in ein audiosignal

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20061020

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWAN

DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1103320

Country of ref document: HK

17Q First examination report despatched

Effective date: 20090602

APBK Appeal reference recorded

Free format text: ORIGINAL CODE: EPIDOSNREFNE

APBN Date of receipt of notice of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA2E

APBR Date of receipt of statement of grounds of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA3E

APAF Appeal reference modified

Free format text: ORIGINAL CODE: EPIDOSCREFNE

APBT Appeal procedure closed

Free format text: ORIGINAL CODE: EPIDOSNNOA9E

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 502005014138

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04H0001000000

Ipc: H04H0020310000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: G10L 19/00 20130101ALN20121211BHEP

Ipc: H04H 20/31 20080101AFI20121211BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 647074

Country of ref document: AT

Kind code of ref document: T

Effective date: 20140115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502005014138

Country of ref document: DE

Effective date: 20140213

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2449043

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20140318

REG Reference to a national code

Ref country code: NL

Ref legal event code: T3

REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1103320

Country of ref document: HK

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: PL

Ref legal event code: T3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140425

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140428

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502005014138

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140311

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20140926

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502005014138

Country of ref document: DE

Effective date: 20140926

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140311

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140331

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 647074

Country of ref document: AT

Kind code of ref document: T

Effective date: 20140311

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20140311

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 12

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20131225

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140326

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20050311

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140331

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 13

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 14

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230512

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20230414

Year of fee payment: 19

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20240320

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240321

Year of fee payment: 20

Ref country code: GB

Payment date: 20240322

Year of fee payment: 20

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: TR

Payment date: 20240228

Year of fee payment: 20

Ref country code: PL

Payment date: 20240301

Year of fee payment: 20

Ref country code: IT

Payment date: 20240329

Year of fee payment: 20

Ref country code: FR

Payment date: 20240320

Year of fee payment: 20