WO2004112399A1 - Raising detectability of additional data in a media signal having few frequency components - Google Patents

Raising detectability of additional data in a media signal having few frequency components Download PDF

Info

Publication number
WO2004112399A1
WO2004112399A1 PCT/IB2004/050906 IB2004050906W WO2004112399A1 WO 2004112399 A1 WO2004112399 A1 WO 2004112399A1 IB 2004050906 W IB2004050906 W IB 2004050906W WO 2004112399 A1 WO2004112399 A1 WO 2004112399A1
Authority
WO
WIPO (PCT)
Prior art keywords
media signal
signal
modified
additional data
unit
Prior art date
Application number
PCT/IB2004/050906
Other languages
French (fr)
Inventor
Minne Van Der Veen
Aweke N. Lemma
Javier F. Aprea
Alphons A. M. L. Bruekers
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to DE602004017993T priority Critical patent/DE602004017993D1/en
Priority to JP2006516691A priority patent/JP2006527958A/en
Priority to US10/560,679 priority patent/US20060168448A1/en
Priority to EP04736871A priority patent/EP1639826B1/en
Publication of WO2004112399A1 publication Critical patent/WO2004112399A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/018Audio watermarking, i.e. embedding inaudible data in the audio signal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/0021Image watermarking
    • G06T1/005Robust watermarking, e.g. average attack or collusion attack resistant
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • H04N1/32154Transform domain methods
    • H04N1/3216Transform domain methods using Fourier transforms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32149Methods relating to embedding, encoding, decoding, detection or retrieval operations
    • H04N1/32203Spatial or amplitude domain methods
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H04N1/32352Controlling detectability or arrangements to facilitate detection or retrieval of the embedded information, e.g. using markers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835Generation of protective data, e.g. certificates
    • H04N21/8358Generation of protective data, e.g. certificates involving watermark
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2201/00General purpose image data processing
    • G06T2201/005Image watermarking
    • G06T2201/0052Embedding of the watermark in the frequency domain
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2201/00General purpose image data processing
    • G06T2201/005Image watermarking
    • G06T2201/0065Extraction of an embedded watermark; Reliable detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3269Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of machine readable codes or marks, e.g. bar codes or glyphs
    • H04N2201/327Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of machine readable codes or marks, e.g. bar codes or glyphs which are undetectable to the naked eye, e.g. embedded codes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/08Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band, e.g. by time division

Definitions

  • the present invention generally relates to the field of providing additional data in a media signal and more particularly to methods, devices, a signal and an information storage medium related to embedding of additional data in a media signal.
  • Content can then be provided by different content providers in the form of media signals of varying shapes and forms.
  • Media signals can for instance be provided as audio signals, in either compressed or uncompressed form, image signals in compressed or uncompressed form as well as video signals in compressed or uncompressed form.
  • audio signals in either compressed or uncompressed form, image signals in compressed or uncompressed form as well as video signals in compressed or uncompressed form.
  • content owners In order to inhibit that media content is unlawfully obtained by persons not entitled to it or that illegal copies of content are being made, there is a need for content owners to protect their content. In order to do this they often need to provide additional information in the media signals. Additional information can also be provided for other reasons, like for instance for providing text in relation to a piece of audio (e.g., lyrics).
  • DRM Digital Rights Management
  • multiplicative watermarking where the media signal to be watermarked is multiplied with the watermark in question.
  • a media signal normally has a lot of different frequency components, whereas sometimes it can have few such components. When the components are few it can be hard to detect a watermark that has been embedded using multiplicative watermarking.
  • multiplicative watermarking scheme a plurality of circular shifted chip sequences of real numbers is multiplied with a properly scaled version of the media signal and added back to the original media signal. Upon detection, the distances between the diverse correlation peaks carry (a coded version of) the watermark information. If the host signal contains few frequency components, the correlation will be weak. There is thus a need for enabling a higher level of detectability for additional data that has to be embedded in a media signal with few frequency components using a multiplicative embedding technique.
  • this objective is achieved by a method of embedding additional data in a media signal comprising the steps of: obtaining a media signal, mixing at least one section of said media signal with a noise signal for providing a modified media signal, and combining said additional data with said modified media signal for providing a first host modifying media signal.
  • this objective is also achieved by a device for embedding additional data in a media signal comprising: IB2004/050906
  • this objective is furthermore achieved by a media signal comprising: at least one section of modified media signal comprising media signal mixed with a noise signal, where additional data has been combined with this modified media signal.
  • this objective is also achieved by an information storage medium comprising: a media signal including at least one section with modified media signal comprising: media signal mixed with a noise signal, where additional data has been combined with this modified media signal.
  • the present invention is furthermore directed towards providing a technique for (automatically) switching between the media signal and a modified version of the media signal in order to selectively enhance the detectability of multiplicatively embedded information to this new host signal.
  • this objective is achieved by a method of embedding additional data in a media signal comprising the steps of: obtaining a media signal, analysing the media signal, mixing at least one section of said media signal with a noise signal for providing a modified media signal, and combining, for different sections of the media signal, said additional data with said modified media signal for providing a first host modifying media signal or with said media signal in dependence of the analysis.
  • this objective is also achieved by a device for embedding additional data in a media signal comprising: a first adding unit for mixing at least one section of said media signal with a noise signal in order to provide a modified media signal, a combiner unit for combining said additional data with said modified media signal for providing a first host modifying media signal or with said media signal, and 6
  • an analysing unit arranged to analyse said media signal and control, for different sections of said media signal, the provision of said media signal mixed with noise or said media signal to the combiner unit in dependence of the analysis.
  • Claims 2 and 16 are directed towards performing the combining using multiplication.
  • Claims 5 and 17 are directed towards shaping the noise signal based on a model of human perception. This has the advantage of making sure that the added noise is not perceptible.
  • Claims 6 and 18 are directed towards shaping also the modified media signal that is combined with said additional data with a signal shaping function based on a model of human perception. This has the advantage of making sure that both the added noise and the embedded watermark are not perceptible.
  • Claims 8, 9, 10, 20, 21 and 22 are directed towards scaling the added noise, adding the media signal to the modified media signal that is combined with said additional data and adding the unsealed noise signal to the media signal that is combined with the additional data. This has the advantage of providing a more predictable control mechanism for the embedding of additional data.
  • Claims 12 and 23 are directed towards analysing the media signal and combining the additional data with sections of the media signal or the media signal mixed with noise in dependence of the analysis.
  • the present invention has the advantage of providing better detectability of additional data when it is embedded in a media signal having few frequency components, e.g. highly tonal signals like excerpts of pitch-pipe or harpsichord.
  • a media signal having few frequency components e.g. highly tonal signals like excerpts of pitch-pipe or harpsichord.
  • the invention it is for instance possible to embed a more easily detectable watermark in a modified media signal compared with an ordinary media signal having these properties. Because of this higher level of detectability the additional data remains detectable even if the quality of the media signal is degraded, i.e. the probability of a correct detection has increased. It is then easier to perform for instance forensic tracking of a processed media signal.
  • the general idea behind the invention is thus to mix a media signal with a noise signal and combine the additional data with the media signal that has been modified in this way.
  • Fig 1 shows a block schematic of a device for embedding a watermark in a modified media signal according to a first embodiment of the invention
  • Fig. 2 shows a block schematic of a first variation of a combiner unit that can be used in the device in fig. 1.
  • Fig. 3 shows a block schematic of a second variation of a combiner unit that can be used in the device in fig. 1
  • Fig. 4 shows a block schematic of a device for embedding a watermark in a modified media signal according to a second embodiment of the invention
  • Fig. 5 shows a block schematic of a device for embedding a watermark in a modified media signal according to a third embodiment of the invention
  • Fig. 6 shows a flow chart of a method of embedding a watermark in a modified media signal according to the third embodiment of the invention
  • Fig. 7 shows a block schematic of a device for embedding a watermark in a modified media signal according to a fourth embodiment of the invention
  • Fig. 8 shows a block schematic of a device for switching between embedding of a watermark in an original media signal or a modified media signal according to the invention
  • Fig. 9 shows an information storage medium in the form of CD disc having a media signal according to the invention stored on it.
  • the present invention relates to the field of providing additional data in media signals having a sparse frequency content in at least parts of the signal.
  • such signals can include the sound from instruments like harpsichord and pitch pipe.
  • the invention is however not limited to audio but can be applied on other media signals like for instance video or digital images.
  • the additional data is preferably provided in the form of a watermark. It should however be realised that the invention is not limited to watermarks, but the additional data can be any additional data that needs to be detected in a media signal, like for instance additional text in relation to a song.
  • Fig. 1 shows a block schematic of a device 10 for embedding additional data in a media signal having sparse frequency content according to a first embodiment of the 4 050906
  • the device 10 includes a first adding unit 12, which first adding unit 12 receives the media signal x and adds a noise signal n to this media signal in order to provide a modified media signal x + n.
  • the media signal x is in these circumstances often referred to as the host signal.
  • the modified host signal x + n is then supplied to a watermark combiner unit 14, which combines the additional data in the form of a watermark w in the modified host signal x + n to provide a first host modifying signal m w at its output.
  • the first host modifying signal m w is added back to the modified host signal x+n (or the host signal x) to provide an output media signal y with said additional data.
  • the combiner unit 14 shown here is a filter that applies the watermark w in the form of suitably selected filter coefficients.
  • the combiner unit 14 is thus a multiplicative unit that modifies the modified host signal x + n through multiplying it with the watermark. Because the modified signal contains more frequency components than the original signal, the watermark is easier to detect.
  • the noise signal n is here an additional watermark carrier, so that both the noise signal and the host signal carry the watermark.
  • signals that have many different frequency components may benefit from this type of embedding, especially by insertion of noise shaping in the higher frequency range. This will not significantly improve robustness of the watermark, but for unprocessed watermarked audio it may yield significantly better detection reliabilities.
  • the combiner unit 14 shows a first variation of the combiner unit 14 according to the invention, which works in the frequency domain.
  • the combiner unit therefore includes a discrete Fourier transform unit 16 which receives the modified host signal x + n and transforms it to the frequency domain.
  • the transformed modified host signal is then provided to a multiplying unit 18, which multiplies the transformed modified host signal with a watermark w.
  • the watermark w is here a frequency domain watermark.
  • the watermarked transformed modified host signal is then provided to an inverse Fourier transform unit 20, which transforms the watermarked transformed modified host signal back into the time domain and supplies it to a multiplying unit 22.
  • the multiplying unit 22 also receives the results from a graceful raising/decaying on/off switching function.
  • the modified host signal x + n is therefore supplied to a unit 24, which uses a temporal gain function G.
  • the output of the multiplying unit 22 is then provided to a scaling unit 26, which scales the multiplied signal with a scaling parameter ⁇ .
  • This multiplied and scaled signal is then provided to the second adding unit 36, which also receives the modified host signal and adds these signals together to form the output signal y, which is the watermarked host signal. More details about embedding of watermarks according to this T/IB2004/050906
  • the above described frequency domain combiner unit can be modified in many ways. It is for instance possible to remove the branch including the amplifying unit and also to remove the scaling unit, although this would degrade the signal quality.
  • Fig. 3 shows another variation of a combiner unit that works in the time domain.
  • the combiner unit 14 includes a bandpass filter 30, which filters the modified host signal x + n and provides the filtered signal to a multiplying unit 32, which also receives a watermark w and multiplies the watermark w with the filtered modified host signal x + n.
  • the output of the multiplying unit 32 is connected to a scaling unit 34, which scales the watermarked signal with a scaling parameter ⁇ and provides it to the second adding unit 36, which also receives the modified host signal x + n.
  • the output of the second adding unit 36 is then the watermarked host signal y.
  • the scaling unit 34 is also here not strictly necessary for providing a watermarked signal.
  • the wate ⁇ nark w is here a time domain watermark. More detail about this watermarking technique can be found in the document, "A temporal domain audio watermarking technique", by Aweke Negash Lemma, Javier Aprea, Werner Oomen and Leon van de Kerkhof, IEEE Transactions on Signal Processing, April 2003, Vol. 51, page 1088-1097, which is herein incorporated by reference.
  • the above described combiner units are just examples of multiplicative combiner units than can be used in the present invention. It should be realised that many other types of multiplicative combiner units can be used instead.
  • the thus described watermarking technique shown in fig. 1 can be improved in that a model of human perception can be used for shaping the noise signal for reducing the perceptible distortion.
  • the model used depends on the type of signal. In case the media signal is an audio signal the model is a psychoacoustic model of the human hearing system and in case a pure image is used a psycho -visual model of the human visual system is used.
  • a block schematic of a device for performing embedding of a watermark into a media signal according to a second embodiment of the invention is shown in fig. 4. The device in fig.
  • the device 10 further includes a first signal shaping unit 40 in the form of a masking filter and a filter control unit 38.
  • the filter control unit 38 receives the host signal x, analyses this signal using a psycho-acoustic model of the human auditory system P.
  • the unit 38 uses the results from the analysis for choosing filter coefficients of the filter 40.
  • the filter 40 which receives the noise signal n, shapes the noise using a first signal shaping function Ml so that a shaped noise signal n s is obtained. This shaped noise signal n s is then provided to the first adding unit 12 for mixing with the host signal x.
  • the filter 40 shapes the noise signal so that it is perceptibly masked by the host signal x. If the media signal were an image the model would be a psycho-visual model of the human visual system instead. It is possible to further vary the device according to the invention by also including a second signal shaping unit using a signal shaping function M2, which is also based on information from the filter control unit 38.
  • a device according to this third embodiment is shown in a block schematic in fig. 5. The functioning of the device in fig. 5 will now be described also in relation to fig. 6, which shows a flowchart of a method according to this third embodiment.
  • the noise adding is in this embodiment the same as the noise adding in fig. 4.
  • the device 10 includes a second noise shaping unit 44.
  • First a host signal x is obtained, step 48, for instance by fetching it from a memory where it is stored.
  • the noise signal n is provided, step 50, for instance from a noise generating unit.
  • the noise signal n is shaped using the first noise shaping function Ml in the filter 40 for obtaining the shaped noise signal n s , step 52.
  • the shaped noise signal n s is then added to or mixed with the host signal x by the first adding unit 12 in order to provide the modified host signal x + n s , step 54.
  • the combiner unit 14, which can for example be only a filter or one of the units shown in fig.
  • the second signal shaping unit 44 uses a second signal shaping function M2 determined by the filter control unit 38 to provide a shaped host modifying signal m ws or second host modifying signal, step 58.
  • the second signal shaping unit 44 is also provided in the form of a filter, the coefficients of which are set according to the above described model P.
  • the function M2 makes sure that there are no extra perceptible artefacts in the watermarked signal.
  • the second host modifying signal m ws is then provided to the second adding unit 36, which also receives the modified host signal x + n s and adds these two together for providing the watermarked host signal or the watermarked output media signal y, step 60.
  • the watermark is perceptibly masked IB2004/050906
  • the media signal x since the noise signal n s is imperceptibly added to the media signal, it provides an imperceptible watermark channel.
  • TQ threshold- in-quite
  • the device and method according to the third embodiment of the invention shown in fig. 5 and 6 has a slight disadvantage, which is that the noise signal is added twice to the host signal. This makes the control of the watermarking process slightly unpredictable.
  • a device for the solution of this problem is shown in a block schematic in fig. 7, in a fourth embodiment of the invention.
  • the noise signal n is first provided to a scaling unit 62, which scales the noise signal with a scaling function ⁇ .
  • is here smaller than one and preferably between 0.1 and 0.2.
  • the downscaled noise signal ⁇ n is then supplied to the first adding unit 12 where it is added to the host signal x in order to provide the modified host signal, which is now denoted x + ⁇ n because the noise signal has been downscaled.
  • the modified host signal is then passed to the combiner unit 14, which embeds the watermark w in the previously described fashion.
  • the output of the combiner unit 14 is connected to a third adding unit 64, which also receives the unsealed noise signal n for adding to the watermarked modified host signal in order to provide a first host modifying signal m w .
  • the signal m w is provided to the second signal shaping unit 44, which filters the first host modifying signal m w according to the previously described function M2, which is based on the function P of the human hearing system analysis made in filter control unit 38.
  • the shaped signal m ws or second host modifying signal from the filter 44 is provided to the second adding unit 36 for addition to the original host signal x.
  • the filter 44 thus makes sure that the host modifying signal m w is perceptibly masked by the host signal x. In this way all additional signal components are only injected into the host signal x in one point, which makes the control mechanism more predictable.
  • the noise signal is added for enabling safer detection of the watermark when the host or media signal has few frequency components, which can be sound frequency components when the signal is an audio signal or spatial frequency components when the signal is an image signal.
  • An audio signal is however not often only made up of spectrally sparse sounds, but can often have few frequency components in just some passages or sections of a piece of music. There can therefore be no need for using the above-described embodiments of the invention in a whole media signal, but only in some T/IB2004/050906
  • Fig. 8 shows a device for providing this functionality.
  • the device includes a first adding unit 12, a watermark combiner unit 14 and a second adding unit 36 according to the first embodiment. It should also be realised that the devices according to the second, third and fourth embodiments can easily be adapted to be used in the device in Fig. 8 with some slight and straightforward modifications. In fig.
  • the first adding unit 12 receives a noise signal n and a host signal x and adds these together for forming a modified host signal x + n according to the above described principles.
  • the output of the first adding unit 12 is connected to the watermark combiner unit 14 via a first switch 68.
  • the host signal is also directly connected to the watermark combiner unit 14 via a second switch 70.
  • An analysing unit 66 uses an analysing function A for analysing the frequency content of the host signal and controls the first and the second switch in dependence of the analysis, such that the first switch 68 connects the first adding unit 12 to the watermark combiner unit 14 if the number of frequency components in the host signal x are sparse and otherwise the second switch 70 connects the unmodified host signal x to the watermark combiner unit 14.
  • the watermark combiner unit 14 then embeds the watermark in the signal it receives in the previously described fashion, and the second adding unit 36 adds the first host modifying signal m w to the unmodified host signal x or modified host signal x + n for provision of the output signal y.
  • the switching is preferably a soft switching function so that the transition from inputting of one signal to the watermark combiner unit 14 to the other is made gracefully.
  • the switch that is switched on is gradually made to let the signal pass through such that at first it is very small or attenuated and gradually rises until the full signal is being passed through the switch.
  • the switch, which is switching off is in the same way gradually attenuating the signal it is to switch off until it is completely switched off. This is also preferably done so that the total energy passed through to the watermark combiner unit is substantially unitary both before, during and after switching. It should be realised that the switching does not have to be soft or graceful, although this is preferred. In case no soft switching is performed, it might be sufficient to only provide one switch, which either connects the modified host signal, or the unmodified host signal to the watermark combiner unit 14. When a single switch is used it is furthermore 6
  • the output signal y can be provided on a storage medium, of which one 72 in the form of a CD disc is shown in fig. 9.
  • the output signal y can also be provided on other types of storage mediums, such as memory in a computer.
  • the noise signal can be made to include data. This can be made in the way that one random sequence can be made to represent a "zero" and another can be made to represent a "one". In this way additive and multiplicative watermarks can be integrated into a single system.
  • the watermark can be embedded in both the time as well as the frequency domain and the media signal can be any type of media signal.
  • a media signal can furthermore be an audio, video or image signal. In the case of audio it can be uncompressed audio such as PCM.
  • the invention is however also possible to apply on compressed media, which in the case of audio can be a MP3 bitstream. However, then the noise has to be appropriately converted to the bitstream. Therefore the present invention is only to be limited by the following claims.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Computer Security & Cryptography (AREA)
  • Editing Of Facsimile Originals (AREA)
  • Image Processing (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Analysing Materials By The Use Of Radiation (AREA)

Abstract

The present invention relates to a methods, devices, a media signal as well as an information storage medium related to embedding additional data in a media signal. A first adding unit (12) mixes the media signal (x) with a noise signal (n) in order to provide a modified media signal (x + n), and a combiner unit (14) combines additional data (w) with the modified media signal (x + n) through multiplying the modified media signal with the additional data in order to provide a host modifying media signal (mw). In this way the additional data can be detected with a higher certainty in an output signal (y) if the media signal (x) includes few frequency components.

Description

4 050906
1 Raising detectability of additional data in a media signal having few frequency components
TECHNICAL FIELD
The present invention generally relates to the field of providing additional data in a media signal and more particularly to methods, devices, a signal and an information storage medium related to embedding of additional data in a media signal.
DESCRIPTION OF RELATED ART
With the evolution of the Internet it is possible to access or retrieve a virtually limitless amount of informational content. Content can then be provided by different content providers in the form of media signals of varying shapes and forms. Media signals can for instance be provided as audio signals, in either compressed or uncompressed form, image signals in compressed or uncompressed form as well as video signals in compressed or uncompressed form. In order to inhibit that media content is unlawfully obtained by persons not entitled to it or that illegal copies of content are being made, there is a need for content owners to protect their content. In order to do this they often need to provide additional information in the media signals. Additional information can also be provided for other reasons, like for instance for providing text in relation to a piece of audio (e.g., lyrics).
One field of use where additional data is provided in media signals is in the field of Digital Rights Management (DRM), where additional data in the form of watermarks are used to indicate the origin of media content and possibly of user in order to inhibit unlawful tampering of the media content.
The possibility of correct and effective watermark detection depends heavily on the method used for embedding the data into the host signal and on properties of this signal. One frequently used type of watermark embedding is the so-called multiplicative watermarking, where the media signal to be watermarked is multiplied with the watermark in question. On the other hand, normally a media signal has a lot of different frequency components, whereas sometimes it can have few such components. When the components are few it can be hard to detect a watermark that has been embedded using multiplicative watermarking. IB2004/050906
International patent application WO- A-02/15587 describes how additional data, like a watermark, is added to a media signal. The signal is here described in relation to a sine wave. A binary code is added to the signal in a high frequency band through either adding noise or not adding noise in this high frequency band. Upon detection, the sequence of digits (i.e., zeroes and ones) obtained represents (a coded version of) the watermark information. The document thus describes a technique for additive watermarking, which is not applicable in a multiplicative watermarking environment. Besides, since the additional information is only provided in a high frequency band, which can easily be filtered away using a simple low-pass filter, it is fragile and therefore not suitable when robustness is an important condition.
In a more robust, multiplicative watermarking scheme, a plurality of circular shifted chip sequences of real numbers is multiplied with a properly scaled version of the media signal and added back to the original media signal. Upon detection, the distances between the diverse correlation peaks carry (a coded version of) the watermark information. If the host signal contains few frequency components, the correlation will be weak. There is thus a need for enabling a higher level of detectability for additional data that has to be embedded in a media signal with few frequency components using a multiplicative embedding technique.
SUMMARY OF THE INVENTION
It is thus an object of the present invention to provide multiplicative embedding of additional data in a media signal that is more robust (i.e., has a higher level of detectability of the additional data), especially in sections of the media signal that have few frequency components. According to a first aspect of the present invention, this objective is achieved by a method of embedding additional data in a media signal comprising the steps of: obtaining a media signal, mixing at least one section of said media signal with a noise signal for providing a modified media signal, and combining said additional data with said modified media signal for providing a first host modifying media signal.
According to a second aspect of the present invention, this objective is also achieved by a device for embedding additional data in a media signal comprising: IB2004/050906
a first adding unit for mixing at least one section of said media signal with a noise signal in order to provide a modified media signal, and a combiner unit for combining said additional data with said modified media signal for providing a first host modifying media signal. According to a third aspect of the present invention, this objective is furthermore achieved by a media signal comprising: at least one section of modified media signal comprising media signal mixed with a noise signal, where additional data has been combined with this modified media signal. According to a fourth aspect of the present invention, this objective is also achieved by an information storage medium comprising: a media signal including at least one section with modified media signal comprising: media signal mixed with a noise signal, where additional data has been combined with this modified media signal.
The present invention is furthermore directed towards providing a technique for (automatically) switching between the media signal and a modified version of the media signal in order to selectively enhance the detectability of multiplicatively embedded information to this new host signal. According to a fifth aspect of the present invention, this objective is achieved by a method of embedding additional data in a media signal comprising the steps of: obtaining a media signal, analysing the media signal, mixing at least one section of said media signal with a noise signal for providing a modified media signal, and combining, for different sections of the media signal, said additional data with said modified media signal for providing a first host modifying media signal or with said media signal in dependence of the analysis.
According to a sixth aspect of the present invention, this objective is also achieved by a device for embedding additional data in a media signal comprising: a first adding unit for mixing at least one section of said media signal with a noise signal in order to provide a modified media signal, a combiner unit for combining said additional data with said modified media signal for providing a first host modifying media signal or with said media signal, and 6
an analysing unit arranged to analyse said media signal and control, for different sections of said media signal, the provision of said media signal mixed with noise or said media signal to the combiner unit in dependence of the analysis.
Claims 2 and 16 are directed towards performing the combining using multiplication.
Claims 5 and 17 are directed towards shaping the noise signal based on a model of human perception. This has the advantage of making sure that the added noise is not perceptible.
Claims 6 and 18 are directed towards shaping also the modified media signal that is combined with said additional data with a signal shaping function based on a model of human perception. This has the advantage of making sure that both the added noise and the embedded watermark are not perceptible.
Claims 8, 9, 10, 20, 21 and 22 are directed towards scaling the added noise, adding the media signal to the modified media signal that is combined with said additional data and adding the unsealed noise signal to the media signal that is combined with the additional data. This has the advantage of providing a more predictable control mechanism for the embedding of additional data.
Claims 12 and 23 are directed towards analysing the media signal and combining the additional data with sections of the media signal or the media signal mixed with noise in dependence of the analysis.
The present invention has the advantage of providing better detectability of additional data when it is embedded in a media signal having few frequency components, e.g. highly tonal signals like excerpts of pitch-pipe or harpsichord. With the invention it is for instance possible to embed a more easily detectable watermark in a modified media signal compared with an ordinary media signal having these properties. Because of this higher level of detectability the additional data remains detectable even if the quality of the media signal is degraded, i.e. the probability of a correct detection has increased. It is then easier to perform for instance forensic tracking of a processed media signal.
The general idea behind the invention is thus to mix a media signal with a noise signal and combine the additional data with the media signal that has been modified in this way.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter. 0906
5
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will now be explained in more detail in relation to the enclosed drawings, where
Fig 1 shows a block schematic of a device for embedding a watermark in a modified media signal according to a first embodiment of the invention,
Fig. 2 shows a block schematic of a first variation of a combiner unit that can be used in the device in fig. 1.
Fig. 3 shows a block schematic of a second variation of a combiner unit that can be used in the device in fig. 1, Fig. 4 shows a block schematic of a device for embedding a watermark in a modified media signal according to a second embodiment of the invention,
Fig. 5 shows a block schematic of a device for embedding a watermark in a modified media signal according to a third embodiment of the invention,
Fig. 6 shows a flow chart of a method of embedding a watermark in a modified media signal according to the third embodiment of the invention,
Fig. 7 shows a block schematic of a device for embedding a watermark in a modified media signal according to a fourth embodiment of the invention,
Fig. 8 shows a block schematic of a device for switching between embedding of a watermark in an original media signal or a modified media signal according to the invention, and
Fig. 9 shows an information storage medium in the form of CD disc having a media signal according to the invention stored on it.
DETAILED DESCRIPTION OF EMBODIMENTS The present invention relates to the field of providing additional data in media signals having a sparse frequency content in at least parts of the signal. In the field of audio such signals can include the sound from instruments like harpsichord and pitch pipe. The invention is however not limited to audio but can be applied on other media signals like for instance video or digital images. The additional data is preferably provided in the form of a watermark. It should however be realised that the invention is not limited to watermarks, but the additional data can be any additional data that needs to be detected in a media signal, like for instance additional text in relation to a song.
Fig. 1 shows a block schematic of a device 10 for embedding additional data in a media signal having sparse frequency content according to a first embodiment of the 4 050906
invention. For this reason the device 10 includes a first adding unit 12, which first adding unit 12 receives the media signal x and adds a noise signal n to this media signal in order to provide a modified media signal x + n. The media signal x is in these circumstances often referred to as the host signal. The modified host signal x + n is then supplied to a watermark combiner unit 14, which combines the additional data in the form of a watermark w in the modified host signal x + n to provide a first host modifying signal mw at its output. Finally, in a second adding unit 36, the first host modifying signal mw is added back to the modified host signal x+n (or the host signal x) to provide an output media signal y with said additional data. The combiner unit 14 shown here is a filter that applies the watermark w in the form of suitably selected filter coefficients. The combiner unit 14 is thus a multiplicative unit that modifies the modified host signal x + n through multiplying it with the watermark. Because the modified signal contains more frequency components than the original signal, the watermark is easier to detect. The noise signal n is here an additional watermark carrier, so that both the noise signal and the host signal carry the watermark. However, also signals that have many different frequency components may benefit from this type of embedding, especially by insertion of noise shaping in the higher frequency range. This will not significantly improve robustness of the watermark, but for unprocessed watermarked audio it may yield significantly better detection reliabilities. Fig. 2 shows a first variation of the combiner unit 14 according to the invention, which works in the frequency domain. The combiner unit therefore includes a discrete Fourier transform unit 16 which receives the modified host signal x + n and transforms it to the frequency domain. The transformed modified host signal is then provided to a multiplying unit 18, which multiplies the transformed modified host signal with a watermark w. The watermark w is here a frequency domain watermark. The watermarked transformed modified host signal is then provided to an inverse Fourier transform unit 20, which transforms the watermarked transformed modified host signal back into the time domain and supplies it to a multiplying unit 22. The multiplying unit 22 also receives the results from a graceful raising/decaying on/off switching function. In order to provide this switching the modified host signal x + n is therefore supplied to a unit 24, which uses a temporal gain function G. The output of the multiplying unit 22 is then provided to a scaling unit 26, which scales the multiplied signal with a scaling parameter α. This multiplied and scaled signal is then provided to the second adding unit 36, which also receives the modified host signal and adds these signals together to form the output signal y, which is the watermarked host signal. More details about embedding of watermarks according to this T/IB2004/050906
principle is described in the document "Robust, multi-functional and high-quality audio watermarking technology", by Michiel van der Veen, Fons Breukers, Jaap Haitsma, Ton Kalker, Aweke Negash Lemma and Werner Oomen in The Proceedings of the 110-th AES Convention, Amsterdam, The Netherlands, May 2001, which is herein incorporated by reference.
The above described frequency domain combiner unit can be modified in many ways. It is for instance possible to remove the branch including the amplifying unit and also to remove the scaling unit, although this would degrade the signal quality.
Fig. 3 shows another variation of a combiner unit that works in the time domain. The combiner unit 14 includes a bandpass filter 30, which filters the modified host signal x + n and provides the filtered signal to a multiplying unit 32, which also receives a watermark w and multiplies the watermark w with the filtered modified host signal x + n. The output of the multiplying unit 32 is connected to a scaling unit 34, which scales the watermarked signal with a scaling parameter α and provides it to the second adding unit 36, which also receives the modified host signal x + n. The output of the second adding unit 36 is then the watermarked host signal y. The scaling unit 34 is also here not strictly necessary for providing a watermarked signal. The wateπnark w is here a time domain watermark. More detail about this watermarking technique can be found in the document, "A temporal domain audio watermarking technique", by Aweke Negash Lemma, Javier Aprea, Werner Oomen and Leon van de Kerkhof, IEEE Transactions on Signal Processing, April 2003, Vol. 51, page 1088-1097, which is herein incorporated by reference.
The above described combiner units are just examples of multiplicative combiner units than can be used in the present invention. It should be realised that many other types of multiplicative combiner units can be used instead. The thus described watermarking technique shown in fig. 1 can be improved in that a model of human perception can be used for shaping the noise signal for reducing the perceptible distortion. The model used depends on the type of signal. In case the media signal is an audio signal the model is a psychoacoustic model of the human hearing system and in case a pure image is used a psycho -visual model of the human visual system is used. A block schematic of a device for performing embedding of a watermark into a media signal according to a second embodiment of the invention is shown in fig. 4. The device in fig. 4 basically includes the same components as the device in fig. 1. There is one difference though and that is that the device 10 further includes a first signal shaping unit 40 in the form of a masking filter and a filter control unit 38. The filter control unit 38 receives the host signal x, analyses this signal using a psycho-acoustic model of the human auditory system P. The unit 38 uses the results from the analysis for choosing filter coefficients of the filter 40. The filter 40, which receives the noise signal n, shapes the noise using a first signal shaping function Ml so that a shaped noise signal ns is obtained. This shaped noise signal ns is then provided to the first adding unit 12 for mixing with the host signal x. Thereafter embedding of a watermark is performed in the above described way in the watermark combiner unit 14. The filter 40 shapes the noise signal so that it is perceptibly masked by the host signal x. If the media signal were an image the model would be a psycho-visual model of the human visual system instead. It is possible to further vary the device according to the invention by also including a second signal shaping unit using a signal shaping function M2, which is also based on information from the filter control unit 38. A device according to this third embodiment is shown in a block schematic in fig. 5. The functioning of the device in fig. 5 will now be described also in relation to fig. 6, which shows a flowchart of a method according to this third embodiment. The noise adding is in this embodiment the same as the noise adding in fig. 4. The only difference here is that the device 10 includes a second noise shaping unit 44. First a host signal x is obtained, step 48, for instance by fetching it from a memory where it is stored. The noise signal n is provided, step 50, for instance from a noise generating unit. Thereafter the noise signal n is shaped using the first noise shaping function Ml in the filter 40 for obtaining the shaped noise signal ns, step 52. The shaped noise signal ns is then added to or mixed with the host signal x by the first adding unit 12 in order to provide the modified host signal x + ns, step 54. The combiner unit 14, which can for example be only a filter or one of the units shown in fig. 2 or 3, receives the modified host signal x + ns and combines the watermark with this signal for providing a watermarked host modified signal mw, which is also referred to as a first host modifying signal, step 56. The first host modifying signal mw is then supplied to a second signal shaping unit 44, which uses a second signal shaping function M2 determined by the filter control unit 38 to provide a shaped host modifying signal mws or second host modifying signal, step 58. The second signal shaping unit 44 is also provided in the form of a filter, the coefficients of which are set according to the above described model P. The function M2 makes sure that there are no extra perceptible artefacts in the watermarked signal. The second host modifying signal mws is then provided to the second adding unit 36, which also receives the modified host signal x + ns and adds these two together for providing the watermarked host signal or the watermarked output media signal y, step 60. In this way the watermark is perceptibly masked IB2004/050906
by the media signal x. It should be realised that since the noise signal ns is imperceptibly added to the media signal, it provides an imperceptible watermark channel.
It is possible to vary the function used. As an alternative a so-called threshold- in-quite (TQ) function can be used when the media signal is an audio signal instead of the functions Ml and/or M2 above. In this case the noise is pre-filtered such that it falls below the hearing threshold. Similar functions can be used for image signals and/or video.
The device and method according to the third embodiment of the invention shown in fig. 5 and 6 has a slight disadvantage, which is that the noise signal is added twice to the host signal. This makes the control of the watermarking process slightly unpredictable. A device for the solution of this problem is shown in a block schematic in fig. 7, in a fourth embodiment of the invention. There is no first signal shaping unit in this device. Here the noise signal n is first provided to a scaling unit 62, which scales the noise signal with a scaling function δ. δ is here smaller than one and preferably between 0.1 and 0.2. The downscaled noise signal δn is then supplied to the first adding unit 12 where it is added to the host signal x in order to provide the modified host signal, which is now denoted x + δn because the noise signal has been downscaled. The modified host signal is then passed to the combiner unit 14, which embeds the watermark w in the previously described fashion. The output of the combiner unit 14 is connected to a third adding unit 64, which also receives the unsealed noise signal n for adding to the watermarked modified host signal in order to provide a first host modifying signal mw. The signal mw is provided to the second signal shaping unit 44, which filters the first host modifying signal mw according to the previously described function M2, which is based on the function P of the human hearing system analysis made in filter control unit 38. The shaped signal mws or second host modifying signal from the filter 44 is provided to the second adding unit 36 for addition to the original host signal x. The filter 44 thus makes sure that the host modifying signal mw is perceptibly masked by the host signal x. In this way all additional signal components are only injected into the host signal x in one point, which makes the control mechanism more predictable.
As mentioned above the noise signal is added for enabling safer detection of the watermark when the host or media signal has few frequency components, which can be sound frequency components when the signal is an audio signal or spatial frequency components when the signal is an image signal. An audio signal is however not often only made up of spectrally sparse sounds, but can often have few frequency components in just some passages or sections of a piece of music. There can therefore be no need for using the above-described embodiments of the invention in a whole media signal, but only in some T/IB2004/050906
10 pieces or sections of it. There is thus a need for being able to embed a watermark according to the above-described embodiments of the invention as well as to be able to embed a watermark according to known principles depending on the properties of the media signal. Fig. 8 shows a device for providing this functionality. The device includes a first adding unit 12, a watermark combiner unit 14 and a second adding unit 36 according to the first embodiment. It should also be realised that the devices according to the second, third and fourth embodiments can easily be adapted to be used in the device in Fig. 8 with some slight and straightforward modifications. In fig. 8 the first adding unit 12 receives a noise signal n and a host signal x and adds these together for forming a modified host signal x + n according to the above described principles. The output of the first adding unit 12 is connected to the watermark combiner unit 14 via a first switch 68. The host signal is also directly connected to the watermark combiner unit 14 via a second switch 70. An analysing unit 66 uses an analysing function A for analysing the frequency content of the host signal and controls the first and the second switch in dependence of the analysis, such that the first switch 68 connects the first adding unit 12 to the watermark combiner unit 14 if the number of frequency components in the host signal x are sparse and otherwise the second switch 70 connects the unmodified host signal x to the watermark combiner unit 14. The watermark combiner unit 14 then embeds the watermark in the signal it receives in the previously described fashion, and the second adding unit 36 adds the first host modifying signal mw to the unmodified host signal x or modified host signal x + n for provision of the output signal y. Here the switching is preferably a soft switching function so that the transition from inputting of one signal to the watermark combiner unit 14 to the other is made gracefully. This means that when switching is performed from one state to another, the switch that is switched on is gradually made to let the signal pass through such that at first it is very small or attenuated and gradually rises until the full signal is being passed through the switch. The switch, which is switching off, is in the same way gradually attenuating the signal it is to switch off until it is completely switched off. This is also preferably done so that the total energy passed through to the watermark combiner unit is substantially unitary both before, during and after switching. It should be realised that the switching does not have to be soft or graceful, although this is preferred. In case no soft switching is performed, it might be sufficient to only provide one switch, which either connects the modified host signal, or the unmodified host signal to the watermark combiner unit 14. When a single switch is used it is furthermore 6
11 possible to provide it in any position which achieves the proper switching of the signals, like for instance before the first adding unit 12.
The output signal y can be provided on a storage medium, of which one 72 in the form of a CD disc is shown in fig. 9. The output signal y can also be provided on other types of storage mediums, such as memory in a computer.
There has thus been described a device and a method for multiplicatively embedding additional data in a media signal when the media signal has few frequency components. With the invention it is possible to embed a watermark in such a media signal which is easier to detect than an ordinary media signal having these properties. The second embodiment makes sure that the added noise is not perceptible and the third embodiment makes sure that both the added noise and the embedded watermark are not perceptible. The fourth embodiment has the advantage of providing a more predictable control mechanism for the embedding of a watermark. A higher level of detectability has furthermore the following advantages. The additional data remains detectable even if the quality of the media signal is degraded. It is then easier to perform for instance copy control or forensic tracking of a processed media signal.
The invention can be varied in many ways. It is for instance possible that the noise signal can be made to include data. This can be made in the way that one random sequence can be made to represent a "zero" and another can be made to represent a "one". In this way additive and multiplicative watermarks can be integrated into a single system. As mentioned before the watermark can be embedded in both the time as well as the frequency domain and the media signal can be any type of media signal. A media signal can furthermore be an audio, video or image signal. In the case of audio it can be uncompressed audio such as PCM. The invention is however also possible to apply on compressed media, which in the case of audio can be a MP3 bitstream. However, then the noise has to be appropriately converted to the bitstream. Therefore the present invention is only to be limited by the following claims.

Claims

4 05090612 CLAIMS:
1. Method of embedding additional data (w) in a media signal (x) comprising the steps of: obtaining a media signal (x), (step 48), mixing at least one section of said media signal (x) with a noise signal (n; ns; δn) for providing a modified media signal (x + n; x + risj x + δn), (step 54), and combining said additional data (w) with said modified media signal, (step 56) for providing a first host modifying media signal (mw).
2. Method according to claim 1, wherein the step of combining is performed by multiplying said modified media signal with said additional data (w).
3. Method according to claim 2, wherein the step of multiplying is performed in the time domain.
4. Method according to claim 2, wherein the step of multiplying is performed in the frequency domain.
5. Method according to claim 1, further comprising the step of shaping said noise signal using a first signal shaping function (Ml) based on a model of human perception , (step 52), for providing a shaped noise signal to be used for providing the modified media signal (x + ns).
6. Method according to claim 1 , further including the step of shaping said first host modifying media signal (mw) with a second signal shaping function (M2) based on a model of human perception, (step 58), for providing a second host modifying media signal (mws).
7. Method according to claim 1, further including the step of adding a host modifying media signal (mw; mws) to said modified media signal (step 60). B2004/050906
13
8. Method according to claim 1 , further including the step of adding a host modifying media signal (mw; mws) to said media signal.
9. Method according to claim 1, further comprising the step of scaling said noise signal using a scaling factor δ prior to the step of mixing for providing a scaled noise signal to be used for providing the modified media signal (x + δn).
10. Method according to claim 9, further including the step of adding an unsealed noise signal to said first host modifying media signal.
11. Method according to claim 1 , wherein said additional data is a watermark (w).
12. Method according to claim 1, further comprising the step of analysing (A) the media signal and providing, for different sections of the media signal, a section of said modified media signal (x + n) or a section of said media signal (x) in dependence of the analysis for combining with said additional data.
13. Method according to claim 12, further comprising the step of switching between said media signal and a modified media signal for combining with said additional data, wherein the step of switching preferably is a graceful switching.
14. Method of embedding additional data (w) in a media signal (x) comprising the steps of: obtaining a media signal (x), analysing (A) the media signal, mixing at least one section of said media signal (x) with a noise signal (n) for providing a modified media signal (x + n), and combining, for different sections of the media signal, said additional data (w) with said modified media signal (x + n) or with said original media signal (x) in dependence of the analysis.
15. Device (10) for embedding additional data (w) in a media signal (x) comprising: a first adding unit (12) for mixing at least one section of said media signal (x) with a noise signal (n; ns; δn) in order to provide a modified media signal (x + n; x + ns; x + δn), and a combiner unit (14) for combining said additional data (w) with said modified media signal for providing a first host modifying media signal (mw).
16. Device according to claim 15, wherein the combiner unit is arranged to combine said additional data with said modified media signal through multiplying said modified media signal with said additional data.
17. Device according to claim 15, further comprising a first signal shaping unit (40) arranged to shape said noise signal using a first signal shaping function (Ml) based on a model (P) of human perception, for providing a shaped noise signal to be used for providing the modified media signal.
18. Device according to claim 15, further comprising a second signal shaping unit (44) arranged to shape said first host modifying media signal with a second signal shaping function (M2) based on a model (P) of human perception, for providing a second host modifying media signal.
19. Device according to claim 15, further comprising a second adding unit (36) arranged to add a host modifying media signal to said modified media signal.
20. Device according to claim 15, further comprising a second adding unit (36) arranged to add a host modifying media signal to said media signal (x).
21. Device according to claim 15, further comprising a scaling unit (62) arranged to scale down said noise signal (δn) prior to mixing with said media signal (x) for providing a scaled noise signal to be used for providing the modified media signal.
22. Device according to claim 21, further comprising a third adding unit (64) arranged to add an unsealed noise signal to said first host modifying media signal. T/IB2004/050906
15
23. Device according to claim 15, further comprising an analysing unit (66) arranged to analyse said media signal (x) and control, for different sections of the media signal, the provision of a section of a modified media signal or a section of said media signal to the combiner unit (14) for combining with said additional data in dependence of the analysis (A).
24. Device according to claim 23, further comprising at least one first switch (68) arranged to connect said media signal or said modified media signal to the combiner unit under the control of the analysing unit.
25. Device according to claim 24, wherein there is a second switch (70) controlled by the analysing unit, wherein the first switch connects said modified media signal to the combiner unit, the second switch connects said media signal to the combiner unit and the switches are arranged to switch gracefully from one state to the other.
26. Device (10) for embedding additional data (w) in a media signal (x) comprising: a first adding unit (12) for mixing at least one section of said media signal (x) with a noise signal (n; ns; δn) in order to provide a modified media signal (x + n; x + ns; x + δn), a combiner unit (14) for combining said additional data (w) with said modified media signal (x + n) or with said media signal (x) for providing a first host modifying signal, and an analysing unit (66) arranged to analyse said media signal (x) and control, for different sections of the media signal, the provision of said modified media signal or said media signal to the combiner unit (14) in dependence of the analysis (A).
27 Media signal (y) comprising: at least one section of modified media signal comprising media signal (x) mixed with a noise signal (n; ns; δn), where additional data (w) has been combined with this modified media signal (x + n; x + ns; x + δn).
28. Information storage medium (72) comprising: a media signal (y) including at least one section with modified media signal comprising: media signal (x) mixed with a noise signal (n; ns; δn), where additional data (w) has been combined with this modified media signal (x + n; x + ns; x+ δn).
PCT/IB2004/050906 2003-06-19 2004-06-15 Raising detectability of additional data in a media signal having few frequency components WO2004112399A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
DE602004017993T DE602004017993D1 (en) 2003-06-19 2004-06-15 INCREASING THE DETECTING CHARACTERISTICS OF ADDITIONAL DATA IN A MEDIASIGNAL WITH LITTLE FREQUENCY COMPONENTS
JP2006516691A JP2006527958A (en) 2003-06-19 2004-06-15 Improved detection of additional data in media signals with few frequency components
US10/560,679 US20060168448A1 (en) 2003-06-19 2004-06-15 Raising detectability of additonal data in a media signal having few frequency components
EP04736871A EP1639826B1 (en) 2003-06-19 2004-06-15 Raising detectability of additional data in a media signal having few frequency components

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP03101792 2003-06-19
EP03101792.4 2003-06-19

Publications (1)

Publication Number Publication Date
WO2004112399A1 true WO2004112399A1 (en) 2004-12-23

Family

ID=33547741

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2004/050906 WO2004112399A1 (en) 2003-06-19 2004-06-15 Raising detectability of additional data in a media signal having few frequency components

Country Status (8)

Country Link
US (1) US20060168448A1 (en)
EP (1) EP1639826B1 (en)
JP (1) JP2006527958A (en)
KR (1) KR20060027351A (en)
CN (1) CN1810034A (en)
AT (1) ATE415784T1 (en)
DE (1) DE602004017993D1 (en)
WO (1) WO2004112399A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7082413B2 (en) * 1999-11-24 2006-07-25 International Business Machines Corporation System and method for authorized compression of digitized music

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2362385A1 (en) * 2010-02-26 2011-08-31 Fraunhofer-Gesellschaft zur Förderung der Angewandten Forschung e.V. Watermark signal provision and watermark embedding
US10210545B2 (en) * 2015-12-30 2019-02-19 TCL Research America Inc. Method and system for grouping devices in a same space for cross-device marketing
US11095927B2 (en) 2019-02-22 2021-08-17 The Nielsen Company (Us), Llc Dynamic watermarking of media based on transport-stream metadata, to facilitate action by downstream entity
TWI802797B (en) 2019-05-10 2023-05-21 美商六科股份有限公司 Method for detecting and responding to a fingerprint mismatch detected after a previously detected fingerprint match, non-transitory computer-readable storage medium, and computing system
WO2020231927A1 (en) 2019-05-10 2020-11-19 The Nielsen Company (Us), Llc Content-modification system with responsive transmission of reference fingerprint data feature
WO2020231813A1 (en) 2019-05-10 2020-11-19 The Nielsen Company (Us), Llc Content-modification system with responsive transmission of reference fingerprint data feature
US11234050B2 (en) 2019-06-18 2022-01-25 Roku, Inc. Use of steganographically-encoded data as basis to control dynamic content modification as to at least one modifiable-content segment identified based on fingerprint analysis
US11012757B1 (en) 2020-03-03 2021-05-18 The Nielsen Company (Us), Llc Timely addition of human-perceptible audio to mask an audio watermark

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999017537A1 (en) * 1997-09-29 1999-04-08 Hewlett-Packard Company Watermarking of digital object
WO2002015587A2 (en) * 2000-08-16 2002-02-21 Dolby Laboratories Licensing Corporation Modulating one or more parameters of an audio or video perceptual coding system in response to supplemental information

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6104863A (en) * 1990-08-17 2000-08-15 Samsung Electronics Co., Ltd. Video signal encoded with additional detail information
US5613004A (en) * 1995-06-07 1997-03-18 The Dice Company Steganographic method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1999017537A1 (en) * 1997-09-29 1999-04-08 Hewlett-Packard Company Watermarking of digital object
WO2002015587A2 (en) * 2000-08-16 2002-02-21 Dolby Laboratories Licensing Corporation Modulating one or more parameters of an audio or video perceptual coding system in response to supplemental information

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
AWEKE NEGASH LEMMA ET AL: "A TEMPORAL DOMAIN AUDIO WATERMARKING TECHNIQUE", IEEE TRANSACTIONS ON SIGNAL PROCESSING, IEEE, INC. NEW YORK, US, vol. 51, no. 4, April 2003 (2003-04-01), pages 1088 - 1097, XP001171829, ISSN: 1053-587X *
COX I J ET AL: "SECURE SPREAD SPECTRUM WATERMARKING FOR MULTIMEDIA", IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE INC. NEW YORK, US, vol. 6, no. 12, 1 December 1997 (1997-12-01), pages 1673 - 1687, XP000199950, ISSN: 1057-7149 *
JIAN ZHAO KOCH E: "A generic digital watermarking model", COMPUTERS AND GRAPHICS, PERGAMON PRESS LTD. OXFORD, GB, vol. 22, no. 4, 1 August 1998 (1998-08-01), pages 397 - 403, XP004145482, ISSN: 0097-8493 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7082413B2 (en) * 1999-11-24 2006-07-25 International Business Machines Corporation System and method for authorized compression of digitized music

Also Published As

Publication number Publication date
KR20060027351A (en) 2006-03-27
EP1639826A1 (en) 2006-03-29
EP1639826B1 (en) 2008-11-26
CN1810034A (en) 2006-07-26
DE602004017993D1 (en) 2009-01-08
ATE415784T1 (en) 2008-12-15
JP2006527958A (en) 2006-12-07
US20060168448A1 (en) 2006-07-27

Similar Documents

Publication Publication Date Title
Yeo et al. Modified patchwork algorithm: A novel audio watermarking scheme
Wu et al. Robust and efficient digital audio watermarking using audio content analysis
Kim et al. Audio watermarking techniques
Kirovski et al. Blind pattern matching attack on watermarking systems
Dhar et al. A new audio watermarking system using discrete fourier transform for copyright protection
Dhar et al. A new DCT-based watermarking method for copyright protection of digital audio
Dhar et al. Digital watermarking scheme based on fast Fourier transformation for audio copyright protection
Wu et al. Robust audio watermarking for copyright protection
Nikmehr et al. A new approach to audio watermarking using discrete wavelet and cosine transforms
EP1634275A2 (en) Bit-stream watermarking
EP1639826B1 (en) Raising detectability of additional data in a media signal having few frequency components
Park et al. Speech authentication system using digital watermarking and pattern recovery
Huang et al. Robust and inaudible multi-echo audio watermarking
JP2005528652A (en) Independent channel watermark encoding and decoding
EP1695337B1 (en) Method and apparatus for detecting a watermark in a signal
Lin et al. Audio watermarking techniques
Mushgil et al. An efficient selective method for audio watermarking against de-synchronization attacks
Şehirli et al. Performance evaluation of digital audio watermarking techniques designed in time, frequency and cepstrum domains
Wang et al. A new adaptive audio watermarking algorithm for copyright protection
US20080273742A1 (en) Watermark Embedding
Trivedi et al. An algorithmic digital audio watermarking in perceptual domain using direct sequence spread spectrum
Artameeyanant Wavelet audio watermark robust against MPEG compression
Dhar et al. An efficient audio watermarking algorithm in frequency domain for copyright protection
Ramesh et al. Novel Hybrid Inaudible Audio Watermarking with Binary Image as Watermark using DWT
Nishimura et al. Advanced audio watermarking based on echo hiding: Time-spread echo hiding

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2004736871

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2006168448

Country of ref document: US

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 10560679

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 3424/CHENP/2005

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 2006516691

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 20048171461

Country of ref document: CN

Ref document number: 1020057024342

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 1020057024342

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2004736871

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 10560679

Country of ref document: US