Classifications

• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
  • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
  • G10L19/018—Audio watermarking, i.e. embedding inaudible data in the audio signal
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
  • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
  • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
  • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
  • G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
  • G10L19/032—Quantisation or dequantisation of spectral components
  • G10L19/035—Scalar quantisation
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
  • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
  • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
  • G10L19/16—Vocoder architecture
  • G10L19/18—Vocoders using multiple modes
  • G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• • G—PHYSICS
  • G10—MUSICAL INSTRUMENTS; ACOUSTICS
  • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
  • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
  • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
  • G10L21/038—Speech enhancement, e.g. noise reduction or echo cancellation using band spreading techniques

Definitions

• the invention relates to a method and to an apparatus for quantisation index modulation for watermarking an input signal, wherein different quantiser curves are used for quan ⁇ tising said input signal.
• QIM quantisation index modulation
• J.J. Eggers et al . mentioned above have proposed an exten ⁇ sion to QIM in order to achieve better capacity in specific watermark channels: in this -QIM all input values x are linearly shifted towards the reference value (i.e. towards the centroid of the quantiser) with a constant factor.
• the Chen/Wornell processing is by definition non-reversible because information is lost in the quantisation step.
• the Eggers/Su/Girod processing is reversible, but it is not subject to any time-variable distortion constraint.
• a problem to be solved by the invention is to avoid degrada ⁇ tion of the audio quality with each watermark embedding-and- removal step by improving the known QIM processing.
• This problem is solved by the quantisation method disclosed in claim 1.
• An apparatus that utilises this method is disclosed in claim 2.
• a method for corresponding regaining is disclosed in claim 8.
• the inventive audio signal watermarking uses specific quan ⁇ tiser curves in time domain and in particular in transform domain for embedding the watermark message into the audio signal, whereby it is almost perfectly reversible and the term 'reversible' means that the watermark can be removed in order to recover the original PCM samples with high (i.e. with near-bit-exact) quality - under the preconditions that the watermarked audio signal has not undergone significant signal modification, and that the secret key is known which is required for detection of the watermark.
• the inventive reversible quantisation index modulation wa ⁇ termarking processing has embedded a power constraint, which is important in audio watermarking in order to guarantee that the modifications of the signal due to the watermark embedding are inaudible.
• the inventive processing provides robustness and capacity characteristics which are competitive to state- of-the-art, non-reversible watermarking schemes, and the in ⁇ vention allows to reverse the watermark embedding process without significant penalties in terms of data rate, robust ⁇ ness and computational complexity of the watermark scheme, whereby the reversal of the watermark embedding process will deliver almost exactly the original PCM audio signal.
• the inventive quantisation method is suited for quantisation index modulation for watermarking an input signal x, wherein different quantiser curves Q m are used for quantising said input signal x and a current characteristic of said quantiser curve is controlled by the current content of a watermark message m, wherein in said quantising the difference between input value and output value at any posi- tion is not greater than T, and said quantising curves Q m are reversible in that for any input value x there is a unique output value y,
• y is the watermarked output signal
• the different quantiser curves Q m are estab ⁇ lished according to the current value of m by different shifts of the complete quantiser curve in x direction.
• a is a predetermined steepness of the medium section of said quantiser curves Q m
• y is the water- marked output signal.
• the inventive quantisation apparatus is suited for quantisation index modulation for watermarking an input signal x, wherein different quantiser curves Q m are used for quantising said input signal x and a current characteristic of said quantiser curve is controlled by the current content of a watermark message m, said apparatus including:
• a is a predetermined steepness of the medium section of said quantiser curves Q m
• y is the water- marked output signal.
• the inventive regaining method is suited for regaining an original input signal x which has been proc ⁇ essed according to said inventive quantisation method, said method including the steps:
• Fig. 1 example of a reversible QIM quantiser curve for with embedding power constraint
• Fig. 2 signal flow of an embedder according to the invention
• the characteristic curve shall be reversible, that is for any input value x there shall be one unique output value y.
• FIG. 1 An example of a characteristic curve for one of the quantis ⁇ ers for the inventive reversible QIM processing with embed ⁇ ding power constraint is shown in Fig. 1 with output y ver- sus input x.
• the curve can be divided into three linear seg ⁇ ments I, II, III marked at the top of the figure.
• y Q m (x) + max(-T, min(T, a(x-Q m (x)))) , where m represents the watermark message and Q m denotes the different curves of quantisers used for embedding message m, e.g. one quantiser curve for '0' bits of m and a different quantiser curve for '1' bits.
• the value of a is fixed in an application, and the choice of a is a trade-off: if a is near '1', the robustness of the embedded watermark is likely to be inferior than for lower values of a, because the average shift towards the reference value is lower than possible. On the other hand, the higher the value of a the better is it possible to reverse the characteristic curve of the embedder in noisy conditions.
• the value of T is adapted to the current psycho-acoustic masking level of the input signal.
• the characteristic curve in Fig. 1 has been designed to maximise the average shift of input values towards the ref ⁇ erence value.
• the different quantiser curves Q m are estab- lished according to the current value of m by different shifts s xm of the complete quantiser curve in x direction.
• Other characteristic curves are possible as well, as long as they fulfil the aforementioned two constraints.
• filter bank coeffi- cients e.g. MDCT frequency bins
• the filter bank coeffi- cients are mutually independent: that means it is desired that any modification of one coef ⁇ ficient (in the embedding process) does only affect exactly the same coefficient at the decoder side (assuming perfect synchronisation of signal segments used for analysis) . Any interference with other (nearby) coefficients shall be avoided.
• One example filter bank with these properties is the MDCT.
• the upper signal path is used for determining an additive watermark signal, which can be determined likewise from the watermarked signal, and includes an MDCT step or stage 21, a 2-frames combiner step/stage 22, an embedder 23 that carries out the above-described inven ⁇ tive quantising, in which the (current) value of T is con- trolled by a psycho-acoustic analyser 26 receiving its input from the output of step/stage 22, a 2-frames spread step/ stage 24, an inverse MDCT step/stage 25, and a combiner that adds the output of IMDCT step/stage 25 with the input signal of MDCT step/stage 21.
• the inventive quantising processing can be carried out in time domain, but preferably the signal processing takes place in frequency domain, i.e. the input signal is fed into an MDCT analysis block and the output watermark signal is produced via an inverse MDCT.
• MDCT/ IMDCT any other suitable time-to-frequency domain/frequency-to-time domain transforms can be used, which must allow perfect (i.e. bit-exact) reconstruction of the time domain signal.
• two consecutive MDCT frames are interpreted as real and imaginary part of one complex spec ⁇ trum. Strictly mathematically, this interpretation is wrong. However, it allows to define an angular spectrum for the purpose of embedding a watermark.
• the actual watermark embedding corresponds to the processings described in WO 2007/ 031423 Al, WO 2006/128769 A2 or WO 2007/031423 Al .
• ⁇ serting watermark information only the angles (i.e. the phases) of the pseudo-complex spectrum are modified accord ⁇ ing to the constraints provided by a psycho-acoustic analy ⁇ sis of the input signal.
• the embedding of the watermark message m is performed ac ⁇ cording to the inventive reversible QIM with embedding power constraint as described in connection with Fig. 1.
• the psy ⁇ cho-acoustic analysis of the original signal is used in or ⁇ der to derive maximum modifications of the angles or phases of individual coefficients of the pseudo-complex spectrum. These maximum values constitute the constraint T used in the characteristic curve from section Reversible QIM watermark ⁇ ing with embedding power constraint.
• the input values x to the embedding curve from that section are the angles of the pseudo-complex spectrum, and the out ⁇ put values y are used to derive the angles of the additive watermark-only signal (in MDCT domain) y-x.
• the reference angles are derived from a pseudo-noise sequence according to the principles described in WO 2007/031423 Al, WO 2006/ 128769 A2 or WO 2007/031423 Al .
• the amplitudes of the com ⁇ plex values defined by two consecutive MDCT spectra are not modified by the watermark embedder .
• the new angles (according to y-x as explained in the previ ⁇ ous paragraph) , together with the amplitudes of the complex interpretation, are again split into two real-valued, con ⁇ secutive MDCT spectra.
• the resulting stream of MDCT spectra is fed into the inverse MDCT filter bank 25 in order to pro ⁇ cute the additive watermark signal.
• the watermark process is reversible because all analysis steps that are applied in order to derive the additive wa ⁇ termark signal are invariant to the embedding of the water- mark. That means, the same additive watermark signal can be derived from the original signal as well as from the water ⁇ marked signal. There are, however, two preconditions to this property :
• the watermarked signal shall not be altered signifi ⁇ cantly. Any major attack or signal modification will impact the reproducibility of the computation of the water ⁇ mark signal.
• the watermark embedding process typically will not be 100% reversible if the watermarked output signal of the embedder is quantised to integer values. If, for exam ⁇ ple, the watermarked signal is quantised to 16 bit integer values, the output signal of a watermark remover will suffer from the quantisation noise of this 16 bit quantiser as compared to the original PCM samples.
• overmarking means that a sequence of embedding and removal of watermarks has been applied to one original audio signal.
• the quality of the signal degrades according to the number of consecutive overmarkings .
• Fig. 3 shows an ex- ample of the performance of the phase-based watermarking ac ⁇ cording to WO 2007/031423 Al, WO 2006/128769 A2 or WO 2007/ 031423 Al .
• Fig. 4 shows the corresponding overmarking performance for the inventive processing for the same input signal using the embodiment described in Fig. 2 (no attack, which means that the watermarked signal has not been modi- fied) .
• the subjective quality of the watermarked signal stays essentially constant even after 100 overmarking steps.
• the noise-like fluctuation of the ODG for each overmarking step is produced by the fact that for each overmarking a different embedding key (i.e. reference sequence) has been applied, which leads to different subjective qualities of the watermarked signals.
• the above principles can also be applied in order to provide a full removal of the watermark, leading with high probability to the bit-exact original in ⁇ put PCM samples of the embedder .
• the output signal of the embedder is quantised with different candidate quantiser curves like at embedding side but with a bit depth (e.g. 24 bit per sample) that is consistently higher than the bit depth of the original embedder-side in ⁇ put PCM samples (e.g. 16 bit per sample) .
• the actual QM curve is determined in MDCT domain as described above.
• the corresponding current watermark message m is removed from signal y so as to provide the regained signal x.
• the removal of the watermark will lead to PCM samples that suf ⁇ fer from the quantisation noise from the quantisation of the watermarked signal.
• this quantisation noise will only affect some LSBs of the higher bit depth output signal of the watermark remover. Therefore this output signal can in turn be quantised to the original precision of the input PCM samples (16 bit per sample in the example above) . This will remove the impairment by the quan ⁇ tisation noise and recover the original PCM samples.
• the invention can be used for applications like:
• DRM digital rights management
• the inventive processing can also be used in connection with spread spectrum based watermarking techniques.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• Computational Linguistics (AREA)
• Signal Processing (AREA)
• Health & Medical Sciences (AREA)
• Audiology, Speech & Language Pathology (AREA)
• Human Computer Interaction (AREA)
• Acoustics & Sound (AREA)
• Multimedia (AREA)
• Mathematical Physics (AREA)
• Editing Of Facsimile Originals (AREA)
• Compression, Expansion, Code Conversion, And Decoders (AREA)

Priority Applications (6)

Applications Claiming Priority (2)

Publications (1)

Family

ID=46397234

Family Applications (1)

Country Status (7)

Cited By (2)

Families Citing this family (7)

Citations (2)

Family Cites Families (9)

• 2011
  • 2011-07-08 EP EP11305883A patent/EP2544179A1/en not_active Withdrawn
• 2012
  • 2012-06-25 WO PCT/EP2012/062194 patent/WO2013007500A1/en not_active Ceased
  • 2012-06-25 BR BR112014000356A patent/BR112014000356A2/pt not_active IP Right Cessation
  • 2012-06-25 EP EP20120730495 patent/EP2729933B1/en not_active Not-in-force
  • 2012-06-25 CN CN201280033915.1A patent/CN103650039B/zh not_active Expired - Fee Related
  • 2012-06-25 JP JP2014517623A patent/JP2014521112A/ja not_active Ceased
  • 2012-06-25 US US14/131,027 patent/US10019997B2/en not_active Expired - Fee Related
  • 2012-06-25 KR KR1020147000420A patent/KR20140041696A/ko not_active Withdrawn

Patent Citations (2)

Non-Patent Citations (5)

Also Published As

Similar Documents

Legal Events