WO2001026262A2 - Verfahren und vorrichtung zum einbringen von informationen in einen datenstrom sowie verfahren und vorrichtung zum codieren eines audiosignals - Google Patents
Verfahren und vorrichtung zum einbringen von informationen in einen datenstrom sowie verfahren und vorrichtung zum codieren eines audiosignalsInfo
- Publication number
- WO2001026262A2 WO2001026262A2 PCT/EP2000/009771 EP0009771W WO0126262A2 WO 2001026262 A2 WO2001026262 A2 WO 2001026262A2 EP 0009771 W EP0009771 W EP 0009771W WO 0126262 A2 WO0126262 A2 WO 0126262A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- spectral values
- audio signal
- short
- data stream
- information
- Prior art date
Links
- 230000005236 sound signal Effects 0.000 title claims abstract description 96
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000003595 spectral effect Effects 0.000 claims abstract description 119
- 230000000873 masking effect Effects 0.000 claims abstract description 100
- 238000001228 spectrum Methods 0.000 claims abstract description 57
- 238000013139 quantization Methods 0.000 claims description 49
- 238000012545 processing Methods 0.000 claims description 13
- 230000007480 spreading Effects 0.000 claims description 10
- 210000004243 sweat Anatomy 0.000 claims description 2
- 238000011156 evaluation Methods 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 10
- 230000008901 benefit Effects 0.000 description 12
- 230000009466 transformation Effects 0.000 description 9
- 238000004364 calculation method Methods 0.000 description 5
- 230000006866 deterioration Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 230000015572 biosynthetic process Effects 0.000 description 4
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000001131 transforming effect Effects 0.000 description 3
- 230000009365 direct transmission Effects 0.000 description 2
- 230000036961 partial effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 229910002056 binary alloy Inorganic materials 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/28—Arrangements for simultaneous broadcast of plural pieces of information
- H04H20/30—Arrangements for simultaneous broadcast of plural pieces of information by a single channel
- H04H20/31—Arrangements for simultaneous broadcast of plural pieces of information by a single channel using in-band signals, e.g. subsonic or cue signal
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/018—Audio watermarking, i.e. embedding inaudible data in the audio signal
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/02—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using spectral analysis, e.g. transform vocoders or subband vocoders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/69—Spread spectrum techniques
- H04B1/707—Spread spectrum techniques using direct sequence modulation
Definitions
- the customer has a decoder that reads the header and, for example, only allows a single copy in compliance with the permitted actions and refuses further copies.
- Illegal customers usually have a substantial potential for creativity to "crack" pieces of music with a header. This already shows the disadvantage of the described procedure for protecting copyrights. Such a header can easily be removed. Alternatively, an illegal user could also modify individual entries in the header, for example to make the entry "Copy prohibited” an entry "Copy completely free”. It is also conceivable that an illegal customer removes his own customer number from the header and then offers the piece of music on his or another homepage on the Internet. From this moment on it is no longer possible to identify the illegal customer because he has removed his customer number. Attempts to prevent such copyright infringement will therefore inevitably result in the copy information having been removed or modified from the piece of music and since the illegal customer who did so can no longer be identified to help him To take responsibility. If, instead, there was a safe introduction of information into the audio signal, state authorities that pursue copyright infringements could identify suspicious pieces of music on the Internet and, for example, determine the user identification of such illegal pieces in order to put an end to illegal users.
- This method already provides a high level of security against music pirates, since on the one hand they may not even know that the piece of music they are copying is marked. Moreover, without an authorized decoder, it is almost impossible to extract the data signal that is inaudibly present in the audio signal.
- audio signals are available as 16-bit PCM samples.
- a music pirate could, for example, manipulate the sampling rate or the levels or phases of the samples in order to make the data signal unreadable, ie undecodable, which would also remove the copyright information from the audio signal. This however, it will not be possible without significant quality losses.
- Data introduced in this way in audio signals can therefore also be referred to as "watermarks" in analogy to banknotes.
- Another disadvantage of this procedure is that due to the fact that the watermark is introduced into the PCM data, there is no certainty as to whether the watermark is still present after audio compression. If watermarked PCM data is encoded at a relatively low bit rate, the encoder introduces a lot of quantization noise during quantization due to the relatively low bit rate, which in extreme cases will result in no more watermarks being decodable. It is therefore problematic that the bit rate of the audio encoder which encodes the watermarked PCM data is not known from the outset with this procedure, which is why it is not possible to reliably control the relationship between watermark energy and interference energy due to the quantization noise.
- the degree of masking ie the ratio of the audio signal energy and the psychoacoustic masking threshold
- the spectral values only have to be roughly quantized without audible interference occurring after a subsequent decoding.
- quantization has to be carried out more finely, in such a way that a relatively small interference energy arises due to the quantization, since the degree of masking is very large here.
- This object is achieved by a method for introducing information into a data stream according to patent claim 1, by a method for coding an audio signal according to patent claim 11 or 12, by a device for inserting information according to patent claim 13 and by a device for coding an audio signal according to patent claim 15 or claim 16 solved.
- the present invention is based on the finding that it must be assumed that a complete decoding must be carried out before the watermark is introduced. Instead, according to the invention, a data stream that has spectral values that represent a short-term spectrum of an audio signal is only partially "unpacked” until the spectral values are available. However, the unpacking is not a complete decoding but only a partial one Decoding, in which the information about the block formation or the block grid used in the original encoder is not touched.
- the method according to the invention is carried out with spectral values and not with temporal samples.
- the information that is to be introduced into the audio signal is subjected to a spreading sequence in the sense of spread spectrum modulation in order to obtain a spreading information signal.
- a spectral representation of the spread information signal is then generated, for example by a filter bank, an FFT, an MDCT or the like, in order to obtain a spectral spread information signal.
- a psychoacoustically maskable disturbance is determined as a function of the frequency for the short-term spectrum of the audio signal, in order then to weight the spectrally spread information signal using the determined interference energy, so that a weighted information signal can be generated whose energy is essentially equal to or below the psychoacoustic masking threshold lies.
- the weighted information signal is then summed with the spectral values of the short-term spectrum of the audio signal in order to obtain sum spectral values which include the short-term spectrum of the audio signal and additionally the information which has been introduced.
- the sum spectral values are processed again in order to obtain a processed data stream which comprises the data about the spectral values of the short-term spectrum of the audio signal and the information to be introduced.
- the processing of the sum spectral values will again involve quantizing and entropy coding, for example using a Huffman code.
- the post-weighting processing which includes quantization use the same quantization step size (s) as in the original bit stream, which has the advantage that the very iterative iteration loops of the quantizer do not have to be recalculated. Furthermore, there are no tandem coding effects that would otherwise be unavoidable, since in the case of a new calculation, quantizer step sizes that deviate to a greater or lesser extent could occur.
- the introduction of a watermark according to the invention directly into a data stream enables, for example, the introduction of a customer number during the delivery of the music to a customer, since the method can run on modern personal computers in multiple real time, since u. a. in addition, the complex frequency-time transformation that would be required for complete decoding can be dispensed with.
- Another advantage of the present invention is that the music provider, i. H. the music provider no longer has to store the PCM samples, but can store precoded data streams, which can have a factor in the order of 12 in the storage space, and that the provider can nevertheless introduce customer-specific watermarks without additional tandem coding effects that would result in a loss of audio quality.
- the method according to the invention can be easily implemented since only an additional time / frequency transformation of the spread information signal is required. Another important advantage is that the method according to the invention has good interoperability, ie that standard data streams can be processed, and that for watermarks according to the known methods and the same watermark decoder can be used for watermarks according to the inventive method. Finally, another advantage is that an audio encoder can no longer erase the watermark because there is precise control over the relationship between quantization noise and watermark energy.
- the psychoacoustically maskable interference energy can be determined in various ways.
- a first option is to use a psychoacoustic model to determine the psychoacoustically maskable interference energy, which model generates the psychoacoustic masking threshold as a function of frequency from the short-term spectrum.
- psychoacoustic models which work with spectral values of the short-term spectrum anyway being particularly advantageous here, since these spectral values are directly due to the partial unpacking of the data stream.
- psychoacoustic models can also be used which are designed for time domain data, a frequency-time transformation being required here, in contrast to the option described above.
- the data stream has been generated in such a way that, in addition to the spectral values and the usual side information, it also contains the psychoacoustic masking threshold as a function of frequency for each short-term spectrum. Determining the psychoacoustically maskable interference energy then simply works by extracting the psychoacoustic masking threshold transmitted in the data stream. In this possibility and the previously described possibility in which the psychoacoustic masking model is calculated, the psychoacoustically maskable interference energy is the psychoacoustic masking threshold itself.
- a disadvantage of the method of transmitting the psychoacoustic masking threshold in the data stream is the fact that a special audio encoder is required is, since in conventional audio coders the psychoacoustic masking threshold is not transmitted, but only the spectral values and the corresponding scale factors.
- compatibility with standard data streams is not required in closed systems. Here, this option can therefore be implemented with simple effort and at low computing time.
- Another possibility is to provide a special audio encoder whose quantizer always works in such a way that the quantization noise is lower than the psychoacoustic masking threshold by a predetermined amount.
- the encoder is designed so that its quantizer quantizes somewhat more finely than it should, in such a way that additional interference energy can be added without an interference being audible. This additional interference energy can then be "used up” when information is introduced into the data stream in order to to contribute.
- this possibility leads to a data stream with an inserted watermark which has not suffered any deterioration in quality.
- a disadvantage of this method as in the case of direct transmission of the psychoacoustic masking threshold, is the fact that this method is not compatible with conventional encoders.
- Another way of determining the psychoacoustically maskable interference energy is to determine the interference energy actually introduced by quantizing the encoder that generated the data stream and to derive the psychoacoustically maskable interference energy that the information is obtained during weighting.
- This option assumes that the encoder has quantized such that the interference energy is below the psychoacoustic masking threshold or only slightly above it.
- This method like the method described as the first option, manages with the standard bit streams, since only the spectral values and the scale factors, both of which are present in the data stream, are required in order to obtain the psychoacoustically maskable interference energy.
- the step size of the quantizer which is assigned to the corresponding scale factor, can be determined from the scale factors in order to calculate the interference energy introduced in a scale factor band, which will typically be equal to or below the psychoacoustic masking threshold.
- the psychoacoustically maskable interference energy used for weighting for the information introduced can be equal to the quantization interference energy, but it can also have a factor between greater than zero and less than one, whereby a factor closer to zero will result in less audible interference due to the watermark, however could be more problematic in extracting than a factor closer to one.
- FIG. 1 shows a block diagram of a device according to the invention for introducing information into a data stream
- Fig. 2 is a detailed block diagram of the watermarking device of Fig. 1;
- 3a shows a schematic illustration of a method for determining the maskable interference energy using a psychoacoustic model
- 3b shows a schematic representation of a method for determining the maskable interference energy when the psychoacoustic masking threshold is transmitted in the data stream
- Fig. 3c is a schematic representation of a method for
- Interference energy is estimated with knowledge of the spectral values and the scale factors
- FIG. 4 shows a block diagram of an audio encoder according to the invention, which either writes the psychoacoustic masking threshold into the data stream, or writes the predetermined amount for the method described in FIG. 3d into the data stream and the quantizer of which is controlled accordingly.
- the system theoretical background of the present invention is briefly illuminated.
- the introduction of the information in the audio signal lead to no or only a very difficult to hear quality deterioration of the audio signal.
- the masking threshold of the audio signal is continuously calculated using a psychoacoustic model.
- the frequency-selective calculation of the masking threshold using, for example, the critical bands and a large number of further psychoacoustic models are known in the art.
- the psychoacoustic model leads to a masking threshold for a short-term spectrum of the audio signal.
- the masking threshold will vary over frequency. It is assumed by definition that a signal introduced into the audio signal will be inaudible when the energy of this signal is below the masking threshold.
- the masking threshold strongly depends on the composition of the audio signal. noisy signals have a higher masking threshold than very tonal signals.
- the energy of the signal that is introduced into the audio signal therefore varies greatly over time.
- a specific signal-to-noise ratio is usually required to decode the information introduced into an audio signal. It can happen that in very tonal audio signal sections the energy of the additionally introduced signal becomes so low that the signal-to-noise ratio is no longer sufficient for safe decoding.
- a decoder can therefore no longer correctly decode individual bits in such areas.
- the introduction of information into an audio signal depending on the psychoacoustic masking threshold can be regarded as the transmission of a data signal over a channel with widely varying interference energy, the audio signal, i. H. the music signal, is interpreted as an interference signal.
- the spectral values which are still entropy-coded behind the demultiplexer 10, are then fed to an entropy decoder 16 and then to an inverse quantizer 18, which, using the quantized spectral values and the associated scale factors, is transmitted to the inverse quantizer 18 via line 14 are provided, the spectral values of the audio signal are generated, which represent the short-term spectrum of the same.
- the spectral values are then fed into a watermark device 20, which generates sum spectral values which comprise the short-term spectrum of the audio signal and, moreover, the information to be introduced.
- FIG. 2 which has a more detailed representation of the watermark device 20
- an MPEG-2 AAC audio encoder for understanding, as described, for example, in Appendix B of the standard ISO / IEC 13818-7: 1997 ( E) is described as an informative part.
- the basic idea behind such an encoder is to reduce the quantization noise below bring so-called psychoacoustic masking threshold, ie hide it.
- DCT discrete cosine transformation
- the psychoacoustic model used in such encoders is based on the psychoacoustic phenomenon of masking. Both frequency domain masking effects and time domain masking effects can be modeled.
- the psychoacoustic model provides an estimate of "noise" energy that can be added to the original audio signal without audible interference. This maximum permissible energy is called the psychoacoustic masking threshold.
- the quantizer 22 and the encoder 24 in Fig. 1 are described below.
- more than one spectral line is quantized with the same quantizer step size. Therefore, several neighboring spectral lines are grouped into so-called scale factor bands.
- the quantizer optimizes the quantizer step size for each scale factor band.
- the quantizer step size is determined so that the quantization error is below or equal to the calculated psychoacoustic masking threshold to ensure that the quantization noise is inaudible. It can be seen that two limitations must be taken into account between which a compromise must be found. On the one hand, the bit consumption should be kept as low as possible in order to achieve high compression ratios, ie a high coding gain.
- This optimization method is typically calculated in an iterative loop.
- the result of this loop is a quantizer step size that clearly corresponds to a scale factor for a scale factor band.
- the spectral values of a scale factor band are quantized with a quantizer step size that is uniquely assigned to the scale factor relevant for the scale factor band. This means that two different scale factors can also result in two different quantizer step sizes.
- the bit stream is composed by a bit stream multiplexer, which essentially performs formatting tasks.
- the data stream which in the case of a binary system is a bit stream, thus contains the quantized and coded spectral values or spectral coefficients as well as the scale factors and further side information which are shown and explained in detail in the MPEG-AAC standard mentioned.
- FIG. 2 shows a more detailed block diagram of the watermarking device 20 from FIG. 1.
- a source 30 for information units information units, preferably in the form of bits, are fed to a device 32 for spreading.
- the device 32 for spreading is based in principle on a spread spectrum modulation, which is particularly advantageous when using a pseudo-noise spreading sequence with a correlation in the watermark extractor.
- the information is applied bit by bit to the spreading sequence.
- the application preferably takes place in such a way that for an information bit with a logic level of +1 the spread sequence is generated unchanged at the output of the device 32, while for an information bit with a logic level of 0, which can correspond, for example, to a voltage level of -1, the reverse spreading sequence is generated at the output of the device 32.
- the device 34 for transforming the spread information signal preferably carries out a spectral transformation which corresponds to the transformation on which the data stream at the input of the demultiplexer 10 (FIG. 1) is based. That is, the means 34 for transforming preferably performs the same modified discrete cosine transform that was originally used to generate the unprocessed data stream. This is easily possible, since information such. B. window type, window shape, window length, etc., as side information in the bit stream. This link is indicated by the line shown in broken lines in FIG. 2 from the bitstream demultiplexer 10 (FIG. 1).
- the sum spectral values after the addition in summer 38 are again subjected to quantization and coding.
- the same scale factors as in the original bit stream can preferably be used. This is shown in FIG. 1 by the connecting line 14 from the demultiplexer 10 to the multiplexer 26. That is, quantization can be performed much more easily by quantizer 22 since it is no longer necessary (but still possible) to perform the iteration loops to determine an optimal compromise between bit rate and quantizer step size. Instead, the already known scale factors are preferably used simply.
- a psychoacoustic model is used to calculate the psychoacoustic masking threshold of the corresponding short-term spectrum using the spectral values of the audio signal. Due to the fact that psychoacoustic models are described in the literature and the standard mentioned, it should only be mentioned here that preferably psychoacoustic models can be used which work with spectral data anyway or contain a time / frequency transformation. In this case, the psychoacoustic model is simplified to the original psychoacoustic model on which each encoder is based, in that it can be "fed” with spectral values immediately, so that no frequency / time transformation in the psychoacoustic model is required at all.
- the first possibility shown in FIG. 3a has the advantage that the psychoacoustic masking threshold can be calculated very precisely and that this method is completely compatible with conventional data streams.
- a disadvantage of this, however, is the fact that the calculation of a psychoacoustic model can usually be relatively time-consuming, so that it can be said that this possibility is very precise and interoperable, but it takes a relatively long time.
- the psychoacoustically maskable interference energy is calculated using the spectral values and the scale factors (40c). It is assumed that the original encoder, which generated the data stream into which the watermark is to be introduced, has already chosen the interference energy introduced by the quantization so that it lies below the psychoacoustic masking threshold or on the psychoacoustic masking threshold. Although this method is somewhat less precise than the direct calculation of the psychoacoustic masking threshold, it is very fast compared to the direct calculation of the psychoacoustic masking threshold and at the same time maintains the interoperability, i. H. also works with standard bitstreams.
- the device according to the invention assumes that the psychoacoustic masking threshold is substantially lower than it should be, which ultimately leads to the spectral representation of the spread information signal after weighting has much less energy than it should have, which means that not all of the available energy that the watermark should have is used.
- a quantizer which always introduces the maximum permissible interference energy through the quantization and does not describe any remaining bits or fills them with any values not taken into account during decoding.
- the option shown in Fig. 3c would be just as accurate as the first two options.
- the variable quantizer however, a variable bit rate also arises.
- the watermarker could also be used to make the bit rate constant by filling in bits representing the watermark so that the constant bit rate is equal to the highest bit rate of the original variable bit rate data stream.
- the energy of the quantization error in a scale factor band is then the sum of the j Fxi
- FIG. 4 showing two possibilities for an encoder for audio signals in order to generate a data stream which, according to the invention, is particularly suitable for the introduction of information.
- Such an audio encoder can basically be constructed in the same way as a known audio encoder, in such a way that it comprises a device 50 for generating a spectral representation of the audio signal, a quantizer 52 for quantizing the spectral representation of the audio signal, an entropy encoder 54 for entropy coding the quantized spectral values and finally includes a data stream multiplexer 56.
- the dashed line in FIG. 4 shows the audio encoder possibility according to the present invention, which corresponds to the option shown in FIG. 3d for the device 40 for determining the maskable interference energy in the device according to the invention shown in FIG. 1.
- the quantizer is controlled by a predetermined amount such that the interference energy introduced by the quantization is below the psychoacoustic masking threshold by the predetermined amount
- the value of the predetermined amount Amount is fed via the dashed line 62 into the data stream multiplexer 56 in order to be contained in the data stream, such that the device for introducing information according to the invention can access the predetermined amount in order to be able to weight accordingly (block 36 in FIG. 2 ).
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
Description
Claims
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE50001467T DE50001467D1 (de) | 1999-10-05 | 2000-10-05 | Verfahren und vorrichtung zum einbringen von informationen in einen datenstrom sowie verfahren und vorrichtung zum codieren eines audiosignals |
US10/089,950 US7454327B1 (en) | 1999-10-05 | 2000-10-05 | Method and apparatus for introducing information into a data stream and method and apparatus for encoding an audio signal |
EP00969432A EP1212857B1 (de) | 1999-10-05 | 2000-10-05 | Verfahren und vorrichtung zum einbringen von informationen in einen datenstrom sowie verfahren und vorrichtung zum codieren eines audiosignals |
AT00969432T ATE234533T1 (de) | 1999-10-05 | 2000-10-05 | Verfahren und vorrichtung zum einbringen von informationen in einen datenstrom sowie verfahren und vorrichtung zum codieren eines audiosignals |
US12/238,365 US8117027B2 (en) | 1999-10-05 | 2008-09-25 | Method and apparatus for introducing information into a data stream and method and apparatus for encoding an audio signal |
US12/366,586 US20090138259A1 (en) | 1999-10-05 | 2009-02-05 | Method and Apparatus for Introducing Information into a Data Stream and Method and Apparatus for Encoding an Audio Signal |
US13/301,324 US20120065964A1 (en) | 1999-10-05 | 2011-11-21 | Method and apparatus for introducing information into a data stream and method and apparatus for encoding an audio signal |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE19947877.5 | 1999-10-05 | ||
DE19947877A DE19947877C2 (de) | 1999-10-05 | 1999-10-05 | Verfahren und Vorrichtung zum Einbringen von Informationen in einen Datenstrom sowie Verfahren und Vorrichtung zum Codieren eines Audiosignals |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/089,950 A-371-Of-International US7454327B1 (en) | 1999-10-05 | 2000-10-05 | Method and apparatus for introducing information into a data stream and method and apparatus for encoding an audio signal |
US12/238,365 Continuation US8117027B2 (en) | 1999-10-05 | 2008-09-25 | Method and apparatus for introducing information into a data stream and method and apparatus for encoding an audio signal |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2001026262A2 true WO2001026262A2 (de) | 2001-04-12 |
WO2001026262A3 WO2001026262A3 (de) | 2001-10-25 |
Family
ID=7924519
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2000/009771 WO2001026262A2 (de) | 1999-10-05 | 2000-10-05 | Verfahren und vorrichtung zum einbringen von informationen in einen datenstrom sowie verfahren und vorrichtung zum codieren eines audiosignals |
Country Status (5)
Country | Link |
---|---|
US (4) | US7454327B1 (de) |
EP (1) | EP1212857B1 (de) |
AT (1) | ATE234533T1 (de) |
DE (2) | DE19947877C2 (de) |
WO (1) | WO2001026262A2 (de) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102005055440A1 (de) * | 2005-11-21 | 2007-05-24 | Siemens Ag | Verfahren und Vorrichtungen zum Einfügen, Erkennen und Entfernen von Wasserzeichen in einem Datenstrom |
AU2005241157B2 (en) * | 2004-04-30 | 2008-05-22 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Information signal processing by carrying out modification in the spectral/modulation spectral region representation |
US7676336B2 (en) | 2004-04-30 | 2010-03-09 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Watermark embedding |
Families Citing this family (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19947877C2 (de) * | 1999-10-05 | 2001-09-13 | Fraunhofer Ges Forschung | Verfahren und Vorrichtung zum Einbringen von Informationen in einen Datenstrom sowie Verfahren und Vorrichtung zum Codieren eines Audiosignals |
DE10129239C1 (de) * | 2001-06-18 | 2002-10-31 | Fraunhofer Ges Forschung | Vorrichtung und Verfahren zum Einbetten eines Wasserzeichens in ein Audiosignal |
AU2002352182A1 (en) * | 2001-11-29 | 2003-06-10 | Coding Technologies Ab | Methods for improving high frequency reconstruction |
US7620545B2 (en) * | 2003-07-08 | 2009-11-17 | Industrial Technology Research Institute | Scale factor based bit shifting in fine granularity scalability audio coding |
DE102004009955B3 (de) * | 2004-03-01 | 2005-08-11 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zum Ermitteln einer Quantisierer-Schrittweite |
JP2006018023A (ja) * | 2004-07-01 | 2006-01-19 | Fujitsu Ltd | オーディオ信号符号化装置、および符号化プログラム |
ES2324726T3 (es) * | 2004-10-20 | 2009-08-13 | Koninklijke Philips Electronics N.V. | Procedimiento para reducir el ruido de cuantificacion. |
JP2007026357A (ja) * | 2005-07-21 | 2007-02-01 | Fuji Xerox Co Ltd | 情報処理サーバ、情報処理システム、及びプログラム |
US7835904B2 (en) * | 2006-03-03 | 2010-11-16 | Microsoft Corp. | Perceptual, scalable audio compression |
ES2376889T3 (es) | 2006-03-24 | 2012-03-20 | Dolby International Ab | Generación de mezclas descendentes espaciales a partir de representaciones paramétricas de señales multicanal |
US20110035212A1 (en) * | 2007-08-27 | 2011-02-10 | Telefonaktiebolaget L M Ericsson (Publ) | Transform coding of speech and audio signals |
US8369972B2 (en) | 2007-11-12 | 2013-02-05 | The Nielsen Company (Us), Llc | Methods and apparatus to perform audio watermarking and watermark detection and extraction |
US8457951B2 (en) * | 2008-01-29 | 2013-06-04 | The Nielsen Company (Us), Llc | Methods and apparatus for performing variable black length watermarking of media |
US8879895B1 (en) | 2009-03-28 | 2014-11-04 | Matrox Electronic Systems Ltd. | System and method for processing ancillary data associated with a video stream |
US9818422B2 (en) * | 2013-08-30 | 2017-11-14 | The Regents Of The University Of California | Method and apparatus for layered compression of multimedia signals for storage and transmission over heterogeneous networks |
JP6272619B2 (ja) * | 2013-11-13 | 2018-01-31 | フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン | オーディオ信号の符号化用エンコーダ、オーディオ伝送システムおよび補正値の判定方法 |
EP2881941A1 (de) * | 2013-12-09 | 2015-06-10 | Thomson Licensing | Verfahren und Vorrichtung zur Wassermarkierung eines Audiosignals |
US9576589B2 (en) * | 2015-02-06 | 2017-02-21 | Knuedge, Inc. | Harmonic feature processing for reducing noise |
US10043527B1 (en) | 2015-07-17 | 2018-08-07 | Digimarc Corporation | Human auditory system modeling with masking energy adaptation |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0446037A2 (de) * | 1990-03-09 | 1991-09-11 | AT&T Corp. | Hybride wahrnehmungsgebundene Kodierung von Audiosignalen |
US5319735A (en) * | 1991-12-17 | 1994-06-07 | Bolt Beranek And Newman Inc. | Embedded signalling |
DE19640825A1 (de) * | 1996-03-07 | 1997-09-11 | Fraunhofer Ges Forschung | Codierer zur Einbringung eines nicht hörbaren Datensignals in ein Audiosignal und Decodierer zum decodieren eines nicht hörbar in einem Audiosignal enthaltenen Datensignals |
US5687191A (en) * | 1995-12-06 | 1997-11-11 | Solana Technology Development Corporation | Post-compression hidden data transport |
Family Cites Families (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5040217A (en) * | 1989-10-18 | 1991-08-13 | At&T Bell Laboratories | Perceptual coding of audio signals |
DE4102324C1 (de) | 1991-01-26 | 1992-06-17 | Institut Fuer Rundfunktechnik Gmbh, 8000 Muenchen, De | |
AU654533B2 (en) * | 1991-03-29 | 1994-11-10 | Sony Corporation | Method of encoding digital signals |
FI89439C (fi) * | 1991-10-30 | 1993-09-27 | Salon Televisiotehdas Oy | Foerfarande foer att dekoda en audiosignal i vilken annan information aer infoerd med anvaendning av maskningseffekt |
DE4136825C1 (de) * | 1991-11-08 | 1993-03-18 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung Ev, 8000 Muenchen, De | |
US5285498A (en) * | 1992-03-02 | 1994-02-08 | At&T Bell Laboratories | Method and apparatus for coding audio signals based on perceptual model |
JP3278900B2 (ja) * | 1992-05-07 | 2002-04-30 | ソニー株式会社 | データ符号化装置及び方法 |
US5301363A (en) * | 1992-06-29 | 1994-04-05 | Corporate Computer Systems, Inc. | Method and apparatus for adaptive power adjustment of mixed modulation radio transmission |
US5623577A (en) * | 1993-07-16 | 1997-04-22 | Dolby Laboratories Licensing Corporation | Computationally efficient adaptive bit allocation for encoding method and apparatus with allowance for decoder spectral distortions |
US5508949A (en) * | 1993-12-29 | 1996-04-16 | Hewlett-Packard Company | Fast subband filtering in digital signal coding |
US5404377A (en) * | 1994-04-08 | 1995-04-04 | Moses; Donald W. | Simultaneous transmission of data and audio signals by means of perceptual coding |
DE4430864C2 (de) * | 1994-08-31 | 2003-04-30 | Mayah Comm Gmbh | Verfahren zum unbemerktem Übertragen und/oder Speichern von Zusatzinformationen innerhalb eines quellencodierten, datenreduzierten Audiosignals |
US6301555B2 (en) * | 1995-04-10 | 2001-10-09 | Corporate Computer Systems | Adjustable psycho-acoustic parameters |
US5937000A (en) * | 1995-09-06 | 1999-08-10 | Solana Technology Development Corporation | Method and apparatus for embedding auxiliary data in a primary data signal |
CA2184949C (en) * | 1995-09-28 | 2000-05-30 | Ingemar J. Cox | Secure spread spectrum watermarking for multimedia data |
US6035177A (en) * | 1996-02-26 | 2000-03-07 | Donald W. Moses | Simultaneous transmission of ancillary and audio signals by means of perceptual coding |
EP0875107B1 (de) * | 1996-03-07 | 1999-09-01 | Fraunhofer-Gesellschaft Zur Förderung Der Angewandten Forschung E.V. | Codierverfahren zur einbringung eines nicht hörbaren datensignals in ein audiosignal, decodierverfahren, codierer und decodierer |
US5812971A (en) * | 1996-03-22 | 1998-09-22 | Lucent Technologies Inc. | Enhanced joint stereo coding method using temporal envelope shaping |
US5960398A (en) * | 1996-07-31 | 1999-09-28 | Wictor Company Of Japan, Ltd. | Copyright information embedding apparatus |
US6061793A (en) * | 1996-08-30 | 2000-05-09 | Regents Of The University Of Minnesota | Method and apparatus for embedding data, including watermarks, in human perceptible sounds |
US5848155A (en) * | 1996-09-04 | 1998-12-08 | Nec Research Institute, Inc. | Spread spectrum watermark for embedded signalling |
GB2318029B (en) * | 1996-10-01 | 2000-11-08 | Nokia Mobile Phones Ltd | Audio coding method and apparatus |
KR100261253B1 (ko) | 1997-04-02 | 2000-07-01 | 윤종용 | 비트율 조절이 가능한 오디오 부호화/복호화 방법및 장치 |
KR100261254B1 (ko) * | 1997-04-02 | 2000-07-01 | 윤종용 | 비트율 조절이 가능한 오디오 데이터 부호화/복호화방법 및 장치 |
US6466912B1 (en) * | 1997-09-25 | 2002-10-15 | At&T Corp. | Perceptual coding of audio signals employing envelope uncertainty |
JP3802219B2 (ja) * | 1998-02-18 | 2006-07-26 | 富士通株式会社 | 音声符号化装置 |
JP3515903B2 (ja) * | 1998-06-16 | 2004-04-05 | 松下電器産業株式会社 | オーディオ符号化のための動的ビット割り当て方法及び装置 |
JP3784993B2 (ja) * | 1998-06-26 | 2006-06-14 | 株式会社リコー | 音響信号の符号化・量子化方法 |
KR100341197B1 (ko) * | 1998-09-29 | 2002-06-20 | 포만 제프리 엘 | 오디오 데이터로 부가 정보를 매립하는 방법 및 시스템 |
US6320965B1 (en) * | 1998-10-14 | 2001-11-20 | Liquid Audio, Inc. | Secure watermark method and apparatus for digital signals |
US6300888B1 (en) * | 1998-12-14 | 2001-10-09 | Microsoft Corporation | Entrophy code mode switching for frequency-domain audio coding |
US6363338B1 (en) * | 1999-04-12 | 2002-03-26 | Dolby Laboratories Licensing Corporation | Quantization in perceptual audio coders with compensation for synthesis filter noise spreading |
US6246345B1 (en) * | 1999-04-16 | 2001-06-12 | Dolby Laboratories Licensing Corporation | Using gain-adaptive quantization and non-uniform symbol lengths for improved audio coding |
DE19947877C2 (de) * | 1999-10-05 | 2001-09-13 | Fraunhofer Ges Forschung | Verfahren und Vorrichtung zum Einbringen von Informationen in einen Datenstrom sowie Verfahren und Vorrichtung zum Codieren eines Audiosignals |
US6499010B1 (en) * | 2000-01-04 | 2002-12-24 | Agere Systems Inc. | Perceptual audio coder bit allocation scheme providing improved perceptual quality consistency |
DE10129239C1 (de) * | 2001-06-18 | 2002-10-31 | Fraunhofer Ges Forschung | Vorrichtung und Verfahren zum Einbetten eines Wasserzeichens in ein Audiosignal |
DE10216261A1 (de) * | 2002-04-12 | 2003-11-06 | Fraunhofer Ges Forschung | Verfahren und Vorrichtung zum Einbetten von Wasserzeicheninformationen und Verfahren und Vorrichtung zum Extrahieren von eingebetteten Wasserzeicheninformationen |
KR100547113B1 (ko) * | 2003-02-15 | 2006-01-26 | 삼성전자주식회사 | 오디오 데이터 인코딩 장치 및 방법 |
DE102004021404B4 (de) * | 2004-04-30 | 2007-05-10 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Wasserzeicheneinbettung |
DE102004021403A1 (de) * | 2004-04-30 | 2005-11-24 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Informationssignalverarbeitung durch Modifikation in der Spektral-/Modulationsspektralbereichsdarstellung |
DE102004054549B3 (de) * | 2004-11-11 | 2006-05-11 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Vorrichtung und Verfahren zum Detektieren einer Manipulation eines Informationssignals |
-
1999
- 1999-10-05 DE DE19947877A patent/DE19947877C2/de not_active Expired - Lifetime
-
2000
- 2000-10-05 AT AT00969432T patent/ATE234533T1/de active
- 2000-10-05 EP EP00969432A patent/EP1212857B1/de not_active Expired - Lifetime
- 2000-10-05 WO PCT/EP2000/009771 patent/WO2001026262A2/de active IP Right Grant
- 2000-10-05 US US10/089,950 patent/US7454327B1/en not_active Expired - Lifetime
- 2000-10-05 DE DE50001467T patent/DE50001467D1/de not_active Expired - Lifetime
-
2008
- 2008-09-25 US US12/238,365 patent/US8117027B2/en not_active Expired - Fee Related
-
2009
- 2009-02-05 US US12/366,586 patent/US20090138259A1/en not_active Abandoned
-
2011
- 2011-11-21 US US13/301,324 patent/US20120065964A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0446037A2 (de) * | 1990-03-09 | 1991-09-11 | AT&T Corp. | Hybride wahrnehmungsgebundene Kodierung von Audiosignalen |
US5319735A (en) * | 1991-12-17 | 1994-06-07 | Bolt Beranek And Newman Inc. | Embedded signalling |
US5687191A (en) * | 1995-12-06 | 1997-11-11 | Solana Technology Development Corporation | Post-compression hidden data transport |
DE19640825A1 (de) * | 1996-03-07 | 1997-09-11 | Fraunhofer Ges Forschung | Codierer zur Einbringung eines nicht hörbaren Datensignals in ein Audiosignal und Decodierer zum decodieren eines nicht hörbar in einem Audiosignal enthaltenen Datensignals |
Non-Patent Citations (2)
Title |
---|
JOHNSTON J D: "TRANSFORM CODING OF AUDIO SIGNALS USING PERCEPTUAL NOISE CRITERIA" IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS,US,IEEE INC. NEW YORK, Bd. 6, Nr. 2, 1. Februar 1988 (1988-02-01), Seiten 314-323, XP002003779 ISSN: 0733-8716 * |
KATE W R TH TEN ET AL: "DIGITAL AUDIO CARRYING EXTRA INFORMATION" INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH & SIGNAL PROCESSING. ICASSP,US,NEW YORK, IEEE, Bd. CONF. 15, 3. April 1990 (1990-04-03), Seiten 1097-1100, XP000146962 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
AU2005241157B2 (en) * | 2004-04-30 | 2008-05-22 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Information signal processing by carrying out modification in the spectral/modulation spectral region representation |
AU2005241157B8 (en) * | 2004-04-30 | 2008-11-06 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Information signal processing by carrying out modification in the spectral/modulation spectral region representation |
US7676336B2 (en) | 2004-04-30 | 2010-03-09 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Watermark embedding |
DE102005055440A1 (de) * | 2005-11-21 | 2007-05-24 | Siemens Ag | Verfahren und Vorrichtungen zum Einfügen, Erkennen und Entfernen von Wasserzeichen in einem Datenstrom |
Also Published As
Publication number | Publication date |
---|---|
EP1212857A2 (de) | 2002-06-12 |
WO2001026262A3 (de) | 2001-10-25 |
US20090076801A1 (en) | 2009-03-19 |
DE50001467D1 (de) | 2003-04-17 |
DE19947877C2 (de) | 2001-09-13 |
ATE234533T1 (de) | 2003-03-15 |
US7454327B1 (en) | 2008-11-18 |
US20120065964A1 (en) | 2012-03-15 |
EP1212857B1 (de) | 2003-03-12 |
DE19947877A1 (de) | 2001-05-10 |
US20090138259A1 (en) | 2009-05-28 |
US8117027B2 (en) | 2012-02-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1212857B1 (de) | Verfahren und vorrichtung zum einbringen von informationen in einen datenstrom sowie verfahren und vorrichtung zum codieren eines audiosignals | |
EP1741215B1 (de) | Wasserzeicheneinbettung | |
DE10129239C1 (de) | Vorrichtung und Verfahren zum Einbetten eines Wasserzeichens in ein Audiosignal | |
DE60114638T2 (de) | Modulation eines oder mehrerer parameter in einem wahrnehmungsgebundenen audio- oder video-kodiersystem in antwort auf zusätzliche information | |
DE602004005197T2 (de) | Vorrichtung und verfahren zum kodieren eines audiosignals und vorrichtung und verfahren zum dekodieren eines kodierten audiosignals | |
DE60213394T2 (de) | Audiokodierung mit partieller enkryption | |
DE60313332T2 (de) | Audiocodierung mit niedriger bitrate | |
DE60117471T2 (de) | Breitband-signalübertragungssystem | |
DE102004009955B3 (de) | Vorrichtung und Verfahren zum Ermitteln einer Quantisierer-Schrittweite | |
EP1155526B1 (de) | Vorrichtung und verfahren zum erzeugen eines verschlüsselten audio- und/oder videodatenstroms | |
EP1112621A1 (de) | Vorrichtung und verfahren zum entropie-codieren von informationswörtern und vorrichtung und verfahren zum decodieren von entropie-codierten informationswörtern | |
WO2006114368A1 (de) | Verfahren und vorrichtung zur geräuschunterdrückung | |
DE19959156A1 (de) | Verfahren und Vorrichtung zum Verarbeiten eines Stereoaudiosignals | |
EP1697931A1 (de) | Vorrichtung und verfahren zum ermitteln eines sch tzwerts | |
DE102007007627A1 (de) | Steganographie in digitalen Signal-Codierern | |
DE602004009926T2 (de) | Vorrichtung und verfahren zum einbetten eines wasserzeichens unter verwendung von subbandfilterung | |
DE60126811T2 (de) | Kodierung von audiosignalen | |
DE69931932T2 (de) | Verfahren und Vorrichtung zum Dekodieren und Einfügen eines Wasserzeichens in einen Datenstrom | |
DE602004000884T2 (de) | Digitales Audiowasserzeichen | |
DE10010849C1 (de) | Vorrichtung und Verfahren zum Analysieren eines Analyse-Zeitsignals | |
EP0905918A2 (de) | Verfahren und Vorrichtung zum Kodieren von Audiosignalen | |
DE19906512C2 (de) | Verfahren zum unbemerkten Übertragen und/oder Speichern von Zusatzinformationen innerhalb eines Signals, insbesondere Audiosignals | |
DE10065363B4 (de) | Vorrichtung und Verfahren zum Decodieren eines codierten Datensignals | |
WO2002080415A2 (de) | Verfahren und vorrichtung zum ermitteln von in ein audiosignal eingebrachten informationen und verfahren und vorrichtung zum einbringen von informationen in ein audiosignal | |
EP1030290A2 (de) | Verfahren zum unbemerkten übertragen und/oder Speichern von Zusatzinformationen innerhalb eines Signals, insbesondere Audiosignals |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
AK | Designated states |
Kind code of ref document: A3 Designated state(s): US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A3 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2000969432 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2000969432 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10089950 Country of ref document: US |
|
WWG | Wipo information: grant in national office |
Ref document number: 2000969432 Country of ref document: EP |