WO1999055089A1 - Multimedia adaptive scrambling system (mass) - Google Patents

Multimedia adaptive scrambling system (mass) Download PDF

Info

Publication number
WO1999055089A1
WO1999055089A1 PCT/US1999/008635 US9908635W WO9955089A1 WO 1999055089 A1 WO1999055089 A1 WO 1999055089A1 US 9908635 W US9908635 W US 9908635W WO 9955089 A1 WO9955089 A1 WO 9955089A1
Authority
WO
WIPO (PCT)
Prior art keywords
samples
sample
scrambled
scrambling
lsbs
Prior art date
Application number
PCT/US1999/008635
Other languages
French (fr)
Inventor
S. Katherine Lam
Kamran Moallemi
Chong U. Lee
Taku Katoh
Naoki Endoh
Original Assignee
Solana Technology Development Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Solana Technology Development Corporation filed Critical Solana Technology Development Corporation
Priority to JP2000545321A priority Critical patent/JP2002512494A/en
Priority to EP99919913A priority patent/EP1095517A1/en
Priority to CA002329315A priority patent/CA2329315A1/en
Priority to KR1020007011703A priority patent/KR20010034802A/en
Priority to AU37525/99A priority patent/AU3752599A/en
Priority to MXPA00010337A priority patent/MXPA00010337A/en
Publication of WO1999055089A1 publication Critical patent/WO1999055089A1/en
Priority to US09/692,084 priority patent/US6888943B1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04KSECRET COMMUNICATION; JAMMING OF COMMUNICATION
    • H04K1/00Secret communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/06Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols the encryption apparatus using shift registers or memories for block-wise or stream coding, e.g. DES systems or RC4; Hash functions; Pseudorandom sequence generators
    • H04L9/065Encryption by serially and continuously modifying data stream elements, e.g. stream cipher systems, RC4, SEAL or A5/3
    • H04L9/0656Pseudorandom key sequence combined element-for-element with data sequence, e.g. one-time-pad [OTP] or Vernam's cipher
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2347Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving video stream encryption
    • H04N21/23476Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving video stream encryption by partially encrypting, e.g. encrypting the ending portion of a movie
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4405Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video stream decryption
    • H04N21/44055Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video stream decryption by partially decrypting, e.g. decrypting a video stream that has been partially encrypted
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/633Control signals issued by server directed to the network components or client
    • H04N21/6332Control signals issued by server directed to the network components or client directed to client
    • H04N21/6334Control signals issued by server directed to the network components or client directed to client for authorisation, e.g. by transmitting a key
    • H04N21/63345Control signals issued by server directed to the network components or client directed to client for authorisation, e.g. by transmitting a key by transmitting keys
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/167Systems rendering the television signal unintelligible and subsequently intelligible
    • H04N7/1675Providing digital key or authorisation information for generation or regeneration of the scrambling sequence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L2209/00Additional information or applications relating to cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
    • H04L2209/60Digital content management, e.g. content distribution

Definitions

  • the present invention relates to a method and apparatus for scrambling digital samples of multimedia data, e.g., such as audio or video data samples, such that the content of the samples is degraded but still recognizable.
  • multimedia data e.g., such as audio or video data samples
  • the invention is suitable for use with digital broadcast streams and digital storage media, such as compact discs (CDs) and digital video discs (DVDs) .
  • CDs compact discs
  • DVDs digital video discs
  • the number of least significant bits (LSBs) scrambled in each sample is selected such that the scrambled samples are degraded but still recognizable.
  • Schemes for communicating and storing digital data have become increasingly popular, particularly in the mass consumer market for digital audio, video, and other data. Consumers may now send, receive, store, and manipulate digital television, audio and other data content, such as computer games and other software, stock ticker data, weather data and the like. This trend is expected to continue with the integration of telephone, television and computer network resources .
  • the distance of transit can be half way around the world, as with delivery on the Internet, or millimeters, such as within a DVD player's internal data transfer from disc to DAC (Digital to Analog Converter) .
  • DAC Digital to Analog Converter
  • the scrambling key prefferably associated with the scrambled data to allow the scrambling key to be easily changed without modifying the player (e.g., DVD or CD player) on which the data is played.
  • the scrambled data should not damage the video or audio equipment even if it is played through any video or audio playback system. Some randomly scrambled waveforms can result in such damage, e.g., to speakers or circuitry.
  • the scrambled data could be any conceivable digital data. It would be desirable for the data to be scrambled at any time, including, for example, when the data signal is created (e.g., during a recording session for an audio track) , when the data signal is being distributed (e.g., during a broadcast, or during manufacture of storage media such as compact discs), or when the data is being played (e.g., on a player in a consumer's home) .
  • the present invention provides a system having the above and other advantages .
  • a method for protecting digital samples of content from illicit use by scrambling the content wherein each sample includes a plurality of bits, ranging from least significant bits (LSBs) to most significant bits.
  • the method includes the step of scrambling a number of LSBs in each sample according to a scrambling key, while preserving a number of MSBs in each sample, to provide corresponding scrambled samples.
  • the number of LSBs scrambled in each sample is provided such that the scrambled samples are degraded but still recognizable .
  • the number of LSBs to be scrambled in each sample may be adaptively determined according to the dynamic range of the sample.
  • the number of LSBs to be scrambled in each sample may be adaptively determined according to the particular frame a sample is in, where different frames can have a different number of LSBs scrambled.
  • the scrambling key may be a pseudo-random scrambling key, for example.
  • the LSBs may be scrambled within the same sample using intra-sample scrambling.
  • the LSBs may be scrambled between different samples using inter- sample scrambling.
  • inter-sample scrambling is horizontal inter-sample scrambling, where bits having the same weight are interchanged between samples .
  • the scrambling key may be embedded into the scrambled samples for use at a decoder in descrambling the scrambled samples.
  • the scrambling key for a current frame of scrambled samples may be embedded into a previous frame of samples. This avoids a delay in recovering the key at the decoder.
  • a corresponding descrambling method, and corresponding apparatuses are also presented.
  • FIG. 1 illustrates adaptive bit modification for successive data samples in successive data frames in accordance with the present invention.
  • FIG. 2(a) illustrates intra-sample scrambling in accordance with the present invention.
  • FIG. 2(b) illustrates original, unscrambled samples .
  • FIG. 2(c) illustrates the samples of FIG. 2(b) after horizontal, inter-sample scrambling in accordance with the present invention.
  • FIG. 3 illustrates a data scrambler and scramble key encoder in accordance with the present invention.
  • FIG. 4 illustrates a data descrambler and scramble key decoder in accordance with the present invention.
  • FIG. 5 illustrates a detailed data scrambler in accordance with the present invention.
  • FIG. 6 illustrates a detailed data descrambler in accordance with the present invention.
  • FIG. 7 illustrates adaptive bit modification with a fixed minimum dynamic range for successive data samples in successive data frames in accordance with the present invention.
  • the present invention relates to a method and apparatus for scrambling digital samples of multimedia data.
  • This subject matter discussed in the following patents and patent applications, each of which is incorporated herein by reference, may be adapted for use with the present invention: U.S. Patent 5,822,360, entitled “Method and Apparatus for Transporting Auxiliary Data in Audio Signals”; application no. 08/764,096, filed December 6, 1996 entitled “Method and Apparatus for Embedding Auxiliary Data in a Primary Data Signal”; U.S. Patent 5,687,191, entitled “Post Compression Hidden Data Transport”; application no. 08/912,434, filed August 18, 1997, entitled “Post Compression Hidden Data Transport for Video”; U.S.
  • Patent 5,719,937 entitled “Multi-Media Copy Management System”; application no. 08/977,719, filed November 25, 1997, entitled “Multi-Media Copy Management System”, and application no. , filed , entitled “Digital Hidden Data Transport” .
  • Similar systems for providing embedded information may also be adapted for use with the present invention. Audio, video or other digital content is scrambled to degrade its quality, but still allow a listener, viewer, or other user to recognize the content .
  • Selective scrambling of a content waveform consists of preservation of some of the MSBs (up to and including the sign bit) and scrambling of some or all of the remaining LSBs.
  • the scrambling noise is maintained at a desired level compared to the original data (e.g., audio, video or other data) .
  • Each data sample's M most significant bits are dynamically preserved. The number M can be chosen before processing begins as a preset parameter, or can vary during processing.
  • Dynamic preservation of MSBs involves performing amplitude range detection on each sample and preserving (or masking) M of the most significant bits within the range of the sample, as shown in Figure 1.
  • M may vary from 0 to the full dynamic range of the digitized samples.
  • M is the number of bits preserved in each sample's dynamic range and can be varied (for example, frame to frame) during processing.
  • M can be part of the information embedded in the content material for the decoder to use.
  • the digital content samples may be in any conceivable compressed or uncompressed digital format, including Pulse Code Modulation (PCM) samples, samples in floating point representation, samples in companding schemes (e.g., ⁇ -law and A- law) , and other compressed bit streams as described below.
  • PCM Pulse Code Modulation
  • a group of uncompressed signal samples are represented by a group of frequency samples, which are quantized according to the perceptual criteria for efficient storage and transmission.
  • the ratio between the number of frequency samples required to represent the number of signal samples are usually fixed, e.g., at one. However, the number of frequency samples actually selected for transmission may be less, since some of the perceptually unimportant frequency samples are often not transmitted.
  • This can be determined by extracting the bit allocation information contained in the compressed bit stream.
  • the frequency samples that are not transmitted usually have zero bits allocated, or otherwise indicated as zeros (e.g., a run length is indicated for a series of zeros) .
  • a binary representation of the frequency samples can be extracted with an augmentation information that indicates the number of bits allocated, dynamic range of the frequency 10
  • the process of partial scrambling is no differen than the process that applies to the uncompressed domain signal samples, e.g., as with a PCM representation.
  • FIG. 1 illustrates adaptive bit modification for successive data samples in successive data frames in accordance with the present invention.
  • Samples of digital data are selectively scrambled such that some of the Most Significant Bits (MSBs) are preserved, and some or all of the remaining data bits (e.g., LSBs) are scrambled.
  • MSBs Most Significant Bits
  • LSBs remaining data bits
  • the key to unscramble the data can be concealed into the scrambled signal (e.g., using the techniques discussed in the aforementioned patents and applications) so that the key is no longer decodable once the content data is unscrambled.
  • the horizontal axis designates successive frames and samples of digital data.
  • each frame has fifteen samples, and each sample has twenty-four bits, although the present invention can accommodate any variation of these parameters .
  • Each sample has a dynamic range between zero to twenty-four bits which is defined by the most significant non-zero bit, not including a sign bit, which may be the leftmost bit in each sample. 11
  • An original waveform 110 designates the dynamic range of each sample prior to scrambling in accordance with the present invention.
  • Regions 120 and 125 designate the bits in each sample which are not modified, while a region 130 designates the bits in each sample which may be scrambled in accordance with the present invention.
  • the first sample 115 of FRAME A has a dynamic range of 18 bits .
  • An example of such a sample might be:
  • the specific number of bits which are not modified can be selected by experimentation to yield data with a desired level of degradation.
  • the bits in the region 130 are subject to scrambling as discussed in greater detail below.
  • the selectively scrambled samples appear noisy.
  • audio samples will sound noisy to the listener, e.g., when played on a player in the user's home.
  • the samples will sound noisier for samples where fewer MSBs are preserved, although the perception of the noise can vary based on the dynamic range of the each sample as well as the neighboring samples, the type of audio being played, the listening environment and other factors .
  • the noise is generally not objectionable for player functions such as cueing and fast forward playback.
  • fast forward playback or fast reverse, if provided
  • there is insufficient time for the player to descramble the samples During normal playback, the player has sufficient time to descramble the samples, so the content is heard or seen with its full dynamic range.
  • the selectively scrambled content material limits the amplitude of the scrambled waveform such that it does not exceed the dynamic range of the original waveform.
  • the scrambled content does not damage the video or audio equipment even if it is played through any video or audio playback system.
  • Scrambling of the data bits can be done within each sample (intra-sample scrambling) or within a group of samples (inter-sample scrambling) . Furthermore, a combination of intra-sample and inter-sample scrambling can be used.
  • Scrambling may take the form of interchanging the position of the data bits (inter-sample scrambling) , masking the data bits with a sequence derived from the scramble key or parts of a scramble key (intra-sample scrambling) , or combinations thereof.
  • the purpose is to randomize or whiten the statistics of the scrambled data bits to make it
  • the descrambler must undo this mapping of the bits .
  • Random or pseudo-random scrambling improves the security of the scrambled data since it will be more difficult for an attacker to detect patterns in the scrambled data.
  • FIG. 2(a) illustrates intra-sample scrambling in accordance with the present invention.
  • An original sample 200 includes bits 31 7 31 6 31 5 31 4 81 3 31 2 81,51 0 , where "SI" denotes "sample
  • FIG. 2(b) illustrates original, unscrambled samples. Like-numbered elements correspond to one another in the figures.
  • FIG. 2(c) illustrates the samples of FIG. 2(b) after horizontal, inter-sample scrambling in accordance with the present invention.
  • Samples 1 (200'), 2 (260') and 3 (270') correspond to Samples 1 (200), 2 (260) and 3 (270) , respectively.
  • the waveform samples are grouped into frames.
  • Each frame is associated with a scramble key, such as a pseudorandom key.
  • the scramble key can be different for each frame and is determined at encoding time.
  • a particularly useful case of inter-sample scrambling is horizontal scrambling, where the bits with the same weight are interchanged among the samples .
  • bit Sl 0 replaces bit S3 0
  • bit SI replaces bit S3 ⁇
  • bit Sl 2 replaces bit S2 2 , and so forth.
  • FIG. 3 illustrates a data scrambler and scramble key encoder in accordance with the present invention.
  • the scramble key is embedded into a scrambled audio content .
  • the scrambler/encoder 300 includes a scramble key generator 310 for generating a scramble key.
  • the scramble key does not have to be the same length as the sample length. A longer scramble key length makes the data more secure.
  • the scramble key is provided to a key buffer
  • the scramble key is provided to a scrambler for scrambling the samples in the original waveform, e.g., as discussed in connection with FIGs 2 (a) -(c) .
  • the same scramble key may be used to scramble a number of samples in a frame.
  • the scrambled waveform is provided to a scramble key encoder 340 to encode the scramble key into the waveform, thereby providing the scrambled waveform with the embedded scramble key.
  • the scramble key may be encoded as auxiliary data in the waveform using the techniques discussed in the aforementioned U.S. patents and applications.
  • the scramble key is concealed by the noise-like scrambled content .
  • FIG. 4 illustrates a data descrambler and scramble key decoder in accordance with the present invention.
  • a descrambler/decoder 400 includes a scramble key decoder 410 that receives the scrambled waveform, e.g., from the scrambler/encoder 300 of FIG. 3.
  • the scrambled waveform may be communicated via any communication channel, and/or recovered from a storage medium, for example.
  • the scramble key decoder 410 recovers the scramble key that was used to scramble the following frame and stores it in a key buffer 420.
  • the scramble key decoder 410 operates using the corresponding technique used by the scramble key encoder 340.
  • the scramble key is retrieved from the buffer 420 for use by a descrambler 430 in descrambling the current frame of samples to provide the descrambled waveform.
  • the descrambled waveform may undergo subsequent processing, such as digital-to-analog conversion, e.g., for viewing or listening by a user.
  • the scramble key is no longer recoverable even by an attacker who has the scramble key decoder 410 17
  • the scramble key is scrambled by the descrambler 430.
  • FIG. 5 illustrates a detailed data scrambler in accordance with the present invention.
  • successive samples each having W bits (sample width)
  • W bits sample width
  • Non-scrambled buffered samples are output from the sample frame buffer 510 according to a linear address generator 515 for scrambling at a scrambler 330 according to a scrambling key.
  • Buffered samples in a pseudo-random order within a frame are output from the sample frame buffer 510' according to addresses from a scramble address generator 525, which receives the scramble key.
  • the buffered samples are bit-wise ANDed at an AND function 530 with a mask bit string for the LSBs (LSB_MASK) to produce LSBs that are interchanged with other samples within the current frame.
  • LSB_MASK is a bit string with l's corresponding to the LSBs to be scrambled in the buffered samples, and O's for the other bits in the buffered samples.
  • a range detector and mask generator function 535 provides LSB_MASK, along with a mask bit string for the MSBs which are to be preserved (i.e., not scrambled) , MSB_MASK.
  • MSB_MASK is a bit string with 1 ' s corresponding to the MSBs to be preserved in the buffered samples, and O's for the other bits in the buffered samples . 18
  • MSB_MASK is bit-wise ANDed with the buffered samples from the sample frame buffer 510 at an AND function 540 to produce the preserved MSBs.
  • Scrambled samples from the scrambler 330 are bit wise ANDed at an AND function 545 with MSB_MASK/ (the inverse of MSB_MASK) and LSB_MASK/ (the inverse of LSB_MASK) .
  • MSB_MASK/ and LSB_MASK/ are obtained from the inverters 550 and 555, respectively.
  • the output of the AND function 545 comprising the scrambled middle bits is provided to a bit-wise OR function 560 for combining with the preserved MSBs and the LSBs that are interchanged with other samples in a frame.
  • the output of the OR function 560 comprises the scrambled samples, which may be provided to the scramble key encoder 340 to provide scrambled samples with the embedded scrambling key.
  • the samples are now ready, e.g., for transmission across a network, or storage on a storage medium.
  • the scrambled key may be embedded in the scrambled samples by providing a scramble key encoder (such as element 340 in FIG. 3) . Note that the embedding of the scrambling key is optional.
  • one method to selectively scramble the audio is to preserve the sign bit and, e.g., two most significant bits of each sample.
  • Amplitude range detection is performed on each audio sample. A mask is generated for each sample corresponding to the amplitude range of that 19
  • MSB_MASK Hexadecimal
  • Each sample has sixteen bits, where the leftmost bit is a sign bit. For example, for the sample value, 0xff98 in hexadecimal, or 1111111110011000 in binary, bitl ⁇ ("1") indicates that this is a negative number, i.e., negative 0x61, or -97 in decimal. Thus, the dynamic range is seven bits (bitO to bit ⁇ ) .
  • the remaining bits are separated into two groups - the least significant bit, and all other remaining bits.
  • the least significant bit is scrambled horizontally by exchanging positions within a frame. Inter-frame scrambling may also be used.
  • the other remaining bits are scrambled by XORing with a bit pattern which is generated from all or part of the scramble key.
  • a linear shift register can be used to vary the bit pattern for each sample. 20
  • the scrambled output consists of 1) the preserved MSBs, 2) the intra- sample scrambled middle bits, and 3) the horizontal inter-sample scrambled LSBs.
  • FIG. 6 illustrates a detailed data descrambler
  • the descrambler may be used for processing data received from the scrambler 500, for example.
  • Elements 610, 510' ', 515', 530' 535', 540', 545', 550', 555' and 560' correspond to elements 510, 510', 515, 530, 535, 540, 545, 550, 555 and 560, respectively in FIG. 5.
  • the scramble key is decoded from the scrambled samples at the scramble key decoder 410, and provided to a buffer 420, and then to the descrambler 430.
  • a linear address generator 515' is used, if necessary, for providing an address to a sample frame buffer 610 to restore the bit pattern for each received sample.
  • the received, scrambled samples are provided from the sample frame buffer 610 to the range detect/mask generator function 535'.
  • the preserved MSBs in each sample are identified the same way as at the scrambler, by using amplitude range detection.
  • the descrambled middle bits in each sample are combined at the OR function 560' with the preserved MSBs and the reordered LSBs .
  • the inverse MSB mask (MSB_MASK/) is provided at the output of an inverter 550' to an AND function 545' for ANDing with the descrambled samples.
  • the output of the AND function 545 ' is provided to the 21
  • OR function 560' for ORing with the preserved MSBs and the reordered LSBs within a frame.
  • the reordered LSBs within a frame are derived from ORing LSB_MASK with the reordered buffered samples, which are derived from the sample frame buffer 510'' in response to addresses from a descramble address generator 625.
  • the LSB's position in a frame is restored, and the descrambled output is obtained by combining the three components at the OR 560' .
  • FIG. 7 illustrates adaptive bit modification with a fixed minimum dynamic range for successive data samples in successive data frames in accordance with the present invention.
  • the preserved dynamic range of the MSBs can be fixed, e.g., at 16 bits.
  • N the number of MSBs to be preserved, can be fixed as a preset parameter before processing (N may vary from 0 to the full dynamic range of the digitized samples) .
  • N 8 in the example shown.
  • the original waveform 110 indicates the dynamic range of each sample prior to scrambling.
  • Region 720 designates the bits in each sample which are not modified, while a region 730 designates the bits in each sample which may be scrambled. For example, for FRAME A, bitl5 (corresponding to a dynamic range of 16) and higher in each sample are not modified, while bitO through bit 14 are modified. For FRAME B and FRAME C, all of the bits are modified, e.g., up to the dynamic range of each sample. 22
  • An advantage of this scheme is that there is no need to determine the dynamic range of each sample at the encoder and decoder.
  • the invention may be implemented with various other alternatives and enhancements, as follows.
  • the number of MSBs to be preserved (N) can be dynamic, varying from frame to frame.
  • scrambling can be done across video frames.
  • Amplitude range detect and mask generation can be a look-up-table with heuristic rules.
  • Scrambling frames can vary in length.
  • Horizontal scrambling can be done on any number of LSBs .
  • All or part of the scramble key can be hidden in the same frame, the previous frame, or any other frame of the content .
  • the implementation hinges on the amount of buffer memory available and the throughput delay requirement .
  • the key can be hidden electronically within sector data or physically with the use of techniques such as pit width modulation.
  • All or part of the scramble key for one stream of the content can be hidden in any separated media such as a pre-paid card.
  • the key may also be a product of a transaction authorization via telephone, Internet, or any other communication means .
  • Scrambling can be done between two or more channels of the same data stream (e.g., front left and right channels of a multi-channel audio segment) .
  • Scrambling can be selectively done for selected channels of a multi-channel stream (e.g., front left and front right channels are scrambled but center, rear left, rear right and subwoofer channels are not) .
  • Scramble Keys can be generated with either non-linear shift registers or non-linear feedback shift registers.
  • side information coded in the compressed stream can simplify the range detection process.
  • bit allocation information For contents in a compressed form, side information coded in the compressed stream, such as bit allocation information, can simplify the range detection process.
  • bit allocation information For some frequency 24
  • the modified frequency samples must be re-packaged to conform to the original bit stream format . This in most cases should not require re-quantization, just re- packetization. This process will be specific to the compression technique used. Some compression schemes may require variable length encoding, such as Huffman code, and specific measures must be taken if the size of the compressed bit stream must remain unchanged. Most compression schemes inherently produce variable length bit streams, and the subsequent transport stream format usually accommodates the change in the size of the bit stream.
  • One side benefit of applying the partial scrambling technique of the present invention to the compressed bit stream may be a slightly easier self synchronization at the decoder. This may occur since the frame structure or the packet structure present in the compressed bit stream format can make it easier for the decoder to determine the scrambling frame boundary.
  • the present invention provides a system for scrambling digital samples of multimedia data, including audio and 25
  • the quality level may be associated with a particular signal to noise ratio, or quality level that is determined by objective and/or subjective tests, for example.
  • a number of LSBs can be scrambled in successive samples in successive frames.
  • the parameters for scrambling may change from frame to frame.
  • the scrambling key can be embedded in the scrambled data and recovered at a decoder to descramble the scrambled samples. After descrambling, the scramble key is no longer recoverable because the scramble key is scrambled by the descrambler.

Abstract

A system (300, 500) for scrambling digital samples (115, 200, 250, 260, 270) of multimedia data, including audio and video data samples, such that the content of the samples is degraded but still recognizable, or otherwise provided at a desired quality level. The samples may be in any conceivable compressed or uncompressed digital format, including Pulse Code Modulation (PCM) samples, samples in floating point representation, samples in companding schemes (e.g., ν-law and A-law), and other compressed bit streams. The quality level may be associated with a particular signal to noise ratio, or quality level that is determined by objective and/or subjective tests, for example. A number of LSBs can be scrambled in successive samples in successive frames (FRAME A, FRAME B, FRAME C). Moreover, the parameters for scrambling may change from frame to frame. Furthermore, all or part of the scrambling key (310) can be embedded (340) in the scrambled data and recovered at a decoder (400, 600) to be used in descrambling. After descrambling, the scramble key is no longer recoverable because the scramble key itself is scrambled by the descrambler.

Description

MULTIMEDIA ADAPTIVE SCRAMBLING SYSTEM (MASS)
BACKGROUND OF THE INVENTION
This application claims the benefit of U.S. Provisional Application No. 60/082,488, filed April 21, 1998.
The present invention relates to a method and apparatus for scrambling digital samples of multimedia data, e.g., such as audio or video data samples, such that the content of the samples is degraded but still recognizable. For example, the invention is suitable for use with digital broadcast streams and digital storage media, such as compact discs (CDs) and digital video discs (DVDs) . The number of least significant bits (LSBs) scrambled in each sample is selected such that the scrambled samples are degraded but still recognizable.
Schemes for communicating and storing digital data have become increasingly popular, particularly in the mass consumer market for digital audio, video, and other data. Consumers may now send, receive, store, and manipulate digital television, audio and other data content, such as computer games and other software, stock ticker data, weather data and the like. This trend is expected to continue with the integration of telephone, television and computer network resources .
However, in many cases it is desirable to control or monitor the use of such digital data. In particular, copyright holders and other proprietary interests have the right to control the distribution and use of their works, including audio, video and literary works.
In a copyright management system where audio and video content are to be protected, it would be desirable to provide data scrambling to deter theft of the content while it is in transit. The distance of transit can be half way around the world, as with delivery on the Internet, or millimeters, such as within a DVD player's internal data transfer from disc to DAC (Digital to Analog Converter) .
It would be desirable to provide a method and apparatus that renders the audio/video content unsuitable for listening/viewing purpose but sufficient for identification of an audio/video passage, e.g., during fast forward playback, when there is insufficient time to descramble the samples .
It would be desirable to scramble bits in successive frames of digital data samples according to a scrambling key, where the scrambling key is embedded into the scrambled signal.
It would be desirable for the scrambling key to be associated with the scrambled data to allow the scrambling key to be easily changed without modifying the player (e.g., DVD or CD player) on which the data is played.
It would be desirable to scramble data such that the content is degraded sufficiently so that it no longer has any significant commercial value, but, at the same time, is perceptually satisfactory for player functions such as cueing and fast forward.
The scrambled data should not damage the video or audio equipment even if it is played through any video or audio playback system. Some randomly scrambled waveforms can result in such damage, e.g., to speakers or circuitry.
It would further be desirable for the scrambled data to be any conceivable digital data. It would be desirable for the data to be scrambled at any time, including, for example, when the data signal is created (e.g., during a recording session for an audio track) , when the data signal is being distributed (e.g., during a broadcast, or during manufacture of storage media such as compact discs), or when the data is being played (e.g., on a player in a consumer's home) .
The present invention provides a system having the above and other advantages .
SUMMARY OF THE INVENTION
A method for protecting digital samples of content from illicit use by scrambling the content is provided, wherein each sample includes a plurality of bits, ranging from least significant bits (LSBs) to most significant bits. The method includes the step of scrambling a number of LSBs in each sample according to a scrambling key, while preserving a number of MSBs in each sample, to provide corresponding scrambled samples. The number of LSBs scrambled in each sample is provided such that the scrambled samples are degraded but still recognizable .
The number of LSBs to be scrambled in each sample may be adaptively determined according to the dynamic range of the sample.
Alternatively, or in addition, the number of LSBs to be scrambled in each sample may be adaptively determined according to the particular frame a sample is in, where different frames can have a different number of LSBs scrambled.
The scrambling key may be a pseudo-random scrambling key, for example.
The LSBs may be scrambled within the same sample using intra-sample scrambling.
Alternatively, or in addition, the LSBs may be scrambled between different samples using inter- sample scrambling.
A particular type of inter-sample scrambling is horizontal inter-sample scrambling, where bits having the same weight are interchanged between samples .
The scrambling key may be embedded into the scrambled samples for use at a decoder in descrambling the scrambled samples.
In particular, the scrambling key for a current frame of scrambled samples may be embedded into a previous frame of samples. This avoids a delay in recovering the key at the decoder. A corresponding descrambling method, and corresponding apparatuses are also presented.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 illustrates adaptive bit modification for successive data samples in successive data frames in accordance with the present invention. FIG. 2(a) illustrates intra-sample scrambling in accordance with the present invention.
FIG. 2(b) illustrates original, unscrambled samples .
FIG. 2(c) illustrates the samples of FIG. 2(b) after horizontal, inter-sample scrambling in accordance with the present invention.
FIG. 3 illustrates a data scrambler and scramble key encoder in accordance with the present invention. FIG. 4 illustrates a data descrambler and scramble key decoder in accordance with the present invention.
FIG. 5 illustrates a detailed data scrambler in accordance with the present invention. FIG. 6 illustrates a detailed data descrambler in accordance with the present invention.
FIG. 7 illustrates adaptive bit modification with a fixed minimum dynamic range for successive data samples in successive data frames in accordance with the present invention. DETAILED DESCRIPTION OF THE INVENTION
The present invention relates to a method and apparatus for scrambling digital samples of multimedia data. This subject matter discussed in the following patents and patent applications, each of which is incorporated herein by reference, may be adapted for use with the present invention: U.S. Patent 5,822,360, entitled "Method and Apparatus for Transporting Auxiliary Data in Audio Signals"; application no. 08/764,096, filed December 6, 1996 entitled "Method and Apparatus for Embedding Auxiliary Data in a Primary Data Signal"; U.S. Patent 5,687,191, entitled "Post Compression Hidden Data Transport"; application no. 08/912,434, filed August 18, 1997, entitled "Post Compression Hidden Data Transport for Video"; U.S. Patent 5,719,937, entitled "Multi-Media Copy Management System"; application no. 08/977,719, filed November 25, 1997, entitled "Multi-Media Copy Management System", and application no. , filed , entitled "Digital Hidden Data Transport" . Similar systems for providing embedded information may also be adapted for use with the present invention. Audio, video or other digital content is scrambled to degrade its quality, but still allow a listener, viewer, or other user to recognize the content .
Selective scrambling of a content waveform consists of preservation of some of the MSBs (up to and including the sign bit) and scrambling of some or all of the remaining LSBs. The scrambling noise is maintained at a desired level compared to the original data (e.g., audio, video or other data) . Each data sample's M most significant bits are dynamically preserved. The number M can be chosen before processing begins as a preset parameter, or can vary during processing.
Dynamic preservation of MSBs involves performing amplitude range detection on each sample and preserving (or masking) M of the most significant bits within the range of the sample, as shown in Figure 1. M may vary from 0 to the full dynamic range of the digitized samples. M is the number of bits preserved in each sample's dynamic range and can be varied (for example, frame to frame) during processing. Moreover, as discussed further below, M can be part of the information embedded in the content material for the decoder to use.
The digital content samples may be in any conceivable compressed or uncompressed digital format, including Pulse Code Modulation (PCM) samples, samples in floating point representation, samples in companding schemes (e.g., μ-law and A- law) , and other compressed bit streams as described below.
Most of the prevailing compression systems, for audio or video or images, tend to use frequency domain techniques to reduce the perceptually redundant information from the signal being compressed. Therefore, a majority of the compressed bit streams can be parsed and decoded into a set of parameters that include a set of frequency samples or transform coefficients. Examples are subband samples in MPEG audio coding, TDAC transform coefficients in AC-3 or AAC audio coding, and DCT coefficients in JPEG and MPEG image and video coding. These representations can be generalized as "frequency samples" .
In a generalized compression scheme, a group of uncompressed signal samples are represented by a group of frequency samples, which are quantized according to the perceptual criteria for efficient storage and transmission. The ratio between the number of frequency samples required to represent the number of signal samples are usually fixed, e.g., at one. However, the number of frequency samples actually selected for transmission may be less, since some of the perceptually unimportant frequency samples are often not transmitted. This can be determined by extracting the bit allocation information contained in the compressed bit stream. The frequency samples that are not transmitted usually have zero bits allocated, or otherwise indicated as zeros (e.g., a run length is indicated for a series of zeros) . In essence, from the compressed bit stream, a binary representation of the frequency samples can be extracted with an augmentation information that indicates the number of bits allocated, dynamic range of the frequency 10
sample, or the scale factor needed to restore the frequency sample to it full value.
Once the binary representation of the frequency samples are extracted, the process of partial scrambling is no differen than the process that applies to the uncompressed domain signal samples, e.g., as with a PCM representation.
FIG. 1 illustrates adaptive bit modification for successive data samples in successive data frames in accordance with the present invention. Samples of digital data are selectively scrambled such that some of the Most Significant Bits (MSBs) are preserved, and some or all of the remaining data bits (e.g., LSBs) are scrambled. In addition, the key to unscramble the data can be concealed into the scrambled signal (e.g., using the techniques discussed in the aforementioned patents and applications) so that the key is no longer decodable once the content data is unscrambled. In FIG. 1, the horizontal axis designates successive frames and samples of digital data. In this example, three frames are shown (FRAME Ay FRAME B and FRAME C) , each frame has fifteen samples, and each sample has twenty-four bits, although the present invention can accommodate any variation of these parameters . Each sample has a dynamic range between zero to twenty-four bits which is defined by the most significant non-zero bit, not including a sign bit, which may be the leftmost bit in each sample. 11
An original waveform 110 designates the dynamic range of each sample prior to scrambling in accordance with the present invention. Regions 120 and 125 designate the bits in each sample which are not modified, while a region 130 designates the bits in each sample which may be scrambled in accordance with the present invention.
For example, the first sample 115 of FRAME A has a dynamic range of 18 bits . An example of such a sample might be:
0a220310ao0190l17016015l14l112011010l9lβ070β0sl4l302010ol where the subscripts denotes the bit position, ranging from bitO (00) for the LSB to bitl7 (117) for the MSB. As shown by the region 125 which extends across
FRAMES A, B and C, the number of MSBs which are not modified (e.g., preserved) for each frame may vary with each frame. For example, for FRAME A, M=2 MSBs are not modified, for FRAME B, M=3 MSBs are not modified, and for FRAME C, M=2 MSBs are not modified. The number of bits that are not modified in each frame may therefore be adaptive. In particular, the number of bits which are not modified may be inversely proportional to the maximum dynamic range of the frame. For example, for FRAME A, the maximum dynamic range is 22 bits, and M=2, while for FRAME B, the maximum dynamic range is only 15 bits, and M=3.
It is also possible to set M to a constant for each frame for simplicity. 12
Generally, the specific number of bits which are not modified can be selected by experimentation to yield data with a desired level of degradation. The bits in the region 130 are subject to scrambling as discussed in greater detail below.
Perceptually, the selectively scrambled samples appear noisy. For example, audio samples will sound noisy to the listener, e.g., when played on a player in the user's home. Generally, the samples will sound noisier for samples where fewer MSBs are preserved, although the perception of the noise can vary based on the dynamic range of the each sample as well as the neighboring samples, the type of audio being played, the listening environment and other factors .
The noise is generally not objectionable for player functions such as cueing and fast forward playback. During fast forward playback (or fast reverse, if provided) , there is insufficient time for the player to descramble the samples. During normal playback, the player has sufficient time to descramble the samples, so the content is heard or seen with its full dynamic range.
In accordance with the present invention, instead of scrambling the content over its entire dynamic range, a portion of the range is preserved so that the content is degraded but still recognizable, e.g., during fast forward playback. This allows the user to conveniently fast forward through audio or video content to locate a precise segment of interest. 13
Furthermore, the selectively scrambled content material limits the amplitude of the scrambled waveform such that it does not exceed the dynamic range of the original waveform. Thus, unlike a randomly scrambled waveform, the scrambled content does not damage the video or audio equipment even if it is played through any video or audio playback system.
Scrambling of the data bits can be done within each sample (intra-sample scrambling) or within a group of samples (inter-sample scrambling) . Furthermore, a combination of intra-sample and inter-sample scrambling can be used.
Scrambling may take the form of interchanging the position of the data bits (inter-sample scrambling) , masking the data bits with a sequence derived from the scramble key or parts of a scramble key (intra-sample scrambling) , or combinations thereof. The purpose is to randomize or whiten the statistics of the scrambled data bits to make it
"look" more random. The descrambler must undo this mapping of the bits .
Random or pseudo-random scrambling improves the security of the scrambled data since it will be more difficult for an attacker to detect patterns in the scrambled data.
FIG. 2(a) illustrates intra-sample scrambling in accordance with the present invention. An original sample 200 includes bits 31731631531481331281,510, where "SI" denotes "sample
1". For simplicity, the sample is shown having only 14
eight bits, although any number of bits may be used for each sample. Additionally, assume M=3, which means the three MSBs (i.e., S17S16S15) are not modified, but the remaining bits (i.e., S14S13S12S11S10) are. Sl7 is assumed to be the MSB of the sample. After intra-sampling scrambling, the modified sample 250 may be obtained, which includes bits Sl.SlsSlsSloSl.Sl.SljSl,. The modified bits may be scrambled using any known scrambling technique. FIG. 2(b) illustrates original, unscrambled samples. Like-numbered elements correspond to one another in the figures. Sample 1 (200), Sample 2 (260), and Sample 3 (270) are shown. FIG. 2(c) illustrates the samples of FIG. 2(b) after horizontal, inter-sample scrambling in accordance with the present invention. Samples 1 (200'), 2 (260') and 3 (270') correspond to Samples 1 (200), 2 (260) and 3 (270) , respectively.
For inter-sample scrambling, the waveform samples are grouped into frames. Each frame is associated with a scramble key, such as a pseudorandom key. The scramble key can be different for each frame and is determined at encoding time. A particularly useful case of inter-sample scrambling is horizontal scrambling, where the bits with the same weight are interchanged among the samples .
For example, bit Sl0 replaces bit S30, bit SI, replaces bit S3ι; bit Sl2 replaces bit S22, and so forth. 15
Note that it is also possible to use non- horizontal scrambling, wherein the weight of the scrambled bits is not maintained.
FIG. 3 illustrates a data scrambler and scramble key encoder in accordance with the present invention. In one possible implementation, the scramble key is embedded into a scrambled audio content .
A major advantage of using partially scrambled samples is that all or part of a key to descramble the samples can be concealed within the scrambled samples themselves. This is important because the scramble key is protected before and after descrambling. The scrambler/encoder 300 includes a scramble key generator 310 for generating a scramble key.
The scramble key does not have to be the same length as the sample length. A longer scramble key length makes the data more secure. The scramble key is provided to a key buffer
320, which stores the key, e.g., for one frame. In this manner, the key for scrambling a current frame is carried in the previous frame. After a one (or more) frame delay, the scramble key is provided to a scrambler for scrambling the samples in the original waveform, e.g., as discussed in connection with FIGs 2 (a) -(c) . Generally, the same scramble key may be used to scramble a number of samples in a frame. The scrambled waveform is provided to a scramble key encoder 340 to encode the scramble key into the waveform, thereby providing the scrambled waveform with the embedded scramble key. For example, the scramble key may be encoded as auxiliary data in the waveform using the techniques discussed in the aforementioned U.S. patents and applications.
The scramble key is concealed by the noise-like scrambled content .
FIG. 4 illustrates a data descrambler and scramble key decoder in accordance with the present invention. A descrambler/decoder 400 includes a scramble key decoder 410 that receives the scrambled waveform, e.g., from the scrambler/encoder 300 of FIG. 3. The scrambled waveform may be communicated via any communication channel, and/or recovered from a storage medium, for example.
The scramble key decoder 410 recovers the scramble key that was used to scramble the following frame and stores it in a key buffer 420. The scramble key decoder 410 operates using the corresponding technique used by the scramble key encoder 340.
The scramble key is retrieved from the buffer 420 for use by a descrambler 430 in descrambling the current frame of samples to provide the descrambled waveform. The descrambled waveform may undergo subsequent processing, such as digital-to-analog conversion, e.g., for viewing or listening by a user.
Advantageously, after descrambling, the scramble key is no longer recoverable even by an attacker who has the scramble key decoder 410 17
because the scramble key is scrambled by the descrambler 430.
FIG. 5 illustrates a detailed data scrambler in accordance with the present invention. In the scrambler 500, successive samples, each having W bits (sample width) , are provided to sample frame buffers 510 and 510'. Non-scrambled buffered samples are output from the sample frame buffer 510 according to a linear address generator 515 for scrambling at a scrambler 330 according to a scrambling key.
Buffered samples in a pseudo-random order within a frame are output from the sample frame buffer 510' according to addresses from a scramble address generator 525, which receives the scramble key. The buffered samples are bit-wise ANDed at an AND function 530 with a mask bit string for the LSBs (LSB_MASK) to produce LSBs that are interchanged with other samples within the current frame. LSB_MASK is a bit string with l's corresponding to the LSBs to be scrambled in the buffered samples, and O's for the other bits in the buffered samples.
A range detector and mask generator function 535 provides LSB_MASK, along with a mask bit string for the MSBs which are to be preserved (i.e., not scrambled) , MSB_MASK. MSB_MASK is a bit string with 1 ' s corresponding to the MSBs to be preserved in the buffered samples, and O's for the other bits in the buffered samples . 18
MSB_MASK is bit-wise ANDed with the buffered samples from the sample frame buffer 510 at an AND function 540 to produce the preserved MSBs.
Scrambled samples from the scrambler 330 are bit wise ANDed at an AND function 545 with MSB_MASK/ (the inverse of MSB_MASK) and LSB_MASK/ (the inverse of LSB_MASK) . MSB_MASK/ and LSB_MASK/ are obtained from the inverters 550 and 555, respectively. The output of the AND function 545 comprising the scrambled middle bits is provided to a bit-wise OR function 560 for combining with the preserved MSBs and the LSBs that are interchanged with other samples in a frame.
The output of the OR function 560 comprises the scrambled samples, which may be provided to the scramble key encoder 340 to provide scrambled samples with the embedded scrambling key. The samples are now ready, e.g., for transmission across a network, or storage on a storage medium. The scrambled key may be embedded in the scrambled samples by providing a scramble key encoder (such as element 340 in FIG. 3) . Note that the embedding of the scrambling key is optional.
As shown in FIG. 5, one method to selectively scramble the audio (e.g., so that it is sufficient for identification of music passage but lacks commercial value for music enjoyment) is to preserve the sign bit and, e.g., two most significant bits of each sample. Amplitude range detection is performed on each audio sample. A mask is generated for each sample corresponding to the amplitude range of that 19
particular sample. Examples of samples quantized to 16-bits in 2 ' s complement format and corresponding masks are shown below:
Example Example Sample Value Mask for sign bit + Mask for sign bit +
Sample Value in Binary two MSBs In two MSBs in Binary in Hexadecimal (MSB_MASK)
Hexadecimal (MSB_MASK)
OxOblf 0000101100011111 OxfcOO 1111110000000000
0xff98 1111111110011000 OxffeO 1111111111100000
Figure imgf000021_0001
Each sample has sixteen bits, where the leftmost bit is a sign bit. For example, for the sample value, 0xff98 in hexadecimal, or 1111111110011000 in binary, bitlδ ("1") indicates that this is a negative number, i.e., negative 0x61, or -97 in decimal. Thus, the dynamic range is seven bits (bitO to bitβ) .
In one example implementation of the scrambler 500, the remaining bits are separated into two groups - the least significant bit, and all other remaining bits. The least significant bit is scrambled horizontally by exchanging positions within a frame. Inter-frame scrambling may also be used. The other remaining bits are scrambled by XORing with a bit pattern which is generated from all or part of the scramble key. A linear shift register can be used to vary the bit pattern for each sample. 20
The scrambled output consists of 1) the preserved MSBs, 2) the intra- sample scrambled middle bits, and 3) the horizontal inter-sample scrambled LSBs. FIG. 6 illustrates a detailed data descrambler
600 in accordance with the present invention. The descrambler may be used for processing data received from the scrambler 500, for example.
Elements 610, 510' ', 515', 530' 535', 540', 545', 550', 555' and 560' correspond to elements 510, 510', 515, 530, 535, 540, 545, 550, 555 and 560, respectively in FIG. 5.
As shown in FIG. 6, the scramble key is decoded from the scrambled samples at the scramble key decoder 410, and provided to a buffer 420, and then to the descrambler 430. A linear address generator 515' is used, if necessary, for providing an address to a sample frame buffer 610 to restore the bit pattern for each received sample. The received, scrambled samples are provided from the sample frame buffer 610 to the range detect/mask generator function 535'. The preserved MSBs in each sample are identified the same way as at the scrambler, by using amplitude range detection. The descrambled middle bits in each sample are combined at the OR function 560' with the preserved MSBs and the reordered LSBs .
The inverse MSB mask (MSB_MASK/) is provided at the output of an inverter 550' to an AND function 545' for ANDing with the descrambled samples. The output of the AND function 545 ' is provided to the 21
OR function 560' for ORing with the preserved MSBs and the reordered LSBs within a frame.
The reordered LSBs within a frame are derived from ORing LSB_MASK with the reordered buffered samples, which are derived from the sample frame buffer 510'' in response to addresses from a descramble address generator 625.
At the output of the AND function 530', the LSB's position in a frame is restored, and the descrambled output is obtained by combining the three components at the OR 560' .
FIG. 7 illustrates adaptive bit modification with a fixed minimum dynamic range for successive data samples in successive data frames in accordance with the present invention.
The preserved dynamic range of the MSBs can be fixed, e.g., at 16 bits. N, the number of MSBs to be preserved, can be fixed as a preset parameter before processing (N may vary from 0 to the full dynamic range of the digitized samples) . N=8 in the example shown.
The original waveform 110 indicates the dynamic range of each sample prior to scrambling. Region 720 designates the bits in each sample which are not modified, while a region 730 designates the bits in each sample which may be scrambled. For example, for FRAME A, bitl5 (corresponding to a dynamic range of 16) and higher in each sample are not modified, while bitO through bit 14 are modified. For FRAME B and FRAME C, all of the bits are modified, e.g., up to the dynamic range of each sample. 22
An advantage of this scheme is that there is no need to determine the dynamic range of each sample at the encoder and decoder.
The invention may be implemented with various other alternatives and enhancements, as follows.
1) For example, referring to FIG. 7, the number of MSBs to be preserved (N) can be dynamic, varying from frame to frame.
2) For video applications, scrambling can be done across video frames.
3) Amplitude range detect and mask generation (e.g., function 535 in FIG. 5, and function 650 in FIG 6) can be a look-up-table with heuristic rules.
4) Scrambling frames can vary in length. 5) Horizontal scrambling can be done on any number of LSBs .
6) All or part of the scramble key can be hidden in the same frame, the previous frame, or any other frame of the content . The implementation hinges on the amount of buffer memory available and the throughput delay requirement .
7) Quiet, silent, or any other special passages can be left unscrambled. In other words, the scrambling can be continuous or discontinuous. 8) All or part of the scramble key for one stream of the content (e.g., video portion of a DVD disc) can be hidden in a different stream of the same content (e.g., the audio portion of the same DVD disc) . 9) All or part of the scramble key can be hidden in any part of the same media (disc) in any 23
form or fashion. For example, in the case of physical media such as CD or DVD, the key can be hidden electronically within sector data or physically with the use of techniques such as pit width modulation.
10) All or part of the scramble key for one stream of the content can be hidden in any separated media such as a pre-paid card. The key may also be a product of a transaction authorization via telephone, Internet, or any other communication means .
11) Scrambling can be done between two or more channels of the same data stream (e.g., front left and right channels of a multi-channel audio segment) .
12) Multiple channels of the same content stream (e.g., front left and rear right channels of a multi -channel audio segment) can share the same scramble key or have different scramble keys. 13) Scrambling can be selectively done for selected channels of a multi-channel stream (e.g., front left and front right channels are scrambled but center, rear left, rear right and subwoofer channels are not) . 14) Scramble Keys can be generated with either non-linear shift registers or non-linear feedback shift registers.
15) For contents in a compressed form, side information coded in the compressed stream, such as bit allocation information, can simplify the range detection process. However, for some frequency 24
samples, there may not be enough bits allocated to clearly differentiate the sign bit, MSB, and the middle bits. If there are no middle bits, the partial scrambling can simply skip those frequency samples. All other operations described for uncompressed domain partial scrambling should apply.
After the partial scrambling, the modified frequency samples must be re-packaged to conform to the original bit stream format . This in most cases should not require re-quantization, just re- packetization. This process will be specific to the compression technique used. Some compression schemes may require variable length encoding, such as Huffman code, and specific measures must be taken if the size of the compressed bit stream must remain unchanged. Most compression schemes inherently produce variable length bit streams, and the subsequent transport stream format usually accommodates the change in the size of the bit stream.
One side benefit of applying the partial scrambling technique of the present invention to the compressed bit stream may be a slightly easier self synchronization at the decoder. This may occur since the frame structure or the packet structure present in the compressed bit stream format can make it easier for the decoder to determine the scrambling frame boundary.
Accordingly, it can be seen that the present invention provides a system for scrambling digital samples of multimedia data, including audio and 25
video data samples, such that the content of the samples is degraded but still recognizable, or otherwise provided at a desired quality level. The quality level may be associated with a particular signal to noise ratio, or quality level that is determined by objective and/or subjective tests, for example. A number of LSBs can be scrambled in successive samples in successive frames. Moreover, the parameters for scrambling may change from frame to frame. Furthermore, the scrambling key can be embedded in the scrambled data and recovered at a decoder to descramble the scrambled samples. After descrambling, the scramble key is no longer recoverable because the scramble key is scrambled by the descrambler.
Although the invention has been described in connection with various specific embodiments, those skilled in the art will appreciate that numerous adaptations and modifications may be made thereto without departing from the spirit and scope of the invention as set forth in the claims.

Claims

26What is claimed is:
1. A method for protecting digital samples of content from illicit use by scrambling the content, wherein each sample includes a plurality of bits, ranging from least significant bits (LSBs) to most significant bits, comprising the step of: scrambling a number of LSBs in each sample according to a scrambling key, while preserving a number of MSBs in each sample, to provide corresponding scrambled samples,- wherein: a number of LSBs is scrambled in each sample such that the scrambled samples are degraded but still recognizable.
2. The method of claim 1, comprising the further step of : determining a dynamic range of each sample; and adaptively selecting the number of LSBs to be scrambled in each sample according to the dynamic range thereof .
3. The method of claim 1, wherein the samples are provided in successive frames, comprising the further step of : adaptively selecting the number of LSBs to be scrambled in each sample according to the frame thereof .
4. The method of claim 1, wherein: 27
said scrambling key is a pseudo-random scrambling key.
5. The method of claim 1, wherein: in said scrambling step, the number of LSBs are scrambled within the same sample using intra-sample scrambling.
6. The method of claim 1, wherein: in said scrambling step, the number of LSBs are scrambled between different samples using inter- sample scrambling.
7. The method of claim 1, wherein: in said scrambling step, the number of LSBs are scrambled between different samples, and within the same sample, using inter-sample and intra-sample scrambling, respectively.
8. The method of claim 1, wherein: in said scrambling step, the number of LSBs are scrambled between different samples using horizontal inter-sample scrambling by interchanging bits having the same weight .
9. The method of claim 1, comprising the further step of: embedding the scrambling key, at least in part, into the scrambled samples for use at a decoder in descrambling the scrambled samples. 28
10. The method of claim 9, wherein: the scrambling key for a current frame of scrambled samples is embedded, at least in part, into a previous frame of samples .
11. The method of claim 9, wherein: the scrambling key for a current frame of scrambled samples is embedded, at least in part, into a current frame of samples .
12. A method for descrambling previously scrambled digital samples of content, wherein each sample includes a plurality of bits, ranging from least significant bits (LSBs) to most significant bits, comprising the step of: descrambling a number of LSBs in each sample according to a scrambling key, while preserving a number of MSBs in each sample, to provide corresponding descrambled samples,- wherein: a number of LSBs is scrambled in each sample such that the scrambled samples are degraded but still recognizable.
13. The method of claim 12, comprising the further step of : determining a dynamic range of each sample; and adaptively selecting the number of LSBs to be descrambled in each sample according to the dynamic range thereof . 29
14. The method of claim 12, wherein the samples are provided in successive frames, comprising the further step of : adaptively selecting the number of LSBs to be descrambled in each sample according to the frame thereof .
15. The method of claim 12, wherein: said scrambling key is a pseudo-random scrambling key.
16. The method of claim 12, wherein: in said descrambling step, the number of LSBs are descrambled within the same sample using intra- sample descrambling.
17. The method of claim 12, wherein: in said descrambling step, the number of LSBs are descrambled between different samples using inter-sample descrambling.
18. The method of claim 12, wherein: in said descrambling step, the number of LSBs are descrambled between different samples, and within the same sample, using inter-sample and intra-sample descrambling, respectively.
19. The method of claim 12, wherein: in said descrambling step, the number of LSBs are descrambled between different samples using 30
horizontal inter-sample descrambling by interchanging bits having the same weight
20. The method of claim 12, wherein the scrambling key is embedded into the scrambled samples, comprising the further step of: recovering the scrambling key from the scrambled samples for use in said descrambling step.
21. The method of claim 20, wherein: the scrambling key for a current frame of scrambled samples is embedded into a previous frame of samples .
22. The method of claim 12, comprising the further steps of: scrambling the scrambling key after descrambling the scrambled sample in said descrambling step.
23. An apparatus for protecting digital samples of content from illicit use by scrambling the content, wherein each sample includes a plurality of bits, ranging from least significant bits (LSBs) to most significant bits, comprising: a scrambler for scrambling a number of LSBs in each sample according to a scrambling key, while preserving a number of MSBs in each sample, to provide corresponding scrambled samples; wherein: 31
a number of LSBs is scrambled in each sample such that the scrambled samples are degraded but still recognizable.
24. An apparatus for descrambling previously scrambled digital samples of content, wherein each sample includes a plurality of bits, ranging from least significant bits (LSBs) to most significant bits, comprising: a descrambler for descrambling a number of LSBs in each sample according to a scrambling key, while preserving a number of MSBs in each sample, to provide corresponding descrambled samples; wherein: a number of LSBs is scrambled in each sample such that the scrambled samples are degraded but still recognizable.
PCT/US1999/008635 1998-04-21 1999-04-20 Multimedia adaptive scrambling system (mass) WO1999055089A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
JP2000545321A JP2002512494A (en) 1998-04-21 1999-04-20 Multimedia adaptive scrambling system
EP99919913A EP1095517A1 (en) 1998-04-21 1999-04-20 Multimedia adaptive scrambling system (mass)
CA002329315A CA2329315A1 (en) 1998-04-21 1999-04-20 Multimedia adaptive scrambling system (mass)
KR1020007011703A KR20010034802A (en) 1998-04-21 1999-04-20 Multimedia adaptive scrambling system
AU37525/99A AU3752599A (en) 1998-04-21 1999-04-20 Multimedia adaptive scrambling system (mass)
MXPA00010337A MXPA00010337A (en) 1998-04-21 1999-04-20 Multimedia adaptive scrambling system (mass).
US09/692,084 US6888943B1 (en) 1998-04-21 2000-10-19 Multimedia adaptive scrambling system (MASS)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US8248898P 1998-04-21 1998-04-21
US60/082,488 1998-04-21

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US09/692,084 Continuation US6888943B1 (en) 1998-04-21 2000-10-19 Multimedia adaptive scrambling system (MASS)

Publications (1)

Publication Number Publication Date
WO1999055089A1 true WO1999055089A1 (en) 1999-10-28

Family

ID=22171545

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/008635 WO1999055089A1 (en) 1998-04-21 1999-04-20 Multimedia adaptive scrambling system (mass)

Country Status (8)

Country Link
EP (1) EP1095517A1 (en)
JP (1) JP2002512494A (en)
KR (1) KR20010034802A (en)
CN (1) CN1151673C (en)
AU (1) AU3752599A (en)
CA (1) CA2329315A1 (en)
MX (1) MXPA00010337A (en)
WO (1) WO1999055089A1 (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000052923A1 (en) * 1999-03-02 2000-09-08 Koninklijke Philips Electronics N.V. Method and arrangement for scrambling and descrambling information
JP2001118330A (en) * 1999-10-18 2001-04-27 Yamaha Corp Data generating method, recorder, recording medium and reproducing device
WO2002087241A1 (en) * 2001-04-18 2002-10-31 Koninklijke Philips Electronics N.V. Audio coding with partial encryption
FR2845543A1 (en) * 2002-10-03 2004-04-09 Medialive SECURE AUDIO STREAM JAMMING SYSTEM
US6760442B1 (en) * 1998-12-18 2004-07-06 Sun Microsystems, Inc. Method and apparatus for adjusting the quality of digital media
EP1465157A1 (en) * 2003-03-31 2004-10-06 Sony United Kingdom Limited Digital audio watermark
AU2002233609B2 (en) * 2001-03-28 2008-05-29 Nds Limited Digital rights management system and method
WO2009001139A1 (en) * 2007-06-28 2008-12-31 Taptu Ltd Audio thumbnail
US7630492B2 (en) 2002-10-03 2009-12-08 Daniel Lecomte Secure audio stream scramble system
US7752446B2 (en) 2002-05-15 2010-07-06 International Business Machines Corporation System and method for digital watermarking of data repository
EP3070937A1 (en) * 2005-10-10 2016-09-21 Apple Inc. Partial encryption techniques for media data
US10461930B2 (en) 1999-03-24 2019-10-29 Wistaria Trading Ltd Utilizing data reduction in steganographic and cryptographic systems
US10644884B2 (en) 1999-12-07 2020-05-05 Wistaria Trading Ltd System and methods for permitting open access to data objects and for securing data within the data objects
US10735437B2 (en) 2002-04-17 2020-08-04 Wistaria Trading Ltd Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth
CN115695675B (en) * 2023-01-03 2023-03-10 北京特立信电子技术股份有限公司 Video encryption method for network data secure exchange

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2875658B1 (en) * 2004-09-21 2007-03-02 Commissariat Energie Atomique ESTIMATING THE MOST NOISE INTERFERENCE SIGNAL RATIO AT THE OUTPUT OF AN OFDM-CDMA RECEIVER.
US8055903B2 (en) 2007-02-15 2011-11-08 Avaya Inc. Signal watermarking in the presence of encryption
CN102156734B (en) * 2011-04-12 2013-05-29 西南科技大学 Video content management method based on semantic hidden indexing

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3784743A (en) * 1972-08-23 1974-01-08 Bell Telephone Labor Inc Parallel data scrambler
US5185794A (en) * 1990-08-06 1993-02-09 Nec Home Electronics, Ltd. System and method for scrambling and/or descrambling a video signal
US5535275A (en) * 1993-07-08 1996-07-09 Sony Corporation Apparatus and method for producing scrambled digital video signals

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3784743A (en) * 1972-08-23 1974-01-08 Bell Telephone Labor Inc Parallel data scrambler
US5185794A (en) * 1990-08-06 1993-02-09 Nec Home Electronics, Ltd. System and method for scrambling and/or descrambling a video signal
US5535275A (en) * 1993-07-08 1996-07-09 Sony Corporation Apparatus and method for producing scrambled digital video signals

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6760442B1 (en) * 1998-12-18 2004-07-06 Sun Microsystems, Inc. Method and apparatus for adjusting the quality of digital media
WO2000052923A1 (en) * 1999-03-02 2000-09-08 Koninklijke Philips Electronics N.V. Method and arrangement for scrambling and descrambling information
US10461930B2 (en) 1999-03-24 2019-10-29 Wistaria Trading Ltd Utilizing data reduction in steganographic and cryptographic systems
JP2001118330A (en) * 1999-10-18 2001-04-27 Yamaha Corp Data generating method, recorder, recording medium and reproducing device
US10644884B2 (en) 1999-12-07 2020-05-05 Wistaria Trading Ltd System and methods for permitting open access to data objects and for securing data within the data objects
AU2002233609B2 (en) * 2001-03-28 2008-05-29 Nds Limited Digital rights management system and method
US7920702B2 (en) 2001-03-28 2011-04-05 Nds Limited Digital rights management system and method
US7512986B2 (en) 2001-03-28 2009-03-31 Nds Limited Digital rights management system and method
WO2002087241A1 (en) * 2001-04-18 2002-10-31 Koninklijke Philips Electronics N.V. Audio coding with partial encryption
US7319756B2 (en) 2001-04-18 2008-01-15 Koninklijke Philips Electronics N.V. Audio coding
KR100927842B1 (en) * 2001-04-18 2009-11-23 아이피지 일렉트로닉스 503 리미티드 A method of encoding and decoding an audio signal, an audio coder, an audio player, an audio system comprising such an audio coder and such an audio player, and a storage medium for storing the audio stream.
US10735437B2 (en) 2002-04-17 2020-08-04 Wistaria Trading Ltd Methods, systems and devices for packet watermarking and efficient provisioning of bandwidth
US7752446B2 (en) 2002-05-15 2010-07-06 International Business Machines Corporation System and method for digital watermarking of data repository
WO2004032418A3 (en) * 2002-10-03 2004-08-05 Medialive Secure audio stream scrambling system
US7630492B2 (en) 2002-10-03 2009-12-08 Daniel Lecomte Secure audio stream scramble system
US8200498B2 (en) 2002-10-03 2012-06-12 Querell Data Limited Liability Company Secure audio stream scramble system
WO2004032418A2 (en) * 2002-10-03 2004-04-15 Medialive Secure audio stream scrambling system
FR2845543A1 (en) * 2002-10-03 2004-04-09 Medialive SECURE AUDIO STREAM JAMMING SYSTEM
US7702404B2 (en) 2003-03-31 2010-04-20 Sony United Kingdom Limited Digital audio processing
EP1465157A1 (en) * 2003-03-31 2004-10-06 Sony United Kingdom Limited Digital audio watermark
EP3070937A1 (en) * 2005-10-10 2016-09-21 Apple Inc. Partial encryption techniques for media data
GB2462969A (en) * 2007-06-28 2010-03-03 Taptu Ltd Audio thumbnail
WO2009001139A1 (en) * 2007-06-28 2008-12-31 Taptu Ltd Audio thumbnail
CN115695675B (en) * 2023-01-03 2023-03-10 北京特立信电子技术股份有限公司 Video encryption method for network data secure exchange

Also Published As

Publication number Publication date
JP2002512494A (en) 2002-04-23
EP1095517A1 (en) 2001-05-02
AU3752599A (en) 1999-11-08
CA2329315A1 (en) 1999-10-28
CN1301460A (en) 2001-06-27
CN1151673C (en) 2004-05-26
KR20010034802A (en) 2001-04-25
MXPA00010337A (en) 2003-05-19

Similar Documents

Publication Publication Date Title
US6888943B1 (en) Multimedia adaptive scrambling system (MASS)
WO1999055089A1 (en) Multimedia adaptive scrambling system (mass)
US6792542B1 (en) Digital system for embedding a pseudo-randomly modulated auxiliary data sequence in digital samples
US8155463B2 (en) Pre-processed information embedding system
EP0889471B1 (en) Custom character-coding compression for encoding and watermarking media content
US5963909A (en) Multi-media copy management system
KR100474438B1 (en) Signal recording / reproducing method and apparatus, signal recording medium, signal transmitting / receiving method and apparatus
US7177430B2 (en) Digital entroping for digital audio reproductions
Lacy et al. Intellectual property protection systems and digital watermarking
US7289961B2 (en) Data hiding via phase manipulation of audio signals
US7308099B1 (en) Device and method for producing an encoded audio and/or video data stream
WO1999062022A1 (en) Pre-processed information embedding system
CA2364433C (en) Signal processing methods, devices, and applications for digital rights management
WO2004114200A2 (en) Method and apparatus for creating multiple unique copies of content
JP2004088619A (en) Code string encryption method, apparatus and encryption release method, apparatus and recording medium
EP1080545A1 (en) Digital hidden data transport (dhdt)
JP2003308096A (en) Method and device for converting data, method and device for reproducing data, method and device for restoring data, data format, recording medium and program
JP2003308099A (en) Method and device for converting data, method and device for restoring data, data format, recording medium and program
JP2003337599A (en) Method and equipment for regenerating signal, method and equipment for recording signal, and method and equipment for generating sign row
AU2004235685A1 (en) Signal processing methods, devices, and applications for digital rights management
JP2003308013A (en) Data conversion method, data converting apparatus, data reconstruction method, data reconstructing apparatus, data format, recording medium, and program
JP2003263195A (en) Method and device for reproducing signal, method and device for recording signal, and method and device for generating code string

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 99806385.1

Country of ref document: CN

AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
ENP Entry into the national phase

Ref document number: 2329315

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 09692084

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: PA/a/2000/010337

Country of ref document: MX

WWE Wipo information: entry into national phase

Ref document number: 1020007011703

Country of ref document: KR

ENP Entry into the national phase

Ref document number: 2000 545321

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 1999919913

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 1020007011703

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 1999919913

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 1999919913

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 1020007011703

Country of ref document: KR