WO2004062287A2 - Protection adaptative et progressive d’images fixes codees en ondelettes - Google Patents
Protection adaptative et progressive d’images fixes codees en ondelettes Download PDFInfo
- Publication number
- WO2004062287A2 WO2004062287A2 PCT/FR2003/050192 FR0350192W WO2004062287A2 WO 2004062287 A2 WO2004062287 A2 WO 2004062287A2 FR 0350192 W FR0350192 W FR 0350192W WO 2004062287 A2 WO2004062287 A2 WO 2004062287A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- stream
- still images
- digital still
- images according
- secure distribution
- Prior art date
Links
- 230000003044 adaptive effect Effects 0.000 title description 5
- 238000000034 method Methods 0.000 claims abstract description 68
- 230000005540 biological transmission Effects 0.000 claims abstract description 12
- 238000006467 substitution reaction Methods 0.000 claims abstract description 11
- 238000004364 calculation method Methods 0.000 claims abstract description 4
- 238000000605 extraction Methods 0.000 claims abstract description 4
- 230000008520 organization Effects 0.000 claims abstract description 4
- 230000004048 modification Effects 0.000 claims description 42
- 238000012986 modification Methods 0.000 claims description 42
- 230000000007 visual effect Effects 0.000 claims description 15
- 230000000295 complement effect Effects 0.000 claims description 14
- 230000009466 transformation Effects 0.000 claims description 6
- 230000003595 spectral effect Effects 0.000 claims description 4
- 239000013598 vector Substances 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 230000002123 temporal effect Effects 0.000 claims description 2
- 238000000844 transformation Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 16
- SNDPXSYFESPGGJ-UHFFFAOYSA-N L-norVal-OH Natural products CCCC(N)C(O)=O SNDPXSYFESPGGJ-UHFFFAOYSA-N 0.000 description 8
- 230000015556 catabolic process Effects 0.000 description 7
- 238000006731 degradation reaction Methods 0.000 description 7
- 238000001914 filtration Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000000750 progressive effect Effects 0.000 description 7
- 230000015572 biosynthetic process Effects 0.000 description 6
- 238000003786 synthesis reaction Methods 0.000 description 6
- 238000000354 decomposition reaction Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 230000016776 visual perception Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000007935 neutral effect Effects 0.000 description 2
- 230000002441 reversible effect Effects 0.000 description 2
- 206010047571 Visual impairment Diseases 0.000 description 1
- 239000000654 additive Substances 0.000 description 1
- 230000000996 additive effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000001143 conditioned effect Effects 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000010978 jasper Substances 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4405—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream decryption
- H04N21/44055—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream decryption by partially decrypting, e.g. decrypting a video stream that has been partially encrypted
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/63—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding using sub-band based transform, e.g. wavelets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/88—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2347—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
- H04N21/23476—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption by partially encrypting, e.g. encrypting the ending portion of a movie
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/254—Management at additional data server, e.g. shopping server, rights management server
- H04N21/2541—Rights Management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/835—Generation of protective data, e.g. certificates
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
- H04N7/17309—Transmission or handling of upstream communications
- H04N7/17318—Direct or substantially direct transmission and handling of requests
Definitions
- the present invention relates to the field of processing wavelet coded digital images.
- the general problem is to provide a method capable of securely transmitting digital data corresponding to high quality images in any digital format, derived from wavelet coding, live or delayed to a display screen and / or to be recorded on the hard disk or any other backup device belonging to a box connecting the remote transmission network to a screen of the monitor or television screen type, while preserving the visual quality but avoiding any fraudulent use such as the possibility of make pirated copies of the digitally coded images recorded on the backup medium of said set-top box.
- the coefficient DC of at least one block of coefficients (DC, AC) of at least one image I is recalculated from the original using an action command C which can be random.
- C the coefficient DC of at least one block of coefficients (DC, AC) of at least one image I
- rank R the original DC coefficients encrypted using a key
- all the data constituting the original stream are included in said protected MPEG-2 stream and are sent together and by the same channel, said protected MPEG-2 stream containing the information for the reconstruction being the only output of the scrambling process. Therefore, this prior art does not meet the criteria of high security, objects of the present invention.
- the present invention relates more particularly to a device capable of securely transmitting a set of digital images of high visual quality to a display and / or to be recorded in the memory of the backup device of a box connecting the network of remote transmission to the display, while preserving the visual quality but avoiding the possibility that these images may be illegally copied.
- the invention relates to a method for the secure distribution of digital still images according to a nominal format resulting from wavelet coding, represented by a bit stream consisting of at least one packet (relating to the organization of the binary sequence) containing at minus a block grouping simple elements (for example coefficients) digitally coded according to a mode specified inside the stream concerned and used by all the decoders capable of restoring or decoding it in order to be able to display it correctly.
- This process includes:
- a preparatory step consisting in modifying at least one of said simple elements according to at least one substitution operation consisting in the extraction of this simple element, followed by its replacement by a datum called decoy,
- Said complementary information is defined as a set consisting of data (for example coefficients describing the original digital stream or extracts from the original stream) and functions (for example, the substitution or permutation function).
- a function is defined as containing at least one instruction relating data and operators.
- Said additional information describes the operations to be carried out to recover the original stream from said modified stream.
- Stream as a structured binary sequence, consisting of simple and ordered elements representing in coded form data and meeting a given audiovisual standard or norm.
- the bit stream restored after descrambling has a different size from the initial bit stream, following the addition of neutral data for the decoder, but remains in conformity with the standard or norm of the initial bit stream, and provides a visually decoded image. and numerically strictly identical to the image decoded from the initial bit stream.
- Granular scalability from the English expression “granular scalability”.
- the scalability property characterizes an encoder capable of encoding or a decoder capable of decoding an ordered set of bit streams so as to produce or reconstruct a multilayer sequence.
- Granularity is defined as the quantity of information capable of being transmitted per layer of a system characterized by any scalability, the system then also being called “granular”.
- Granular scalability is also called “qualitative scalability”.
- the present invention provides protection of the wavelet-encoded digital image based entirely on the structure of the “bitstream” (bit sequence), protection which consists in modifying targeted parts of the bitstream relating to wavelet modeling and its characteristics.
- the true values are extracted from the bitstream and are stored as additional information, and in their places are put random or calculated values or permuted values, of the same sizes as the original values, and this for the entire digital stream.
- said replacement values are of different size from the original values.
- the scrambler adds “decoys” to the decoder, which receives as input a bit stream completely conforming to the original digital format, but from which the decoded and displayed image is not acceptable from the point of view of human visual perception.
- the scrambling module performs a bitstream analysis and selects the locations of the bitstream where it introduces disturbances.
- the action of introducing disturbances is defined by modification.
- a disturbance is defined as a change (eg change of value, inversion of the sign, saturation, thresholding), or a substitution by a random or calculated value, or a permutation.
- the scrambling-descrambling process carried out is without loss of quality for the original image.
- the scrambling operation is also carried out with a partial decoding - encoding of the bit stream (bitstream) representing the encoded image.
- bitstream bit stream
- the modifications are then directly applied to the decoded wavelet coefficients, the original wavelet coefficients are stored as additional information and the modified wavelet coefficients are re-encoded in order to generate a modified main flow conforming to the standard or norm of the initial flow. .
- the protection is based on the principle of deleting and replacing the information encoding the original visual signal by any method, namely: substitution, modification, permutation or displacement of the information.
- This protection is also based on knowledge of the structure of the stream at the output of the visual encoder: the scrambling depends on the content of said digital stream.
- the original stream is reconstituted on the recipient equipment from the modified main stream already present or available (for example on a CD or DVD) or sent in real time to the recipient equipment and additional information sent in real time at visualization including data and functions executed using digital routines (set of instructions).
- the additional information stored during the preparatory step and transmitted on the recipient equipment also allows the original content to be reconstructed from the modified main stream.
- the reconstitution step introduces, according to a determined mode, neutral data for the decoder in the reconstituted stream from the modified main stream and additional information, in order to modify the size of the reconstituted stream while preserving its conformity vis-à-vis with respect to the standard or the native standard, as well as the numerical and qualitative equality of the decoded image with the image decoded from the original stream.
- the structured bit stream represents the wavelet coded image.
- it can represent a succession of digital images resulting from a wavelet coding.
- the modifications make the image resulting from the decoding of said stream unusable by the user, because it is scrambled.
- said stream can be understood and interpreted by the appropriate decoder, without the latter being disturbed, and displayed on a screen.
- the modification of one or more of the components of said digital stream will cause a degradation of the image from a visual point of view and transform it into a completely incomprehensible and unpleasant signal from the point of view of subjective human visual perception.
- the present invention relates to a method for the secure distribution of digital still images according to a nominal format resulting from digital wavelet coding, represented by an original stream consisting of at least one packet (relating to the organization of the binary sequence) containing at least one block grouping simple elements
- a preparatory step consisting in modifying at least one of said simple elements according to at least one substitution operation consisting in the extraction of this simple element, followed by its replacement by a datum called decoy,
- the modified main stream is recorded or available on the recipient equipment prior to the transmission of the additional information on the recipient equipment.
- the modified main stream and the additional information are transmitted together in real time at the time of viewing.
- the nominal stream format resulting from wavelet coding is defined by a standard or coder common to a community of users.
- this method comprises a step of analyzing at least part of the original flow, said step of analyzing determining the nature of the modifications to be made to said simple elements.
- the step of determining the modification of the simple elements to be performed during said analysis step takes into account the concrete structure of at least part of the original image.
- the method comprises a prior step of analog / digital conversion in a structured format, the method being applied to an analog visual signal.
- the additional information includes at least one digital routine capable of executing a function.
- said preparatory modification step is carried out adaptively on said original flow as a function of at least part of the characteristics representative of the structure, content and parameters of the original image, of the profile recipient, and external events.
- the modified main stream conforms to the standard or native standard of the original stream.
- the size of the modified main stream is strictly equal to the size of the original stream.
- the modifications made during said preparatory step are carried out directly on the packets of the initial bit stream grouping blocks of simple coded elements.
- the modifications made during said preparatory step are carried out on at least one of the simple elements obtained by decoding at least one packet of the initial bit stream.
- the modifications are carried out on at least one of the spatial scalability layers of the fixed images coded in wavelets. In another embodiment, the modifications are carried out on at least one of the qualitative scalability layers of the wavelet-coded fixed images.
- modifications are carried out on at least one set of at least one simple element as a function of the parameters of the modifications carried out beforehand on at least one set of at least one simple element within the same flow.
- said still images constitute a succession of images over time.
- said modification of said simple elements is different for at least two images of said succession of images.
- said modification of the simple elements of an image of said succession of images includes the modification of the simple elements of the preceding images in the temporal order of the succession based on the properties of spatial and qualitative scalability of the wavelet transformations.
- said modification of said simple elements is applied to only a spatial part of the image, determined on the basis of the properties and characteristics of the transformation into wavelets.
- said modification of said simple elements is applied to at least one spectral component originating from the wavelet transform in order to thus target the part of the visual flow to be scrambled.
- this process is without loss of quality.
- this method comprises an additional step of reconstituting said original stream comprising: a step of reconstruction by applying a reconstruction function from additional information coming from a channel separated from the vector of said stream main ; a step of decoding said stream reconstructed by a method adapted to said nominal format.
- the size of the stream reconstituted on the recipient equipment is equal to the size of the original stream.
- the size of the stream reconstituted on the destination equipment is different from that of the original stream.
- the additional information makes it possible to reconstruct the original stream from the modified main stream in which the order of the packets has been changed during a transcoding operation carried out after the preparatory step and before the reconstruction step L ' invention also relates to equipment for implementing this method, comprising an encoder according to said nominal format and means for transmitting a digital stream, characterized in that it further comprises means for processing a stream original consisting in modifying at least one of the simple elements of the main flow, the equipment further comprising means for transferring the additional information corresponding to said modification.
- the invention also relates to equipment for implementing the method, comprising a decoder according to said nominal format and means for receiving a digital stream, characterized in that it further comprises means for receiving additional information associated with the main stream and means for reconstructing the original stream by processing said main stream and said complementary information.
- the invention finally relates to a system for the distribution of digital still images comprising at least one equipment for broadcasting fixed images digitally encoded in wavelets and a plurality of playback equipment and telecommunication means connecting the broadcasting equipment and restitution equipment characterized in that the broadcasting equipment comprises a means for modifying at least one of the simple elements of the main stream, and in that the telecommunication means are composed of a first means for the transmission of main information coded in wavelets and second means for transferring the complementary information corresponding to said modification, the restitution equipment comprising means for reconstructing the original stream by processing said main stream and said complementary information and means for decoding the information coming from the first means of transmission.
- the wavelet transform of an image consists in applying to the original image a succession of high-pass and low-pass filters developed from the characteristics of analysis wavelets.
- the synthesis operation which consists in reconstructing the image from the set or a subset of the wavelet coefficients, obeys a reverse filtering scheme.
- a wavelet transform step on a digital image (which can be composed of one or more matrices of real or integer values) is equivalent to a filtering operation on the rows and columns of one or more value matrices followed by a dyadic decrease in size (halved). It therefore generates at each step 4 new matrices of wavelet coefficients, called sub-bands and whose width and height are equal to half the width and height of the transformed matrix (dyadic progression).
- an image I of width L and height H and resolution r.
- the application of a transformation stage wavelet therefore generates 4 matrices of wavelet coefficients of dimension (L / 2, H / 2): the sub-band LL r - ⁇ , result of a low pass filtering horizontal (lines) and vertical (columns) on the image I, the sub-band LH r _ ⁇ , result of a horizontal low-pass and vertical high-pass filtering, the sub-band HL r _ ⁇ , result of a horizontal high-pass and vertical low-pass filtering and the sub -band HH r _ ⁇ , result of a horizontal and vertical high pass filtering.
- a wavelet transform at R levels is associated with R + l resolution levels, numbered from R to 0, with R and 0 corresponding respectively to the finest (initial image) and coarsest resolution levels.
- Each sub-band resulting from the wavelet decomposition of the image I is thus identified by its orientation (LL or HL or LH or HH) and its corresponding level of resolution (0, ..., R).
- the original image is considered the LL R sub-band.
- the sub-band LLi is thus decomposed into 4 new sub-bands LLi_ ⁇ , HLi-i, LHi_ ⁇ and HHi-i and whose size is divided by two compared to LLi.
- the process is iterated until the LLo subband has been obtained.
- 3R + 1 sub-bands of wavelet coefficients are generated: LL 0 , HL X , LHi, HH lf HL 2 , LH 2 , HH 2 , ..., HL R , LH R , HH R.
- 3R + 1 sub-bands consists in applying an inverse filtering operation on the wavelet coefficients followed by a dyadic increase in size.
- a progressive reconstruction of the image according to different levels of resolution can thus be carried out.
- the 3 sub-bands of wavelet coefficients HL r - ⁇ , LH r _ ⁇ , HH-i a new resolution image r is obtained.
- the only sub-band of wavelet coefficients LLo is an approximation of the original image LL R and whose resolution is 2 R times lower than the original image.
- the 3R wavelet coefficients sub-bands HL r - ⁇ , LH r _ ⁇ , HH r - ⁇ correspond to details in the image, extracted at the resolution level r-1.
- the wavelet coefficients resulting from the wavelet transform of an image are therefore the local characteristics of frequency information.
- a wavelet transform at R levels of an image generates an approximation "image", of lower resolution 2 R and 3R "images" of ' details at different resolutions (0 to R).
- the wavelet coding is characterized by its spatial and qualitative (or granular) scalability, which makes it possible to obtain different resolutions for the encoded images and also allows the realization of an adaptive and progressive scrambling.
- An application example is for a sequence of still images encoded with the "Motion JPEG-2000" standard. Progressive scrambling is applied so that the user begins to look at the succession of unscrambled images. Then, we start to apply a slight scrambling which we reinforce more and more, until the images become completely scrambled. The aim is to arouse the user's interest in the estate images, but by removing the rights to view them if the latter has not purchased them.
- One embodiment of this application is to scramble the succession of images with one or more given algorithms by gradually modifying the scrambling parameters over a determined period of time so as to increase the inconvenience, until arriving at completely scrambled images. and not visible.
- the image scrambling method whose compression scheme involves wavelet transforms consists in introducing disturbances on the wavelet coefficients belonging to one or more different sub-bands.
- a perturbation is defined as a change in value or a permutation.
- the disturbance can also be a substitution by a random or calculated value.
- the amplitude and the position of the wavelet coefficients being characteristic of the frequency and spatial information present in the image, and this at several levels of resolution, frequency and spatial disturbances will be generated on the image reconstructed from the modified wavelet coefficients .
- a high amplitude coefficient signals the presence of a local intensity discontinuity (detail) in the image whose "size" is measured as a function of the resolution r of the sub-band: the finest discontinuities will be extracted for large r and coarser for weak r.
- the human eye is essentially sensitive to discontinuities in the image. They are the ones who wear the maximum visual information. These discontinuities can be due to physical and / or geometric properties of the objects present in the image.
- the wavelet coefficients of the LLo band are modified.
- Another example of spatially oriented scrambling is to modify wavelet coefficients that are attached to a particular "tile-precinct" entity.
- a tile is a component resulting from the partition of the original image into several connected rectangular regions.
- a “precinct” (enclosure in French) is a rectangular area grouping together three subsets of wavelet coefficients belonging respectively to the sub-bands LH, HL and HH, for a limited spatial region in the image and for a fixed resolution.
- Another example of spectrally oriented scrambling is to modify the wavelet coefficients generated by the decomposition of one of the spectral or colorimetric components of the image.
- Spectral-oriented disturbances (choice of a component for a color image) and / or spatially (choice of a tile and / or a precinct) can thus be applied.
- Another example of scrambling is to work at different resolutions.
- the perturbation is applied to wavelet coefficients belonging to one or more sub-bands of the same level of resolution r.
- the effects of the disturbance will be visible on each tile of the image reconstructed from the disturbed coefficients and higher resolutions ie r + 1, r + 2, ..., R.
- wavelet coding provides multiple possibilities for simple or progressive scrambling, this depending on the belonging to one of the sub-bands of the coefficients to which the disturbances relate: by modifying wavelet coefficients belonging to a sub -band HL the vertical discontinuities of the reconstructed image are degraded, by modifying coefficients belonging to a sub-band LH the horizontal discontinuities of the reconstructed image are degraded, and by modifying coefficients belonging to a sub-band HH the discontinuities diagonals of the reconstructed image are degraded.
- the scrambling of an image or of a succession of wavelet coded images can be controlled according to 4 axes of action: a spectral axis (choice of one or more components), a spatial axis (choice of one or several tiles, one or more precincts), a resolution axis (level r of resolution to be scrambled and extent of the scrambling), and finally a qualitative axis (choice of one or more sub-bands among LL, HL, LH or HH, choice of the nature and intensity of the disturbances).
- Adaptive and progressive scrambling is performed as a function of the initial coding parameters of the image (number of components, number of tiles, number of precincts, number R of levels of decomposition).
- the various disturbances and modifications of the wavelet coefficients envisaged are for example the modification of the values of the coefficients by thresholding, the addition / substitution of noise, the permutation, the substitution by one or more random values, the change of sign.
- a thresholding operation consists in forcing a new value named nval one or more wavelet coefficients c if their images calculated by a function F (defined according to a heuristic method) is less than a threshold ⁇ fixed a priori:
- F different thresholds ⁇ and different nval can be considered.
- the intensity of the scrambling is adjustable.
- Another disturbance consists in adding / substituting a noise, that is to say in adding / replacing to the value of one or more wavelet coefficients Ci a random or pseudo-random noise of known statistical law.
- the intensity of the disturbance is adjustable.
- Another disturbance consists in permuting according to a deterministic or random scheme the position of the coefficients in a sub-band or several fixed sub-bands.
- the scrambling of the wavelet coded images is also carried out adaptively according to the profile of the client.
- Figure 1 illustrates a particular embodiment of the client-server system according to one invention.
- the image encoded (l) according to the JPEG-2000 standard that one wishes to secure is sent to an analysis system (121) and scrambling (122) intended to generate a modified main flow (124) and additional information
- the original stream (1) can be directly in digital form (10) or in analog form (11). In the latter case, the analog stream (11) is converted by an encoder not shown in a digital format (10). In the rest of the text, we will note (1) the input bit stream.
- the analysis (121) and scrambling (122) systems decide which scrambling to apply and which parameters of the stream to modify according to the type of wavelet encoder with which it has been encoded (e.g. JPEG-2000, JJ2000, JASPER, Kakadu, Motion JPEG-2000, Still Texture in MPEG-4, etc.).
- the modified JPEG-2000 stream is then transmitted from the buffer (125), via a high speed network (4) of the radio type, cable, satellite, etc., to the client (8), and more precisely in its memory (81 ) of type RAM, ROM, hard disk.
- the client wishes to see an image present in the memory (81)
- the recipient equipment (8) sends a request to the server (12), which verifies the rights of this user. Two possibilities are then possible: - either the recipient (8) does not have the rights necessary to view the image. In this case, the flow
- the server (12) transmits the appropriate additional information (123) which is stored in the buffer (126) by the link (6), in whole or in part.
- the synthesis system makes a display request to the server (12) containing the additional information (123) necessary for the reconstruction of the original image (1).
- the server (12) then sends a 'link (6) via telecommunications networks (6) the type analog or digital phone line, DSL (Digital Subscriber Line), WLL (Wireless Local Loop), DAB (Digital Audio Broadcasting) or digital mobile telecommunications (GSM, GPRS, UMTS) additional information (123) allowing the reconstruction of the initial image so that the client (8) can view the image.
- the synthesis system uses a 'link (6) via telecommunications networks (6) the type analog or digital phone line, DSL (Digital Subscriber Line), WLL (Wireless Local Loop), DAB (Digital Audio Broadcasting) or digital mobile telecommunications (GSM, GPRS, UMTS) additional information (123) allowing the reconstruction of the initial image so that
- the present invention relates more particularly to the analysis (121) and scrambling (122) modules, given the complexity and the property of multilayers and scalability of the wavelet encoded flows.
- An example of scrambling performed by the scrambling module is the saturation of the wavelet coefficients relative to the details. This method consists in forcing the value of one or more wavelet coefficients c belonging to one or more of the sub-bands HL r , LH r , HH r ; r being fixed) at a value nval if their amplitudes (modules) are greater than threshold:
- the threshold value influences the number of wavelet coefficients modified in a sub-band: the lower the threshold, the greater the number of modified coefficients and the greater the degradations.
- the scrambling is adaptive according to the modified sub-band.
- the distribution of the value of the wavelet coefficients within a sub-band can be modeled by a Laplacian distribution. The larger r is, the more the distribution spreads, that is to say that we find more and more wavelet coefficients of high amplitudes. Thus, for a fixed threshold, the number of coefficients modified in each sub-band is not constant.
- nval adjusts the intensity of the degradation introduced on the reconstructed image. Plus the absolute value
- modified wavelet coefficients belong to the HL sub-band, artefacts of vertical direction appear on the reconstructed image.
- modified wavelet coefficients belong to the LH sub-band, artefacts of horizontal direction appear on the reconstructed image.
- modified wavelet coefficients belong to the HH sub-band, checkerboard-type artefacts appear on the reconstructed image.
- the value of r adjusts the resolution level where the faults are introduced. More r is weak, the more the degradation will be spatially extended in the reconstructed image.
- the complementary information (123) is then composed of the wavelet coefficients c replaced by nval and of their position in the transformed image.
- scrambling produced by the module (122) is the substitution of the original coefficients by wavelet coefficients to which noise is added.
- the additional information (123) is then composed of the characteristics of the added noise and of the subtraction function of this noise for the modified coefficients.
- Another scrambling embodiment is the permutation of wavelet coefficients.
- the basic idea is to permute in a deterministic or random way the coefficients belonging to one or more sub-bands. Permutations can be performed deterministically (and signed by a permutation matrix P) or randomly over entire rows or columns of coefficients, or between subsets of coefficients. For example deterministic permutations of lines in sub-bands HL, HH and random permutations of lines in sub-bands LH (horizontal details).
- the visual effect obtained is a strong degradation of the image in the swapped areas, blurring effects and degradations of the contours.
- the additional information (123) consists of functions of inverse permutations of the permutations produced by the scrambling device (123).
- Another embodiment of scrambling is to replace the wavelet coefficients belonging to a resolution level r, of! coefficients Random wavelets chosen according to a uniform probability law.
- the visual effect obtained is a destruction of the details of the image at resolutions r, r + l, ..., R thus causing strong visual degradation.
- the additional information (123) consists of the original wavelet coefficients and their locations in the initial flow.
- the decomposition into wavelets also makes it possible to carry out a localized scrambling of an image or of a succession of images.
- the idea is to degrade, according to one of the three previous methods (thresholding, permutation, noise) a part of the image, in a targeted manner, that is to say only areas of interest which make the image not acceptable from a human visual perception point of view. In this way, an unpleasant effect is obtained, while limiting the amount of additional information.
- An exemplary embodiment illustrates the principle is described below.
- (L, H) be the dimension of the original image and (w, h) the dimension of the area that we want to confuse on the original image.
- the area to be scrambled is located in the center of the image, that is to say the area in general where the most relevant information is located in an image.
- nlr, ncr are respectively the number of rows and columns of the matrix of wavelet coefficients in the sub-band considered.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
- Color Television Systems (AREA)
Abstract
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP03810003A EP1588563B1 (fr) | 2002-12-31 | 2003-12-19 | Protection adaptative et progressive d'images fixes codees en ondelettes |
AT03810003T ATE484154T1 (de) | 2002-12-31 | 2003-12-19 | Adaptiver und progressiver schutz von wavelet- codierten bildern |
DE60334497T DE60334497D1 (de) | 2002-12-31 | 2003-12-19 | Adaptiver und progressiver schutz von wavelet-codierten bildern |
AU2003302190A AU2003302190A1 (en) | 2002-12-31 | 2003-12-19 | Adaptive and gradual protection of fixed images which are coded in wavelets |
US11/167,783 US7529415B2 (en) | 2002-12-31 | 2005-06-27 | Adaptive and progressive protection of fixed images encoded in wavelets |
US12/408,877 US8094953B2 (en) | 2002-12-31 | 2009-03-23 | Adaptive and progressive protection of fixed images encoded in wavelets |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR0216916A FR2849565B1 (fr) | 2002-12-31 | 2002-12-31 | Protection adaptative et progressive d'images fixes codees en ondelettes |
FR0216916 | 2002-12-31 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/167,783 Continuation US7529415B2 (en) | 2002-12-31 | 2005-06-27 | Adaptive and progressive protection of fixed images encoded in wavelets |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2004062287A2 true WO2004062287A2 (fr) | 2004-07-22 |
WO2004062287A3 WO2004062287A3 (fr) | 2004-08-26 |
Family
ID=32480333
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/FR2003/050192 WO2004062287A2 (fr) | 2002-12-31 | 2003-12-19 | Protection adaptative et progressive d’images fixes codees en ondelettes |
Country Status (7)
Country | Link |
---|---|
US (2) | US7529415B2 (fr) |
EP (1) | EP1588563B1 (fr) |
AT (1) | ATE484154T1 (fr) |
AU (1) | AU2003302190A1 (fr) |
DE (1) | DE60334497D1 (fr) |
FR (1) | FR2849565B1 (fr) |
WO (1) | WO2004062287A2 (fr) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8793722B2 (en) | 2003-02-04 | 2014-07-29 | Nagra France | Protection method and device for the secure distribution of audio-visual works |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2909507B1 (fr) * | 2006-12-05 | 2009-05-22 | Medialive Sa | Procede et systeme de distribution securisee de donnees audiovisuelles par marquage transactionel |
GB2482264B (en) * | 2007-09-14 | 2012-04-18 | Doo Technologies Fzco | Method and system for processing of images |
GB2452765A (en) * | 2007-09-14 | 2009-03-18 | Dooworks Fz Co | Combining multiple image streams by reducing the colour depth of each bit stream combining them onto a single stream |
DE102010050075A1 (de) * | 2010-10-29 | 2012-05-03 | Bayerische Motoren Werke Aktiengesellschaft | Verfahren zum Betreiben einer Navigationseinrichtung und Navigationseinrichtung |
US8995306B2 (en) * | 2011-04-06 | 2015-03-31 | Cisco Technology, Inc. | Video conferencing with multipoint conferencing units and multimedia transformation units |
US11797565B2 (en) | 2019-12-30 | 2023-10-24 | Paypal, Inc. | Data validation using encode values |
US11669428B2 (en) * | 2020-05-19 | 2023-06-06 | Paypal, Inc. | Detection of matching datasets using encode values |
CN112261239B (zh) * | 2020-09-18 | 2022-05-17 | 太原理工大学 | 一种基于pud自适应分解的明文相关图像加密方法 |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1033880A2 (fr) * | 1999-03-01 | 2000-09-06 | Sharp Kabushiki Kaisha | Embrouillage d'images numériques pour systèmes de codage d'images |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2771581B1 (fr) * | 1997-11-26 | 1999-12-17 | Thomson Multimedia Sa | Procede d'embrouillage et procede de desembrouillage de donnees video numeriques et dispositifs mettant en oeuvre les procedes |
US7280607B2 (en) * | 1997-12-12 | 2007-10-09 | Freescale Semiconductor, Inc. | Ultra wide bandwidth communications method and system |
EP1011269B1 (fr) | 1998-12-08 | 2007-02-14 | Irdeto Access B.V. | Système de traitement d'un signal d'information |
US20010051881A1 (en) * | 1999-12-22 | 2001-12-13 | Aaron G. Filler | System, method and article of manufacture for managing a medical services network |
GB2358565A (en) * | 2000-01-21 | 2001-07-25 | Central Research Lab Ltd | A method of scrambling a signal |
US20030161141A1 (en) * | 2002-02-22 | 2003-08-28 | Irwin Kotovsky | Method and apparatus for lighting made from different materials |
US7349542B2 (en) * | 2002-07-25 | 2008-03-25 | Georgia Tech Research Corporation | Systems, methods and computer program products for encryption and decryption using wavelet transforms |
JP4093405B2 (ja) * | 2002-10-25 | 2008-06-04 | 株式会社リコー | 画像処理装置、プログラム及び記憶媒体 |
EP1587045A4 (fr) * | 2003-01-22 | 2006-03-29 | Matsushita Electric Ind Co Ltd | Systeme de fourniture d'information de trafic, procede et dispositif pour la formulation de cette information |
-
2002
- 2002-12-31 FR FR0216916A patent/FR2849565B1/fr not_active Expired - Lifetime
-
2003
- 2003-12-19 EP EP03810003A patent/EP1588563B1/fr not_active Expired - Lifetime
- 2003-12-19 DE DE60334497T patent/DE60334497D1/de not_active Expired - Lifetime
- 2003-12-19 AU AU2003302190A patent/AU2003302190A1/en not_active Abandoned
- 2003-12-19 WO PCT/FR2003/050192 patent/WO2004062287A2/fr not_active Application Discontinuation
- 2003-12-19 AT AT03810003T patent/ATE484154T1/de not_active IP Right Cessation
-
2005
- 2005-06-27 US US11/167,783 patent/US7529415B2/en active Active
-
2009
- 2009-03-23 US US12/408,877 patent/US8094953B2/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1033880A2 (fr) * | 1999-03-01 | 2000-09-06 | Sharp Kabushiki Kaisha | Embrouillage d'images numériques pour systèmes de codage d'images |
Non-Patent Citations (4)
Title |
---|
CHANG-TSUN LI ET AL: "Image authentication and integrity verification via content-based watermarks and a public key cryptosystem" PROCEEDINGS 2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (CAT. NO.00CH37101), PROCEEDINGS OF 7TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VANCOUVER, BC, CANADA, 10-13 SEPT. 2000, vol. 3, 10 septembre 2000 (2000-09-10), pages 694-697, XP010529562 2000, Piscataway, NJ, USA, IEEE, USA ISBN: 0-7803-6297-7 * |
LI GONG ET AL: "Elements of trusted multicasting" NETWORK PROTOCOLS, 1994. PROCEEDINGS., 1994 INTERNATIONAL CONFERENCE ON BOSTON, MA, USA 25-28 OCT. 1994, LOS ALAMITOS, CA, USA,IEEE COMPUT. SOC, 25 octobre 1994 (1994-10-25), pages 23-30, XP010100693 ISBN: 0-8186-6685-4 * |
WEE S J W ET AL: "SECURE SCALABLE VIDEO STREAMING FOR WIRELESS NETWORKS" 2001 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING. PROCEEDINGS. (ICASSP). SALT LAKE CITY, UT, MAY 7 - 11, 2001, IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), NEW YORK, NY: IEEE, US, vol. 6 OF 6, 7 mai 2001 (2001-05-07), pages 2049-2052, XP001109759 ISBN: 0-7803-7041-4 * |
ZENG W ET AL: "EFFICIENT FREQUENCY DOMAIN VIDEO SCRAMBLING FOR CONTENT ACCESS CONTROL" ACM MULTIMEDIA, PROCEEDINGS OF THE INTERNATIONAL CONFERENCE, NEW YORK, NY, US, 30 octobre 1999 (1999-10-30), pages 285-294, XP000956270 cité dans la demande * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8793722B2 (en) | 2003-02-04 | 2014-07-29 | Nagra France | Protection method and device for the secure distribution of audio-visual works |
Also Published As
Publication number | Publication date |
---|---|
ATE484154T1 (de) | 2010-10-15 |
FR2849565B1 (fr) | 2005-06-03 |
US20060215875A1 (en) | 2006-09-28 |
FR2849565A1 (fr) | 2004-07-02 |
EP1588563A2 (fr) | 2005-10-26 |
AU2003302190A1 (en) | 2004-07-29 |
US20090180613A1 (en) | 2009-07-16 |
WO2004062287A3 (fr) | 2004-08-26 |
US8094953B2 (en) | 2012-01-10 |
DE60334497D1 (de) | 2010-11-18 |
US7529415B2 (en) | 2009-05-05 |
EP1588563B1 (fr) | 2010-10-06 |
AU2003302190A8 (en) | 2004-07-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2004062292A1 (fr) | Methode et appareil de transmition securisee d’images code jpeg | |
EP1470722B1 (fr) | Dispositif pour la diffusion securisee, l acces conditionnel , la visualisation controlee, la copie privee et la gestion des droits de contenus audiovisuels de type mpeg-4 | |
US8094953B2 (en) | Adaptive and progressive protection of fixed images encoded in wavelets | |
WO2004095840A2 (fr) | Embrouillage et desembrouillage et distribution securisee de sequences audiovisuelles issues de codeurs videos bases sur un traitement par ondelettes | |
EP1470714B1 (fr) | Dispositif securise pour le traitement des oeuvres audiovisuelles de haute qualite | |
EP1588561B2 (fr) | Procede et systeme adaptatif et progressif de distribution securisee d images fixes codees en ondelettes | |
FR2843517A1 (fr) | Dispositif pour le brouillage de contenus multimedias et audiovisuels de type mpeg-4 | |
WO2004071090A2 (fr) | Procede et systeme automatiques et adaptatifs d'analyse et d'embrouillage pour des flux video numeriques | |
EP1623578B1 (fr) | Procede et systeme pour securiser l embrouillage, le desembrouillage et la distribution de sequences visuelles vectorielles | |
EP1547364B1 (fr) | Desembrouillage adaptatif et progressif de flux video | |
EP1590961B1 (fr) | Procede et dispositif de protection pour la diffusion securisee d'oeuvres audiovisuelles | |
WO2004032510A1 (fr) | Embrouillage adaptatif et progressif de flux video | |
EP1554879B1 (fr) | Dispositif pour la transformation de contenus multimedias et audiovisuels de type mpeg-2 en contenus securises de meme type | |
FR2850514A1 (fr) | Desembrouillage adaptatif et progressif d'images fixes codees en ondelettes |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PH PL PT RO RU SC SD SE SG SK SL TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 589/MUMNP/2005 Country of ref document: IN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11167783 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2003810003 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2003810003 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 11167783 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: JP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: JP |