Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
  • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
  • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
  • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
  • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
  • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
  • H04N21/2347—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
  • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
  • H04N21/835—Generation of protective data, e.g. certificates
  • H04N21/8355—Generation of protective data, e.g. certificates involving usage data, e.g. number of copies or viewings allowed
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/16—Analogue secrecy systems; Analogue subscription systems
  • H04N7/167—Systems rendering the television signal unintelligible and subsequently intelligible
  • H04N7/1675—Providing digital key or authorisation information for generation or regeneration of the scrambling sequence

Definitions

• the present invention relates to the scrambling of any program or multimedia sequence using a nominal stream format of MPEG-4 type so as to carry out by authorized users, conditional access, secure broadcasting, recording control. , private copying and viewing of these multimedia programs or sequences and offers a secure system for processing, accessing, broadcasting, delivering, recording, private copying, viewing and managing rights to interactive video or multimedia programs and sequences.
• the general problem is to provide a device capable of securely transmitting a set of films of high visual quality in an MPEG-4 type format live to a television screen and / or to be recorded on the hard disk of a box connecting the remote transmission network to a screen such as a monitor, television screen, video projector or cinema screen while preserving audiovisual quality but avoiding any fraudulent use such as the possibility of making pirated copies of films or audiovisual programs recorded on the hard drive of the set-top box.
• the invention also allows complete control over the use of copies and the rights attached to the works thus distributed.
• a first layer prevents the registration of encrypted keys by protecting c ⁇ encrypted keys from users and by encrypting the che: starting from the conditional access module of the receiver t going to the transport decryption module;
• a second layer prevents a key stored on the receiver from being re-executed at the transpoi decryption module of a second receiver;
• a third layer prevents the user from decrypting transport streams without an encryption module by encrypting the fli a second time before passing it into some memory or some; processor accessible by a user.
• Event tables are transmitted with the transport stream not encrypted for immediate use or encrypted, so as to prevent unauthorized use.
• the main drawback of this solution is that it must transmit not only the encrypted data to the users, but also the decryption keys.
• the transmission of the decryption keys can be done before, at the same time or after the transmission of audiovisual programs.
• the decryption keys as well as the decryption functions of audiovisual decoders can include improved security means such as smart cards or other physical keys which can optionally , be updated remotely.
• document O09908428 discloses a multi-application processing method for a localizable active terminal in which at least one connection is made with an identifiable program dedicated to the execution of an application, said program dictating its conditions of operation at the terminal for the provision of functions.
• the terminal dialogues punctually, by the use of a link, with the management center for the realization, if necessary, of the inputs and outputs of the latter's capacities, the management center becoming slave or not of the terminal at level 1 'application to the incoming program.
• This invention also relates to the method for identifying the program and the terminal in operation. This prior art method divides the stream into a part serving to identify the user and a part which contains the program itself. In particular, said program is not unusable but only locked by the first part.
• the document EP0778513 describes a process making it possible to prevent the illegal use of information by adding control information to it in order to verify the rights of the user.
• the system makes it possible to constantly know which part of the information is used and by which user and thereby to know whether this user is in an illegal position or not. This process therefore secures the data by adding additional information which distorts the initial information.
• This invention does not claim any innovative means of protection, the protection is based on encryption keys which, although reset periodically, remain the same for all visual streams. In the event that a malicious person recovers these keys, he will be able to view all the visual flows during their period of validity.
• the method of this document applies to systems for the wide distribution of television programs, the protected films being descrambled and viewed in real time on the client equipment, and is therefore not applicable to video services on the air. request, since the possibility of storing the protected films on the recipient equipment is not treated.
• the document WO0049483 proposes a method for creating a link between the users and an editor of digitized entities.
• the method comprises at least one of the following steps: the step of subdividing said digital entity into two parts; 1 step to memorize a game in a zone memory of a server connected to a computer network; The step of transmitting the other party to at least one user having computer equipment; the step of connecting said computer equipment to said computer network; the step of establishing a functional link between said first part and said second part.
• Patent WO0197520 also presents methods, methods and devices for controlling the transmission and recording of digital content of MPEG-2 type.
• this patent has no specificity for audiovisual documents of the MPEG-4 type.
• the method is completely ineffective for low-speed telecommunications networks because it substitutes all or part of the I images whose weight in bytes is very expensive during the transmission of the second stream.
• the closest prior art is found in the HyperLOCK Technologies patents, the most relevant of which is document US05937164.
• This invention uses the solution which consists in separating the stream into two parts, the smallest of which has information necessary for the use of the largest.
• this patent is not sufficient to respond to the problem identified.
• document US5892825 includes the previous patent but in a narrower context because the streams are still encrypted there;
• document US6035329 is based on the same principle, it relates to a method allowing the reading of a disc of CD-ROM or DVD-ROM type conditionally to the identification of the rights by the insertion of a smart card on which the information necessary for reading are stored. This process is not yet sufficient for our problem because it does not guarantee that the modified stream is of the same format as the original stream.
• document US6185306 relates to a method of transmitting encrypted data from a website to a requesting computer. This process however allows the user to have at any given time all the tools necessary to copy the data.
• the prior art also knows the document EP0949815 which relates to a method and a system for protecting an MPEG type video stream, comprising decoding modules, arrangement and rearrangement tables, and which consists in reversing or permuting the order macroblocks or slices (slices) in the images, in order to degrade the visual quality of the resulting stream, thus ensuring the protection of this stream, and ensuring that the resulting stream respects the standard of the original stream, thus making it possible to read the protected stream on any player capable of accepting the original format without being disturbed or damaged.
• a first embodiment includes the protection arrangement table stored on the module manufacturing the protected stream, and an adequate rearrangement table located on the decryption module.
• Another variant is to build from the protection table a rearrangement table which is then sent to the decryption module at the same time as the scrambled data.
• a third variant consists in that the decryption module manufactures the rearrangement table on the basis of information from the arrangement table sent by the encryption system.
• the method applying only to MPEG streams containing natural video does not refer to MPEG-4 type streams.
• the variant of this invention which permutes "slices" is not applicable to MPEG-4 type flows because the "slice" structure does not exist in MPEG-4 type flows.
• This invention does not completely respond to security problems, it offers a conventional jamming solution, permuting the elements constituting the video stream, but the protected stream contains all the elements constituting it, which is sent in full to the user. . If an ill-intentioned person takes possession of the arrangement or rearrangement tables, the flow can be descrambled.
• the protected data and the arrangement tables or the rearrangement tables are sent by the same route as the protected initial flow, or even in a variant the protected data and the information for the rearrangement tables are sent by the same way and at the same time.
• the invention relates to a method for the distribution of video sequences according to a nominal flow format consisting of data representing a succession of audiovisual scenes made up of audiovisual objects hierarchized according to a script describing their spatial and temporal relationships comprising each at least one P plane as is the case with the MPEG-4 standard.
• the MPEG-4 standard indeed introduces the notion of Video Object (VO for “Video Object”), for example a character or a passing car, in the case simpler the VO being a rectangular object.
• the MPEG-4 standard also introduces the video object layer (VOL).
• VOL video object layer
• the latter is composed of Video Object Plan Groups (GOV) which contain several Video Object Plans (VOP), which represent a video object at a given time.
• This decomposition into an object greatly facilitates interactivity, and it becomes easier to obtain information about an object (the player or the passing car).
• MPEG-4 compression The basic principle of MPEG-4 compression is content. It is then necessary to separate the background of the animated objects.
• One of the characteristics of MPEG-4 is to separate the objects and the background of a scene, to then benefit from it for the compression and the additional functionalities that this will entail. This allows for a panoramic, for example, to transmit the complete background only once and to send the animated objects separately.
• An MPEG-4 coded audiovisual scene is described as a set of individualized and independent elements. It contains basic components grouped by type. These groups correspond to the branches of a cutting tree where each leaf represents a simple basic element.
• MPEG-4 audiovisual scene must be understood as the composition of audiovisual objects according to a script describing their spatial and temporal relationships.
• MPEG-4 functionality requires a representation environment or architecture that uses a different data structure from MPEG-1 and MPEG-2, because significant parts of the visual information must be accessible for interaction and manipulation .
• VOP Video Object Plan
• the task of the VOP definition plane is to define the significant objects of the scene with which independent interactions and manipulations will be possible. This means that these objects are represented in such a way as to provide simple and preferably independent access to the other objects on the scene.
• the different VOPs do not necessarily have the same spatial and temporal resolutions.
• VOP Video Object Layer
• the rectangular image is only a special case of coding multiple VOPs as an image of arbitrary shape.
• the MPEG-4 VM MPEG-4 Video Verification Model
• the information concerning the shape is not transmitted if the sequence to be coded contains only standard images of rectangular size.
• the MPEG-4 video coding algorithm has a structure similar to the MPEG-1 and MPEG-2 algorithms. This is suitable for applications that require high coding efficiency without requiring extensive content-based functionality.
• the MPEG-4 VM compression algorithm is based on the hybrid DPCM / Transform technique already used by the MPEG-1 and MPEG-2 standards.
• the first VOP of each GOV is coded in mode I.
• Each of the following images is coded using inter-image prediction (P-VOP). Only the data from the nearest previously encoded image is used for prediction. To this is added support for B-VOPs.
• the coding process is the same as that of the MPEG-1 and MPEG-2 standards.
• the input images which must be coded for each VOP layer are of arbitrary shape and the position and shape of the images vary over time. respecting a reference window.
• MPEG-4 VM then introduces the concept of VOP reference window with a macroblock grid adaptable to the shape. All the VOL layers which must be coded for an input video sequence are defined with respect to the reference window whose size is constant.
• the information on the shape of a VOP is coded before the coding of the position vectors based on the macroblock grid of the VOP and can be used both for encoding and for decoding. In the next steps of the process, only information about the movement and texture of the macroblock blocks is coded (which includes standard macroblocks and contour macroblocks).
• the invention relates, in its most general sense, to a method for distributing video sequences according to a nominal flow format intended to describe a plurality of audiovisual scenes, each scene consisting of a plurality of hierarchical audiovisual objects and of a descriptor of said hierarchy and of the spatial and temporal relationships between said objects, each video object comprising at least one digital plane P, characterized in that a flow analysis is carried out before transmission to the client equipment to generate a first modified stream, presenting the format of a nominal stream, and a second stream of any format, comprising the digital information able to allow the reconstruction of said modified plans, then to transmit separately the two streams thus generated from the server to the recipient equipment, and in that a summary of a flow is calculated on the recipient equipment in nominal format as a function of said first stream and said second stream.
• said synthesis produces a flow strictly identical to the original flow, that is to say that the process is lossless.
• each video object comprises at least one plane N, the data representing said plane being calculated as a function of the differences between said plane N and at least one other plane.
• said first stream has modified N planes.
• the data of at least one plane N is calculated by compensation for movement of said plane N with respect to the previous plane N.
• Plan N is then called plan P (predicted).
• the data of at least one plane N is calculated by compensation for movement of said plane N with respect to the preceding and following N or P planes.
• the plane N is then called plane B (bidirectional).
• the nominal stream format is defined by the MPEG-4 standard.
• said first stream has modified planes P.
• said first stream has modified B planes.
• Video streams of MPEG-4 type decompose in the form of a succession of I, P, B or S planes.
• the I planes are called Intra. These are the reference planes, of large size, they do not contain information related to the movement.
• the planes P are said to be predicted. They are linked to the planes preceding them (I and / or P planes) by motion vectors in a single direction, called forward or "Forward”.
• Planes B are said to be bidirectional. They are linked to planes I and / or P preceding and following them by motion vectors in both directions (forward and backward or "Backward").
• one of the characteristics of the MPEG-4 standard consists in decomposing a video scene into different video objects, the background can then be uncorrelated from the other video objects and encoded in the form of a plane called Sprite (S-VOP). .
• S-VOP plane called Sprite
• These plans can be static or mobile. In the latter case, we then speak of an S-GMC plan for “global motion compensation”), these mobile plans also contain information related to movement.
• the basic unit for understanding movement in a plane is the Macrobloc, which generally corresponds to a 16x16 pixel block of the image (in specific cases the size may be different, but this does not hinder the invention in any way) .
• Each Macrobloc must contain one type among the five different possible types: "Inter”, “Inter + Q”, “Inter4v”, "Intra” or “Intra + Q”).
• Each Macroblock also contains other data necessary to decode the following information. These data are differential motion vectors and luminance and chrominance blocks (4 Y blocks, 1 Cb block and 1 Cr block), which each contain the differential DC and AC coefficients, if they exist. They are used to reconstruct the DC and AC coefficients of the current block.
• the DC coefficient represents the continuous component resulting from the transformation into a discrete cosine of the values of the pixels of the block.
• the AC coefficients represent one or more non-zero horizontal and / or vertical spatial frequencies.
• the motion vectors are reconstructed at the decoder from the differential motion vector values from the stream. These values are encoded in VLC whose authorized values are normalized. They are the only values from the flow allowing to find the motion vectors.
• each of these values is decoded according to the type of movement of the plane to which it belongs. These are Forward, Backward and Direct.
• the differential motion vector is described by two values (in pixels), the first corresponds to the horizontal displacement, the second to the vertical displacement.
• differential motion vectors can also be decoded. There is only one differential motion vector in each BAB.
• the BAB or Binary Alpha Blocks are groups of 16x16 pixels from the cutting of the limitation rectangle set up for the shape coding for the video object.
• the horizontal and vertical values are coded in VLC and the authorized values are normalized.
• the video streams contain differential motion vectors, the transformation of which effectively protects the stream, making it difficult to accept visually for the human eye, while ensuring its visualization on any MPEG-4 player. .
• said analysis decides on the differential motion vectors to be modified as a function of the size desired for said second flux and of the degradation desired for said first modified flux; these changes may to be: to replace differential motion vectors of a plane P with differential motion vectors of another plane P, to invert two differential motion vectors of the same plane P, to invert two differential motion vectors of two planes P of the same flow, replace differential motion vectors of a plane P with random values, invert the value of one or more well-chosen bits of the value of the differential motion vectors of a plane P.
• at least one plane B is modified in the same way as the planes P.
• said analysis decides which planes P, B and S to modify as a function of the size desired for said second flow and the level of degradation desired for said first modified flow.
• an N plane is necessarily of type P or type B.
• the transmission of said first stream is carried out through a physically distributed hardware medium such as a CD-ROM, a DVD, a hard disk or a memory card of the flash memory type for example.
• the transmission of said first stream is carried out through a broadband network (cable, satellite, optical fiber, radio, DSL, DAB).
• a broadband network capable, satellite, optical fiber, radio, DSL, DAB.
• the transmission of said second stream is carried out through a cable network, through a switched telephone network (analog or digital PSTN), through a mobile telephone network using GSM, GPRS or UMTS standards, through a BLR network (radio local loop) or through a DSL type network.
• a switched telephone network analog or digital PSTN
• GSM Global System for Mobile communications
• GPRS global positioning system
• UMTS Universal Mobile Subscriber Identity
• the transmission of said second stream is carried out through a broadband network of the same type as the network used by said first stream, or even through the same network.
• the transmission of said second stream is carried out by means of a memory card of the flash memory type or by means of a smart card.
• the transmission of one of the two flows or of the two flows is encrypted.
• the two generated flows can be intended for a single device, for a group of devices or for all devices.
• the reconstruction is conditioned by a transaction.
• Reconstruction can also be authorized for viewing a private copy requested by the client.
• the invention relates to equipment for the manufacture of a video stream for the implementation of this method comprising at least one multimedia server containing the original video sequences and characterized in that it comprises a device for analysis of the video stream coming from said server to generate the two streams.
• this equipment includes a memory for recording a “copy” marker.
• private indicates for each sequence the rights of each user: private copy which can be viewed an unlimited number of times, private copy which can be viewed a limited number of times and what number, private copying prohibited.
• the invention relates to equipment for operating a video stream with a view to implementing this method comprising a standard stream decoder, at least one recording interface (hard disk, flash memory type memory ) intended to store the content of said first stream and / or a disc player (CD, DVD, etc.) and at least one display interface (standard screen, wireless screen, video projector) characterized in that it comprises a means for the recomposition of the original flow from the two flows.
• a standard stream decoder at least one recording interface (hard disk, flash memory type memory ) intended to store the content of said first stream and / or a disc player (CD, DVD, etc.)
• at least one display interface standard screen, wireless screen, video projector
• said means is a software application installed on the equipment.
• said means is a fixed electronic device.
• said means is a portable (mobile) electronic device with its incorporated screen.
• said means uses a product-specific resource (card) in order to avoid copying the temporary information from the second stream onto a permanent medium.
• said recording interface also stores a “private copy” marker in relation to said first stream indicating for this sequence the rights of the user: private copy which can be viewed an unlimited number of times, private copy can be viewed a limited number of times and what number, private copying prohibited.
• the equipment comprises a chip card reader making it possible to identify the user.
• the equipment comprises a chip card reader, the chip card containing the software applications.
• the equipment comprises a chip card reader, the chip card containing the data of said second stream for a given content.
• the invention relates to a system for the transmission of a video stream characterized in that it comprises equipment for producing a video stream, at least one equipment for operating a video stream and at least one network. of communication between the production equipment and the operating equipment (s).
• FIG. 1 describes the overall architecture of a system for implementing the method according to the invention
• FIG. 2 represents a particular embodiment of the flow analysis and synthesis system according to the invention
• FIG. 3 represents a particular embodiment of the flow synthesis system according to the invention.
• the invention relates to a nominal format data stream, in particular but not exclusively to an MPEG-4 type stream.
• the format of the audiovisual stream used must have the following characteristics: this format must decompose data into frames
• each frame comprising a complete I plane and at least one P plane calculated by coding the differences
• each frame comprises at least one plane B calculated by coding the differences (motion compensation) between this plane and the planes I and / or P preceding and following.
• the invention relates to a nominal format data stream, in particular but not exclusively to an MPEG-4 type stream.
• the format of the audiovisual stream used must have the following characteristics:
• this format must decompose the data into frames, each frame comprising at least one P plane;
• each plane P contains differential motion vectors between the different blocks and / or macroblocks of the planes P.
• the general principle of a method for securing a video stream is set out below.
• the objective is to authorize video-on-demand and pay-per-view services across all these broadcasting networks and local recording in the user's digital set-top box.
• the solution consists in permanently keeping a part of the recorded audiovisual program outside the user's home, in fact in the broadcasting and transmission network, this part being essential for viewing said audiovisual program on a screen. television or monitor type, but being of very low volume by ratio to the total volume of the digital audiovisual program recorded by the user. The missing part will be transmitted via the broadcast transmission network when viewing said pre-recorded digital audiovisual program at the user's.
• FIG. 1 is a block diagram of a distribution system according to the present invention.
• FIG. 2 represents a particular embodiment of the flow analysis and synthesis system according to the invention.
• FIG. 3 represents a particular embodiment of the flow synthesis system according to the invention.
• the video interface arrangement (8) is adapted to connect at least one display device, for example a monitor, a video projector or a television screen type device (6), to at least a broadband transmission and broadcasting network interface (4) and at least one telecommunications network interface (10).
• this arrangement is composed of a module (8) mainly comprising, on the one hand, a processing unit suitable for processing, in particular decoding and descrambling any video stream of MPEG-4 type according to a software program for decoding and descrambling preloaded, so as to display it, in real time or deferred, to store it, to record it and / or to send it on a telecommunications network and, on the other hand, at least a screen interface (7) and an interface for connection to a local or wide area network (5) and / or (9).
• the broadband transmission and broadcasting network (4) and the telecommunications network (10) can be combined into a single network.
• the module's hard disk (8) can be used as a buffer memory to temporarily store at least part of the program or of the video sequence to be displayed, in the event of delayed viewing or of limitation in the bandwidth of the transmission network. Viewing can be delayed or delayed at the request of the user or the portal (12).
• connection interface (5) is connected to a broadband transmission and broadcasting network (4) such as a modem, a satellite modem, a cable modem, a line interface fiber optic or radio or infrared interface for wireless communication.
• a broadband transmission and broadcasting network (4) such as a modem, a satellite modem, a cable modem, a line interface fiber optic or radio or infrared interface for wireless communication.
• MPEG-4 Since the successive shots of a video sequence contain a large number of identical visual elements (as in cinema, an image looks like the previous one), MPEG-4 only records elements that differ from the original shot. An entire reference plane will therefore be modified while preserving the modifications made to the differential motion vectors in the portal (12) and, for the successive planes which depend on this reference plane I, it is not necessary to make modifications. since they will cause the visualized flow to diverge due to the disturbances brought to the P planes.
• MPEG-4 compression therefore begins, first, by decomposing the image into different square matrices comprising several points or pixels, each having their own colorimetric value. A calculation makes it possible to obtain an average value for each matrix within which each point is now embedded. This treatment generates a pixelation and the appearance of uniform flat areas, where there were shades of tint.
• the second step in MPEG-4 compression is to keep only changing elements from one plane to another.
• the principle consists in capturing a few images over time, the intermediate images being calculated from these.
• the analysis of complete reference planes makes it possible to predict intermediate planes P.
• planes B we insert between reference planes and predicted planes, planes B.
• the video is represented as a succession of individual planes, each of which is treated as a two-dimensional matrix of image elements (pixels).
• the color representation of each pixel includes three components: a luminance component Y and two chrominance components, Cb and Cr.
• Compression of digitized video is achieved by the use of several techniques: under sampling of chrominance information to adapt to the sensitivity of the human visual system (HVS), quantification, compensation of movement (MC) to exploit redundancy temporal, transformation in the frequency domain by the transformation in discrete cosine (DCT) to exploit the spatial redundancy, variable length coding (VLC) and interpolation of images.
• HVS human visual system
• MC compensation of movement
• DCT discrete cosine
• VLC variable length coding
• the human visual system Since the human visual system (HVS) is most sensitive to the resolution of the luminance component of an image, the pixel values Y are encoded at full resolution. The human visual system is less sensitive to chrominance information. Subsampling eliminates pixel values based systematically on position, which reduces the amount of information to be compressed by other techniques. The standard maintains a set of chrominance pixels for each 2x2 neighborhood of luminance pixels.
• the basic coding unit for an image is the macroblock.
• the macroblocks of each image are coded successively, from left to right, and from top to bottom.
• Each macroblock is composed of 6 8x8 blocks: four luminance blocks, a Cb chrominance block and a Cr chrominance block. Note that the four luminance blocks cover the same area of the image as each of the chrominance blocks, due to the sub-sampling of the chrominance information, carried out to adapt the coding to the sensitivity of the human visual system.
• the first operation is the choice of the coding mode which depends on the type of image, on the efficiency of the motion-compensated prediction in the coded region, and on the nature of the signal contained in the block.
• a motion-compensated prediction of the contents of the block, based on past or future reference images is formed. This prediction is subtracted from the actual data of the current macroblock, to form an error signal.
• this error signal is divided into 6 8x8 blocks (4 luminance blocks and 2 chrominance blocks in each macroblock) to each of which is applied a discrete cosine transformation.
• the resulting 8x8 block of DCT coefficients is quantized.
• the resulting two-dimensional block is zigzagged to be converted into a one-dimensional chain of quantized DCT coefficients.
• the additional information of the macroblock (type, vectors, etc.) as well as the data of the quantized coefficients are coded. To achieve maximum efficiency, a number of variable length coding tables are defined for the different data elements. Range length coding is applied to the quantized coefficient data.
• the DCT coefficient of the upper left point (0,0) of the block represents a zero horizontal and vertical frequency: it is called DC (continuous) coefficient. Since the DC coefficient is proportional to the average value of the pixels in the 8x8 block, predictive coding allows additional compression, since the difference in the average values of the neighboring 8x8 blocks tends to be relatively small.
• the other coefficients represent one or more non-zero horizontal and / or vertical spatial frequencies and are called AC coefficients. For that the level of quantification of the coefficients corresponding to the high spatial frequencies favors the creation of a zero coefficient, a quantification step is chosen such that the human visual system (VHS) has little chance of perceiving the loss of the spatial frequency concerned, unless the value of the coefficient is above this level of quantification.
• VHS human visual system
• the statistical coding of the predicted ranges of consecutive high order coefficients of zero value contributes considerably to the compression gain.
• VLC Variable Length Coding
• the invention consists in using and modifying the differential motion vectors of the planes P and / or B and / or S, in order to be able to manipulate the appearance and the visual validity of the sequence to which the plans in question belong.
• the complete MPEG-4 stream (101) is analyzed by the analysis device (121) of the portal (12); all the planes P are analyzed in order to find each of their differential motion vectors. For each value found, the system saves it in the buffer (123) of the portal (12), and it is replaced in the stream by the maximum value authorized by the standard, identically for each value found.
• the transformed stream is stored in the output buffer (122), its size is different from the original stream (101), but it is perfectly readable by any reader (8) capable of reading the original stream ( 101).
• all the planes P of the complete MPEG-4 stream (101) are analyzed by the analysis device (121) of the portal (12) in order to find each of their differential motion vectors.
• all the planes P of the complete MPEG-4 stream (101) are analyzed by the analysis device (121) of the portal (12) in order to find each of their differential motion vectors.
• a conventional MPEG-4 decoder When reading the bitstream, a conventional MPEG-4 decoder identifies the start of a coded clip, then the type of the clip. To avoid any confusion between a standard decoder box often called “Set Top Box or STB”, the standard MPEG-4 decoder will be called “Player” (“Player” or “Viewer”) in the remainder of the document.
• This Reader can be made in hardware and / or software.
• the MPEG-4 player successively decodes each macroblock in the plan. The plan is rebuilt when all of its macroblocks have been processed. If it is an I plane, it constitutes a reference plane for the subsequent planes and it is stored in place of the oldest reference plane.
• the plans are thus available, in digital form, for post-processing and display, at the option of the application.
• the characteristics in accordance with the invention are the differential motion vectors contained in the planes P.
• the device according to the invention will interpose false differential motion vectors of the same kind as the differential motion vectors removed and kept in the portal (12 ) so that the standard MPEG-4 player of module (8) is not disturbed by these modifications which it will ignore and reconstruct as output an MPEG- output stream 4 which will not be correct from the visual point of view for a human being but correct from the point of view of MPEG-4 format.
• the MPEG-4 player in the housing (8) is a standard MPEG-4 player and is in no way modified or affected by the changes made to the P plans.
• connection interface (9) is connected to an extended telecommunications network (10), directly or by a local network serving as an access network and consists for example of a line interface subscriber (Analog or digital telephone network, DSL, BLR, GSM, GPRS, UMTS, etc.).
• a line interface subscriber Analog or digital telephone network, DSL, BLR, GSM, GPRS, UMTS, etc.
• the audiovisual programs are conventionally broadcast in multicast mode (“broadcast”) via the broadband transmission network (4) of the radio type, cable, satellite, digital radio, DSL, etc. from the server (1) directly via the link (3bis) or via the portal (12) via the link (2) and (3) to the decoder module (8) through the link (5).
• Each audiovisual program thus broadcast may or may not be encrypted, and, in accordance with the present invention, the MPEG-4 type streams include modifications at the level of certain P and or B planes as described above.
• certain audiovisual programs thus modified and incomplete are recorded in the hard disk of the box (8).
• modified differential motion vectors of the P planes thus transmitted are never recorded in the hard disk of the box (8) because the reconstructed P planes are directly displayed on the display screen (6) via the link (7) after being processed by the Reader of the box (8) from its volatile local memory. Once processed and displayed, the modified and / or missing differential motion vectors of the planes P having just been transmitted by the portal (12) will be erased from the local volatile memory of the box (8).
• the original values of the differential motion vectors of the planes P thus broadcast can be encrypted or not, by any existing or future encryption means. It is the same for the algorithms, the functions and the parameters of reordering of the modified differential motion vectors of the planes P.
• the box (8) Whenever the user wants to watch a program recorded in the hard disk of the box (8) the box (8) will automatically connect to the portal (12). Likewise when the user pauses, the transmission of the modified differential motion vectors of the P planes coming from the portal (12) will be interrupted until the resumption of viewing, thus guaranteeing that all the information of an audiovisual program. do not end up in the housing (8) at a given time and thus preventing a person ill to make pirated copies of these recordings.
• the box (8) comprises a smart card reader which will allow the portal (12) to authenticate the user who owns the box (8).
• the smart card contains said second stream which has been stored by the portal (12). If authorized, the smart card also allows the user to make private copies of audiovisual programs recorded on the hard disk of his decoder box (8). For this, if the user wants to make a private copy of an audiovisual program, he will do it conventionally on a video recorder via the link (7) which connects the box (8) to the display screen (6).
• the box (8) will automatically connect to the portal (12) and will indicate to the latter that the user wants to read his private copy; in return, if the reading of the private copy is possible for this user who has this smart card connected to this box (8), the decoder box (8) will then receive the modified and / or missing differential motion vectors from the plans P as well as all the other information allowing viewing of the audiovisual program constituting private copying.
• the server which will record the "private copy" information for this program in the private copy memory (124). of the portal (12) and for this user authenticated by the smart card.
• the box (8) will automatically connect to the portal (12) and will indicate to the latter that the user wants to read his private copy; in return, if the reading of the private copy is possible for this user who has this smart card and for this program, the decoder unit (8) will then receive the missing differential motion vectors from the P planes as well as all the other information allowing viewing the audiovisual program constituting private copying.
• the so-called private copy may allow the user to watch this same audiovisual program in an unlimited manner or a number of times determined in advance by the service provider who authorized this private copying.
• the present invention also relates to the physical box (8) used by the consumer to access the data.
• This physical box is located at the user's home. It provides a set of functionalities which manage the appropriate information to be presented according to the selection of the audience and manages the connection and communication with the remote server.
• the physical box corresponding to the video interfacing arrangement (8) is produced as a fixed autonomous device with integrated hard disk. According to a particular embodiment, the physical box corresponding to the video interface arrangement (8) is produced as a portable autonomous device
• the autonomous physical box (8) comprises a smart card reader.
• the video interfacing arrangement (8) is produced as an additional card which will be installed in a PC type computer and will be connected to at least one broadband transmission and broadcasting network interface ( 4) and at least one telecommunication network interface (10).
• This card will use the hard drive of the PC computer for recording the first stream, but will include its own calculator and its own volatile memory so as not to leave the malicious PC user with the means of accessing information.
• the video and multimedia servers (1) and / or (12) comprise means for coding, transcoding and scrambling of video data, in particular means for adding cryptographic and security information at the start and throughout the sequences.
• the invention degrades the MPEG-4 stream from a visual point of view until it no longer allows recognition of the transmitted and displayed scenes without having access to additional data and characteristics, but completely reconstructs the MPEG-4 stream. in the video interfacing arrangement (8) without any loss.
• the present invention is more particularly focused on audiovisual data, it is understood that all interactive multimedia information and all interactive data can be processed by the present arrangement and the present system, the MPEG-4 type video data being the most elaborate. .
• the present invention will be better understood thanks to the following description presenting the physical basis of the present invention and with reference to FIG. 2 of the appended drawing representing a preferred embodiment of the latter as a non-limiting example of particularly good embodiment suitable for cable and satellite networks.
• the complete MPEG-4 stream (101) is analyzed by the analysis device (121) of the portal (12) and will thus be separated into a stream of MPEG-4 type but some or all of the differential motion vectors of the planes P will have been processed and which will be sent via exit (122) from the portal to the broadband transmission broadcasting network (4).
• the other part of the modified MPEG-4 stream will be stored in the buffer memory (122) of the portal (12).
• the portal (12) will keep in a buffer memory (122) the modifications which have been made to this MPEG-4 stream by the analyzer (121) of the portal (12). It is specified that, for the same MPEG-4 input stream (101), the processing of the stream may be different for each user (8) and / or for each group of users (8).
• the buffer memory (123) of the portal (12) includes a different memory area for each user.
• the differential motion vectors of certain planes P of the MPEG-4 stream are modified; for a second user, certain vectors of differential movement of the P planes and of certain B planes of the MPEG-4 stream are modified; in the third example, the device (8) is portable (mobile).
• the portal (121) has chosen the MPEG-4 stream (101) which it will have to send to the user (8) in order to be watched in deferred fashion on its television screen (6).
• This user is connected to a digital cable broadcasting network (4) and to an ADSL telecommunications network (10).
• the analysis system (121) of the portal (12) will therefore read the incoming MPEG-4 stream (101) and, each time it detects a plane P, it breaks it down into macroblocks, then into blocks.
• This analysis allows him to recognize in the code the differential motion vectors, and to substitute some of them by random values, in order to make the planes (and consequently the sequence) unreadable from the human visual point of view.
• the true values of the differential motion vectors will be stored in the output buffer (123), which will later allow the reconstitution of the starting sequence in the housing (8), following the reverse diagram.
• one out of two macroblocks comprises a modified block (differential motion vectors).
• the analysis system (121) then writes the value of the substituted coefficient of the modified plane P into the buffer (123).
• the analysis system (121) continues its analysis until the end of the MPEG-4 input stream.
• the new modified MPEG-4 stream is then recorded in the output buffer (122) to be broadcast on the broadcast network (4) through the link (5).
• the substituted differential motion vectors of the modified P planes of the incoming MPEG-4 stream (101) are stored in the buffer (123) of the portal (12).
• the modified MPEG-4 output stream coming from the output buffer (122) of the portal (12) is broadcast via the broadband network (4) to one or more users (8 ).
• Each authorized decoder unit (8) which wishes to record this MPEG-4 stream thus modified can then read this MPEG-4 stream and record it on its hard disk (85).
• This recording initiative is left to the decoder (8) under the control of the portal (12).
• the analysis system (121) had written at the start of the MPEG-4 stream, additional data information which specified the recipients of this modified MPEG-4 stream.
• the recipients can thus be a particular recipient (8) and he alone, a group of recipients (8) or all of the decoders (8) connected to the network (4).
• the phase described above corresponds to the first phase of preparation of the MPEG-4 stream by the portal (12), its transmission via the broadband network (4) and its recording in a decoder (8).
• This decoder can then display this MPEG-4 stream recorded on its hard disk (85).
• the synthesis system (87) of the decoder (8) will read the MPEG-4 file from its hard disk (85) and will send it to a conventional MPEG-4 player (81). If no additional data is received by the synthesis system (87), then the MPEG-4 stream which reaches the player (81) is processed and displayed as is, which causes significant distortion of the display on the display screen (6).
• the modified planes P which are processed by the synthesis system (87) do not correspond to the planes P which are necessary for a correct visualization, since certain vectors of differential motion have been replaced by random differential motion vectors.
• the recorded stream is indeed an MPEG-4 type stream
• the player (81) makes no difference and displays the information on the output screen (6) which appears well as data from a video stream. MPEG-4 but totally inconsistent with the human being who looks at the screen (6). Any copy of the MPEG-4 stream coming from the hard disk (85) of the box (8) will produce the same visual effect when it is restored by any MPEG-4 player; any use of this copy which is ill-intentioned is therefore doomed to failure.
• the user of the decoder (8) wants to view on his screen (6) the audiovisual program recorded on his hard disk (85), he requests it from the synthesis system (87) with his remote control as he would with a VCR or DVD player presenting a menu on its television screen.
• the synthesis system (87) then makes a request to the hard disk (85) and begins to analyze the modified MPEG-4 stream coming from the hard disk (85) via the read buffer (83).
• the synthesis system (87) then establishes a link with the portal (12) via the telecommunications network (10) which is in our example a DSL link.
• the synthesis system (87) sends the substituted differential motion vectors and the data from the server's buffer memory (123). corresponding to modified P shots of the stream recorded on the hard disk (85). These differential motion vectors and position data arrive at the synthesis system (87) via the input buffer memory (86) and are temporarily stored in the volatile memory (88) of the synthesis system (87).
• the synthesis system (87) reconstitutes in reverse to the analysis process described above, the planes P modified by the real plans P, and sends the new MPEG-4 stream thus reconstituted towards the player (81) to be correctly displayed on the screen (6).
• the differential motion vectors to be substituted and the data associated with these planes P are erased from the volatile memory (88).
• the portal (12) verified that the user of the housing (8) was well authorized to do so. For this, the portal (12) reads the information contained on the smart card (82) of the box (8) and verifies that this user is authorized to watch this audiovisual program. It is only after this verification that the differential motion vectors and the associated data are sent from the buffer (123) to the box (8) corresponding to this user via the network (10). In the example produced, the user has also made a private copy of his audiovisual program.
• the synthesis system (87) has therefore written in a part (84) of the hard disk (85) additional data as well that the number of the smart card (82) and the information “private copy” as data associated with this audiovisual program. During the next private reading of this audiovisual program, the synthesis system (87) will analyze these associated data and will thus inform the portal (12) that the user of the decoder (8) is reading the private copy. If this function is authorized for this user (8) by the portal (12), the differential motion vectors and the associated data will then be sent by the portal (12) to the buffer (86) as described above. Otherwise, the differential motion vectors and associated data will not be sent and the user of the decoder (8) will not be able to watch the reconstructed MPEG-4 stream. Let us now describe in detail the different steps for the second user (8).
• the broadcasting network (4) is a satellite network and the telecommunication network (10) is a low bandwidth GSM type cellular telephone system.
• the user of the decoder (8) will receive the MPEG-4 streams and the complementary data from the portal (12).
• the analysis system (121) takes only one plane P on n where n is a random number between 1 and 12 and takes into account B.
• the analysis system (121) will read the MPEG-4 input stream (101) and after drawing the random number n, the synthesis system modifies the differential motion vectors in the nth plane P of the MPEG-4 stream. After each plan P thus modified, the analysis system (121) will make a new drawing of a random number n. Each random number thus used is recorded in the buffer (123) of the portal (12).
• the analysis system (121) takes into account a plan B over m where m is a random number between 1 and 5, in a frame for which the plan P has not been modified.
• the analysis system (121) of the portal (12) reads the incoming MPEG-4 stream (101) and, each time it detects an nth plane P or a mth plane B, it breaks it down into macroblocks, then into blocks .
• This analysis allows him to recognize in the code the differential motion vectors, and to substitute some of them by random values, in order to make the planes (and consequently the sequence) unreadable from the human visual point of view.
• the true values of the differential motion vectors will be stored in the output buffer (123), which will later allow the reconstitution of the starting sequence in the housing (8), following the reverse diagram.
• all the differential motion vectors of this nth plane P will not be modified.
• Only one out of two macroblocks comprises a modified block (differential motion vectors), while respecting the equality of the modification frequencies for the six blocks of a macroblock.
• the substitution of each differential motion vector is done by a randomly calculated differential motion vector, but its value is compared with the value of the differential motion vector to be substituted so as to check its deviation. If this difference is too small, another random number is calculated so as to increase the difference between the vector to be substituted and the substitution vector.
• planes B For the reconstruction of the MPEG-4 stream, the decoder (8) reads the buffers (86) and (87) and decodes the data elements of the binary train, in accordance with the defined syntax.
• the decoder When reading the bit stream, the decoder identifies the start of a coded clip, then the type of clip. It successively decodes each macroblock of the plan. The macroblock type and motion vectors are used to construct a prediction of the current macroblock, based on past and future reference planes that have been stored in the decoder. The data of the differential motion vectors are decoded. The result is added to the prediction signal, with a defined dynamic.
• the synthesis system Before sending the MPEG-4 stream to the player (81), the synthesis system (87) replaces the differential motion vectors of the P and B planes which have been replaced by those of the stream coming from the buffer (86).
• the reading of these random numbers and of the differential movement vectors substituted from the output buffer (123) of the portal (12) and reading the MPEG-4 stream thus modified from the hard disk (85) of the box (8) allows the synthesis system (87) to reconstruct the P and B planes and to send everything to the player (81).
• the plan is reconstructed by the reader (81) when all these macroblocks have been processed. If it is a plan P or a plan B, it constitutes a reference plane for the subsequent plans and it is stored in place of the old reference plane.
• the second flow required a bandwidth of less than one per thousand of the bandwidth required to transmit the high-quality MPEG-4 stream, ie less than one kilobit per second for the second stream versus one megabits per second for the first MPEG-4 stream. Let us now describe in detail the different steps for this third user.
• the MPEG-4 stream is processed by the analysis system (12) in the same way as the MPEG-4 stream of the second embodiment.
• the first modified MPEG-4 stream is recorded and recorded on a physical medium (20) of CD type from the output buffer memory of the analysis system (12).
• the second stream is stored in the buffer (123) and is also additionally recorded on a physical medium (10bis) of credit card format consisting of a smart card and a flash memory.
• This card (10bis) will be read by card reader (82) of the device (8).
• the device (8) is an autonomous, portable and mobile system.
• the device (8) comprises the synthesis system (87), the standard MPEG-4 player (81), the two buffer memories (86) and (83) as well as the disc player (85).
• the device (8) further comprises an integrated screen (6bis) of the flat screen type which allows the user to view his audiovisual programs directly on his autonomous device (8).
• the user of the device (8) introduces into his disc player (85) a disc (20bis) of type (20) identical to that recorded by the analysis system (12 ).
• This disc (2Obis) thus contains an MPEG-4 stream of the type first Flux, that is to say with the differential motion vectors of certain planes P and / or B substituted.
• the user of the device (8) can therefore view this MPEG-4 stream on his screen (6bis) integrated into his device.
• the MPEG-4 stream will not be visually correct.
• the user inserts into the chip card reader (82) the memory card (10bis) containing the second flow with the differential motion vectors.
• the synthesis system then reconstructs the correct MPEG-4 stream from the first stream from the disc (2Obis) and from the second stream from the card (10bis) connected to the player (82).
• the smart card (10bis) contains the data and the differential motion vectors of several second streams for the reconstruction of several MPEG-4 streams.
• the device (8) comprises a cellular link to a GSM network (10).

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Databases & Information Systems (AREA)
• Computer Security & Cryptography (AREA)
• Television Signal Processing For Recording (AREA)
• Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)

Applications Claiming Priority (3)

Publications (1)

Family

ID=30470966

Family Applications (1)

Country Status (7)

Families Citing this family (11)

Family Cites Families (9)

• 2002
  • 2002-08-06 FR FR0210002A patent/FR2843517B1/fr not_active Expired - Lifetime
• 2003
  • 2003-08-06 US US10/523,675 patent/US20050243924A1/en not_active Abandoned
  • 2003-08-06 WO PCT/FR2003/002477 patent/WO2004015996A2/fr active Application Filing
  • 2003-08-06 AU AU2003282814A patent/AU2003282814A1/en not_active Abandoned
  • 2003-08-06 CN CNB038238292A patent/CN100438620C/zh not_active Expired - Lifetime
  • 2003-08-06 JP JP2004526983A patent/JP2005535242A/ja active Pending
  • 2003-08-06 EP EP03756530A patent/EP1527605A2/fr not_active Withdrawn

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events