WO2005076618A1

WO2005076618A1 - System and method for providing customised audio/video sequences

Info

Publication number: WO2005076618A1
Application number: PCT/GB2005/000351
Authority: WO
Inventors: Philippe Boulanger
Original assignee: Sony United Kingdom Limited
Priority date: 2004-02-05
Filing date: 2005-02-01
Publication date: 2005-08-18
Also published as: GB2412802A; GB0402586D0

Abstract

A method and system of providing customised video sequences, the system including: a video sequence database having at least one video sequence data file containing video data for a respective video sequence and customisation data for the respective video sequence; a user customisation interface for selecting one of a plurality of files of image data representing respective images wherein the customisation data provides information to allow insertion and animation of the images in the respective video sequence and a customisation processor for processing a selected file of image data according to the customisation data of said at least one said video sequence data file and combining the processed data with the video data of said at least one video sequence data file so as to insert the respective image in the video sequence of said at least one video sequence data file and provide , corresponding output video data.

Description

SYSTEM AND METHOD FOR PROVIDING CUSTOMISED AUDIO/VIDEO SEQUENCES

The present invention relates to a system, individual parts of it and corresponding methods for providing customised video sequences together with similar parts for producing customised audio sequences. In this regard, reference to video is intended to cover, in addition to traditional film or video, sets of consecutive still images.

Due to the ease of transfer of audio/video content over the internet, substantial lost revenues are occurring for the music and pictures industry. Furthermore, broadband availability and easy P2P (peer-to-peer) tools are increasing piracy. However, it becomes increasingly difficult for the industry to prevent this piracy.

One of the root factors in this difficulty is the fact that the content is standard. As a result, each copy is valuable in almost the same way to everyone.

The present invention is based on a recognition that advantage can be taken of Broadband and P2P technologies to provide additional markets.

If the content of a video sequence is customised according to specific end-user parameters, it is no longer standard. The customised content instead has additional value for specific end users or groups of end users.

WO 01/50416 proposes an automatic personalised media creation system. This systems elicits a performance from a user using audio and/or video cues and is automatically captured. The video and/or audio of the performance is recorded using a video camera which is automatically adjusted to the user's physical dimensions and position. Also, the performance is analysed for acceptability and the user is asked to perform again the desired actions if the performance is unacceptable. The desired footage is automatically composited and edited onto pre-recorded and/or dynamic media template footage and is rendered and stored for later delivery. However, this system is unsuitable for achieving what is desired for the present invention. It requires complicated and expensive equipment to film and direct a user according to the requirements of particular footage.

It is an object of the present invention to provide customisation of video and/or audio sequences such that this can be achieved easily and quickly by end users.

According to the present invention, there is provided a method of providing customised audio/video content, the method including: acquiring audio/video content; . providing customisation data with the audio/video content, the customisation data providing information to allow processing and insertion of additional content in the audio/ video content; selecting additional content by which to customise the audio/video content; and processing the additional content according to the customisation data and combining the processed content with the audio/video content so as to create the customised audio/video content.

The method can additionally include the step of obtaining permissions to use, in the customized video sequence, at least one of 1) the video data and 2) the image data.

According to the present invention, there is also provided a system for providing customised video sequences, the system including a video sequence database having at least one video sequence data file containing video data for a respective video sequence and customisation data for the respective video sequence; a user customisation interface for selecting one of a plurality of files of image data representing respective images wherein the customisation data provides information to allow insertion and animation of the images in the respective video sequence; and a customisation processor for processing a selected file of image data according to the customisation data of said at least one said video sequence data file and combming the processed data with the video data of said at least one video sequence data file so as to insert the respective image in the video sequence of said at least one video sequence data file and provide corresponding output video data.

Thus, when a video sequence is prepared in the studio, data is also gathered about that video sequence such that it may be provided as customisation data to the end user. For instance, information may be gathered regarding the position and movement of a particular character in the scene and provided as part of the customisation data. This will allow an end user to insert a replacement character in the same position and having the same movements. Similarly, the customisation data may allow an end user to choose backgrounds or environments. Data may be gathered regarding the positions of items in the scene, such that it can be determined whether or not an inserted character moves in front of or behind a particular item.

The resulting video sequence data file allows the end user easily to customise the video sequence.

Of course, the video sequence may be directly or indirectly computer generated. This might happen in the studio or, alternatively, under the control of the end user, optionally in real time. For instance, a computer animated character of a game could then take the form of a person whose image is stored as one of the files of image data.

The files of image data can easily be used to provide appropriate data for customising the video sequence according to the customisation data. The files or image data could contain three-dimensional image representations or two-dimensional images to be processed. The end user can provide appropriate images of choice, for instance using a camera.

In this way, video sequences, such as short video clips or entire feature films can be customised or personalised according to the taste of a particular end-user. This adds greatly to the interest and desirability of the video sequence. Similarly, animated games and the like can be customised as described above. Also, where the video comprises a set of consecutive still images (with or without text), customised comic- strip type images can be provided. These may be printed, for instance as a complete strip. Alternatively, the images can be provided by means of for example the Internet, WAP or MMS (Multimedia Messaging Service) telephones.

According to the present invention, there may also be provided a database having stored thereon at least one video sequence data file including: video data; and customisation data providing information to allow insertion and animation of an image to be defined by a user.

There may also be provided a video sequence customisation device for providing customised video sequences from a) a video sequence data file containing video data for a respective video sequence and customisation data for the respective video sequence and b) a file of image data representing a respective image, wherein the customisation data provides information to allow insertion and animation of images in the video sequence, the device including: a customisation processor for processing a file of image data according to the customisation data of a video sequence data file and for combining the processed data with the. video data of the video sequence data file so as to insert tiie respective image in the video sequence of the video sequence data file and provide corresponding output video data.

Preferably, one or more of the video sequence database, the user customisation interface and the customisation processor are located at different physical locations on a network.

Thus, the video sequence database and customisation processor may be provided on a server with the user customisation interface provided remotely with the end-user. In this way, the end user will receive only video data, either in its un-customised or in its customised form. The end-user can use the user customisation interface to define the required customisation of the video sequence. Once the video sequence has been customised, the customised video data can then be sent to the end-user.

The video sequence database could be provided on a recording medium, such as a DVD, for physical distribution to end-users.

In this situation, the end-user could have the customisation processor, for instance embodied in a PC, for carrying out the customisation process.

Preferably, the user customisation interface is arranged to select a video sequence data file from the video sequence database and the customisation processor is arranged to process the selected file of image data and combine the processed data according to the customisation data of the selected video sequence data file.

In this way, the end-user is able to choose from a plurality of different video sequences and also from a plurality of different images for customisation of those video sequences.

The system may also include an image database including a plurality of said files of image data wherein the user customisation interface allows selection of one of the files of image data in said image database.

The image database may be provided with one or more pre-set images provided by the distributor or film studio. Similarly, the image database can be used to store one or more images previously created or obtained by the end-user.

The image database may be located with the user customisation interface or remote from the user customisation interface. Where the image database is located remote from the end-user, it is possible to levy a fee each time a file of image data is used. On the other hand, user-defined image data is likely to be stored in an image database with the user customisation interface. It is, of course, possible to provide an image database in both locations.

The image database may be provided on a recording medium, such as a DVD/ CD/ROM, for physical distribution to end-users.

In this way, pre-set files of image data may be sold and distributed to end-users.

The system may be provided with an image processor for creating, from an image, one of said files of image data.

Preferably, the image processor is located with the user customisation interface.

In this way, an end-user may create personal files of image data, for instance images of the end-user and/or friends, family etc.

Preferably, the system further includes an output device for displaying the output video data.

The output device may be located anywhere convenient for the requirements of the system, for instance remotely connected by means of a network.

Thus, the output device may be located with or remote from the user customisation interface, with or remote from the video sequence database and/or with or remote from the customisation processor.

When the system is embodied in a telephone network, it thus becomes possible for a user to prepare a customised video sequence and send this to be received by another telephone on the network. he system may further include an advertisement database having at least one supplementary file of image data representing a respective supplementary image; wherein the customisation data additionally provides information to allow insertion of supplementary images in the respective video sequence; and according to a predetermined user profile, the customisation processor is arranged additionally to process a supplementary file of image data from the advertisement database according to the customisation data of said at least one video sequence data file and to combine the processed data with the video data of said at least one video sequence data file so as to insert the respective supplementary image in the video sequence.

In this way, images may automatically be inserted into the customised video sequence, those images forming advertisements. By making use of the customisation process, different images can be inserted for different users, thereby targeting advertising effectively.

The present invention is not limited only to video sequences. Hence, there may also be provided a system for providing customised audio sequences, the system including: an audio sequence database having at least one audio sequence data file containing a stream of soundtrack parameters for a respective audio sequence; a user customisation interface for selecting one of a plurality of files of voice parameters for respective voices; and a customisation processor for combining the voice parameters of the selected file with the stream of soundtrack parameters of said at least one audio sequence database file so as to produce audio data corresponding to the audio sequence of said at least one audio sequence database file in the voice of the selected file.

Of course, according to the present invention, there is also provided a database having stored thereon at least one audio sequence data file. According to the present invention, there is also provided an audio sequence customisation device including a customisation processor. Similarly, a user customisation interface and customisation processor may be used for handling both audio and video sequences.

It will be appreciated that the invention can be embodied in software such that the present invention may also provide an appropriate computer program and computer program product.

The invention can also be embodied in various business models.

According to the present invention, there is provided a method for providing customised A/V content including the steps of:

providing access to A/V content;

providing customisation data for the A/V content, the customisation data providing information to allow the processing and insertion of additional content in the A/V content;

providing means for ingestion of additional content by which to customise the A/V content; and

providing means enabling the processing of the additional content according to the customisation data and means enabling the processed additional content to be combined with the A/V content so as to create customised A/V content.

providing access to A/V content; providing customisation data for the A/V content, the customisation data providing information to allow the processing and insertion of additional content in the A/V content;

ingesting additional content by which to customise the A/V content;

enabling the processing of the additional content according to the customisation data; and

enabling the processed additional content to be combined with the A/V content so as to create customised A/V content.

At least one of the steps of provision of access to A/V content and provision of customisation data can be dependant on payment.

Payment can be a subscription or by voucher, optionally containing a key or code for enabling access to at least one of the AV content and customisation data and/or allowing the customisation to take place. The key or code may allow access to only certain portions of AV content and/or customisation data. User may enter the code manually or the code may be provided in software for allowing access and/or customisation rights. The code may be obtained by a download from a network.

At least one of the AV content and the customisation data can be provided over a transmission medium. Transmission medium may be a broadcast medium, e.g. satellite, cable, terrestrial or other broadband network or a "pull service" such as ftp download on a broadband network. Further, the customised data may be broadcast or streamed. There may be a television or radio programme or channel dedicated to showing customised data. User may only pay for customisation if their customised data is broadcast. Display of customised data may be on a display board (optionally as part of a digital signage solution) in a theatre, shop, waiting area or any suitable public space. A DVD or other suitable data carrier of customised data may be sold or otherwise distributed.

Payment can be at least one indirect payment for instance telephone, MMS, SMS premium number or premium per kb download (e.g. GPRS).

At least one of the AV content and the customisation data can be provided on a storage medium for instance, sale or rent. The storage medium could be distributed for free or at reduced cost to an end user by a promoter subject to advertisements being carried in or inserted into the customised data. Similarly, AV content and/or customisation data may be available for free or reduced cost download when advertisements are included and/or inserted.

Access to the AV content and/or execution of the customisation data can be determined by a restriction parameter for instance time restricted or number of use restricted.

Additional content can be provided dependant on further payment to a 3^rd party, for instance premium characters.

Media space, for instance for advertisements, can be made available in the AV content dependant on payment or payment in kind, for instance including viral marketing in which the system is advertised within itself. Customisation may be performed on a reduced cost or free basis if sponsored or if advertisements are displayed in the customised content. Advertisements may form part of one or more of the AV content, the customisation data and the customised data.

According to the present invention there is also provided a method for requesting to provide additional information for customising A/V content including the steps of : providing access to A/V content;

providing means requesting additional content;

providing means for enabling the processing of the additional content to be combined according to the customisation data and means enabling the processed content to be combined with the A/V content so as to create customised A/V content.

providing access to A/V content;

ingesting additional content by which to customise the A/V content;

enabling the processing of the additional content according to the customisation data; and enabl^'ing the processed additional content to be combined with the A/V content so as to create customised A/V content.

This may include nominating for yourself or voting from a list or a lottery in which customised data is provided only for winning entrants. The nominating, voting, lottery entrance or results may be performed using an SMS service.

The step of requesting additional content can be dependant on the selection of additional content from a predetermined list of additional content.

The selection of additional content from a predetermined list of additional content can be by means of at least one vote.

It will be appreciated that these business models are given as examples only and that AV content for customisation, customisation data and customised data may, for example, be interchangeable between models.

The invention wiUbe more clearly understood from the following description, given by way of example only, with reference to the accompanying drawings, in which:

Figure 1 illustrates schematically a system of the present invention;

Figure 2 illustrates schematically an overview of the system;

Figure 3 illustrates schematically the creation of a master content file;

Figure 4 illustrates an alternative embodiment of the present invention;

Figure 5 illustrates schematically creation of character description file; Figure 6 illustrates the present invention embodied in a telephone network;

Figure 7 illustrates the present invention embodying audio customisation; and

Figure 8 illustrates a video template example.

The present invention relates to mass-customisation of content so as to take advantage of the "Napster" effect.

It relates to a new class of content which is re-usable and which makes use of specific parameters provided by the end-user. Thus, in a video sequence, it allows the end-user to cast actors for characters in a video sequence and/or choose the background or environment. As mentioned above, the video sequence can also include a set of consecutive still images.

The content is provided as raw video data and also data to facilitate the customisation. In combination with this, the customisation process is arranged such that it can be achievedin real-time (in a digital broadcast environment) for customising news, weather or other bulletins, commercials, etc. The system can be made available at specific locations, for instance shops. Similarly, there can be non-real time applications, for instance using Content Customisation^" Farms or end-user devices such as PVRs (Personal Video Recorders), Sony PlayStations™ or PCs.

It is proposed that the story line scenario of a video sequence forming the customisable content should be the same for everyone, building upon the specific skills of the content specialists (scenarios, dialogues, special effects, pace, music ...). In other words, these aspects will be chosen and defined by the director of the video sequence in the studio.

Figure 1 illustrates the overall general concept. Once'a video sequence has been prepared by, for instance, a studio, the video data for that sequence is provided with customisation data in a database of master content files. The customisation data provides information for the video data to allow customisation by the end-user.

Where the video data comprises a set of still images, or course, these can be acquired using a still camera. Alternatively, the still images could be scanned or created by software and the like.

The database 2 may be provided directly to the end user, for instance as a DVD or CD or ROM. In these instances, the data carrier may be protected using any suitable form of Digital Rights Management, including copy prevention mechanisms, digital watermarking or encryption. In a preferred embodiment, the database is provided as a server on a network, such that the customisation data itself is never directly available to the end user. A different digital watermark may be applied to the video sequence(s) on each storage medium distributed which enables tracking or policing of individual copies in the case where unauthorized copies of the video sequence(s) are made. This is sometimes known as a digital fingerprint. Preferably the digital watermarking scheme is resistant to collusion attack, in which unauthorized copies are made with the intension of defeating the watermarking scheme (or implicating other legitimate users) by generating an unauthorized copy from a number of individually watermarked versions. Common collusion attacks are performed by averaging the sample values of content from a number of individually watermarked versions. Watermarks may be inserted in the spatial, frequency, time or any other suitable domain.

Where the database 2 contains more than one master content file or video sequence data, the end-user then selects the file 4 of the video sequence of his or her choice.

The end-user is then able to choose how to customise the video sequence, for instance by inserting desired images in the video sequence. In the illustrated embodiment, the end-user can select images of actors to play various characters in the video sequence.

A database 6 of images, in this case, characters or actors, ma be provided from which to choose the particular images 8 for use with the selected video sequence file.

The database 6 -of selectable images may be provided as part of the service. However, as will be mentioned below, means might also be provided for the end-user to capture his or her own images, for instance of friends or family, to include in the database. Thus, the database 6 could be distributed between one or more of a database on a network, a purchased ROM or random access memory or local user memory.

With the video sequence file 4 and cast of characters file 8 both chosen, the customisation processor then processes the data for the images of the cast of characters 8 according to the customisation data of the selected master content or video sequence data file 4. In other words, the image data from the file 8 might be sized, positioned and/or animated as necessary. It is then combined with the raw video data of the file 4 so as to produce the required customised content 12 making up the output video data.

The output video data can then be provided back to the end-user and/or a third party.

By means of the present invention, it is possible to offer to any customer what previously would have been too complex to manipulate for a normal user.

In order to realize this, the process is arranged to be sufficiently simple so that the video and 3D manipulation is done automatically and seamlessly for the end-user.

As illustrated in Figure 2, the preferred elements are:

1) Creation of a 3D model: the user provides a couple of still pictures. There should be as little user interaction as possible. 2) ' Video template: the video will be prepared so that the integration of a 3D character is much easier.

3) Video customization: because the video has been designed for customization, the 5 process is predefined and can be applied easily for any user.

• Figure 3 illustrates the examples of the customisation data which can be determined during production and provided for use in customisation a video sequence.

10 In particular, in relation to the time line, during filming and production of a video sequence, information can be recorded for the following: 3D definition (foregrounds and set layouts); per layouts, such as lighting, wind, 3D object mapping, videos and pictures, advertisement locations and props; 15 soundtracks, such as international soundtracks and per language soundtracks; per character, such as positions, moves, speeches (per language), alterations; per camera, such as positions, moves, film sensitivity, film format, lens parameters (zoom, focus, aperture, shutter speed, depth of field, etc), filter parameters; and 20. effects.

This information can be used to customise the video sequence asrequired, for instance inserting images of characters in such a way that they follow the conditions of the original filming. 25 In other words, the purpose of this process is to create a video template which contains all the data needed for the customization process. The video should include preferably at least the following elements:

30 1) Standard video with all elements appearing on screen 2) Camera information: position, focus 3) ' Light and colour information

4) Information about objects that might interact with the 3D character

5) Path and animation of the 3D character

These elements could be included in the video template with existing techniques used in motion pictures or video games. The following approaches are preferred:

1) Get as much information when the video is shot a) Take a video with character, and without character b) Take some picture with test chart to get information about light and colour c) Reference camera information d) Motion capture

2) Identify information from the video (even though some information can be retrieved, manual work is probably needed).

By using a system such as this, it is possible to provide unique content to unique customers. Casting can be done by the end user, using his family, friends, colleagues etc. In this way, the content has a very special value for the end user. The content will also have a special value for other people whose images have been inserted in the Video sequence or indeed to an enclosed group of individuals related in some way to those people. It allows people to insert images of themselves or friends or family into their favourite movies or shows and to perform with stars of those shows. Similarly, friends or colleagues can be inserted into sequences for fun.

This process combines the video template and the 3D character and is done automatically without manual work.

In short, the 3D character can act as a puppet that will follow the script described in the video template: " A polygon mesh can be inserted according to key points annotated on the video template, including interaction with object (through layer properties).

Shadows and light exposure can be added to the mesh according to the information included in the video template.

The texture can be adapted to fit the colour and light conditions of the video.

Based on the example of video template given below, the customisation process will mostly appear on the 3D character layer. The things to do will be: replace the 3D character by matching the key points in the environment adapt the 3D model to the environment: camera position, focus, lights conditions, colour calculate and integrate interaction with other object: this could be complex depending on the scenario of the video, but the basic interaction will be with lights and shadows.

Once the work on the 3D character layers is done all layers are merged and the customized video is created.

The resulting content takes advantage of the "Napster" effect by providing viral marketing.

The customised content being sent to others will promote itself and recipients will be willing to have their own customised content.

The customised content could carry promotional messages, for instance promoting products or services or selling the media space to other companies. Advertisements could be customised in respect of end-user segments.

Furthermore, referring to Figure 4, it will be seen how advertisements may be included in a video sequence by means of the customisation data.

A database of master advertisement files 14 can be provided in the system. This can provide files similar to those in the image database 6 of characters or actors. However, instead of end-user selection, appropriate files or images can be selected from the database 14 according to predetermined business rules and end-user profiles.

In certain, circumstances, it may be necessary to obtain permission from a rights holder in a piece of media in order to be legitimately able to customise it. Conversely if a user wished to insert a celebrity character (premium character) into their own home video, it may be necessary to obtain permissions from that celebrity. The step of obtaining permissions may involve contacting the rights holder and receiving the necessary permissions. This may be done for example by means of connection to a networked database which issues the necessary permissions and authorisations. The database may be operated as a permissions brokering service by a third party.

Hence, in the customisation processor 10, there is a process 10a of character inclusion according to the selection by the end-user and also of advertisement inclusion 10b.

This allows advertising to be directed effectively to end users within customised content which feels very personal to the end user.

To create a 3D model out of still image preferably the following elements are used:

3D model structure : key points are located on the picture, such as eyes, mouth, and nose location. The key points can then be used to modify a 3D model consisting of polygons, so that it is adapted to the morphology of the person represented on the pictures. 3D model texture: this texture created out of the pictures can be mapped on the polygons mesh.

As much as possible, face recognition software can be used in order to rriinirnize manual work for the end-user.

Figure 5 illustrates schematically one way of creating a file 8 of image data for a character.

Two-dimensional images of a head from different views may be taken so as to build up a three-dimensional representation of the character. In addition, various facial expressions may be taken to assist in animation of the face.

For some animations, it may be necessary, in addition to the head, to acquire images of , the full body and process these similarly.

It is also possible for the images to be in the form of drawings or other artificial images. These may be generated internally, possibly automatically, as part of the system, for instance by software. Alternatively, images may be acquired by image scanning and the like.

As will be mentioned further below, it some applications, there may be the need to acquire voice parameters.

Of course, the users' rights with regard to these images will require careful consideration.

Figure 6 illustrates schematically another arrangement in which the present invention has significant advantages. In a telephone network, an end-user telephone 20 may be used to select a particular master content or video sequence data file and also to select the desired images or characters for insertion into that sequence.

The files may be held remotely on the system and, indeed, the customisation process may be conducted remotely.

The resulting customised video sequence can then be transmitted to a third party end- user telephone 22.

It would also be possible to use the end-user telephone 20 to input (by means of a camera) images of characters to be inserted into the video sequence.

The present invention can thus be used in a number of different environments and arranged in a number of different ways .

It can be delivered for example through the Internet, or physical DVDs, CDs, UMD, HiMD or wireless to mobile telephones (next generation of background screens or MMS). The services could be subscription based, paid by advertisements or funded on a pay-per-us e basis .

It can be used in combination with all new movies or music videos. Indeed, where music video clips are currently provided free as part of advertising, allowing customisation in the manner proposed could provide a new revenue stream.^'

There can be specifically designed content.

Furthermore, virtual actors can be provided, allowing an end-user to choose from a selection of known actors to insert into the video sequence. A fee can be charged for using such known actors . The system can be used to sell media space in content or, as explained above, advertisements could be based on target customers.

It allows the selling of viral marketing media space with commercials of specific content to be sent on the network.

The customisation processing may be integrated as a real-time feature in operating in hardware and/or software in for example TV sets, set-top boxes, personal video recorders, PCs, mobile phones, gaming platforms, PDAs.

In the studio, some cameras and devices already capture automatically studio set parameters. However, for the present invention, cameras and devices are used to produce real-time information for the customisation data and capture parameters such as camera positions, moves, objectives, lighting, 3D environment, character positions and moves, advertisement locations on the set etc.

In one embodiment, it is proposed that images of a member of the audience to a video presentation can be used for the image data, such that that member of the audience is automatically inserted into the video sequence.

As mentioned above, it is possible to applythe present invention to audio sequences as well as video sequences.

Figure 7 illustrates schematically the process involved.

A file 30 is provided containing the voice parameters of a particular person. These parameters enable synthesisation of speech with the apparent voice of the person having those voice parameters. During the production of a particular audio sequence, usually in conjunction with a video sequence, soundtrack parameters are calculated and recorded for the particular . speech or dialogue required. These are stored as a file 32. A customisation processor 40, which could be part of the customisation processor 10 discussed above, then synthesises the speech or dialogue defined by the soundtrack

• parameters with -the voice parameters of a selected file or person. In this way, a soundtrack may be produced with the speech or dialogue as defined by the soundtrack parameter file 32, but with the voice of the character chosen, to produce the output soundtrack 42.

As with the video customisation discussed above, the various elements of this system can be provided at different locations on a network and in different forms. It allows the end-user to choose from predetermined voices or, indeed, voice parameters may be determined for the end-user and/or friends or family, such that those voices can be used to recite the required speech or dialogue.

The invention may also be used as part of a business method for revenue generation. it may be used with PlayStations ^/PCs/TVs/PVRs or any device or combination of devices with sufficient data processing power and could be: a)Online Based on subscription, or pay per use. b)Offline The customisable content is sold or rented on a media (CD/DVD/UMD/HiMD), with or without the customisation SW. The customisable content might be here restricted in time or number of uses. c)Broadcast Based on subscription, or pay per use.

It may be used with telephones and could be: ^' a)Based on subscription for a limited or unlimited use of content b)Based on premium SMS, MMS, phone number or equivalent pay per use schemes.

On all points above, it could include customisation of Advertisements. For instance, media space inside the customisable content is sold to advertisers. Customisation might be or not be based on user profile, and/or business rules .

There may be Subsidized/Sponsored content. For instance, all previous fees/costs can be reduced for end-users, even down to 0, if a company sponsors or pays for viral marketing activities.

It could be used with Movie Theatres. For instance, a fee on every Movie Ticket could be requested for using the IP in Theaters using these technologies.

It could be used in public booths similar to photo booths.

It could be used with Interactive TV (Who wants to be an actor, model, presenter...?) Use of any return channels, SMS, premium phone numbers, web sites... for: Applying for acting virtually in a broadcast show (music, soap, movie, game, presentation of news, commercials...). Voting for who should act virtually or should be rejected in a broadcast show (music, soap, movie, game, presentation of news, commercials...). In this case, regular TV is used by end users, and the customisation process is made at broadcast or production time. And licenses for the rights of above.

It could be used with Viral Marketing. For instance, a fee on Viral Marketing deployment could be requested to bring a customised or customisable content into Viral Marketing networks (internet based or others). It could include Use of Characters. For instance, the use of some (known) Characters might be authorized only with a fee, above any subscription or pay per use.

As previously mentioned, media sequences for customisation may be protected from ^' unauthorised use by DRM. Data for insertion to form the output customised content may itself be protected in a similar way. Whilst the output customised data may normally be of little value exeept to the person who generated and/or features within it, it may be desirable to protect the output customised data (for instance when premium characters are involved). Again DRM such as digital watermarking/ fingerprinting and encryption may be used to protect, track or police the customised output enabling rights holders to protect against unauthorised use.

The system may be designed as promotional or preview system in which customised content is generated with a perceivable (e.g. audible or visible) watermark that degrades the output customised content in some way. For example, a visible watermark may obscure part^'of the output customised content, but still provide a preview to the user. In such circumstances, a user could decide from preview output with a perceivable watermark whether they liked the output and whether to purchase enabling data (such as key) which allows removal (so-called washing) of the perceivable watermark. Once washed, the output customised content can be fully appreciated by the user. It is not necessary to regenerate the custom content since content portions obscured by the perceivable watermark is included within the output customised content in an encrypted form. The enabling data removes the perceivable watermark, decrypts the content portions that were obscured by the perceivable watermark and restores the customised content. A perceivable watermark may take the form of an advertisement or give instructions on how to obtain enabling data to remove it. The enabling data may wash the perceivable watermark and insert a digital watermark which is substantially invisible into the restored customised content for tracking/policing. The perceivable watermark may alter with time, such that the customised content becomes increasingly obscured, tempting the user into purchasing enabling data. Video Template Example

In this example, as illustrated in Figure 8, the video template consists of two main elements: the video layers the 3D environment data The video layers:

The number of video-layers will depend on how many characters will be in the scene, in general there should be at least a background, the layer containing the 3D character to be replaced and a foreground layer.

The order of the layers can evolve during the video.

In some cases, it may not be necessary to consider interaction between objects in different layers. However, extra layers could be used to take into account object interaction in terms of light and shadow.

Each video layer is preferably shot independently (or created fully digitally), taking into account the 3D parameters environment (e.g. camera position, light conditions...). ^' In order to merge the layers, two techniques can be used: chroma keying or the use of the alpha channel.

The 3D environment data:

Example of data to be gathered: o Camera data: In particular this includes the position, focal length, aperture, exposure, color balance...

o Lights data: This should includes all data about light sources in the environment (position, color, intensity).

o 3D character data: in particular this might include the coordinates of the key points of the 3D character. In some cases, other data might also be needed.

o Other: for instance data about objects that would interact with the character (e.g. water, smoke, wind, objects...). Extra data might also be gathered in order to facilitate the calculation of shadows.

The data should preferably be referenced for a certain number of key frames, a transition function will enable a smooth and seamless evolution of the parameters during the video.

Claims

1. A system for providing customised video sequences, the system including: a video sequence database having at least one video sequence data file containing video data for a respective video sequence and customisation data for the ■ respective video sequence; a user customisation interface for selecting at least one of a plurality of files of image data representing respective images wherein the customisation data provides information to allow insertion and animation of the images in the respective video sequence; and a customisation processor for processing at least one selected file of image data according to the customisation data of said at least one said video sequence data file and combining the processed data with the video data of said at least one video sequence data file so as to insert at least one respective image in the video sequence of said at least one video sequence data file and provide corresponding output video data.

2. A system according to claim 1 wherein: one or more of the video sequence database, the user customisation interface and the customisation processor are located at different physical locations on a network.

3. A system according to claim 1 or 2 wherein: the video sequence database is provided on a recording medium for physical distribution to end users.

4. A system according to claim 1, 2 or 3 wherein; the user customisation interface is arranged to select a video sequence data file from said video sequence database and the customisation processor is arranged to process the selected file of image data and combine the processed data accoding to the customisation data of the selected video sequence data file so as to insert the respective image of the selected file of image data in the video sequence of the selected video sequence data file. .

5. A system according to any preceding claim, further including: an image database including a plurality of said files of image data; wherein the usercustomisation interface allows selection of one of said files of image data in said image database.

6. A system according to claim 5 wherein the image database is located at one of: with the user customisation interface; and remote from the user customisation interface.

7. A system according to claim 5 or 6 wherein: the image database is provided on a recording medium for physical distribution to end users.

8. A system according to any preceding claim, further including: an image processor for creating, from an image, one of said files of image data.

9. A system according to claim 8 wherein: the image processor is located with the user customisation interface.

10. A system according to any preceding claim, further including: an output device for displaying the output video data.

11. A system according to claim 10 wherein the output device is located at one of: with the user customisation interface; ' with the video sequence database; with the customisation processor; remote from the user customisation interface; remote from the video sequence database; and remote from the customisation processor.

12. A. system-according to any preceding claim further including: an advertisement database having at least one supplementary file of image data representing a respective supplementary image; wherein the customisation data additionally provides information to allow insertion of supplementary images in the respective video sequence; and according to a predetermined user profile, the customisation processor is arranged additionally to process at least one supplementary file of image data from the advertisement database according to the customisation data of said at least one video sequence data file and to combine the processed data with the video data of said at least one video sequence data file so as to insert at least one respective supplementary image in the video sequence.

13. A telephone network including the system of any preceding claim.

14. A database having stored therein at least one video sequence data file including: video data; and customisation data providing information to allow insertion and animation of an image to be defined by a user.

15. A video sequence customisation device for providing customised video sequences from a) a video sequence data file containing video data for a respective video sequence and customisation data for the respective video sequence and b) at least one file of image data representing at least one respective image, wherein the customisation data provides information to allow insertion and animation of images in the video sequence, the device including: a customisation processor for processing at least one file of image data according to the customisation data of a video sequence data file and for combining the processed data with the video data of the video sequence data file so as to insert at least one respective image in the video sequence of the video sequence data file and provide corresponding output video data.

16. A video sequence customisation device according to claim 15 further including: a user customisation interface for selecting at least one of a plurality of files of image data representing respective images; wherein the customisation processor is arranged to process at least one selected file and combine the processed data of the at least one selected file with the video sequence data file.

17. A system according to any one of claims 1-13 , further including: an audio sequence database having at least one audio sequence data file containing a stream of soundtrack parameters for a respective audio sequence; wherein the user customisation interface is additionally for selecting one of a plurality of files of voice parameters for respective voices; and the customisation processor is additionally for combining the voice parameters of the selected file with the stream of soundtrack parameters of said at least one audio sequence data file so as to produce audio data corresponding to the audio sequence of said at least one audio sequence data file in the voice of the selected file.

18. A system for providing customised audio sequences, the system including: an audio sequence database having at least one audio sequence data file containing a stream of soundtrack parameters for a respective audio sequence; a user customisation interface for selecting one of a plurality of files of voice parameters for respective voices; and a customisation processor for combining the voice parameters of the selected file with the stream of soundtrack parameters of said at least one audio sequence database file sσ as to produce audio data corresponding to the audio sequence of said ^" at least one audio sequence database file in the. voice of. the selected file.

19. , A method of providing customised audio/video content, the method including: acquiring audio/video content; providing customisation data with the audio/video content, the customisation data providing information to allow processing and insertion of additional content in the audio/ ideo content; selecting additional content by which to customise the audio/video content; and processing the additional content according to the customisation data and combining the processed content with the audio/video content so as to create the customised audio/video content.

20. A method of providing customised video sequences from a) a video sequence data file containing video data for a respective video sequence and customisation data for the respective video sequence and b) at least one file of image data representing at - least one respective image, wherein the customisation data provides information to allow insertion and animation of images in the video sequence, the method including: processing at least one file of image data according to the customisation data of a video sequence data file ; and combining the processed data with the video data of the video sequence data file so as to insert at least one respective image in the video sequence of the video sequence data file and provide corresponding output video data.

21. ' A method according to claim 20 further including: obtaining permissions to use in the customised video sequence at least one of 1) the video data and 2) the image data.

22. A computer program comprising program code means for performing all the steps of claim 19, 20 or 21 when said program is run on a computer.

23. A computer program product comprising program code means stored on a computer readable medium for performing the method of claim 19, 20 or 21 when said program product is run on a computer.