Connect public, paid and private patent data with Google Patents Public Datasets

Method and system for personalizing images inserted into a video stream

Info

Publication number
EP0950318A4
EP0950318A4 EP19980952997 EP98952997A EP0950318A4 EP 0950318 A4 EP0950318 A4 EP 0950318A4 EP 19980952997 EP19980952997 EP 19980952997 EP 98952997 A EP98952997 A EP 98952997A EP 0950318 A4 EP0950318 A4 EP 0950318A4
Authority
EP
Grant status
Application
Patent type
Prior art keywords
video
user
image
images
personalization
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP19980952997
Other languages
German (de)
French (fr)
Other versions
EP0950318A1 (en )
Inventor
Dan Bar-El
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SCIDEL TECHNOLOGIES Ltd
Original Assignee
SCIDEL TECHNOLOGIES LTD
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44012Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2668Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network, synchronizing decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44222Monitoring of user selections, e.g. selection of programs, purchase activity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client or end-user data
    • H04N21/4532Management of client or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/454Content or additional data filtering, e.g. blocking advertisements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/454Content or additional data filtering, e.g. blocking advertisements
    • H04N21/4545Input to filtering algorithms, e.g. filtering a region of the image
    • H04N21/45455Input to filtering algorithms, e.g. filtering a region of the image applied to a region of the image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/458Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/60Selective content distribution, e.g. interactive television, VOD [Video On Demand] using Network structure or processes specifically adapted for video distribution between server and client or between remote clients; Control signaling specific to video distribution between clients, server and network components, e.g. to video encoder or decoder; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/60Selective content distribution, e.g. interactive television, VOD [Video On Demand] using Network structure or processes specifically adapted for video distribution between server and client or between remote clients; Control signaling specific to video distribution between clients, server and network components, e.g. to video encoder or decoder; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
    • H04N21/65Transmission of management data between client and server
    • H04N21/654Transmission by server directed to the client
    • H04N21/6547Transmission by server directed to the client comprising parameters, e.g. for client setup
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/812Monomedia components thereof involving advertisement data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8146Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H04N21/8153Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17345Control of the passage of the selected programme

Abstract

A method and system for personalizing images inserted into a video stream, provided by a video service (11) to each of its clients (12) according to a priori individual knowledge of its clients. The present invention generates a user profile (10) from video sequences selected by the user from a video server (11) having a plurality of video sequences stored therein. The selected video sequence is personalized according to the user profile, for transmission to the user (12).

Description

METHOD AND SYSTEM FOR PERSONALIZING IMAGES INSERTED INTO A

VIDEO STREAM

FIELD OF THE INVENTION

The present invention relates to systems and methods for inserting images into a video stream in general.

BACKGROUND OF THE INVENTION

Currently, video services mainly include broadcasting of standard TV programs over the air, through cable systems or via satellite. The latter is in the form of digital video. Other digital video services are mainly transmitted point-to-point via communication networks such as the telephone system or the

Internet.

There are two forms of TV advertising. In one, an advertising video clip is shown between portions of a TV show or static images are superimposed on a portion of a screen. In another, bulletin boards of advertisements are seen. The latter is common at sports events where the advertising boards ring the sports arena and are seen both by the spectators at the event and by the viewers seeing the event via TV.

Because the sports events occur in one location, the advertising boards generally have advertisements thereon of the companies which market in that location. However, if the sports event is broadcast by TV, it can be viewed by many other viewers, few of whom are in the locale of the sports event. As a result, the advertisement may be ignored by the viewers.

There exist systems which can insert images into the video stream to replace the advertisement on the advertising board. These systems use the chroma-key method to replace the portions of each frame of a video stream having a specific color or colors.

One system, described in U.S. Patent 5,491 ,517 and owned by the common assignees of the present invention, inserts images onto specific portions of the playing field. The disclosure of U.S. Patent 5,491 ,517 is incorporated herein by reference.

The insertion of the images is typically performed at the local broadcasting station and, typically, the images to be inserted are advertisements for local products.

At present, digital video services exist mainly in the form of TV using direct broadcast from satellite (DBS), such as: directTV in the US, or over the Internet as a downloadable file or as a live stream (using products from Real Networks of the USA or VDOnet of the USA). The video stream is mainly uni-directional, from the server machine to the client machine. However, in some cases, especially for videos downloaded from the Internet, the client has some control over the playback. For example, the MediaPlayer of the WINDOWS operating system from Microsoft Corporation of the USA, which can be used for playing video streams, has pause/stop, rewind and play controls. Advertising on the Internet is limited to messages displayed in fixed areas of the page or text. The advertisement is typically in the form of a banner with a fixed message or some sort of animation within the banner is also common.

SUMMARY OF THE INVENTION

An object of the present invention is to provide a method and system which enables a video service provider to personalize the video stream provided to each of its clients according to a priori individual knowledge of its clients

The present invention generates an user profile from video sequences selected by the user from a video server having a plurality of video sequences stored therein The selected video sequence is personalized according to the user profile, for transmission to the user In another embodiment, the video server broadcasts the video sequence, accompanied by video parameters for placement of insertable images, to a plurality of users, wherein each user has a matched image storage unit, from which at least one image can be inserted into the video sequence transmitted by the broadcaster In accordance with another preferred embodiment of the present invention, the system and method also include an image server for generating user profiles and for providing images to each image storage unit based on the user profile

Additionally, in accordance with a preferred embodiment of the present invention, the personalization includes associating group profiles with images to be implanted, selecting at least one image from among the images to be implanted according to the group profile which most closely matches the user profile and implanting the selected at least one image into the video sequence Moreover, in accordance with a preferred embodiment of the present invention, all of the personalization can occur in a single processing. Alternatively, the implanting can occur in one processing unit and the association and selection can occur in a second processing unit.

Finally, the present invention can include receiving user feedback in response to the at least one selected and implanted image and providing the user feedback to the video server.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be understood and appreciated more fully from the following detailed description taken in conjunction with the appended drawings in which:

Fig. 1 is a schematic illustration of system for personalizing a video sequence, constructed and operative in accordance with a preferred embodiment of the present invention, in conjunction with user computers which receive the personalized video sequence; Fig. 2 is a block diagram illustration of a personalization system forming part of the system of Fig. 1 ;

Fig. 3A is a schematic illustration of transformations, useful in understanding the operation of the personalization system of Fig. 2;

Fig. 3B is a schematic illustration of a permission mask, useful in understanding the operation of the personalization system of Fig. 2;

Fig. 4 is a block diagram illustration of a personalization module forming part of the personalization system of Fig. 2;

Figs. 5A and 5B are schematic illustration of mixing operations, useful in understanding the operation of the personalization module of Fig. 4; and Figs. 6 and 7 are schematic illustrations of two alternative systems for personalizing a video sequence in conjunction with user computers which receive the personalized video sequence. DETAILED DESCRIPTION OF THE PRESENT INVENTION

The present invention is a system for personalizing video based on some

knowledge (e.g. sex, age, hobbies, etc.) of the individual user requesting the video. The personalization can take many forms. It can be an advertisement for

a company present only in the area where the user lives or works or for a

company selling products of a type the user is known to like or for any other type of product or service which relates to the individual knowledge of the user. There

can be multiple advertisements. For systems where the user can provide input, the personalization can change over time in response to some or all of the user's

input.

Reference is now made to Fig. 1 which generally illustrates the operation of the system of the present invention.

The personalization system 10 operates on a video server 1 1 and communicates with a multiplicity of user computers or "clients" 12 (two are

shown), typically via a network of some kind, such as a local area network and/or

the Internet. The network communication is typically bi-directional, as described hereinbelow. The bi-directional communication can also be formed from a

broadcast download to the user computers 12 and communication from the user computers 12 via the telephone system or the Internet.

Each user requests whichever video sequence he desires to see. The requested video sequence is personalized with advertising images whose

predefined profile the user fits. For example, company A might want to advertise

to young men who like to read science fiction books. If the user fits this description, his video sequence will include the advertising image or images of company A. Company B might want to advertise to children who recently took an algebra course. The video sequence requested by such a child will have company B's images implanted therein.

For example and as shown on the monitors 28 of computers 12, the video might include the movement of a person 29 along a street 30 to a building 32. For a first user who is known to be a young person, the advertisement might be for a drink. Fig. 1 shows a drink bottle 34 on one wall 35 of a building along the street, in the monitor labeled 28A. For a user who is known to be a soccer fan, the advertisement might be for a sports company. Monitor 28B shows a soccer ball 36 on wall 35.

In this example, both users view the same video but each receives a different advertisement, personalized by their user profile. It will be appreciated that the two users can view different video sequences but the implanted images that they will receive are a function of their profile. In order to display the personalized video, the user computer 12 typically includes a video unit 14. Such a unit is similar to the REALVIDEO video application manufactured by Real Networks with which a user communicates with a video server and which receives and displays a video stream.

Each user's profile is typically created and updated based on his or her input. The input can be in answer to a questionnaire, it can be gathered from the user's responses to the advertising images previously implanted in his personalized video sequence, it can be based on the user's address on the network or any other fact about the user which the server 11 has the ability to gather. The user computer 12 also includes a pointing device 16, such as a mouse, a trackball, a touch screen, etc. with which the user can point to objects on the screen. The operating system of the user computer 12 monitors the cursor movements and selections of the user and provides the location to which the user pointed to all of the applications on the computer, including the video unit 14.

Video unit 14 compares the location received from the operating system with the area or specific pixel locations of the implanted image, as provided from the video server 11. The data from the server 11 is described in more detail hereinbelow. If the user, once he views the personalized video, indicates the implanted image using pointing device 16, video unit 14 can transmit an indication of this fact, including the name associated with the object, to the video server 11. The video server 11 typically responds to the user's request and the user identifier 20 (Fig. 2) uses this information to update the user's profile. The video server 11 can also gather information regarding the responses of its users to the various advertising images which the personalization system 10 implants. This information is valuable feedback to the companies about the quality of their advertisements and/or products.

Reference is now made to Fig. 2 which illustrates the system of the present invention, to Fig. 4 which details elements of the system of Fig. 2 and to Figs. 3A, 3B and 5 which are useful in understanding the operation of the system of Fig. 2.

The personalization system 10 comprises a user identifier 20, a user database 21 , an object storage unit 22, a video controller 24, a video analyzer 25 and a plurality of video personalization modules 26, one per user currently receiving a video stream.

The user identifier 20 operates to identify the client or some aspect of the client. The user identifier 20 acquires the identifying information once the communication between the user and the server has been initiated. Typically, when the user accesses the video server, there is either some login procedure, as is common for video servers on the Internet which charge money for their services, or some handshaking between the client computer and the server which results in the server uniquely identifying the client computer. The login procedure can include questions which the user must answer from which the user identifier 20 builds a profile of the user or it can simply ask the identification of the user. The former is common as part of setting up a subscription with the video server. The latter is common once the user is a subscriber to the service.

After logging in, the user identifier 20 then provides the user's profile to the object storage unit 22 which, in turn, compares the user's profile to a set of profiles predefined by the advertisers for each of their advertising images or sets of images. The object storage unit 22 selects the closest stored profile. The profiles typically group users by any desired characteristic, or set of characteristics, of the user, such as residential area, family data, hobbies, sex, etc. or based on the user's previous requests.

Fig. 2 shows the same example display as Fig. 1 , where a young user receives a drink advertisement and a soccer fan receives a soccer advertisement. Another method for identifying the user utilizes the handshaking information, which uniquely identifies the computer 12 to the server. For example, when a computer 12 accesses the video server via the Internet, the computer 12 has to indicate the Internet Protocol (IP) address at which computer 12 is connected to the Internet. These IP addresses are regionally allocated and thus,

user identifier 20 can determine the approximate geographic location of the

computer 12 and can use this geographic location as the user profile.

The user identifier 20 provides the object storage unit 22 with the user

profile and provides the user's video request to the video controller 24.

The object storage unit 22 stores the various images to be inserted into

the videos and organizes them according to the group profile defined for them.

The personalized data can be a single image to be inserted multiple times and/or a set of images to be inserted within the video at different times. The

personalized data includes a name for each image to be inserted as well as a schedule of when and for how long to implant each image.

In response to a received user profile, object storage unit 22 determines

the group profile which most closely matches the user profile and outputs the

images associated with the matched group profile. If there are more than one set of images associated with the matched group profile, the object storage unit 22

selects one of the sets of images. Furthermore, object storage unit 22 can update

the user profile to mark which set of images the user has already been seen. Video controller 24 selects a video sequence for each user in response to

his request. The video sequence can either be a stored or a real-time one. The

video controller 24 also receives video parameters from video analyzer 25 defining how to implant the images. As described hereinbelow, the video analyzer

25 generates the parameters from analyzing each frame of the video sequence. This analysis is performed in real-time, if the sequence is received in real-time, otherwise, it is performed off-line.

Object storage unit 22 and video controller 24 both provide their output to

the personalization module 26 associated with the user. Object storage unit 22

outputs the personalized data, such as a set of advertisements, associated with the user's group and the names associated with each image to be implanted and

video controller 24 provides the selected video and the associated video

parameters describing how to transform the personalized data in order to implant the personalized data into the video stream.

Thus, as shown in Fig. 2, each personalization module 26 receives a user's requested video, the personalized data to be implanted therein and the video parameters. Fig. 2 also shows the output of the two modules 26, assuming

that both users requested the same video having the street scene. One user has

the bottle 34 implanted therein and the other has the soccer ball 36 implanted

therein.

The images of the personalized data are designed "flat", with no perspective in them. One such image 37 is shown in Fig. 3A. However, the

surfaces on which they are to be implanted, such as a surface 38, are viewed in

perspective. The video analyzer 25 analyzes each frame of the video stream to determine the viewing angle of the camera towards the surface on which the

image is to be implanted and which elements of the frame are foreground and

which are background. The analysis can be performed in many ways, some of

which are described in US 5,491 ,517 and in PCT Publications WO 97/12480, assigned to the common assignee of the present invention, the teachings of which are incorporated herein by reference.

According to U.S. Patent 5,491 ,517, video analyzer 25 has a flat model

37 of the surface. Analyzer 25 finds the surface within each frame of the video

stream and determines a transformation T, per frame, from the flat model 37 to the perspective view 38 in each frame. There can be many surfaces which can

receive an implant and each implant is associated with only one surface. Fig. 3A shows two surfaces, two implants 39 to be implanted thereon and the resultant

perspective implanted images 41.

Video analyzer 25 also determines which elements of the frame are

foreground elements and which are background elements. For example, in Fig. 2, the person 29 is a foreground element and the walls 35 and building 32 are background elements. Typically, the background / foreground information is described by a "permission mask" which marks the pixel frame over which the

frame the image can be implanted, where implantation is only allowed in the background areas. Fig. 3B illustrates a permission mask 43 for the video frame

shown in Fig. 2, where the hatching marks areas where implantation is allowed. The permission mask 43 indicates that the area of person 29 (Fig. 2) is the only

area where implantation is not allowed.

The transformations T, location information regarding the location of the

surface within each frame, and permission mask form the video parameters which analyzer 25 produces.

The personalization modules 26 use each transformation T to transform,

per frame, the flat images 39 of the personalized data into perspective images 41 whose perspective matches that of the surface on which the images are to be implanted. The personalization modules 26 then implant the perspective images 41 into the background of the current frame, thereby producing a personalized frame which is transmitted to the user's computer 12. Typically, the personalization modules 26 also attach data about the area or pixels of the frame where the implanted perspective image is to be found and a name for the implanted perspective image.

Fig. 4 details one video personalization module 26. It comprises a personalized data storage unit 38, an image adapter 40, a video personalization scheduler 42 and a mixer 44.

The personalized data storage unit 38 receives the personalized data for the personalization module 26 and provides a selected image from the personalized data when indicated to do so by the scheduler 42.

The scheduler 42 receives a predefined schedule, which is associated with the personalized data, of when and where to insert an image of the personalized data and for how long. The schedule is prepared in advance, typically according to advertising considerations. Some advertisers will pay for many minutes of insertion while others will pay for minimal amounts. The schedule defines when, and for how long, each image will be displayed. The scheduler 42 also indicates onto which section of the surface the personalized data is to be implanted.

During operation, the scheduler 42 receives a timing signal by which it measures the passage of time, starting from the moment the personalization module 26 first receives the video stream. When so indicated by the schedule, the scheduler 42 provides an image selection signal to the storage unit 38 which furnishes the selected image to the image adapter 40. At the same time, the scheduler 42 provides a location signal to the image adapter 40 to indicate onto which section of the surface, if there are more than one, to implant the selected image.

Image adapter 40 also receives the transformation and location parameters from the video controller 24 (Fig. 2). Using these parameters, image adapter 40 transforms the flat selected image into one with the perspective of the current frame, as discussed hereinabove with respect to Fig. 3A. Since the image is typically much smaller than a frame, image adapter 40 places the perspective image in the proper location within a blank frame. Figs. 5A and 5B show two adapted images 49A and 49B, with the two perspective images of Fig. 3A in their respective locations within the frame. The hatched portions 50 of Figs. 5A and 5B remain blank; only the image portions 52 of Figs. 5A and 5B contain image data. Image adapter 40 can be any suitable image adapter which can perform the adaptation described hereinabove. Two such image adapters are described in U.S. 5,491 ,517 and WO 97/12480. The two applications also describe suitable mixers 44.

Image adapter 40 also defines the space within which the adapted image is placed. This typically is a bounding box around the adapted selected image which describes where, in the frame, the adapted image is placed.

Mixer 44 mixes the adapted image produced by frame adapter 40 with the current frame of the video stream to create one frame ("a personalized frame") of a personalized video stream. Mixer 44 typically uses the permission mask 43 (Fig. 3B) and the adapted images 49A and 49B (Figs. 5A and 5B) to control the mixing process. Wherever the permission mask 43 indicates the presence of the background, implantation can occur.

For implantation, the mixer 44 provides the personalized frame with data of the original frame only if the adapted images 49A and 49B is blank for that pixel. Wherever the adapted images 49A and 49B has image data and the permission mask 43 allows implantation, mixer 44 mixes the image data with the data of the original frame. Mixer 44 can just replace the original frame data with the image data or it can blend the two, or it can perform any desired other mixing operation.

Mixer 44 also transmits the name associated with the implanted image and some indication of its location in the frame. The indication is typically based on the bounding box of the adapted image, as determined by the image adapter 40. However, mixer 44 determines if there are any foreground elements which are superimposed over the implanted image and how this affects the shape of the implanted image.

The indication produced by the mixer is an outline of the area within which the implanted image sits or a listing of the pixels which include the implanted image. This information is transmitted together with the personalized frame. The indication can be used by the video unit 14 (Fig. 1) to determine whether or not the user has indicated the implanted image with his pointing device 16.

It will be appreciated that the present invention provides personalized video streams based on a priori information about a user. Shown here is a system with a video server, with a plurality of personalization modules, connected to a plurality of clients via a data network.

However, other combinations of servers, personalization modules and clients are also incorporated within the scope of the present invention. For example, as shown in Fig. 6 to which reference is now briefly made, the personalization module can reside on the client side of the network. The video server 11 has a personalization preparation system 60 which is similar to the personalization system 10 but it does not include any personalization modules 26. The latter reside in each of the user computers 12 and are referenced 62. In this embodiment, the video server 11 transmits the requested video sequences along with the video parameters and the personalized data to the user computer 12. The individual personalization modules 62 create the personalized videos therefrom, typically "on-the-fly".

Alternatively, as shown in Fig. 7 to which reference is now briefly made, the video sequences can be broadcast, or multi-cast, irrespective of the users requests. In this embodiment, the video server 11 has the personalization preparation system 60 but only transmits one video sequence and its video parameters at a time to the network. Each user computer has a video personalization module 62, as in the previous embodiment; however, in this embodiment, the modules 62 store the personalized data for a significant period of time (in the personalized data storage unit 38 of Fig. 4). Periodically, the personalized data is updated, as indicated by the dashed lines of Fig. 7.

The personalization is, once again, according to the individual preferences of the users. These preferences can be provided to the personalization preparation system 60 via any of the methods described hereinabove.

The personalization modules 62 can reside in the user computers 12 or, if the network is that of cable or satellite television, in a local "set-top" box which provides output to a user television.

It will be appreciated by persons skilled in the art that the present invention is not limited by what has been particularly shown and described herein above. Rather the scope of the invention is defined by the claims that follow:

Claims

1. A video personalization system comprising:
a video server having a plurality of video sequences stored therein;
means for receiving a selection of a video sequence from a user;
means for generating a user profile from user information provided to said video server;
a personalization system for personalizing said selected video sequence according to said user profile thereby creating a personalized, selected video sequence for transmission to said user.
2. A system according to claim 1 and wherein said personalization system includes:
means for associating group profiles with images to be implanted;
means for selecting at least one image from among said images to be implanted according to the group profile which most closely matches said user profile; and
means for implanting said selected at least one image into said video sequence.
3. A system according to claim 2 and wherein said means for implanting are implemented in one processing unit and said means for associating and said means for selecting are implemented in a second processing unit.
4. A system according to claim 1 and also comprising means for receiving user feedback in response to said at least one selected
and implanted image and for providing said user feedback to said
video server.
5. A video personalization system comprising:
a video server having a multiplicity of video sequences stored therein;
a broadcaster for broadcasting a video sequence to a plurality of clients, wherein each video sequence is accompanied by video
parameters for placement of insertable images;
per client:
a local image storage unit for storing a plurality of user-matched, locally stored images; and
insertion means for inserting at least one of said locally stored
images into a video sequence transmitted by said broadcaster.
6. A system according to claim 5 and also comprising an image server
for generating user profiles and for providing images to each local
image storage unit based on the user profile of the user associated with each client.
7. A method for personalizing video sequences, the method comprising
the steps of:
having a plurality of video sequences stored in a video server; receiving a selection of a video sequence from a user;
generating a user profile from user information provided to said video server;
personalizing said selected video sequence according to said user profile thereby creating a personalized, selected video sequence for transmission to said user.
8. A method according to claim 7 and wherein said step of personalizing includes the steps of:
associating group profiles with images to be implanted;
selecting at least one image from among said images to be
implanted according to the group profile which most closely matches said user profile; and
implanting said selected at least one image into said video
sequence.
9. A method according to claim 8 and wherein said step of implanting occurs in a first processing unit and wherein said steps of
associating and selecting occur in a second processing unit.
10. A method according to claim 7 and also including the steps of
receiving user feedback in response to said at least one selected
and implanted image and providing said user feedback to said video server.
1. A method for personalizing video sequences, the method comprising the steps of:
storing a multiplicity of video sequences stored in a video server;
broadcasting a video sequence to a plurality of clients, wherein each video sequence is accompanied by video parameters for placement of insertable images;
per client:
storing a plurality of user-matched, locally stored images; and
inserting at least one of said locally stored images into a video sequence transmitted by said broadcaster.
12. A method according to claim 11 and also comprising the steps of generating user profiles and providing images to each local image storage unit based on the user profile of the user associated with each client.
EP19980952997 1997-11-13 1998-11-09 Method and system for personalizing images inserted into a video stream Withdrawn EP0950318A4 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
IL12219497 1997-11-13
IL12219497 1997-11-13
PCT/IL1998/000545 WO1999026415A1 (en) 1997-11-13 1998-11-09 Method and system for personalizing images inserted into a video stream

Publications (2)

Publication Number Publication Date
EP0950318A1 true EP0950318A1 (en) 1999-10-20
EP0950318A4 true true EP0950318A4 (en) 2003-02-05

Family

ID=11070848

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19980952997 Withdrawn EP0950318A4 (en) 1997-11-13 1998-11-09 Method and system for personalizing images inserted into a video stream

Country Status (2)

Country Link
EP (1) EP0950318A4 (en)
WO (1) WO1999026415A1 (en)

Families Citing this family (65)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7743330B1 (en) * 2000-06-19 2010-06-22 Comcast Ip Holdings I, Llc Method and apparatus for placing virtual objects
US9053640B1 (en) 1993-12-02 2015-06-09 Adrea, LLC Interactive electronic book
EP1305947B1 (en) * 2000-07-28 2013-02-20 Comcast IP Holdings I, LLC Method and apparatus for locally targeting virtual objects within a terminal
US7721307B2 (en) * 1992-12-09 2010-05-18 Comcast Ip Holdings I, Llc Method and apparatus for targeting of interactive virtual objects
US9286294B2 (en) 1992-12-09 2016-03-15 Comcast Ip Holdings I, Llc Video and digital multimedia aggregator content suggestion engine
US8073695B1 (en) 1992-12-09 2011-12-06 Adrea, LLC Electronic book with voice emulation features
US7207053B1 (en) 1992-12-09 2007-04-17 Sedna Patent Services, Llc Method and apparatus for locally targeting virtual objects within a terminal
CA2151456C (en) 1992-12-09 2004-03-02 John S. Hendricks Reprogrammable terminal for suggesting programs offered on a television program delivery system
US7168084B1 (en) 1992-12-09 2007-01-23 Sedna Patent Services, Llc Method and apparatus for targeting virtual objects
GB2348346B (en) * 1997-03-11 2000-12-06 Actv Inc A digital interactive system for providing full interactivity with live programming events
EP0963115A1 (en) * 1998-06-05 1999-12-08 THOMSON multimedia Apparatus and method for selecting viewers' profile in interactive TV
US6567981B1 (en) 1998-08-03 2003-05-20 Elysium Broadband Inc. Audio/video signal redistribution system
US7230653B1 (en) 1999-11-08 2007-06-12 Vistas Unlimited Method and apparatus for real time insertion of images into video
JP2001168818A (en) * 1999-12-10 2001-06-22 Sony Corp Data transmission method and system, information processing method and system, data transmitter, signal processor, contents data processing method and data providing method
WO2001067764A3 (en) * 2000-03-06 2002-04-04 Artemedia Ag Selective supply
US8006261B1 (en) * 2000-04-07 2011-08-23 Visible World, Inc. System and method for personalized message creation and delivery
WO2001080565A3 (en) * 2000-04-17 2002-04-11 Cachestream Corp Channel dancer, virtual channel scheduler
JP3775168B2 (en) 2000-04-20 2006-05-17 株式会社日立製作所 Transmitter and receiver
US7334249B1 (en) * 2000-04-26 2008-02-19 Lucent Technologies Inc. Method and apparatus for dynamically altering digital video images
JP2001357300A (en) 2000-06-12 2001-12-26 Sony Corp Method, system and, device for providing video content program storage medium stored with program providing video content, advertisement video providing device, program storage medium stored with program providing advertisement video video, content reproducing device, program storage medium stored with program reproducing video content, advertisement charge totalizing method, and program storage medium stored with program totalizing advertisement charge
CN1394441A (en) * 2000-08-21 2003-01-29 皇家菲利浦电子有限公司 Method and system for active modification of video content responsively to processes and data embedded in video stream
US8151295B1 (en) 2000-08-31 2012-04-03 Prime Research Alliance E., Inc. Queue based advertisement scheduling and sales
US7039932B2 (en) * 2000-08-31 2006-05-02 Prime Research Alliance E., Inc. Queue-based head-end advertisement scheduling method and apparatus
US7185353B2 (en) * 2000-08-31 2007-02-27 Prime Research Alliance E., Inc. System and method for delivering statistically scheduled advertisements
US6944585B1 (en) 2000-09-01 2005-09-13 Oracle International Corporation Dynamic personalized content resolution for a media server
GB0021891D0 (en) * 2000-09-06 2000-10-25 Wave Ltd M Adaptive video delivery
US7870576B2 (en) 2000-09-08 2011-01-11 Prime Research Alliance E., Inc. Targeted advertising through electronic program guide
US7331057B2 (en) 2000-12-28 2008-02-12 Prime Research Alliance E, Inc. Grouping advertisement subavails
US8290351B2 (en) 2001-04-03 2012-10-16 Prime Research Alliance E., Inc. Alternative advertising in prerecorded media
GB2374779B (en) * 2001-04-20 2005-11-02 Autodesk Canada Inc Processing image data
US7206434B2 (en) 2001-07-10 2007-04-17 Vistas Unlimited, Inc. Method and system for measurement of the duration an area is included in an image stream
US20030023972A1 (en) * 2001-07-26 2003-01-30 Koninklijke Philips Electronics N.V. Method for charging advertisers based on adaptive commercial switching between TV channels
US8909729B2 (en) 2001-11-20 2014-12-09 Portulim Foundation Llc System and method for sharing digital media content
US8122466B2 (en) * 2001-11-20 2012-02-21 Portulim Foundation Llc System and method for updating digital media content
US7711774B1 (en) 2001-11-20 2010-05-04 Reagan Inventions Llc Interactive, multi-user media delivery system
US8150235B2 (en) * 2002-02-08 2012-04-03 Intel Corporation Method of home media server control
KR20040089729A (en) * 2002-03-12 2004-10-21 코닌클리케 필립스 일렉트로닉스 엔.브이. Interactive television system
DE10218944A1 (en) * 2002-04-22 2003-11-06 Deutsche Telekom Ag Method for applying individualized marking e.g. for video films, involves ascertaining data for localizing original object in picture sequence by ascertaining necessary data as meta-data
EP1416727A1 (en) 2002-10-29 2004-05-06 Accenture Global Services GmbH Moving virtual advertising
US20040194128A1 (en) * 2003-03-28 2004-09-30 Eastman Kodak Company Method for providing digital cinema content based upon audience metrics
US9743078B2 (en) 2004-07-30 2017-08-22 Euclid Discoveries, Llc Standards-compliant model-based video encoding and decoding
US9532069B2 (en) 2004-07-30 2016-12-27 Euclid Discoveries, Llc Video compression repository and model reuse
US7508990B2 (en) 2004-07-30 2009-03-24 Euclid Discoveries, Llc Apparatus and method for processing video data
US8902971B2 (en) 2004-07-30 2014-12-02 Euclid Discoveries, Llc Video compression repository and model reuse
US9578345B2 (en) 2005-03-31 2017-02-21 Euclid Discoveries, Llc Model-based video encoding and decoding
US8145528B2 (en) 2005-05-23 2012-03-27 Open Text S.A. Movie advertising placement optimization based on behavior and content analysis
US9648281B2 (en) 2005-05-23 2017-05-09 Open Text Sa Ulc System and method for movie segment bookmarking and sharing
US7877689B2 (en) * 2005-05-23 2011-01-25 Vignette Software Llc Distributed scalable media environment for movie advertising placement in user-created movies
US8141111B2 (en) 2005-05-23 2012-03-20 Open Text S.A. Movie advertising playback techniques
US20070078944A1 (en) * 2005-09-12 2007-04-05 Mark Charlebois Apparatus and methods for delivering and presenting auxiliary services for customizing a channel
US8893179B2 (en) 2005-09-12 2014-11-18 Qualcomm Incorporated Apparatus and methods for providing and presenting customized channel information
JP5649303B2 (en) * 2006-03-30 2015-01-07 エスアールアイ インターナショナルSRI International A method and apparatus for annotating media streams
US7992165B1 (en) * 2006-04-06 2011-08-02 Velti USA, Inc. Insertion of digital media
WO2008091484A3 (en) * 2007-01-23 2008-11-13 Euclid Discoveries Llc Object archival systems and methods
CA2676219C (en) 2007-01-23 2017-10-24 Euclid Discoveries, Llc Computer method and apparatus for processing image data
CN102685441A (en) 2007-01-23 2012-09-19 欧几里得发现有限责任公司 Systems and methods for providing personal video services
US9137497B2 (en) 2007-04-11 2015-09-15 At&T Intellectual Property I, Lp Method and system for video stream personalization
EP1981274A1 (en) * 2007-04-12 2008-10-15 Alcatel Lucent Multimedia descriptions for adding additional multimedia
WO2009040538A1 (en) * 2007-09-25 2009-04-02 British Telecommunications Public Limited Company Multimedia content assembling for viral marketing purposes
EP2104104A1 (en) * 2008-03-20 2009-09-23 British Telecommunications Public Limited Company Multimedia content assembling for viral marketing purposes
US8793256B2 (en) 2008-03-26 2014-07-29 Tout Industries, Inc. Method and apparatus for selecting related content for display in conjunction with a media
JP5567021B2 (en) 2008-10-07 2014-08-06 ユークリッド・ディスカバリーズ・エルエルシーEuclid Discoveries,Llc Video compression which are based on features
US20120192226A1 (en) * 2011-01-21 2012-07-26 Impossible Software GmbH Methods and Systems for Customized Video Modification
US20150242086A1 (en) * 2014-02-21 2015-08-27 Markport Limited Drag and drop event system and method
CA2942336A1 (en) 2014-03-10 2015-09-17 Euclid Discoveries, Llc Continuous block tracking for temporal prediction in video encoding

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5264933A (en) * 1991-07-19 1993-11-23 Princeton Electronic Billboard, Inc. Television displays having selected inserted indicia
WO1996008109A1 (en) * 1994-09-08 1996-03-14 Carles John B System and method for selectively distributing commercial messages over a communications network
WO1996017467A2 (en) * 1994-11-29 1996-06-06 Frederick Herz System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5617565A (en) * 1994-11-29 1997-04-01 Hitachi America, Ltd. Broadcast interactive multimedia system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4991011A (en) * 1988-12-23 1991-02-05 Scientific-Atlanta, Inc. Interactive television terminal with programmable background audio or video
US5099319A (en) * 1989-10-23 1992-03-24 Esch Arthur G Video information delivery method and apparatus
US5029014A (en) * 1989-10-26 1991-07-02 James E. Lindstrom Ad insertion system and method for broadcasting spot messages out of recorded sequence
US5715018A (en) * 1992-04-10 1998-02-03 Avid Technology, Inc. Digital advertisement insertion system
US5761601A (en) * 1993-08-09 1998-06-02 Nemirofsky; Frank R. Video distribution of advertisements to businesses
US5600366A (en) * 1995-03-22 1997-02-04 Npb Partners, Ltd. Methods and apparatus for digital advertisement insertion in video programming

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5264933A (en) * 1991-07-19 1993-11-23 Princeton Electronic Billboard, Inc. Television displays having selected inserted indicia
WO1996008109A1 (en) * 1994-09-08 1996-03-14 Carles John B System and method for selectively distributing commercial messages over a communications network
WO1996017467A2 (en) * 1994-11-29 1996-06-06 Frederick Herz System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5617565A (en) * 1994-11-29 1997-04-01 Hitachi America, Ltd. Broadcast interactive multimedia system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO9926415A1 *

Also Published As

Publication number Publication date Type
WO1999026415A1 (en) 1999-05-27 application
EP0950318A1 (en) 1999-10-20 application

Similar Documents

Publication Publication Date Title
US6226030B1 (en) Automated and selective distribution of video broadcasts
US7661118B2 (en) Methods, systems, and products for classifying subscribers
US6697792B2 (en) Method for distributing information
US7313802B1 (en) Method and system to provide deals and promotions via an interactive video casting system
US20070100688A1 (en) Method and apparatus for dynamic ad creation
US20040078825A1 (en) System & method for sending live video on the internet
US20050216940A1 (en) Method and system which enables subscribers to select videos from websites for on-demand delivery to subscriber televisions via cable television network
US6807675B1 (en) Apparatus and method for selecting viewers' profile in interactive TV
US20020055876A1 (en) Method and apparatus for interactive advertising using user responses
US20040032424A1 (en) Method and system for producing and administering a web-cast event
US20060212900A1 (en) Method and apparatus for delivery of targeted video programming
US5909439A (en) Satellite communications system
US20030002638A1 (en) Interactive TV using remote control with built-in phone
US6813775B1 (en) Method and apparatus for sharing viewing preferences
US20050050070A1 (en) Daypart guide workflow
US20030079226A1 (en) Video segment targeting using remotely issued instructions and localized state and behavior information
US20020069405A1 (en) System and method for spokesperson interactive television advertisements
US6209132B1 (en) Host apparatus for simulating two way connectivity for one way data streams
US5805154A (en) Integrated broadcast application with broadcast portion having option display for access to on demand portion
US7103903B1 (en) Interactive television broadcast system
US7360230B1 (en) Overlay management
US8171510B2 (en) Method for using banner advertisements during commercial breaks
US20030126597A1 (en) On-screen stripe and other methods for delivering information that facilitate convergence of audio/visual programming and advertisements with internet and other media usage
US20020112002A1 (en) System and process for creating a virtual stage and presenting enhanced content via the virtual stage
US20070271587A1 (en) System and method for collaborative, peer-to-peer creation, management & synchronous, multi-platform distribution of profile-specified media objects

Legal Events

Date Code Title Description
AK Designated contracting states:

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

17P Request for examination filed

Effective date: 19990812

A4 Despatch of supplementary search report

Effective date: 20021227

RIC1 Classification (correction)

Ipc: 7H 04N 7/10 A

Ipc: 7H 04N 7/16 B

Ipc: 7H 04N 7/173 B

18D Deemed to be withdrawn

Effective date: 20030315

REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1023673

Country of ref document: HK