JP2000049847A - Method and device for dynamically changing multimedia contents - Google Patents

Abstract

PROBLEM TO BE SOLVED: To evaluate and flexibly change multimedia contents by receiving a contents request containing a contents designation, and dynamically changing objects more than one based on the contents designation and control designation higher than one dimension of a multimedia stream. SOLUTION: A client 209 issues the request, which contains a contents designation 248 concerning contents more than one dimension, concerning multimedia contents through a network 201. The client 209 is provided with a CPU 240, a memory 245 such as a RAM and a storage device 242 such as a DASD. The memory 245 stores a client logic 249. The client logic 249 is provided as a computer executable code to be loaded from a remote or local permanent optical storage device, a magnetic storage device or the DASD to the memory 245 and executed by the CPU 240. The client logic 249 includes reproduction (video reproducing operation logic) 247.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

FIELD OF THE INVENTION The present invention relates generally to dynamic masking and modification of multimedia content based on content designation.

[0002]

BACKGROUND OF THE INVENTION With the increasing popularity of the World Wide Web (WWW), general interest has been directed to the content of web sites. Ideally, users should have control over the content that enters their home.

A recently established standard uses existing web protocols, such as the Hypertext Transfer Protocol (HTTP), and allows for content specification as metadata in object headers. Platform for Internet Content Selection (PICS: Pl
The atform for Internet Content Selection protocol specifies one way to send meta information about electronic content. PICS is a web consortium
Protocol Recommendation (see http://www.w3.org/PICS). PICS was initially used to send value-based rating labels, for example, "How much nudity is associated with this content?", But the form and meaning of meta-information is quite common . In PICS, meta-information about electronic content is grouped according to the information's "rating service" or producer-and-intended-usage, and within one such group, any number of Category or dimensional information is transmitted. Each category has a range of allowed values, and a particular category may have a single value or multiple values for a particular portion of content. Further meta information groups (known as "PICS labels")
May include expiration information. Furthermore, mechanisms exist for applying a PICS label to more than one piece of electronic content. Each PICS label corresponding to a particular piece of electronic content can be independently added or removed from the content.

[0004] For example, an image file having a PICS label is transmitted from a server, and the "evaluation service" field of the label is set to "SafeSur".
f) According to the "Reputation System", it may indicate that it contains a value-based reputation label.
Augmented by request and response headers that support S. Technical bodies that define other common application protocols, such as NNTP, are also currently considering adding PICS support. As part of these protocols, a list of the type of PICS label desired may be included with the request. PICS also specifies a query format for receiving PICS information from a central label bureau server. An example of a PICS label is (PICS-1.1 "http: //the.rating.service" label f
or "http: //the.content" exp "1997.07.01T08: 15-05
00 "r (n4s3v2l0)), where 'n', 's',' v 'and'
l ′ is a transmission name of various meta information types, and applicable values for this content are 4 (corresponding to n), 3 (corresponding to s), 2 (corresponding to v) and 0 (corresponding to l) ). I
Only software that recognizes D "http: //the.rating.service" will know how to interpret these categories and values.

[0005] The prior art includes various systems aimed at storing user preferences for selecting coded video and / or video streams.
For multimedia streams such as video and audio, it is inflexible to evaluate the entire multimedia presentation using one criterion. For example, in a two-hour video, a scene that includes violence or sexually explicit content may be a video subject to high violence or high sexual content ratings, and therefore, based on most user designations, viewing the video Will be blocked.

[0006] For example, US Pat.
Issue 160, "Automatic Censorship of Video Programs"
(Issued May 29, 1990) uses a classification code to switch from the first video stream to another video stream previously selected by the viewer. In addition to the aforementioned lack of flexibility, the censorship standards used under this proposal would be derived from central censorship authority.
This approach also requires broadcaster participation depending on its effectiveness.

[0007] As another example, US Pat.
550575, "Viewer Discretion Television Prog
ram Control System "(issued August 27, 1996)
Provides both time and content control for multiple variable numbers of viewers. However, control is limited to a portion of the entire video.

As yet another example, US Pat. No. 5,434,678 to Abecassis, “Seamless Transmission of N
on-Sequential Video Segments "(July 18, 1995
Issued on a daily basis). This patent describes a non-sequentially stored video program of variable content video programs, depending on the viewer's pre-established video content preferences.
It relates to selectively retrieving segments and transmitting them seamlessly. Here, video segments may be selected from a single source by applying video content preferences to the video segment map. This approach also requires the production of variable content video programs and the participation of broadcasters depending on their effectiveness.

[0009]

Thus, certain objects, such as portions of a single video frame or audio samples, can be dynamically masked or filtered or modified according to the user's content specification. What is needed is a system and method for evaluating and flexibly modifying multimedia content.
There is also a need for a system that does not require the generation of customized or variable content or the effectiveness of broadcaster participation.

[0010] Further, there is a need for such a video distribution system and method within an Internet and World Wide Web compatible transmission system such as HTTP. Further, there is a need for a system that can be flexibly applied in the presence of a hierarchy of nodes. The present invention addresses these needs.

[0011]

SUMMARY OF THE INVENTION In accordance with the above needs, the present invention is directed to an improved method and apparatus for dynamically changing multimedia content at the object level based on a viewer's content specification. Examples of objects include any identifiable objects in a multimedia stream, such as portions of a video frame or audio samples. Examples of such a multimedia stream include an audio stream, a video stream, or a combination of one or more of these streams.

Various embodiments describe control specifications that are part of a multimedia stream, or can be provided as a separate stream by a third party. For example, in an Internet environment, PICS-based control designations are detailed. The PICS control designation may be part of the multimedia stream itself or may be separately deployed and transmitted for dynamic changes in content. PICS-based content specification is also provided so that viewers can specify multi-dimensional content selections.

The present invention has the feature that the multimedia stream can be dynamically changed and masked within the proxy hierarchy on the Internet. For example, multimedia
Objects in the stream are flexibly in client stations such as set-top boxes or computers, intermediate computer nodes such as proxy nodes or gateways, content servers, or cooperative combinations of one or more of these nodes. Can be changed.

The present invention has the further feature of enabling an organization to specify intranet-wide policies. This is, for example, by allowing intermediate nodes to add or merge content specifications with outgoing requests. The invention has the further feature of applying multiple masks (control designations), even when provided by different sources.

An example of a method for modifying an object associated with the content of a multimedia stream, having the features of the present invention, includes the steps of receiving a content request including a content specification, and controlling the multimedia based on the content specification and the control specification. Dynamically changing one or more objects in one or more dimensions of the stream.

One embodiment of the present invention is a fuzz ball (f
uzz ball) has the feature of dynamically changing a portion of a video frame according to a control specification. The resulting fuzz ball may be used to display one or more specified objects, such as a portion of a video frame or an audio sample. Can be changed / masked as specified.

The present invention has the further feature of notifying the user of the percentage of video to be blocked as specified prior to transmission.

The present invention further has other features that overlap several fuzz ball specifications in response to a content specification dealing with a multidimensional or rating system. Furthermore,
The invention has the other feature of multicasting one multimedia stream to multiple viewers, with each client 209 rendering or masking the video using a customized specification.

[0019]

FIG. 1 shows an example of an Internet environment having features of the present invention. As shown, one or more content servers 135 are connected to a network 165, while a client station 125, such as a set-top box or client 125, according to the present invention, connects directly or through a proxy hierarchy 110-11.
5 is connected to the network 165. The content server node 135 communicates through the network
Any computer node that can service multimedia requests. A third party mask provider 155 may provide a pre-configured frame-level mask (described in detail below in connection with FIG. 3), which dynamically refines content according to the present invention. Can be used to remove unwanted information, for example, changing at the frame level.

Client 125 requests multimedia content including multidimensional content designations 248, such as medium violence and low nudity (as described in detail below in connection with FIG. 11). , To the server 135 via the network 165.

According to the present invention, the use of piggybacked metadata allows information to be efficiently communicated between client 125, server 135, and mask provider 155. In HTTP, the information exchange can be included as metadata in the object header by using existing web protocols. The PICS protocol specifies how to transmit meta information about electronic content. PICS is a Web Consortium Protocol Recommendation (see http://www.w3.org/PICS). PICS initially started with, for example, "How much nudity is associated with this content?"
Used to submit value-based rating labels,
The format and meaning of meta-information is quite common. PICS
In, meta-information about electronic content is grouped according to an "evaluation service" or creator and intended use of the information, and within any such group any number of categories or dimensions of information may be transmitted. Each category has a range of allowed values, and for a particular portion of content, a particular category may have one or more values. Further, a meta information group (known as a "PICS label") may include expiration information. Furthermore, PICS label,
Mechanisms exist that allow it to be applied to more than one piece of electronic content. Each PICS label for a particular portion of electronic content can be independently added or removed from the content.

For example, an image file having a PICS label may be sent from a server, and the "Evaluation Service" field of the label may indicate that it contains a value-based evaluation label according to a "Safe Surf" evaluation system. . According to the present invention, as the image file passes through the corporate proxy, it can be processed or updated to reflect the current content according to the "reputation service" with the new category value of the PICS label. Thus, the client computer only sees the updated category value of the PICS label. The HTTP protocol has been augmented with request and response headers that support PICS. An example of a PICS label is (PICS-1.
1 "http: //the.rating.service" label for "http: // the.
content "exp" 1997.07.01T08: 15-0500 "r (n4s3v2l
0)), where 'n', 's', 'v' and 'l' are transmission names of various meta-information types and the value applicable to this content is 4 (corresponding to n ), 3 (corresponding to s), 2 (v
) And 0 (corresponding to 1). ID "http: // the.
Only software that recognizes "rating.service" will know how to interpret these categories and values.
Technical bodies that define other common application protocols, such as NNTP, are also currently considering adding PICS support. A list of the types of PICS labels desired as part of these protocols may be included with the request. PICS also specifies a query format for receiving PICS information from the central label office server. In the preferred embodiment, the content specification 248 also has the PICS Rule 1.0 (Pics
Rule-1.0).

Referring to FIG. 1, in accordance with the present invention, an organization may apply an intranet-wide policy through the ability of proxies 110, 115 to add content designations to outgoing requests or merge different designations. Can be specified.
According to another embodiment of the present invention, the server 135 adapts to determine whether the specification applies (described below in connection with FIG. 7), and if so, passes the mask request to the mask provider 155. (Detailed below in connection with FIG. 12). The mask provider selects a control specification 237 (also referred to as a mask) that can be used to modify the content and sends it to the server 135 to satisfy the viewer specification (see FIG. 13 below). In detail). Those skilled in the art will appreciate that the control designation may also be stored on the content server 203. In various embodiments, control specifications 237 may be applied by server 135, proxy 110, or client 125, and a plurality of control specifications 237 provided from different sources may be applied. Objects, such as portions of video frames or audio samples, may be dynamically changed according to the selected control designation 237 before being displayed at the client 209 (FIGS. 9-10 and 12).
In detail below in connection with).

Examples of clients 125 include, but are not limited to, PCs, workstations, set-top boxes, and the like. In a PC or workstation environment, the client software is preferably a video character player (TM) sold by IBM or a Real Video Player (TM) sold by Progressive Networks. , Including video playback software. Examples of network 165 include the Internet, the World Wide Web, intranets, and local area networks.
And a network (LAN). Examples of video content servers 135 include products such as Video Charger ™ sold by IBM and Real Video ™ sold by Progressive Network. Proxy servers 110 through 11
An example of 5 includes the Internet Connection Server (ICS) ™ sold by IBM. Content server 135 or proxy server 110
To 115 run on any computer node and include S / 390 SY sold by IBM.
SPLEX ™, SP2 ™, or RS60
Products such as the 00.TM. workstation are included.

FIG. 2 shows a more detailed example of a network 201 and a system having features of the present invention. As shown, the system is a client 209, such as a conventional workstation, PC or set-top box.
including. The client 209 can issue a request for multimedia content including the content designation 248 for one or more dimensions of content via the network 201. The client 209 preferably includes a CPU 240, a memory 245 such as a RAM, and a storage device 242 such as a DASD. Memory 245
Stores client logic 249 according to the present invention (described in detail below in connection with FIG. 11). The client logic is
Preferably, the remote or local permanent optical storage (C
D-ROM), or a magnetic storage device (such as a disk), or computer-executable code loaded from a DASD into the memory 245;
40. Client logic 249 includes video playback operation logic 247 (described in detail below in connection with FIG. 12).

The mask provider 205 preferably
CPU 227, memory 235 such as RAM, and DAS
D and the like. Memory 235 includes mask provider logic 239 (described in greater detail below in connection with FIG. 13), which is preferably implemented as computer-executable code loaded from DASD 230 into memory 235 and executed by CPU 227. You. The mask provider has various control specifications 237, in this case,
Fuzz, dynamically changing or masking a portion of one or more frames of a video according to a content specification 248;
It has a ball track 337 (described in more detail below in connection with FIGS. 3-5). Fuzz ball track designation,
Include a separate stream or a video stream 390
Content server 20
3, interpreted at an intermediate node, such as client 209 or proxy 280, and
Change or mask objects in 0 (mask
An example of the provider logic is shown in FIG. 13). In any case, a fuzz ball 397 is generated based on the control designation and changes the content before it is displayed at the client station.

[0027] Content server node 203 is any conventional computer node that can service requests over network 201. The content server 203 is preferably a CPU 260, a RAM
And a storage device 265 such as a disk or DASD. According to the present invention, preferably
Server logic 268 (detailed below in connection with FIG. 6), implemented as computer-executable code, may be remote (via a network) or local permanent optical storage (CD-ROM) or magnetic storage (such as a disk). ) Or from DASD 265, loaded into memory 263 and executed by CPU 260. Server logic 2
68 is preferably a video check handler 267
(Described below in connection with FIG. 7), and a video show handler 269 (described below in connection with FIG. 8). Video check handler 267 determines whether there is a version of the requested video that can be modified or masked to satisfy the content specification. If so, the version closest to the content designation 248 is selected. Video show handler 269 distributes the video stream based on the content designation. The video stream is preferably transmitted separately from the control designation 237 for downstream rendering before being displayed at the client station.

In short, the client 209 first
Deliver content requests that include multi-dimensional content designations 248, such as medium violence and low nudity. As a result, if a threshold determination is made whether the designation is satisfied, a video check request (described in more detail below in connection with FIG. 5) is communicated to the content server. In a preferred embodiment, the server response is unambiguous such as "yes" (ie, such a version exists) or conditional, e.g., if the version can be distributed but 20% is blocked out Either. Viewer /
If the client 209 determines that the response is acceptable, a video presentation request (described below in connection with FIG. 8) is communicated to the content server 203 requesting distribution of the modified video.

If the content designation 248 can be satisfied, the mask display request (FIG. 11)
05 to obtain the corresponding control designation 237 or fuzz ball track (FIGS. 3-5). Those skilled in the art will appreciate that the mask provider logic 239 and control designation 237 may also be present at the content server 203 or at certain intermediate nodes. mask·
The provider 205 selects one or more control designations 237 that can satisfy the multidimensional designation of the viewer based on their labels (described in detail below in connection with FIG. 10). When the control specification 237 is applied by the server 203, it is changed by the control specification 237 before the content is transmitted to the client 209.

Preferably, the control designation 237 is transmitted as an additional track (or stream) along with the original video stream (described in more detail below in connection with FIG. 12). For example, for multicast video, different viewers may have many different designations. Therefore, it is more efficient for the content server 203 to include various control specifications together with the multicast transmission, and to allow each client 209 to flexibly select an appropriate control specification 237 and dynamically apply it. In another example, an organization (such as a school or corporation) or individual user, or a subgroup within an organization, may have different content designations 248
Having. In this case as well, the content server 203 provides the control designation 237 by transmission, and at each intermediate (proxy) server and client station,
By applying the appropriate control designations 237, changing the content as the video passes through them,
It is more efficient.

FIG. 3 shows an example of a video stream (frame n to frame n + 4) changed by a set of fuzz balls generated according to the control designation 237. In this example, the control designations 237 are separate “fuzz ball” tracks 337 and the fuzz ball 397
Is shown as a rectangular area that can change an object such as a portion of a video frame or an audio sample.
The result of the content rating achieved by applying the fuzz ball track 337 is shown in an O-label 396 in the track's header using the PICS protocol. The fuzz ball may be generated by various conventional methods, such as by manipulating or overlaying audio or video data. Fuzz ball track 337 specifies a sequence of fuzz ball 397 that has a fuzz ball size 382 and position, and a temporal relationship 386 with video stream 390.
For example, video stream 390 may have a known dimension (1
5, 30) (frame n to frame n + 4). The placement of fuzz ball 397 within the video stream is represented in fuzz ball track 337 as a file. The temporal relationship of the fuzz ball 397 to the stream may be frame number 386, or other means such as a time stamp, or any means of identifying the particular object to be modified, ie, size 382 (height and width dimensions). ,
And position 384 (x and y coordinates) within the video frame. In this example, fuzz ball track 337 locates frame n at position (6,20)
Is designated as having a fuzz ball 397 of size (2, 4). In frame n + 3, the position (10, 4) and size (4, 8) are changed. A plurality of fuzz ball tracks 337, as described below.
Are associated with the same stream 390 and combined to achieve comprehensive but fine-grained modification of objects in the video stream. As detailed below, the content designation 248 communicated from the client 209 advantageously handles multi-dimensions such as violence, blasphemy, and nudity. A different fuzz ball 397 is provided at each level accordingly in each dimension. The control designation 237 is stored, for example, by a third party mask provider in a file separate from the video stream and transmitted to the content server 203 upon request. Examples of mask provider logic are described below in connection with FIG. As described below in connection with FIG.
7 are transmitted from the content server 203, preferably with the content, and are dynamically interpreted at the client station based on the control designation to change the corresponding object in the video stream 390 prior to its display.

For example, the client 209 specifies a content specification 248 having a violence of 3 or less and a nudity of 2 or less in a video request, and the requested video assigns a violence evaluation value 5 and a nudity evaluation value 4 to the requested video. Consider the example you have. Assume that the higher the rating, the more violent the violence and the nudity of the video. Preferably, when a plurality of control designations 237 are combined, the fuzz ball
The smallest category value in each dimension between tracks is the category value resulting from that dimension. Thus, the number of control specifications 237 that can be generated is reduced in order for the mask provider to support more combinations of content specifications 248 over multiple dimensions. In this example, to satisfy the content designation 248, the O with the resulting violence value of 3
-Another O with label 396 and the resulting naturity value 2
Control designation 23 with either label 396 or one fuzz ball track to which both can be distributed
7 is required. For example, violence value 3 and nudity value 4
Suppose that there is a control specification 237 having a violence degree value of 5 and a nakedness degree value of 2. According to the present invention, by combining these control designations 237 in the video, a violence degree value of 3 and a nakedness degree value of 2 are achieved.
Because the minimum nudity value in the above example is 2,
This is because the minimum violence value is 3. This feature combining control specification 237 is a control specification 2 that needs to be maintained.
Minimize the number of 37.

Referring again to FIG. 3, there are shown examples of three different types of PICS labels according to the present invention. Video label 392 (also referred to as "V-label") may be used by the content server node to identify the content rating of the entire video.

As described in detail below, frame labels 394 (also referred to as “F-labels”) are used to identify content ratings and / or to modify objects in video stream 390. Can be used by the content server. When a given video frame is masked or changed, the F-label category values may be updated to reflect the frame's current content rating.

In one embodiment, the control designation 237 is transmitted as a separate stream (or file), which in this embodiment is referred to as a "fuzz ball track" 337. Preferably, each "fuzz ball track" 337 includes an overlay label 396 (also referred to as an "O-label") in its header. O-label 396 may be used to specify the resulting content rating after fuzz ball 397 has been applied to objects in stream 390. Based on the content designation 248, an appropriate fuzz ball track 337 is selected and the content is changed.

In the preferred embodiment, the PICS profile language known as PICS Rules 1.0 is used to generate a content request with a content specification 248. PICS is a World Wide Web Consortium (W3C) draft recommendation. For example, http: /
"PICS Profile Language Working Group-PICS RU found at /www1.raleigh.ibm.com/PICS/PicsRULZ.html
LZ 1.0 ". One skilled in the art will recognize that many other conventional means of storing and communicating the content specification 248 are:
It will be understood that they can be used within the spirit and scope of the present invention.

FIGS. 4 and 5 show examples of a user interface for storing the content designation 248 according to the present invention. In an Internet environment, the user interface of Content Advisor 310 is incorporated as part of a browser running on client 209 by means known to those skilled in the art. Alternatively or additionally, the proxy administrator of proxy 280 may specify content specification 248. As shown in FIG. 3, one or more dimensions of content 312 may be selected through a list of categories 314 for that change. Optionally, a rating control 316 is provided to specify a maximum rate of content that can be changed. As described below,
Content specification 248 may be stored in the PICS Rules 1.0 language. As shown in FIG. 5, the host / media type 318 indicates that the content request is
Indicate the type of host and media that should accompany 48. In this example, all hosts for streaming media (audio and video) are specified. The content designation 248 is
It may be stored on permanent storage such as DASD 242. As described in detail below, the request to the content server 203 includes an HTTP request header or PICS rules. For example, Internet Explorer 3.0 (trademark), a browser sold by Microsoft Corporation
Please refer to. This provides a dialog box in the Options / Security section called Content Advisor / Rating, which allows the user to enter and store advanced content specifications. Future versions of Internet Explorer will have the ability to send the content specification 248 to the content server as part of an HTTP request. Those skilled in the art will appreciate that there are many other different ways to generate the content designation 248 within the spirit and scope of the present invention.

In the following, an example of content specification in the PICS rule 1.0 format for communication with the content server 203 will be described. The URL of the rule language extension that supports server content changes is the reqExtension statement "h
ttp: //www.w3.org/Customization.html ",
The URL of the evaluation service is "http: //labelbureau.coolne
ss.org/ratings/V1.html "(short name or short name" Cool "
Has). The content is specified by the Re
Provided in the jectUnless, RejectIf, and AcceptIf clauses. For the sake of explanation, the two-dimensional content specification 248, i.e., i) regional-based aptitude specification, i.e., CentralAmericaAppropriateness, and ii)
Consider adult content, i.e., content designation 248 based on nudity, but more dimensions are possible. The Alteration Transmit extension clause allows the content server to merge the control designation 237 with the video frame (merge is "true") or allows the merge to be performed at the client or at a particular intermediate node. (The merge is "false"). The parameter clause alterationPercentReturn indicates that the percentage of video to be changed should be returned to the client 209.

[Table 1]

Here, for example, the server 230 that receives the content request and the content designation 248 receives four different versions of the video 41 (see Table 2), namely, video 41-0-0, video 41-1-4, Video 4
1-1-1 and a video 41-1-2, and based on the video 41-1-4, another input for identifying a fuzz ball track, namely a mask 41-1-4-.
3 (representing control designation 380) may be present. In Table 1,
A column in the server content file identifies a given version of the video, a column in the type indicates the type of file, B represents an alternate video copy, and M represents a fuzz ball track 337. Central America Ap
propriateness), Nudity content specification,
And values corresponding to the percentage of content to be changed or masked (change rate) are provided in the third, fourth and fifth columns, respectively. To show how the V-label (392) and O-label 396 are specified under PICS, the corresponding labels for video 41-0-0 and mask 41-1-4-3 are as follows: Shown in Here, "lr" represents label evaluation. (Video 41-0-0) V-label: lr (CentralAme
ricaAppropriateness0 Nudity 0 Pct 30) and (Mask 41-1-4-3) O-label: ir (Centra
lAmericaAppropriateness 1 Nudity 0 Pct 5).

[Table 2]

In this case, the content server 203
The client 209 specifies the content 248 of the client 209, that is, ((Cool.CentralAmericaAppropriateness>
0) and (Cool. Nudity <3)) and (PICS. AlterationP
ercentMax <20))
It is determined that it has the version of 1-2). Therefore, the video 41-1-2 should be transmitted to the client 209. The HTTP response header contains the PICS change rate (9%).

The following example uses GET check & url = video4 to find out if the content specification 248 can be satisfied.
1 Same as Case A, except that the check request represented by the HTTP / 1.1 statement (FIG. 6, step 410) is first sent from the client 209 to the video server. Again, the PICS known as PICS Rule 1.0
A profile language is preferably used.

[Table 3]

In case A, a version that satisfies the content specification 248 is found, and an HTTP “200” response code is returned to the client. The HTTP response header also contains the PICS change rate.

In the following example, a mask request (FIG. 11, step 935) is sent along with the content specification 248 for the control specification 237 used to modify the content so that the content specification 248 is satisfied. -Sent to the provider 205. Again, PICS rules 1.
The PICS profile language known as 0 is used. An example of a video URL is "http://video.owner.com/
videos / video41 ". In the following example, this corresponds to" http% 3A% 2 "corresponding to the URL parameter value in the mask acquisition request.
F% 2Fvideo.owner.com% 2Fvideos% 2Fvideo41 ". The mask check request to determine whether the content specification 248 can be provided by the mask provider 205 is a" Get mask (Get mask) ) By replacing "Get check"
It is configured similarly.

[Table 4]

Here, the content designation ((Cool.Central
AmericaAppropriateness> 0) and (Cool.Nudity <
3)) Control specification 237ma that can change contents so as to satisfy and (PICS.AlterationPercentMax <8))
sk41-1-4-3 exists, and the control designation 237 can be transmitted to the content server 203. HTTP response header is PI
Includes CS change rate.

Case B: In case B, client 2
09 sends the video request along with the content
It communicates to the server 203 and the video stream 390 and fuzz ball track 337 are returned to the client. And in the AlterationTransmit statement it is indicated that the fuzz ball should not be applied on the server side, ie it should be executed on the client node.

[Table 5]

As an example, here the content server has two different video versions, namely video 4
2-0-0 and video 42-1-4.
Control designation 237, that is, the mask 42-1-
Assume that 4-1 exists. This can be summarized as follows:

[Table 6]

In this case, the content specification ((Cool.Centr
alAmericaAppropriateness> 0) and (Cool.Nudity <
There is no unmodified version that satisfies 3)). However, if the mask 42-1-4-1 is the video 42-1-
4 and the resulting content satisfies the content designation. Video 42-1-4 should be sent with V-mask 42-1-4-1 because the modified transmission node indicates (merge "false"). The protocol request statement is {alterationPer
centReturn true} clause, so the response header is PICS
The change rate, namely 7, is shown.

There are various alternative embodiments, and extensions of object labeling or content specification 248 may be used within the spirit and scope of the present invention. For example, other protocols such as RTSP and MPEG may also be used to provide the content specification 248.

[0049] The control designation 237 indicates how the stream content should be changed. It provides instructions for the presentation of a frame or group of frames of a multimedia stream and specifies blocking, skipping, and overlaying. As mentioned above,
One type of control designation 237 is another fuzz ball track 337. Another type is the edit decision list, which indicates the frame to change or replace.

According to the present invention, control designations 237 can be flexibly provided in each frame, group of frames, or video header. The control designation at the level of the frame group or at the video header is time-based, so that a particular frame can be identified by timing information. In a preferred embodiment, the masking / modification of the multimedia stream content is provided in the distribution of the real-time video stream,
The same concept is applicable to any other type of multimedia stream that may include multiple streams of video and audio.

Those skilled in the art will appreciate that while control specifications have been described as separate streams or tracks, there are various alternative ways of providing object-level control specifications. For example, each frame of the video may include a rich PICS label that specifies the required control information associated with that frame, such as the F-label 394. frame PICS label "F-Label" ----- --------- 00001 (PICS-1.1 "http://www.coolness.org/ratings/V1.html" lr (CentralAmericaAppropriateness 1 Nudity 2 Nudity1x 0 Nudity1y 0 Nudity1h 480 Nudity1w 640)) 00002 (PICS-1.1 "http://www.coolness.org/ratings/V1.html" lr (CentralAmericaAppropriateness 1 Nudity3 Nudity3x 206 Nudity3y 113 Nudity3w199 Nudity3d Nudity1h 294 Nudity1w 307))

Here, Nudity1x and Nudity1y specify the position (x coordinate and y coordinate, (0, 0) in the frame 00001) of the fuzz ball for achieving the nudeness value 1, and Nudity1h and Nudity1w are: The size (height and width, 480 and 640 for frame 00001, respectively) is specified. Similarly, Nudity3x and Nudity3y specify the position (x-coordinate and y-coordinate) of the fuzz ball to achieve the nudeness value 3, and Nudity3h and Nudity3w specify the size (height and width).

Frame 00001 has a nudity value of 2 and a Central American fitness value of 1 and is capable of achieving a nudity value of 1
Two fuzz balls are designated. Frame 2 has a nudity value of 3 and a Central American fitness value of 1 and two fuzz balls are designated. One of them provides a nakedness value of 3, and the other provides a nakedness value of 1.

If the request is not for a multicast stream, the server can modify the content based on the control specification 237 and the client content specification 248 and send the modified stream 390 to the requesting client. To return the PICS change rate, a value can be calculated using the formula (number of frames with fuzz ball / total number of frames) × 100. In the case of multicasting, the client 209 controls the control specification 23 so as to satisfy the content specification 248.
7, the content can be changed. Viewers with different content designations 248 will not
7, the contents are changed differently.

Those skilled in the art will appreciate that the fuzz ball can have any shape. Instead of a rectangle,
Fuzz balls can take the shape of a polygon or a circle.

FIG. 6 shows an example of the content server logic 268. As shown, at step 405, the content server 203 waits for an input. At step 410, different actions are taken depending on the input received. If the input received is a video check request, the video check handler 267 is called at step 415. The video check handler determines whether there is a version of the requested video that can be modified or masked to satisfy the content specification.
A detailed example of a video check handler is described with reference to FIG. At step 420, if the input received is a video show request, then at step 425 the video show handler 269 is invoked. The video show handler distributes the video stream based on the content designation. If the requested video has multiple versions, the video show handler checks whether any version satisfies the content specification 248. A detailed example of the video show handler 269 will be described with reference to FIG. For other types of input that are not in the focus of the present invention (eg, conventional HTTP or FTP requests for web documents), various suitable handlers 430 may be invoked.

FIG. 7 shows the video check handler 26.
7 is shown. The video check handler determines whether there is a version of the requested video that can be modified or masked to satisfy the content specification 248. At step 505, if the requested video has multiple versions, it is determined whether any version satisfies the content designation 248 (step 5).
25). If so, a "yes" response is returned to client 20
9 (step 520). Otherwise, the version closest to the content designation 248 is selected (step 530). In the preferred embodiment, the content
For each video stored in the server mask information for a valid control specification 237, the server
7 (i.e., the O-label 396) and a prediction of the amount of information to be blocked by each control designation 237. In step 540, the server 203 determines whether the version can be changed or masked based on the control designation 237 information so as to satisfy the content designation 248. If possible, at step 560, a prediction of the amount of video that needs to be removed or blocked may be obtained. This prediction (upper limit) can be obtained by adding the amount of information blocked by each fuzz ball that needs to be applied. Step 57
At 0, the "qualified" response (included in the HTTP response header and indicating the PICS change rate) is returned to the requester and indicates the amount to be blocked. In step 505,
If there is only one version of the video available in the server, it is checked in step 510 whether this version satisfies the content specification 248. If so, a "yes" response is returned to client 20
9 (step 520). If not, processing continues at step 540 described above.

FIG. 8 shows an example of the video show handler 269. The video show handler distributes the video stream based on the content designation 248. Step 6
If the requested video has more than one version at 05, it is checked at step 615 whether the version satisfies the content specification. If so, at step 640, the version closest to the content designation is selected, and at step 645, the selected version is sent to the client 209. Step 615
If none of the versions satisfies the content designation, in step 625, the closest version is selected. At step 630, a frame masking / modification routine is called. A detailed example of the frame masking / modification routine is described with reference to FIG.
If there is only one version of the video in the server at step 605, it is checked at step 610 whether this version satisfies the user specification. If so, the video is transmitted to the client in step 602.

FIG. 9 shows an example of the frame masking / change routine (step 630 in FIG. 8). flame·
Masking / modification routines are used for video
Modify, mask or merge / add ball tracks. For example, when an object in a video frame is masked or changed, the category value of the V-label 392 may be updated to reflect a change in the result of the video's current content rating. For example, if a video having a V-label 392 violence value 5 is overwritten by a fuzz ball track 337 having an O-label 396 violence value 2, the resulting video will have a V-label violence value 2 . Alternatively, as described above, the F-label 394 may have the content designation 248 as part of the multimedia stream without requiring a separate fuzz ball track 337. For the remainder of this example, assume that the multimedia stream includes an F-label 394 with each frame of the multimedia stream. At step 705, the next frame of the video is stored
5 is fetched. At step 710, the frame
If label 394 (F-label) satisfies content designation 248, the frame is transmitted to client 209 (step 715). Otherwise, step 72
At 0, it is checked whether there is an alternative frame that satisfies the content specification. If yes, step 7
At 25, an alternate frame is fetched. Otherwise, at step 730, based on the O-label 396,
It is checked whether there is one or more fuzz ball tracks 337 that can be applied to satisfy the content specification. This specifies the lowest category value of each dimension among all fuzz ball tracks.
48 can be achieved. If the lowest category value in each dimension is less than the content specification 248, then there is a set of fuzz ball tracks that satisfy the content specification. In that case, step 735
Calls the fuzz ball routine. An example of a fuzz ball routine is described with reference to FIG. In step 730, the fuzz ball track 33
If 7 is not available, a blank frame may be sent (step 740).

FIG. 10 shows the fuzz ball routine 73.
5 is shown. At step 810, a set of fuzz balls 397 that satisfy the multidimensional content specification with a minimal amount of blocking are selected based on their labels (ie, O-labels). For example, if the video is
Consider the case where the content designation 248 has a violence value of 4 and has no violence value, with a violence value of 7 and a nudity value of 3 specified in the label 392.
Assume now that four fuzz ball tracks with the following O-label 396 are available. They include truck 1 with violence value 4 and nudity value 3, truck 2 with violence value 3 and nudity value 3, truck 3 with violence value 7 and nudity value 2, violence value 7 and Track 4 with nudity value 1. In this case, fuzz ball track 1 is selected because it satisfies the request with a minimum amount of blocking. Step 82
At 0, if the fuzz ball track 337 is applied by the server according to the instructions in the content designation 248, the fuzz ball 397 is superimposed on the corresponding video frame before transmission of the frame (step 83).
0). Otherwise, the fuzz ball track is transmitted along with the original frame as an additional track 337 (step 840). For example, in multicast video, different viewers may have different content designations. Thus, the content server 203 transmits the various fuzz ball tracks 337 (as separate tracks) along with the video transmission, causing each client 209 to select and apply the appropriate fuzz ball track 337. Is desirable. In another example, an organization (such as a school or legal entity) and individual users, or subgroups within the organization, each have their own content designation 24
8 The fuzz ball 397 can be overlapped on the same dimension by a plurality of fuzz ball tracks 337. Also in this case, the content server 203
Separately transmits the control designation 237 to the intermediate node, such as a gateway or proxy server 280, and to the client station 209 with the appropriate fuzz ball.
It is more efficient to apply tracks 337 and change the content as the video passes through them.

FIG. 11 shows an example of the client logic 249. As shown, at step 910, client 209 specifies in its video request a request such as medium violence and low nudity. In the preferred embodiment, the specification format uses the PICS profile language known as PICS Rule 1.0. Typically, for each category of evaluation scheme, client 209 can specify the desired maximum level. At step 915, a video check request is sent to the content server to see if the content designation 248 can be satisfied. In a preferred embodiment, the response is either a "yes" to indicate that such a version exists, or a modified response, the latter of which, for example, may be distributed with a version,
FIG. 8 shows that 20% is blocked as described in connection with FIG. If, at step 920, the response is deemed acceptable, at step 940, a video show request requesting distribution of the video is sent to the content server. In step 945, a play video operation 247 is invoked to receive and play the video. A detailed example of the playback operation will be described with reference to FIG. If, at step 920, the response to the content specification 248 is not acceptable, the client 209 queries a third party mask provider at step 925 to indicate a type of mask required for the content specification 248. Is sent to the mask provider. In a preferred embodiment,
The designation format is a PICS known as PICS Rule 1.0
Use a profile language. Typically, for each category in the evaluation system, the client 209 can specify the desired level for the control specification 237 in the mask check request. For example, if the video has a violence value of 5 and a nudity value of 7, and the content specification 248 specifies a violence value of 3 and a nudity value of 2, there is a control specification 237 that satisfies the content specification 248. To find out, a mask check request for violence degree value 3 and nudity value 2 is sent to the mask provider. In step 930, if the response from the mask provider indicates that the specification can be satisfied, step 93
At 5, a mask display request is sent to the mask provider to obtain control designation 237 or fuzz ball track 337.

When the client 209 receives a video request,
Content designation 248 including violence degree value 3 and nudity degree value 2
And the requested video is by its V-label:
Consider an example that is shown to have a violence rating of 5 and a nude rating of 4. The unmodified video fails both the violence and nudity ratings, as indicated by its V-label, so that in order to satisfy the content specification, the client 209 uses the appropriate control specification 23.
7 needs to be applied. This means that the client 209 may have one or more fuzz ball tracks with appropriate O-labels 396 such that the minimum category value between fuzz ball tracks for nudity and violence satisfies the content specification. It means that the track 337 needs to be acquired. For example, assume that the following two fuzz ball tracks are available. That is,
The first fuzz ball track has a violence value 3 and a nudity value 4 indicated by its O-label, and the second fuzz ball track has a violence value 5 and a nudity value 2 Have. These fuzz ball tracks can be supplied by either a content provider or a third party mask provider. In fact, the two fuzz ball tracks can come from different providers. It is assumed here that the fuzz ball track is available from one of the third party mask providers 205. Does the client 209 have one or more fuzz ball tracks 337 for the mask provider to satisfy violence 3 and nudity 2 for the requested video by sending a mask check request? You can find out. The mask provider returns an acknowledgment in this case because the request can be satisfied by the two fuzz ball tracks described above. Client 209 then sends a request for video to the content provider, and simultaneously sends requests for two fuzz ball tracks to the mask provider. Alternatively, the content provider may interact with the mask provider. By overwriting the video with both these fuzz ball tracks 337, a violence value of 3 and a nakedness value of 2 are achieved. This overwriting, as shown in FIG. 3, includes on each frame a fuzz ball for the violence mask from the first fuzz ball track corresponding to that frame and a fuzz ball from the second fuzz ball track. It can be performed on a frame basis by overwriting both fuzz balls for the nude mask. An example of client playback is described in connection with FIG.

FIG. 12 shows an example of a block diagram of the client playback operation 247. In short, the video stream 1002, the associated audio stream 1001, and the fuzz
A ball track 1003 (which may come from a different source, such as mask provider 205) arrives at the client station. For illustrative purposes, only one audio, video and fuzz ball track is shown, but there may be more than one of each track. In particular, there may be multiple fuzz ball tracks associated with a single multimedia content. Multimedia
The stream is received and decoded by the client, as shown in steps 1015 and 1035 for video, and by steps 1010 and 1030 for audio, and by steps 1020 and 1040 for fuzz ball, respectively. And decrypted or processed. A fuzz ball is created in step 1040 and overwritten on the appropriate video frame in step 1050. The audio rendering in step 1045 is combined with the fuzz ball overwrite based on timing or synchronization information embedded in the stream to provide final video rendering in step 1060. More complex masking techniques for overwriting two different video streams are known, for example, the stream being overwritten is actually another video. For this, for example, Chen
U.S. Patent No. 5,257,113, "Mixing and Pl
ayback of JPEG Compressed Packet Videos "(1993
(Issued October 26, 2012).

For example, consider a video clip containing a sequence of frames numbered 1 through n. To mask the video sequence, a fuzz ball 397 is generated, which overwrites the video sequence at specific locations within each frame.
For simplicity, it is assumed here that the fuzz ball is simply a black rectangle. Recall from FIG. 3 that the fuzz ball track is represented as a list of frame numbers (or time stamps), position coordinates (positions within the frame), and size of the fuzz ball.

Referring again to FIG. 12, the incoming video is received at step 1015 from a network or file. At step 1035, the video is decoded and each video frame is passed to the fuzz ball overwrite module (step 1050) (described in detail above in connection with FIG. 10) along with the frame number along with a bit map (matrix of integer values). ) Passed as. Meanwhile, the incoming fuzz ball track is received from the network or file at step 1020 and passed to the fuzz ball generation module (step 1040), where each fuzz ball is generated as a rectangular matrix of integer values. (The integer value indicates the color of the fuzz ball, where the integer value corresponds to black). This fuzz ball
The matrix is also passed to the fuzz ball overwrite module (step 1050) along with the fuzz ball frame number and position coordinates (see FIG. 3). At step 1050, the fuzz ball frame number Z is compared to the current video frame number V. If Z> V,
At step 1060, the video frames are transmitted unchanged to the video rendering module (step 1060) and displayed. At step 1050,
The next video frame (transmitted by the video decoding module in step 1035) is retrieved by the fuzz ball overwrite module. If Z <V, then in step 1050 the fuzz ball overwrite module retrieves the next fuzz ball (transmitted in step 1040) from the fuzz ball generation module. If Z = V, the video frame integer matrix is overwritten by the fuzz ball integer matrix at the position in the video frame specified by the fuzz ball position coordinates. The modified video frame is passed to a video rendering module (step 1060) and rendered by one of many conventional methods known to those skilled in the art. The process continues as described above for the remainder of the video, and the next video frame (transmitted by the video decoding module at step 1035) is retrieved by the fuzz ball overwrite module (step 1050), The next fuzz ball (transmitted in step 1040) is retrieved from the fuzz ball generation module.

FIG. 13 shows a mask having the characteristics of the present invention.
Here is an example of provider logic. As shown, step 1
At 110, the mask provider waits for input. In step 1115, different actions are performed depending on the input received. If the received input is a mask check request, in step 1125, the content designation 2
It is determined whether there is a fuzz ball track 337 that can satisfy 48. If present, step 1
At 150, a "positive" response is sent. Otherwise, "
A "negative" response is sent (step 1160). At step 1120, if the received input is a mask display request, the requested fuzz ball track is distributed (step 1140). For other types of input that are not (e.g., insert / delete / update control specification 237), the appropriate various handlers are invoked (step 1130).

Those skilled in the art will appreciate that a heterogeneous environment is a conventional content server, proxy or client station where some nodes do not understand the masking protocol of the present invention and do not participate in masking / filtering operations. It will be appreciated that the method of masking or modifying a multimedia stream also works. For example, if the content server is a conventional server, the client 209 can interact directly with the mask provider to obtain a fuzz ball track and perform a masking operation at the client. In other words, in FIG. 11, steps 915 and 920 are bypassed, and the process moves from step 910 to step 925. For conventional client stations that cannot perform the masking operation, it is also possible for an intermediate proxy or content server to perform the masking operation. Indeed, in an organization such as a school or corporation, the proxy node 280 performs the masking operation based on the organization's (intranet-wide) policy, transparent to client stations that are not capable of performing or requesting the masking operation. Or you can request. Within the proxy hierarchy (see FIG. 1), one or more proxies select and apply their own masking criteria, while some proxies are conventional proxies that do not participate in the masking operation.
On the other hand, each client station may also request or perform additional masking operations based on local requests independent of the proxy.

Those skilled in the art will appreciate that the control designation 237 stream may include video / audio other than visual or audio fuzz balls. These are P
It may include visual captions or speech conversions in the particular language (eg, Chinese, Spanish, etc.) required within the ICS profile.

Therefore, according to the present invention, the content designation 246
Dynamically masking or changing an identifiable object in a video stream, such as a portion of a video frame, a portion of a video stream, or an audio sample, or replacing an object. Includes features that provide fine-grained means. Dynamic content changes may be performed flexibly and sequentially at the server 203, the proxy 280, the client 209, or a cooperative combination of these nodes. Moreover, not all of them are required to participate.

Those skilled in the art will recognize that the preferred embodiment is PICS
It has been described with respect to the Internet using a new adaptive form of the present invention, but it will be understood that the invention is not limited to such an environment. For example, it is known to transmit control signals during a vertical blanking interrupt (VBI) of a standard television broadcast. The majority of television today uses closed captioning (closed c
aptioning controller, which can be optimized through conventional software algorithms that decode any signal transmitted to the VBI of the television set. This controller is currently typically used for satellite programs, on-screen (on-s
creen) programmed to prevent programming and closed captioning. The controller also provides a commonly known "V-chip" for automatically blocking programs based on their ratings.
(Recently enacted Telecommunication Bi
ll) as part of 652). The V-chip converter is
Available in the fall of 1997, it is used to enable televisions without the necessary technology. According to the present invention, a controller or V-chip converter can be programmed to provide the content designation 248 by conventional means. Assuming that the functionality provided by the control designation, such as F-label 394, is transmitted during the VBI of the transmission and that there is sufficient processing power, the control unit may determine that the control designation 237 and the content designation 24
9, object-level content changes can be performed. Alternatively, the additional processing power is
09 set-top box version or V
-Provided by chip converter as needed. If the video stream 390 and the control designation 237 are transmitted as more than one stream (FIG. 3), the controller is described in connection with the V-label 392 and O-label 396 in the preferred embodiment. A function similar to that of can be adapted to change content.

The present invention relates to a conventional frame-oriented video
It is not limited to the stream transmission system. For example, MPEG (Moving Picture Coding Experts Grou
p) is a working group of the ISO / IEC responsible for the development of international standards for compression, decompression, processing and coded representation of moving pictures and sounds. MPEG-2 decoders have been included in numerous set-top boxes to help the satellite and cable television industries transition from analog to digital technology. A new standard, MPEG-4, is currently under development. The MPEG-4 standard has, among other things, the following standardization methods: 1) how to represent audio, visual, or audiovisual content (referred to as "audio / visual objects" or AVOs), 2) primitive objects ("primitive AVOs"). ), For example as an audiovisual scene, to a composite audiovisual object, 3) a method of multiplexing and synchronizing the data associated with the AVO and transmitting it over a network, so as to be adapted to the appropriate quality of service, and ) How to interact with the audiovisual scene generated on the client side (eg http: //www.q-tea
m.de/mpeg4/whatmpeg.htm). Therefore,
The "object" of the present invention is, for example, an MPEG-4 AV
It should be understood to include identifiable and modifiable objects in the multimedia bit stream, such as O. Similarly, the MPEG-4 PC project aims at the realization of a PC including the creation of an authoring system for MPEG-4 (eg, http: // ww
wq-team.de/mpeg4/contcrea.htm).

In summary, the following items are disclosed regarding the configuration of the present invention.

(1) In a multimedia network including a multimedia stream, a method for changing an object associated with the content of the multimedia stream, comprising: receiving a content request including a content designation; Based on the content designation and control designation, the multimedia
Dynamically changing one or more objects in one or more dimensions of the stream. (2) the step of dynamically changing includes generating a first stream including the content, generating a second stream including the control specification for the content, and including the control specification. Receiving a request for content, and dynamically changing the content of the first stream according to the control designation and the content designation.
The method according to the above (1). (3) The method according to (2), further comprising, in response to the receiving, determining a percentage of the content that is changed according to the content specification and notifying a content requester. (4) The method of (2), further comprising communicating a blocking indicator to the requester without playing a video if the percentage exceeds a threshold. (5) The method according to (2), wherein the control specification includes a multidimensional control specification. (6) the content includes a video, the control specification includes a fuzz ball specification, and the dynamically changing step generates the fuzz ball specification corresponding to one or more content specifications; Receiving a request for the content that includes the content designation, and dynamically overwriting at least a portion of the video frame based on the fuzz ball designation and the content designation in response to the receiving. The method according to (1) above. (7) The content designation and the control designation are PICS
The method of claim 6, including a protocol, wherein the method includes generating separate fuzz ball designations corresponding to different content designations, and selecting a fuzz ball designation based on the PICS designations. . (8) The method according to (6), wherein the content designation is time-based. (9) The method according to (6), wherein the generating step includes generating the fuzz ball designation as one or more fuzz balls having a size, a position, and a temporal relationship with a frame of the video. Method. (10) The method of (1), wherein the step of dynamically changing comprises combining a plurality of content designations dealing with either a multi-dimensional or rating system. (11) The method of (10), wherein the content comprises video, and comprising the step of overwriting a plurality of fuzz ball filters in response to the combining step. (12) The method according to (1), wherein the content request includes a multidimensional content specification, and the step of dynamically changing includes dynamically changing the content according to a plurality of control specifications and the multidimensional content specification. ) Described method. (13) The method according to (1), further including a step of transmitting one of the content designation and the control designation according to one of a PICS protocol, an RSTP protocol, and an MPEG protocol. (14) the content includes a video, and the PICS
A protocol comprising a plurality of PICS labels, communicating a V-label indicating a content rating of the video and an overlay label indicating an effect of changing the content rating; and responsive to the dynamic change, the V-label Updating the category value of (13). (15) The method according to (12), wherein the content includes a video, and comprising dynamically changing a frame of the video according to the plurality of control specifications and the multidimensional content specification. (16) The method according to (15), wherein the content includes a video, and the step of dynamically changing a frame of the video includes masking a frame of the video according to the plurality of control specifications and the multidimensional content specification. )
The described method. (17) The step of dynamically changing the content
(15) comprising dynamically changing frames of the video at one or more of a server, a client, a set-top box, and a proxy node.
The described method. (18) the network comprises the World Wide Web including a hierarchy of servers, and the intermediate proxy server comprises:
The method of (1) above, comprising the step of changing the content designation of the outgoing content request. (19) The method according to (18), wherein the hierarchy includes a heterogeneous proxy hierarchy, and wherein the changing is not performed by a client or all servers in the hierarchy. (20) multicasting one multimedia stream to a plurality of requesters, rendering the video by the requesters, wherein at least two of the requesters render the video according to different content specifications; The method according to the above (1), comprising: (21) generating one or more separate fuzz ball designations for said different content designations;
Selecting one or more fuzz ball designations according to an ICS protocol. (22) The method according to (1), wherein the step of dynamically changing includes a step of dynamically bypassing, masking, blocking, and replacing an object. (23) The method of (22), wherein the content comprises a video, and comprising replacing one or more frames or segments of the video with one or more alternative frames or segments. (24) the step of dynamically changing includes generating a second stream including the control specification for the content, wherein the control specification includes a video header;
Said (1) generated at either a group of frames of said video, or at an individual frame level.
The described method. (25) The method according to (22), wherein the content includes video, and comprising skipping a video frame or video segment based on the control designation and the content designation. (26) The (22) said (22), wherein said content comprises video and comprises masking or blocking a particular portion of a video frame or stream at either a server, proxy, set-top box, or client. the method of. (27) The method according to (1), including transmitting the control designation and the content as one stream. (28) The method of (27), wherein the content comprises video, and wherein the transmitting comprises transmitting the control designation during a vertical blanking interrupt of the multimedia stream. (29) The method of (27), wherein the communicating comprises associating a frame label with one or more frames of the video. (30) The method of (1), comprising: multicasting a multimedia stream to a plurality of requesters; and rendering each of the requesters with at least two different content designations. (31) The method according to (6), comprising overwriting a plurality of fuzz ball designations and satisfying the content designation. (32) The method of (1), wherein the object comprises an identifiable object in the multimedia stream comprising at least a portion of a frame of video and a sample of audio. (33) A computer program product comprising a computer usable medium having computer readable program code means for modifying an object associated with a content of a multimedia stream, wherein the computer readable program code means comprises a computer. Program code means for instructing the multimedia stream to receive a content request including a content specification, and moving one or more objects in one or more dimensions of the multimedia stream based on the content specification and the control specification. Computer program product comprising program code means for instructing the user to make a global change. (34) The program code means for instructing a dynamic change, the program code means for instructing the computer to generate a first stream including the content, and the program code means for the content. Program code means for instructing to generate a second stream including a control designation, program code means for instructing to receive a request for the content including the control designation, the control designation and the content designation Computer code means for instructing to dynamically change the content of the first stream according to the above.
Program products. (35) The program code means for instructing the computer to determine a ratio of the content changed in accordance with the content designation in response to the reception and to notify a content requester of the content. 34) The computer program product according to the above. (36) The program described in (34), further comprising program code means for instructing the computer to transmit a blocking indicator to the requester without playing a video if the ratio exceeds a threshold. Computer program products. (37) The computer program product according to (34), wherein said control specification includes a multidimensional control specification. (38) The content includes a video, the control specification includes a fuzz ball specification, and the program code means for dynamically changing includes:
Program code means for instructing to generate the fuzz ball designation corresponding to one or more content designations; program code means for instructing to receive a request for the content including the content designation; The program code means for instructing to dynamically overwrite at least a portion of the video frame based on the fuzz ball designation and the content designation in response to the fuzz ball designation and the content designation. Program products. (39) The content designation and the control designation are PIC
Computer readable program code means including an S protocol, wherein the computer readable program code means instructs the computer to generate separate fuzz ball designations corresponding to different content designations; , Program code means for instructing to select a fuzz ball designation. (40) The computer program product according to (38), wherein the content designation is time-based. (41) The program code means for instructing to generate, instructs to generate the fuzz ball designation as one or more fuzz balls having a size, a position and a time relationship with the frame of the video. The computer program product according to (39), further comprising: (42) The program according to (33), wherein the program code means for instructing to change dynamically includes a program code means for instructing to combine a plurality of content specifications dealing with either a multidimensional or an evaluation system. ) Computer program product as described. (43) The computer program product of (42), wherein the content comprises video and includes program code means responsive to the combining to instruct to overwrite a plurality of fuzz ball filters. (44) The program, wherein the content request includes a multidimensional content specification and instructs to change dynamically.
The computer program product of (33), wherein the code means includes program code means for instructing to dynamically change the content in accordance with the plurality of control specifications and the multidimensional content specification. (33) The computer program product according to (33), further comprising program code means for instructing transmission of one of the content designation and the control designation according to any one of RSTP protocol and MPEG protocol. The content comprises a video, and the PICS
The program code means wherein the protocol includes a plurality of PICS labels and indicates to be conveyed, such that the program code means conveys a V-label indicating the content rating of the video and an overlay label indicating the effect of changing the content rating. The computer program product of (45), further comprising program code means for instructing, and program code means for instructing to update said V label category value in response to said dynamic change. (47) The content according to (45), wherein the content includes a video, and program code means for instructing to dynamically change a frame of the video according to the plurality of control designations and the multidimensional content designation. Computer program product. (48) A program for instructing the content to include a video and dynamically changing a frame of the video.
The computer program product of (47), wherein the code means includes program code means for instructing masking of the video frame according to the plurality of control designations and the multidimensional content designation. (49) The program code means for instructing a dynamic change includes a content server, a client,
The computer program product of claim 47, including program code means at one or more of a set-top box and a proxy node to dynamically change the frame of the video. (50) The network comprises the World Wide Web including a hierarchy of servers, wherein the intermediate proxy server comprises:
The program code means for instructing to change the content designation of the outgoing content request.
3) The computer program product according to the above. (51) The program code means for instructing the hierarchy to include a different type of proxy hierarchy and changing the program code means for instructing that the change is not executed by a client or all servers in the hierarchy. The computer program product according to the above (50). (52) program code means for instructing a multimedia stream to be multicast to a plurality of requesters; and program code means for instructing a video to be rendered by the requester, wherein at least two of the requester means One renders the video according to different content specifications,
(33) The computer program product according to the above (33), comprising program code means. (53) A program code means for instructing to generate one or more separate fuzz ball designations for the different content designations, and selecting one or more fuzz ball designations according to the PICS protocol. (52) including program code means for instructing
Computer program product as described. (54) The program code means for instructing to change dynamically comprises a program for instructing to dynamically bypass, mask, block and replace an object.
The computer according to the above (33), comprising a code means.
Program products. (55) The content of (54), wherein the content comprises a video and includes program code means for instructing one or more frames or segments of the video to be replaced by one or more alternative frames or segments. Computer program product. (56) The program code means for instructing to change dynamically includes program code means for instructing to generate a second stream including the control specification for the content, wherein the control specification is a video stream. The computer program product of claim 33, wherein the computer program product is generated at either the header, a group of frames of the video, or at an individual frame level. (57) The computer program according to (54), wherein the content includes video, and includes program code means for instructing to skip a video frame or a video segment based on the control specification and the content specification. Product. (58) The program code means for instructing the content to include video and masking or blocking a particular portion of a video frame or video stream at either a server, proxy, set-top box, or client. Including (54)
Computer program product as described. (59) The computer program product according to (33), further comprising program code means for instructing transmission of the control designation and the content as one stream. (60) the program code means for instructing the content to include video and transmitting the program code for transmitting the control designation during a vertical blanking interrupt of the multimedia stream; The computer program product of (59), including means. (61) The computer program of (59), wherein the program code means for instructing to convey includes program code means for instructing to associate a frame label with one or more frames of the video. Product. (62) program code means for instructing to multicast one multimedia stream to a plurality of requesters; and program code for instructing each requester to render the video using at least two different content specifications. Means,
The computer program product according to (33). (63) The computer program product according to (38), further comprising program code means for overwriting a plurality of fuzz ball designations and instructing the content designation to be satisfied. (64) The computer program product of (33), wherein the object comprises an identifiable object in the multimedia stream comprising at least a portion of a frame of video and a sample of audio.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an Internet environment having features of the present invention.

FIG. 2 illustrates a more detailed example of a network environment having features of the present invention.

FIG. 3 shows the “fuzz ball” and “fuzz ball” of FIG.
It is a figure showing an example of "control designation".

FIG. 4 is a diagram showing an example of a user interface for storing a content designation according to the present invention.

FIG. 5 is a diagram showing an example of a user interface for storing a content designation according to the present invention.

FIG. 6 illustrates an example of the content server logic of FIG.

FIG. 7 is a diagram illustrating an example of a video check handler of a server.

8 illustrates an example of the video show handler of FIG.

FIG. 9 is a diagram showing an example of a frame masking / change routine of FIG. 8;

FIG. 10 is a diagram illustrating an example of the fuzz ball routine of FIG. 9;

FIG. 11 is a diagram illustrating an example of the client logic of FIG. 2;

FIG. 12 is a diagram illustrating an example of a client playback operation.

FIG. 13 illustrates an example of the mask provider logic of FIG.

[Explanation of symbols]

110, 111, 112, 113, 114, 115 Proxy Tier 125, 209 Client 135, 203 Content Server 155 Mask Provider 165, 201 Network 205 Mask Provider 227, 240, 260 CPU 235, 245, 263 Memory 239 Mask Provider logic 227, 240, 260 CPU 230, 242, 265 Storage 247 Video playback operation logic 248 Multidimensional content specification 249 Client logic 267 Video check handler 268 Content server logic 269 Video show handler 280 Proxy node 310 Content Advisor 316 Evaluation control 318 Host / media type 337, 1003 Fuzz ball track 382 Fuzz Rule size 386 Temporal relationship 390, 1002 Video stream 392 Video label (V-label) 394 Frame label (F-label) 396 Overlay label (O-label) 397, 735 Fuzz ball 430 Handler 1001 Associated audio stream

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] July 17, 1998 (1998.7.1)
7)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Full text

[Correction method] Change

[Correction contents]

[Document Name] Statement

Title: Method and apparatus for dynamically changing multimedia content

[Claims]

DETAILED DESCRIPTION OF THE INVENTION

[0001]

FIELD OF THE INVENTION The present invention relates generally to dynamic masking and modification of multimedia content based on content designation.

[0002]

BACKGROUND OF THE INVENTION With the increasing popularity of the World Wide Web (WWW), general interest has been directed to the content of web sites. Ideally, users should have control over the content that enters their home.

A recently established standard uses existing web protocols, such as the Hypertext Transfer Protocol (HTTP), and allows for content specification as metadata in object headers. Platform for Internet Content Selection (PICS: Pl
The atform for Internet Content Selection protocol specifies one way to send meta information about electronic content. PICS is a web consortium
Protocol Recommendation (see http://www.w3.org/PICS). PICS was initially used to send value-based rating labels, for example, "How much nudity is associated with this content?", But the form and meaning of meta-information is quite common . In PICS, meta-information about electronic content is grouped according to the information's "rating service" or producer-and-intended-usage, and within one such group, any number of Category or dimensional information is transmitted. Each category has a range of allowed values, and a particular category may have a single value or multiple values for a particular portion of content. Further meta information groups (known as "PICS labels")
May include expiration information. Furthermore, mechanisms exist for applying a PICS label to more than one piece of electronic content. Each PICS label corresponding to a particular piece of electronic content can be independently added or removed from the content.

[0004] For example, an image file having a PICS label is transmitted from a server, and the "evaluation service" field of the label is set to "SafeSur".
f) According to the "Reputation System", it may indicate that it contains a value-based reputation label.
Augmented by request and response headers that support S. Technical bodies that define other common application protocols, such as NNTP, are also currently considering adding PICS support. As part of these protocols, a list of the type of PICS label desired may be included with the request. PICS also specifies a query format for receiving PICS information from a central label bureau server. An example of a PICS label is (PICS-1.1 "http: //the.rating.service" label f
or "http: //the.content" exp "1997.07.01T08: 15-05
00 "r (n4s3v2l0)), where 'n', 's',' v 'and'
l ′ is a transmission name of various meta information types, and applicable values for this content are 4 (corresponding to n), 3 (corresponding to s), 2 (corresponding to v) and 0 (corresponding to l) ). I
Only software that recognizes D "http: //the.rating.service" will know how to interpret these categories and values.

[0005] The prior art includes various systems aimed at storing user preferences for selecting coded video and / or video streams.
For multimedia streams such as video and audio, it is inflexible to evaluate the entire multimedia presentation using one criterion. For example, in a two-hour video, a scene that includes violence or sexually explicit content may be a video subject to high violence or high sexual content ratings, and therefore, based on most user designations, viewing the video Will be blocked.

[0006] For example, US Pat.
Issue 160, "Automatic Censorship of Video Programs"
(Issued May 29, 1990) uses a classification code to switch from the first video stream to another video stream previously selected by the viewer. In addition to the aforementioned lack of flexibility, the censorship standards used under this proposal would be derived from central censorship authority.
This approach also requires broadcaster participation depending on its effectiveness.

[0007] As another example, US Pat.
550575, "Viewer Discretion Television Prog
ram Control System "(issued August 27, 1996)
Provides both time and content control for multiple variable numbers of viewers. However, control is limited to a portion of the entire video.

As yet another example, US Pat. No. 5,434,678 to Abecassis, “Seamless Transmission of N
on-Sequential Video Segments "(July 18, 1995
Issued on a daily basis). This patent describes a non-sequentially stored video program of variable content video programs, depending on the viewer's pre-established video content preferences.
It relates to selectively retrieving segments and transmitting them seamlessly. Here, video segments may be selected from a single source by applying video content preferences to the video segment map. This approach also requires the production of variable content video programs and the participation of broadcasters depending on their effectiveness.

[0009]

Thus, certain objects, such as portions of a single video frame or audio samples, can be dynamically masked or filtered or modified according to the user's content specification. What is needed is a system and method for evaluating and flexibly modifying multimedia content.
There is also a need for a system that does not require the generation of customized or variable content or the effectiveness of broadcaster participation.

[0010] Further, there is a need for such a video distribution system and method within an Internet and World Wide Web compatible transmission system such as HTTP. Further, there is a need for a system that can be flexibly applied in the presence of a hierarchy of nodes. The present invention addresses these needs.

[0011]

SUMMARY OF THE INVENTION In accordance with the above needs, the present invention is directed to an improved method and apparatus for dynamically changing multimedia content at the object level based on a viewer's content specification. Examples of objects include any identifiable objects in a multimedia stream, such as portions of a video frame or audio samples. Examples of such a multimedia stream include an audio stream, a video stream, or a combination of one or more of these streams.

Various embodiments describe control specifications that are part of a multimedia stream, or can be provided as a separate stream by a third party. For example, in an Internet environment, PICS-based control designations are detailed. The PICS control designation may be part of the multimedia stream itself or may be separately deployed and transmitted for dynamic changes in content. PICS-based content specification is also provided so that viewers can specify multi-dimensional content selections.

The present invention has the feature that the multimedia stream can be dynamically changed and masked within the proxy hierarchy on the Internet. For example, multimedia
Objects in the stream are flexibly in client stations such as set-top boxes or computers, intermediate computer nodes such as proxy nodes or gateways, content servers, or cooperative combinations of one or more of these nodes. Can be changed.

The present invention has the further feature of enabling an organization to specify intranet-wide policies. This is, for example, by allowing intermediate nodes to add or merge content specifications with outgoing requests. The invention has the further feature of applying multiple masks (control designations), even when provided by different sources.

An example of a method for modifying an object associated with the content of a multimedia stream, having the features of the present invention, includes the steps of receiving a content request including a content specification, and controlling the multimedia based on the content specification and the control specification. Dynamically changing one or more objects in one or more dimensions of the stream.

One embodiment of the present invention is a fuzz ball (f
uzz ball) has the feature of dynamically changing a portion of a video frame according to a control specification. The resulting fuzz ball may be used to display one or more specified objects, such as a portion of a video frame or an audio sample. Can be changed / masked as specified.

The present invention has the further feature of notifying the user of the percentage of video to be blocked as specified prior to transmission.

The present invention further has other features that overlap several fuzz ball specifications in response to a content specification dealing with a multidimensional or rating system. Furthermore,
The invention has the other feature of multicasting one multimedia stream to multiple viewers, with each client 209 rendering or masking the video using a customized specification.

[0019]

FIG. 1 shows an example of an Internet environment having features of the present invention. As shown, one or more content servers 135 are connected to a network 165, while a client station 125, such as a set-top box or client 125, according to the present invention, connects directly or through a proxy hierarchy 110-11.
5 is connected to the network 165. The content server node 135 communicates through the network
Any computer node that can service multimedia requests. A third party mask provider 155 may provide a pre-configured frame-level mask (described in detail below in connection with FIG. 3), which dynamically refines content according to the present invention. Can be used to remove unwanted information, for example, changing at the frame level.

Client 125 requests multimedia content including multidimensional content designations 248, such as medium violence and low nudity (as described in detail below in connection with FIG. 11). , To the server 135 via the network 165.

According to the present invention, the use of piggybacked metadata allows information to be efficiently communicated between client 125, server 135, and mask provider 155. In HTTP, the information exchange can be included as metadata in the object header by using existing web protocols. The PICS protocol specifies how to transmit meta information about electronic content. PICS is a Web Consortium Protocol Recommendation (see http://www.w3.org/PICS). PICS initially started with, for example, "How much nudity is associated with this content?"
Used to submit value-based rating labels,
The format and meaning of meta-information is quite common. PICS
In, meta-information about electronic content is grouped according to an "evaluation service" or creator and intended use of the information, and within any such group any number of categories or dimensions of information may be transmitted. Each category has a range of allowed values, and for a particular portion of content, a particular category may have one or more values. Further, a meta information group (known as a "PICS label") may include expiration information. Furthermore, PICS label,
Mechanisms exist that allow it to be applied to more than one piece of electronic content. Each PICS label for a particular portion of electronic content can be independently added or removed from the content.

For example, an image file having a PICS label may be sent from a server, and the "Evaluation Service" field of the label may indicate that it contains a value-based evaluation label according to a "Safe Surf" evaluation system. . According to the present invention, as the image file passes through the corporate proxy, it can be processed or updated to reflect the current content according to the "reputation service" with the new category value of the PICS label. Thus, the client computer only sees the updated category value of the PICS label. The HTTP protocol has been augmented with request and response headers that support PICS. An example of a PICS label is (PICS-1.
1 "http: //the.rating.service" label for "http: // the.
content "exp" 1997.07.01T08: 15-0500 "r (n4s3v2l
0)), where 'n', 's', 'v' and 'l' are transmission names of various meta-information types and the value applicable to this content is 4 (corresponding to n ), 3 (corresponding to s), 2 (v
) And 0 (corresponding to 1). ID "http: // the.
Only software that recognizes "rating.service" will know how to interpret these categories and values.
Technical bodies that define other common application protocols, such as NNTP, are also currently considering adding PICS support. A list of the types of PICS labels desired as part of these protocols may be included with the request. PICS also specifies a query format for receiving PICS information from the central label office server. In the preferred embodiment, the content specification 248 also has the PICS Rule 1.0 (Pics
Rule-1.0).

Referring to FIG. 1, in accordance with the present invention, an organization may apply an intranet-wide policy through the ability of proxies 110, 115 to add content designations to outgoing requests or merge different designations. Can be specified.
According to another embodiment of the present invention, the server 135 adapts to determine whether the specification applies (described below in connection with FIG. 7), and if so, passes the mask request to the mask provider 155. (Detailed below in connection with FIG. 12). The mask provider selects a control specification 237 (also referred to as a mask) that can be used to modify the content and sends it to the server 135 to satisfy the viewer specification (see FIG. 13 below). In detail). Those skilled in the art will appreciate that the control designation may also be stored on the content server 203. In various embodiments, control specifications 237 may be applied by server 135, proxy 110, or client 125, and a plurality of control specifications 237 provided from different sources may be applied. Objects, such as portions of video frames or audio samples, may be dynamically changed according to the selected control designation 237 before being displayed at the client 209 (FIGS. 9-10 and 12).
In detail below in connection with).

Examples of clients 125 include, but are not limited to, PCs, workstations, set-top boxes, and the like. In a PC or workstation environment, the client software is preferably a video character player (TM) sold by IBM or a Real Video Player (TM) sold by Progressive Networks. , Including video playback software. Examples of network 165 include the Internet, the World Wide Web, intranets, and local area networks.
And a network (LAN). Examples of video content servers 135 include products such as Video Charger ™ sold by IBM and Real Video ™ sold by Progressive Network. Proxy servers 110 through 11
An example of 5 includes the Internet Connection Server (ICS) ™ sold by IBM. Content server 135 or proxy server 110
To 115 run on any computer node and include S / 390 SY sold by IBM.
SPLEX ™, SP2 ™, or RS60
Products such as the 00.TM. workstation are included.

FIG. 2 shows a more detailed example of a network 201 and a system having features of the present invention. As shown, the system is a client 209, such as a conventional workstation, PC or set-top box.
including. The client 209 can issue a request for multimedia content including the content designation 248 for one or more dimensions of content via the network 201. The client 209 preferably includes a CPU 240, a memory 245 such as a RAM, and a storage device 242 such as a DASD. Memory 245
Stores client logic 249 according to the present invention (described in detail below in connection with FIG. 11). The client logic is
Preferably, the remote or local permanent optical storage (C
D-ROM), or a magnetic storage device (such as a disk), or computer-executable code loaded from a DASD into the memory 245;
40. Client logic 249 includes video playback operation logic 247 (described in detail below in connection with FIG. 12).

The mask provider 205 preferably
CPU 227, memory 235 such as RAM, and DAS
D and the like. Memory 235 includes mask provider logic 239 (described in greater detail below in connection with FIG. 13), which is preferably implemented as computer-executable code loaded from DASD 230 into memory 235 and executed by CPU 227. You. The mask provider has various control specifications 237, in this case,
Fuzz, dynamically changing or masking a portion of one or more frames of a video according to a content specification 248;
It has a ball track 337 (described in more detail below in connection with FIGS. 3-5). Fuzz ball track designation,
Include a separate stream or a video stream 390
Content server 20
3, interpreted at an intermediate node, such as client 209 or proxy 280, and
Change or mask objects in 0 (mask
An example of the provider logic is shown in FIG. 13). In any case, a fuzz ball 397 is generated based on the control designation and changes the content before it is displayed at the client station.

[0027] Content server node 203 is any conventional computer node that can service requests over network 201. The content server 203 is preferably a CPU 260, a RAM
And a storage device 265 such as a disk or DASD. According to the present invention, preferably
Server logic 268 (detailed below in connection with FIG. 6), implemented as computer-executable code, may be remote (via a network) or local permanent optical storage (CD-ROM) or magnetic storage (such as a disk). ) Or from DASD 265, loaded into memory 263 and executed by CPU 260. Server logic 2
68 is preferably a video check handler 267
(Described below in connection with FIG. 7), and a video show handler 269 (described below in connection with FIG. 8). Video check handler 267 determines whether there is a version of the requested video that can be modified or masked to satisfy the content specification. If so, the version closest to the content designation 248 is selected. Video show handler 269 distributes the video stream based on the content designation. The video stream is preferably transmitted separately from the control designation 237 for downstream rendering before being displayed at the client station.

In short, the client 209 first
Deliver content requests that include multi-dimensional content designations 248, such as medium violence and low nudity. As a result, if a threshold determination is made whether the designation is satisfied, a video check request (described in more detail below in connection with FIG. 5) is communicated to the content server. In a preferred embodiment, the server response is unambiguous such as "yes" (ie, such a version exists) or conditional, e.g., if the version can be distributed but 20% is blocked out Either. Viewer /
If the client 209 determines that the response is acceptable, a video presentation request (described below in connection with FIG. 8) is communicated to the content server 203 requesting distribution of the modified video.

If the content designation 248 can be satisfied, the mask display request (FIG. 11)
05 to obtain the corresponding control designation 237 or fuzz ball track (FIGS. 3-5). Those skilled in the art will appreciate that the mask provider logic 239 and control designation 237 may also be present at the content server 203 or at certain intermediate nodes. mask·
The provider 205 selects one or more control designations 237 that can satisfy the multidimensional designation of the viewer based on their labels (described in detail below in connection with FIG. 10). When the control specification 237 is applied by the server 203, it is changed by the control specification 237 before the content is transmitted to the client 209.

Preferably, the control designation 237 is transmitted as an additional track (or stream) along with the original video stream (described in more detail below in connection with FIG. 12). For example, for multicast video, different viewers may have many different designations. Therefore, it is more efficient for the content server 203 to include various control specifications together with the multicast transmission, and to allow each client 209 to flexibly select an appropriate control specification 237 and dynamically apply it. In another example, an organization (such as a school or corporation) or individual user, or a subgroup within an organization, may have different content designations 248
Having. In this case as well, the content server 203 provides the control designation 237 by transmission, and at each intermediate (proxy) server and client station,
By applying the appropriate control designations 237, changing the content as the video passes through them,
It is more efficient.

FIG. 3 shows an example of a video stream (frame n to frame n + 4) changed by a set of fuzz balls generated according to the control designation 237. In this example, the control designations 237 are separate “fuzz ball” tracks 337 and the fuzz ball 397
Is shown as a rectangular area that can change an object such as a portion of a video frame or an audio sample.
The result of the content rating achieved by applying the fuzz ball track 337 is shown in an O-label 396 in the track's header using the PICS protocol. The fuzz ball may be generated by various conventional methods, such as by manipulating or overlaying audio or video data. Fuzz ball track 337 specifies a sequence of fuzz ball 397 that has a fuzz ball size 382 and position, and a temporal relationship 386 with video stream 390.
For example, video stream 390 may have a known dimension (1
5, 30) (frame n to frame n + 4). The placement of fuzz ball 397 within the video stream is represented in fuzz ball track 337 as a file. The temporal relationship of the fuzz ball 397 to the stream may be frame number 386, or other means such as a time stamp, or any means of identifying the particular object to be modified, ie, size 382 (height and width dimensions). ,
And position 384 (x and y coordinates) within the video frame. In this example, fuzz ball track 337 locates frame n at position (6,20)
Is designated as having a fuzz ball 397 of size (2, 4). In frame n + 3, the position (10, 4) and size (4, 8) are changed. A plurality of fuzz ball tracks 337, as described below.
Are associated with the same stream 390 and combined to achieve comprehensive but fine-grained modification of objects in the video stream. As detailed below, the content designation 248 communicated from the client 209 advantageously handles multi-dimensions such as violence, blasphemy, and nudity. A different fuzz ball 397 is provided at each level accordingly in each dimension. The control designation 237 is stored, for example, by a third party mask provider in a file separate from the video stream and transmitted to the content server 203 upon request. Examples of mask provider logic are described below in connection with FIG. As described below in connection with FIG.
7 are transmitted from the content server 203, preferably with the content, and are dynamically interpreted at the client station based on the control designation to change the corresponding object in the video stream 390 prior to its display.

For example, the client 209 specifies a content specification 248 having a violence of 3 or less and a nudity of 2 or less in a video request, and the requested video assigns a violence evaluation value 5 and a nudity evaluation value 4 to the requested video. Consider the example you have. Assume that the higher the rating, the more violent the violence and the nudity of the video. Preferably, when a plurality of control designations 237 are combined, the fuzz ball
The smallest category value in each dimension between tracks is the category value resulting from that dimension. Thus, the number of control specifications 237 that can be generated is reduced in order for the mask provider to support more combinations of content specifications 248 over multiple dimensions. In this example, to satisfy the content designation 248, the O with the resulting violence value of 3
-Another O with label 396 and the resulting naturity value 2
Control designation 23 with either label 396 or one fuzz ball track to which both can be distributed
7 is required. For example, violence value 3 and nudity value 4
Suppose that there is a control specification 237 having a violence degree value of 5 and a nakedness degree value of 2. According to the present invention, by combining these control designations 237 in the video, a violence degree value of 3 and a nakedness degree value of 2 are achieved.
Because the minimum nudity value in the above example is 2,
This is because the minimum violence value is 3. This feature combining control specification 237 is a control specification 2 that needs to be maintained.
Minimize the number of 37.

Referring again to FIG. 3, there are shown examples of three different types of PICS labels according to the present invention. Video label 392 (also referred to as "V-label") may be used by the content server node to identify the content rating of the entire video.

As described in detail below, frame labels 394 (also referred to as “F-labels”) are used to identify content ratings and / or to modify objects in video stream 390. Can be used by the content server. When a given video frame is masked or changed, the F-label category values may be updated to reflect the frame's current content rating.

In one embodiment, the control designation 237 is transmitted as a separate stream (or file), which in this embodiment is referred to as a "fuzz ball track" 337. Preferably, each "fuzz ball track" 337 includes an overlay label 396 (also referred to as an "O-label") in its header. O-label 396 may be used to specify the resulting content rating after fuzz ball 397 has been applied to objects in stream 390. Based on the content designation 248, an appropriate fuzz ball track 337 is selected and the content is changed.

In the preferred embodiment, the PICS profile language known as PICS Rules 1.0 is used to generate a content request with a content specification 248. PICS is a World Wide Web Consortium (W3C) draft recommendation. For example, http: /
"PICS Profile Language Working Group-PICS RU found at /www1.raleigh.ibm.com/PICS/PicsRULZ.html
LZ 1.0 ". One skilled in the art will recognize that many other conventional means of storing and communicating the content specification 248 are:
It will be understood that they can be used within the spirit and scope of the present invention.

FIGS. 4 and 5 show examples of a user interface for storing the content designation 248 according to the present invention. In an Internet environment, the user interface of Content Advisor 310 is incorporated as part of a browser running on client 209 by means known to those skilled in the art. Alternatively or additionally, the proxy administrator of proxy 280 may specify content specification 248. As shown in FIG. 3, one or more dimensions of content 312 may be selected through a list of categories 314 for that change. Optionally, a rating control 316 is provided to specify a maximum rate of content that can be changed. As described below,
Content specification 248 may be stored in the PICS Rules 1.0 language. As shown in FIG. 5, the host / media type 318 indicates that the content request is
Indicate the type of host and media that should accompany 48. In this example, all hosts for streaming media (audio and video) are specified. The content designation 248 is
It may be stored on permanent storage such as DASD 242. As described in detail below, the request to the content server 203 includes an HTTP request header or PICS rules. For example, Internet Explorer 3.0 (trademark), a browser sold by Microsoft Corporation
Please refer to. This provides a dialog box in the Options / Security section called Content Advisor / Rating, which allows the user to enter and store advanced content specifications. Future versions of Internet Explorer will have the ability to send the content specification 248 to the content server as part of an HTTP request. Those skilled in the art will appreciate that there are many other different ways to generate the content designation 248 within the spirit and scope of the present invention.

In the following, an example of content specification in the PICS rule 1.0 format for communication with the content server 203 will be described. The URL of the rule language extension that supports server content changes is the reqExtension statement "h
ttp: //www.w3.org/Customization.html ",
The URL of the evaluation service is "http: //labelbureau.coolne
ss.org/ratings/V1.html "(short name or short name" Cool "
Has). The content is specified by the Re
Provided in the jectUnless, RejectIf, and AcceptIf clauses. For the sake of explanation, the two-dimensional content specification 248, i.e., i) regional-based aptitude specification, i.e., CentralAmericaAppropriateness, and ii)
Consider adult content, i.e., content designation 248 based on nudity, but more dimensions are possible. The Alteration Transmit extension clause allows the content server to merge the control designation 237 with the video frame (merge is "true") or allows the merge to be performed at the client or at a particular intermediate node. (The merge is "false"). The parameter clause alterationPercentReturn indicates that the percentage of video to be changed should be returned to the client 209.

[Table 1]

Here, for example, the server 230 that receives the content request and the content designation 248 receives four different versions of the video 41 (see Table 2), namely, video 41-0-0, video 41-1-4, Video 4
1-1-1 and a video 41-1-2, and based on the video 41-1-4, another input for identifying a fuzz ball track, namely a mask 41-1-4-.
3 (representing control designation 380) may be present. In Table 1,
A column in the server content file identifies a given version of the video, a column in the type indicates the type of file, B represents an alternate video copy, and M represents a fuzz ball track 337. Central America Ap
propriateness), Nudity content specification,
And values corresponding to the percentage of content to be changed or masked (change rate) are provided in the third, fourth and fifth columns, respectively. To show how the V-label (392) and O-label 396 are specified under PICS, the corresponding labels for video 41-0-0 and mask 41-1-4-3 are as follows: Shown in Here, "lr" represents label evaluation. (Video 41-0-0) V-label: lr (CentralAme
ricaAppropriateness0 Nudity 0 Pct 30) and (Mask 41-1-4-3) O-label: ir (Centra
lAmericaAppropriateness 1 Nudity 0 Pct 5).

[Table 2]

In this case, the content server 203
The client 209 specifies the content 248 of the client 209, that is, ((Cool.CentralAmericaAppropriateness>
0) and (Cool. Nudity <3)) and (PICS. AlterationP
ercentMax <20))
It is determined that it has the version of 1-2). Therefore, the video 41-1-2 should be transmitted to the client 209. The HTTP response header contains the PICS change rate (9%).

The following example uses GET check & url = video4 to find out if the content specification 248 can be satisfied.
1 Same as Case A, except that the check request represented by the HTTP / 1.1 statement (FIG. 6, step 410) is first sent from the client 209 to the video server. Again, the PICS known as PICS Rule 1.0
A profile language is preferably used.

[Table 3]

In case A, a version that satisfies the content specification 248 is found, and an HTTP “200” response code is returned to the client. The HTTP response header also contains the PICS change rate.

In the following example, a mask request (FIG. 11, step 935) is sent along with the content specification 248 for the control specification 237 used to modify the content so that the content specification 248 is satisfied. -Sent to the provider 205. Again, PICS rules 1.
The PICS profile language known as 0 is used. An example of a video URL is "http://video.owner.com/
videos / video41 ". In the following example, this corresponds to" http% 3A% 2 "corresponding to the URL parameter value in the mask acquisition request.
F% 2Fvideo.owner.com% 2Fvideos% 2Fvideo41 ". The mask check request to determine whether the content specification 248 can be provided by the mask provider 205 is a" Get mask (Get mask) ) By replacing "Get check"
It is configured similarly.

[Table 4]

Here, the content designation ((Cool.Central
AmericaAppropriateness> 0) and (Cool.Nudity <
3)) Control specification 237ma that can change contents so as to satisfy and (PICS.AlterationPercentMax <8))
sk41-1-4-3 exists, and the control designation 237 can be transmitted to the content server 203. HTTP response header is PI
Includes CS change rate.

Case B: In case B, client 2
09 sends the video request along with the content
It communicates to the server 203 and the video stream 390 and fuzz ball track 337 are returned to the client. And in the AlterationTransmit statement it is indicated that the fuzz ball should not be applied on the server side, ie it should be executed on the client node.

[Table 5]

As an example, here the content server has two different video versions, namely video 4
2-0-0 and video 42-1-4.
Control designation 237, that is, the mask 42-1-
Assume that 4-1 exists. This can be summarized as follows:

[Table 6]

In this case, the content specification ((Cool.Centr
alAmericaAppropriateness> 0) and (Cool.Nudity <
There is no unmodified version that satisfies 3)). However, if the mask 42-1-4-1 is the video 42-1-
4 and the resulting content satisfies the content designation. Video 42-1-4 should be sent with V-mask 42-1-4-1 because the modified transmission node indicates (merge "false"). The protocol request statement is {alterationPer
centReturn true} clause, so the response header is PICS
The change rate, namely 7, is shown.

There are various alternative embodiments, and extensions of object labeling or content specification 248 may be used within the spirit and scope of the present invention. For example, other protocols such as RTSP and MPEG may also be used to provide the content specification 248.

[0049] The control designation 237 indicates how the stream content should be changed. It provides instructions for the presentation of a frame or group of frames of a multimedia stream and specifies blocking, skipping, and overlaying. As mentioned above,
One type of control designation 237 is another fuzz ball track 337. Another type is the edit decision list, which indicates the frame to change or replace.

According to the present invention, control designations 237 can be flexibly provided in each frame, group of frames, or video header. The control designation at the level of the frame group or at the video header is time-based, so that a particular frame can be identified by timing information. In a preferred embodiment, the masking / modification of the multimedia stream content is provided in the distribution of the real-time video stream,
The same concept is applicable to any other type of multimedia stream that may include multiple streams of video and audio.

Those skilled in the art will appreciate that while control specifications have been described as separate streams or tracks, there are various alternative ways of providing object-level control specifications. For example, each frame of the video may include a rich PICS label that specifies the required control information associated with that frame, such as the F-label 394. frame PICS label "F-Label" ----- --------- 00001 (PICS-1.1 "http://www.coolness.org/ratings/V1.html" lr (CentralAmericaAppropriateness 1 Nudity 2 Nudity1x 0 Nudity1y 0 Nudity1h 480 Nudity1w 640)) 00002 (PICS-1.1 "http://www.coolness.org/ratings/V1.html" lr (CentralAmericaAppropriateness 1 Nudity3 Nudity3x 206 Nudity3y 113 Nudity3w199 Nudity3d Nudity1h 294 Nudity1w 307))

Here, Nudity1x and Nudity1y specify the position (x coordinate and y coordinate, (0, 0) in the frame 00001) of the fuzz ball for achieving the nudeness value 1, and Nudity1h and Nudity1w are: The size (height and width, 480 and 640 for frame 00001, respectively) is specified. Similarly, Nudity3x and Nudity3y specify the position (x-coordinate and y-coordinate) of the fuzz ball to achieve the nudeness value 3, and Nudity3h and Nudity3w specify the size (height and width).

Frame 00001 has a nudity value of 2 and a Central American fitness value of 1 and is capable of achieving a nudity value of 1
Two fuzz balls are designated. Frame 2 has a nudity value of 3 and a Central American fitness value of 1 and two fuzz balls are designated. One of them provides a nakedness value of 3, and the other provides a nakedness value of 1.

If the request is not for a multicast stream, the server can modify the content based on the control specification 237 and the client content specification 248 and send the modified stream 390 to the requesting client. To return the PICS change rate, a value can be calculated using the formula (number of frames with fuzz ball / total number of frames) × 100. In the case of multicasting, the client 209 controls the control specification 23 so as to satisfy the content specification 248.
7, the content can be changed. Viewers with different content designations 248 will not
7, the contents are changed differently.

Those skilled in the art will appreciate that the fuzz ball can have any shape. Instead of a rectangle,
Fuzz balls can take the shape of a polygon or a circle.

FIG. 6 shows an example of the content server logic 268. As shown, at step 405, the content server 203 waits for an input. At step 410, different actions are taken depending on the input received. If the input received is a video check request, the video check handler 267 is called at step 415. The video check handler determines whether there is a version of the requested video that can be modified or masked to satisfy the content specification.
A detailed example of a video check handler is described with reference to FIG. At step 420, if the input received is a video show request, then at step 425 the video show handler 269 is invoked. The video show handler distributes the video stream based on the content designation. If the requested video has multiple versions, the video show handler checks whether any version satisfies the content specification 248. A detailed example of the video show handler 269 will be described with reference to FIG. For other types of input that are not in the focus of the present invention (eg, conventional HTTP or FTP requests for web documents), various suitable handlers 430 may be invoked.

FIG. 7 shows the video check handler 26.
7 is shown. The video check handler determines whether there is a version of the requested video that can be modified or masked to satisfy the content specification 248. At step 505, if the requested video has multiple versions, it is determined whether any version satisfies the content designation 248 (step 5).
25). If so, a "yes" response is returned to client 20
9 (step 520). Otherwise, the version closest to the content designation 248 is selected (step 530). In the preferred embodiment, the content
For each video stored in the server mask information for a valid control specification 237, the server
7 (i.e., the O-label 396) and a prediction of the amount of information to be blocked by each control designation 237. In step 540, the server 203 determines whether the version can be changed or masked based on the control designation 237 information so as to satisfy the content designation 248. If possible, at step 560, a prediction of the amount of video that needs to be removed or blocked may be obtained. This prediction (upper limit) can be obtained by adding the amount of information blocked by each fuzz ball that needs to be applied. Step 57
At 0, the "qualified" response (included in the HTTP response header and indicating the PICS change rate) is returned to the requester and indicates the amount to be blocked. In step 505,
If there is only one version of the video available in the server, it is checked in step 510 whether this version satisfies the content specification 248. If so, a "yes" response is returned to client 20
9 (step 520). If not, processing continues at step 540 described above.

FIG. 8 shows an example of the video show handler 269. The video show handler distributes the video stream based on the content designation 248. Step 6
If the requested video has more than one version at 05, it is checked at step 615 whether the version satisfies the content specification. If so, at step 640, the version closest to the content designation is selected, and at step 645, the selected version is sent to the client 209. Step 615
If none of the versions satisfies the content designation, in step 625, the closest version is selected. At step 630, a frame masking / modification routine is called. A detailed example of the frame masking / modification routine is described with reference to FIG.
If there is only one version of the video in the server at step 605, it is checked at step 610 whether this version satisfies the user specification. If so, the video is transmitted to the client in step 602.

FIG. 9 shows an example of the frame masking / change routine (step 630 in FIG. 8). flame·
Masking / modification routines are used for video
Modify, mask or merge / add ball tracks. For example, when an object in a video frame is masked or changed, the category value of the V-label 392 may be updated to reflect a change in the result of the video's current content rating. For example, if a video having a V-label 392 violence value 5 is overwritten by a fuzz ball track 337 having an O-label 396 violence value 2, the resulting video will have a V-label violence value 2 . Alternatively, as described above, the F-label 394 may have the content designation 248 as part of the multimedia stream without requiring a separate fuzz ball track 337. For the remainder of this example, assume that the multimedia stream includes an F-label 394 with each frame of the multimedia stream. At step 705, the next frame of the video is stored
5 is fetched. At step 710, the frame
If label 394 (F-label) satisfies content designation 248, the frame is transmitted to client 209 (step 715). Otherwise, step 72
At 0, it is checked whether there is an alternative frame that satisfies the content specification. If yes, step 7
At 25, an alternate frame is fetched. Otherwise, at step 730, based on the O-label 396,
It is checked whether there is one or more fuzz ball tracks 337 that can be applied to satisfy the content specification. This specifies the lowest category value of each dimension among all fuzz ball tracks.
48 can be achieved. If the lowest category value in each dimension is less than the content specification 248, then there is a set of fuzz ball tracks that satisfy the content specification. In that case, step 735
Calls the fuzz ball routine. An example of a fuzz ball routine is described with reference to FIG. In step 730, the fuzz ball track 33
If 7 is not available, a blank frame may be sent (step 740).

FIG. 10 shows the fuzz ball routine 73.
5 is shown. At step 810, a set of fuzz balls 397 that satisfy the multidimensional content specification with a minimal amount of blocking are selected based on their labels (ie, O-labels). For example, if the video is
Consider the case where the content designation 248 has a violence value of 4 and has no violence value, with a violence value of 7 and a nudity value of 3 specified in the label 392.
Assume now that four fuzz ball tracks with the following O-label 396 are available. They include truck 1 with violence value 4 and nudity value 3, truck 2 with violence value 3 and nudity value 3, truck 3 with violence value 7 and nudity value 2, violence value 7 and Track 4 with nudity value 1. In this case, fuzz ball track 1 is selected because it satisfies the request with a minimum amount of blocking. Step 82
At 0, if the fuzz ball track 337 is applied by the server according to the instructions in the content designation 248, the fuzz ball 397 is superimposed on the corresponding video frame before transmission of the frame (step 83).
0). Otherwise, the fuzz ball track is transmitted along with the original frame as an additional track 337 (step 840). For example, in multicast video, different viewers may have different content designations. Thus, the content server 203 transmits the various fuzz ball tracks 337 (as separate tracks) along with the video transmission, causing each client 209 to select and apply the appropriate fuzz ball track 337. Is desirable. In another example, an organization (such as a school or legal entity) and individual users, or subgroups within the organization, each have their own content designation 24
8 The fuzz ball 397 can be overlapped on the same dimension by a plurality of fuzz ball tracks 337. Also in this case, the content server 203
Separately transmits the control designation 237 to the intermediate node, such as a gateway or proxy server 280, and to the client station 209 with the appropriate fuzz ball.
It is more efficient to apply tracks 337 and change the content as the video passes through them.

FIG. 11 shows an example of the client logic 249. As shown, at step 910, client 209 specifies in its video request a request such as medium violence and low nudity. In the preferred embodiment, the specification format uses the PICS profile language known as PICS Rule 1.0. Typically, for each category of evaluation scheme, client 209 can specify the desired maximum level. At step 915, a video check request is sent to the content server to see if the content designation 248 can be satisfied. In a preferred embodiment, the response is either a "yes" to indicate that such a version exists, or a modified response, the latter of which, for example, may be distributed with a version,
FIG. 8 shows that 20% is blocked as described in connection with FIG. If, at step 920, the response is deemed acceptable, at step 940, a video show request requesting distribution of the video is sent to the content server. In step 945, a play video operation 247 is invoked to receive and play the video. A detailed example of the playback operation will be described with reference to FIG. If, at step 920, the response to the content specification 248 is not acceptable, the client 209 queries a third party mask provider at step 925 to indicate a type of mask required for the content specification 248. Is sent to the mask provider. In a preferred embodiment,
The designation format is a PICS known as PICS Rule 1.0
Use a profile language. Typically, for each category in the evaluation system, the client 209 can specify the desired level for the control specification 237 in the mask check request. For example, if the video has a violence value of 5 and a nudity value of 7, and the content specification 248 specifies a violence value of 3 and a nudity value of 2, there is a control specification 237 that satisfies the content specification 248. To find out, a mask check request for violence degree value 3 and nudity value 2 is sent to the mask provider. In step 930, if the response from the mask provider indicates that the specification can be satisfied, step 93
At 5, a mask display request is sent to the mask provider to obtain control designation 237 or fuzz ball track 337.

When the client 209 receives a video request,
Content designation 248 including violence degree value 3 and nudity degree value 2
And the requested video is by its V-label:
Consider an example that is shown to have a violence rating of 5 and a nude rating of 4. The unmodified video fails both the violence and nudity ratings, as indicated by its V-label, so that in order to satisfy the content specification, the client 209 uses the appropriate control specification 23.
7 needs to be applied. This means that the client 209 may have one or more fuzz ball tracks with appropriate O-labels 396 such that the minimum category value between fuzz ball tracks for nudity and violence satisfies the content specification. It means that the track 337 needs to be acquired. For example, assume that the following two fuzz ball tracks are available. That is,
The first fuzz ball track has a violence value 3 and a nudity value 4 indicated by its O-label, and the second fuzz ball track has a violence value 5 and a nudity value 2 Have. These fuzz ball tracks can be supplied by either a content provider or a third party mask provider. In fact, the two fuzz ball tracks can come from different providers. It is assumed here that the fuzz ball track is available from one of the third party mask providers 205. Does the client 209 have one or more fuzz ball tracks 337 for the mask provider to satisfy violence 3 and nudity 2 for the requested video by sending a mask check request? You can find out. The mask provider returns an acknowledgment in this case because the request can be satisfied by the two fuzz ball tracks described above. Client 209 then sends a request for video to the content provider, and simultaneously sends requests for two fuzz ball tracks to the mask provider. Alternatively, the content provider may interact with the mask provider. By overwriting the video with both these fuzz ball tracks 337, a violence value of 3 and a nakedness value of 2 are achieved. This overwriting, as shown in FIG. 3, includes on each frame a fuzz ball for the violence mask from the first fuzz ball track corresponding to that frame and a fuzz ball from the second fuzz ball track. It can be performed on a frame basis by overwriting both fuzz balls for the nude mask. An example of client playback is described in connection with FIG.

FIG. 12 shows an example of a block diagram of the client playback operation 247. In short, the video stream 1002, the associated audio stream 1001, and the fuzz
A ball track 1003 (which may come from a different source, such as mask provider 205) arrives at the client station. For illustrative purposes, only one audio, video and fuzz ball track is shown, but there may be more than one of each track. In particular, there may be multiple fuzz ball tracks associated with a single multimedia content. Multimedia
The stream is received and decoded by the client, as shown in steps 1015 and 1035 for video, and by steps 1010 and 1030 for audio, and by steps 1020 and 1040 for fuzz ball, respectively. And decrypted or processed. A fuzz ball is created in step 1040 and overwritten on the appropriate video frame in step 1050. The audio rendering in step 1045 is combined with the fuzz ball overwrite based on timing or synchronization information embedded in the stream to provide final video rendering in step 1060. More complex masking techniques for overwriting two different video streams are known, for example, the stream being overwritten is actually another video. For this, for example, Chen
U.S. Patent No. 5,257,113, "Mixing and Pl
ayback of JPEG Compressed Packet Videos "(1993
(Issued October 26, 2012).

For example, consider a video clip containing a sequence of frames numbered 1 through n. To mask the video sequence, a fuzz ball 397 is generated, which overwrites the video sequence at specific locations within each frame.
For simplicity, it is assumed here that the fuzz ball is simply a black rectangle. Recall from FIG. 3 that the fuzz ball track is represented as a list of frame numbers (or time stamps), position coordinates (positions within the frame), and size of the fuzz ball.

Referring again to FIG. 12, the incoming video is received at step 1015 from a network or file. At step 1035, the video is decoded and each video frame is passed to the fuzz ball overwrite module (step 1050) (described in detail above in connection with FIG. 10) along with the frame number along with a bit map (matrix of integer values). ) Passed as. Meanwhile, the incoming fuzz ball track is received from the network or file at step 1020 and passed to the fuzz ball generation module (step 1040), where each fuzz ball is generated as a rectangular matrix of integer values. (The integer value indicates the color of the fuzz ball, where the integer value corresponds to black). This fuzz ball
The matrix is also passed to the fuzz ball overwrite module (step 1050) along with the fuzz ball frame number and position coordinates (see FIG. 3). At step 1050, the fuzz ball frame number Z is compared to the current video frame number V. If Z> V,
At step 1060, the video frames are transmitted unchanged to the video rendering module (step 1060) and displayed. At step 1050,
The next video frame (transmitted by the video decoding module in step 1035) is retrieved by the fuzz ball overwrite module. If Z <V, then in step 1050 the fuzz ball overwrite module retrieves the next fuzz ball (transmitted in step 1040) from the fuzz ball generation module. If Z = V, the video frame integer matrix is overwritten by the fuzz ball integer matrix at the position in the video frame specified by the fuzz ball position coordinates. The modified video frame is passed to a video rendering module (step 1060) and rendered by one of many conventional methods known to those skilled in the art. The process continues as described above for the remainder of the video, and the next video frame (transmitted by the video decoding module at step 1035) is retrieved by the fuzz ball overwrite module (step 1050), The next fuzz ball (transmitted in step 1040) is retrieved from the fuzz ball generation module.

FIG. 13 shows a mask having the characteristics of the present invention.
Here is an example of provider logic. As shown, step 1
At 110, the mask provider waits for input. In step 1115, different actions are performed depending on the input received. If the received input is a mask check request, in step 1125, the content designation 2
It is determined whether there is a fuzz ball track 337 that can satisfy 48. If present, step 1
At 150, a "positive" response is sent. Otherwise, "
A "negative" response is sent (step 1160). At step 1120, if the received input is a mask display request, the requested fuzz ball track is distributed (step 1140). For other types of input that are not (e.g., insert / delete / update control specification 237), the appropriate various handlers are invoked (step 1130).

Those skilled in the art will appreciate that a heterogeneous environment is a conventional content server, proxy or client station where some nodes do not understand the masking protocol of the present invention and do not participate in masking / filtering operations. It will be appreciated that the method of masking or modifying a multimedia stream also works. For example, if the content server is a conventional server, the client 209 can interact directly with the mask provider to obtain a fuzz ball track and perform a masking operation at the client. In other words, in FIG. 11, steps 915 and 920 are bypassed, and the process moves from step 910 to step 925. For conventional client stations that cannot perform the masking operation, it is also possible for an intermediate proxy or content server to perform the masking operation. Indeed, in an organization such as a school or corporation, the proxy node 280 performs the masking operation based on the organization's (intranet-wide) policy, transparent to client stations that are not capable of performing or requesting the masking operation. Or you can request. Within the proxy hierarchy (see FIG. 1), one or more proxies select and apply their own masking criteria, while some proxies are conventional proxies that do not participate in the masking operation.
On the other hand, each client station may also request or perform additional masking operations based on local requests independent of the proxy.

Those skilled in the art will appreciate that the control designation 237 stream may include video / audio other than visual or audio fuzz balls. These are P
It may include visual captions or speech conversions in the particular language (eg, Chinese, Spanish, etc.) required within the ICS profile.

Therefore, according to the present invention, the content designation 246
Dynamically masking or changing an identifiable object in a video stream, such as a portion of a video frame, a portion of a video stream, or an audio sample, or replacing an object. Includes features that provide fine-grained means. Dynamic content changes may be performed flexibly and sequentially at the server 203, the proxy 280, the client 209, or a cooperative combination of these nodes. Moreover, not all of them are required to participate.

Those skilled in the art will recognize that the preferred embodiment is PICS
It has been described with respect to the Internet using a new adaptive form of the present invention, but it will be understood that the invention is not limited to such an environment. For example, it is known to transmit control signals during a vertical blanking interrupt (VBI) of a standard television broadcast. The majority of television today uses closed captioning (closed c
aptioning controller, which can be optimized through conventional software algorithms that decode any signal transmitted to the VBI of the television set. This controller is currently typically used for satellite programs, on-screen (on-s
creen) programmed to prevent programming and closed captioning. The controller also provides a commonly known "V-chip" for automatically blocking programs based on their ratings.
(Recently enacted Telecommunication Bi
ll) as part of 652). The V-chip converter is
Available in the fall of 1997, it is used to enable televisions without the necessary technology. According to the present invention, a controller or V-chip converter can be programmed to provide the content designation 248 by conventional means. Assuming that the functionality provided by the control designation, such as F-label 394, is transmitted during the VBI of the transmission and that there is sufficient processing power, the control unit may determine that the control designation 237 and the content designation 24
9, object-level content changes can be performed. Alternatively, the additional processing power is
09 set-top box version or V
-Provided by chip converter as needed. If the video stream 390 and the control designation 237 are transmitted as more than one stream (FIG. 3), the controller is described in connection with the V-label 392 and O-label 396 in the preferred embodiment. A function similar to that of can be adapted to change content.

The present invention relates to a conventional frame-oriented video
It is not limited to the stream transmission system. For example, MPEG (Moving Picture Coding Experts Grou
p) is a working group of the ISO / IEC responsible for the development of international standards for compression, decompression, processing and coded representation of moving pictures and sounds. MPEG-2 decoders have been included in numerous set-top boxes to help the satellite and cable television industries transition from analog to digital technology. A new standard, MPEG-4, is currently under development. The MPEG-4 standard has, among other things, the following standardization methods: 1) how to represent audio, visual, or audiovisual content (referred to as "audio / visual objects" or AVOs), 2) primitive objects ("primitive AVOs"). ), For example as an audiovisual scene, to a composite audiovisual object, 3) a method of multiplexing and synchronizing the data associated with the AVO and transmitting it over a network, so as to be adapted to the appropriate quality of service, and ) How to interact with the audiovisual scene generated on the client side (eg http: //www.q-tea
m.de/mpeg4/whatmpeg.htm). Therefore,
The "object" of the present invention is, for example, an MPEG-4 AV
It should be understood to include identifiable and modifiable objects in the multimedia bit stream, such as O. Similarly, the MPEG-4 PC project aims at the realization of a PC including the creation of an authoring system for MPEG-4 (eg, http: // ww
wq-team.de/mpeg4/contcrea.htm).

In summary, the following items are disclosed regarding the configuration of the present invention.

(1) In a multimedia network including a multimedia stream, a method for changing an object associated with the content of the multimedia stream, comprising: receiving a content request including a content designation; Based on the content designation and control designation, the multimedia
Dynamically changing one or more objects in one or more dimensions of the stream. (2) the step of dynamically changing includes generating a first stream including the content, generating a second stream including the control specification for the content, and including the control specification. Receiving a request for content, and dynamically changing the content of the first stream according to the control designation and the content designation.
The method according to the above (1). (3) The method according to (2), further comprising, in response to the receiving, determining a percentage of the content that is changed according to the content specification and notifying a content requester. (4) The method of (2), further comprising communicating a blocking indicator to the requester without playing a video if the percentage exceeds a threshold. (5) The method according to (2), wherein the control specification includes a multidimensional control specification. (6) the content includes a video, the control specification includes a fuzz ball specification, and the dynamically changing step generates the fuzz ball specification corresponding to one or more content specifications; Receiving a request for the content that includes the content designation, and dynamically overwriting at least a portion of the video frame based on the fuzz ball designation and the content designation in response to the receiving. The method according to (1) above. (7) The content designation and the control designation are PICS
The method of claim 6, including a protocol, wherein the method includes generating separate fuzz ball designations corresponding to different content designations, and selecting a fuzz ball designation based on the PICS designations. . (8) The method according to (6), wherein the content designation is time-based. (9) The method according to (6), wherein the generating step includes generating the fuzz ball designation as one or more fuzz balls having a size, a position, and a temporal relationship with a frame of the video. Method. (10) The method of (1), wherein the step of dynamically changing comprises combining a plurality of content designations dealing with either a multi-dimensional or rating system. (11) The method of (10), wherein the content comprises video, and comprising the step of overwriting a plurality of fuzz ball filters in response to the combining step. (12) The method according to (1), wherein the content request includes a multidimensional content specification, and the step of dynamically changing includes dynamically changing the content according to a plurality of control specifications and the multidimensional content specification. ) Described method. (13) The method according to (1), further including a step of transmitting one of the content designation and the control designation according to one of a PICS protocol, an RSTP protocol, and an MPEG protocol. (14) the content includes a video, and the PICS
A protocol comprising a plurality of PICS labels, communicating a V-label indicating a content rating of the video and an overlay label indicating an effect of changing the content rating; and responsive to the dynamic change, the V-label Updating the category value of (13). (15) The method according to (12), wherein the content includes a video, and comprising dynamically changing a frame of the video according to the plurality of control specifications and the multidimensional content specification. (16) The method according to (15), wherein the content includes a video, and the step of dynamically changing a frame of the video includes masking a frame of the video according to the plurality of control specifications and the multidimensional content specification. )
The described method. (17) The step of dynamically changing the content
(15) comprising dynamically changing frames of the video at one or more of a server, a client, a set-top box, and a proxy node.
The described method. (18) the network comprises the World Wide Web including a hierarchy of servers, and the intermediate proxy server comprises:
The method of (1) above, comprising the step of changing the content designation of the outgoing content request. (19) The method according to (18), wherein the hierarchy includes a heterogeneous proxy hierarchy, and wherein the changing is not performed by a client or all servers in the hierarchy. (20) multicasting one multimedia stream to a plurality of requesters, rendering the video by the requesters, wherein at least two of the requesters render the video according to different content specifications; The method according to the above (1), comprising: (21) generating one or more separate fuzz ball designations for said different content designations;
Selecting one or more fuzz ball designations according to an ICS protocol. (22) The method according to (1), wherein the step of dynamically changing includes a step of dynamically bypassing, masking, blocking, and replacing an object. (23) The method of (22), wherein the content comprises a video, and comprising replacing one or more frames or segments of the video with one or more alternative frames or segments. (24) the step of dynamically changing includes generating a second stream including the control specification for the content, wherein the control specification includes a video header;
Said (1) generated at either a group of frames of said video, or at an individual frame level.
The described method. (25) The method according to (22), wherein the content includes video, and comprising skipping a video frame or video segment based on the control designation and the content designation. (26) The (22) said (22), wherein said content comprises video and comprises masking or blocking a particular portion of a video frame or stream at either a server, proxy, set-top box, or client. the method of. (27) The method according to (1), including transmitting the control designation and the content as one stream. (28) The method of (27), wherein the content comprises video, and wherein the transmitting comprises transmitting the control designation during a vertical blanking interrupt of the multimedia stream. (29) The method of (27), wherein the communicating comprises associating a frame label with one or more frames of the video. (30) The method of (1), comprising: multicasting a multimedia stream to a plurality of requesters; and rendering each of the requesters with at least two different content designations. (31) The method according to (6), comprising overwriting a plurality of fuzz ball designations and satisfying the content designation. (32) The method of (1), wherein the object comprises an identifiable object in the multimedia stream comprising at least a portion of a frame of video and a sample of audio. (33) A computer program product comprising a computer usable medium having computer readable program code means for modifying an object associated with a content of a multimedia stream, wherein the computer readable program code means comprises a computer. Program code means for instructing the multimedia stream to receive a content request including a content specification, and moving one or more objects in one or more dimensions of the multimedia stream based on the content specification and the control specification. Computer program product comprising program code means for instructing the user to make a global change. (34) The program code means for instructing a dynamic change, the program code means for instructing the computer to generate a first stream including the content, and the program code means for the content. Program code means for instructing to generate a second stream including a control designation, program code means for instructing to receive a request for the content including the control designation, the control designation and the content designation Computer code means for instructing to dynamically change the content of the first stream according to the above.
Program products. (35) The program code means for instructing the computer to determine a ratio of the content changed in accordance with the content designation in response to the reception and to notify a content requester of the content. 34) The computer program product according to the above. (36) The program described in (34), further comprising program code means for instructing the computer to transmit a blocking indicator to the requester without playing a video if the ratio exceeds a threshold. Computer program products. (37) The computer program product according to (34), wherein said control specification includes a multidimensional control specification. (38) The content includes a video, the control specification includes a fuzz ball specification, and the program code means for dynamically changing includes:
Program code means for instructing to generate the fuzz ball designation corresponding to one or more content designations; program code means for instructing to receive a request for the content including the content designation; The program code means for instructing to dynamically overwrite at least a portion of the video frame based on the fuzz ball designation and the content designation in response to the fuzz ball designation and the content designation. Program products. (39) The content designation and the control designation are PIC
Computer readable program code means including an S protocol, wherein the computer readable program code means instructs the computer to generate separate fuzz ball designations corresponding to different content designations; , Program code means for instructing to select a fuzz ball designation. (40) The computer program product according to (38), wherein the content designation is time-based. (41) The program code means for instructing to generate, instructs to generate the fuzz ball designation as one or more fuzz balls having a size, a position and a time relationship with the frame of the video. The computer program product according to (39), further comprising: (42) The program according to (33), wherein the program code means for instructing to change dynamically includes a program code means for instructing to combine a plurality of content specifications dealing with either a multidimensional or an evaluation system. ) Computer program product as described. (43) The computer program product of (42), wherein the content comprises video and includes program code means responsive to the combining to instruct to overwrite a plurality of fuzz ball filters. (44) The program, wherein the content request includes a multidimensional content specification and instructs to change dynamically.
The computer program product of (33), wherein the code means includes program code means for instructing to dynamically change the content in accordance with the plurality of control specifications and the multidimensional content specification. (33) The computer program product according to (33), further comprising program code means for instructing transmission of one of the content designation and the control designation according to any one of RSTP protocol and MPEG protocol. The content comprises a video, and the PICS
The program code means wherein the protocol includes a plurality of PICS labels and indicates to be conveyed, such that the program code means conveys a V-label indicating the content rating of the video and an overlay label indicating the effect of changing the content rating. The computer program product of (45), further comprising program code means for instructing, and program code means for instructing to update said V label category value in response to said dynamic change. (47) The content according to (45), wherein the content includes a video, and program code means for instructing to dynamically change a frame of the video according to the plurality of control designations and the multidimensional content designation. Computer program product. (48) A program for instructing the content to include a video and dynamically changing a frame of the video.
The computer program product of (47), wherein the code means includes program code means for instructing masking of the video frame according to the plurality of control designations and the multidimensional content designation. (49) The program code means for instructing a dynamic change includes a content server, a client,
The computer program product of claim 47, including program code means at one or more of a set-top box and a proxy node to dynamically change the frame of the video. (50) The network comprises the World Wide Web including a hierarchy of servers, wherein the intermediate proxy server comprises:
The program code means for instructing to change the content designation of the outgoing content request.
3) The computer program product according to the above. (51) The program code means for instructing the hierarchy to include a different type of proxy hierarchy and changing the program code means for instructing that the change is not executed by a client or all servers in the hierarchy. The computer program product according to the above (50). (52) program code means for instructing a multimedia stream to be multicast to a plurality of requesters; and program code means for instructing a video to be rendered by the requester, wherein at least two of the requester means One renders the video according to different content specifications,
(33) The computer program product according to the above (33), comprising program code means. (53) A program code means for instructing to generate one or more separate fuzz ball designations for the different content designations, and selecting one or more fuzz ball designations according to the PICS protocol. (52) including program code means for instructing
Computer program product as described. (54) The program code means for instructing to change dynamically comprises a program for instructing to dynamically bypass, mask, block and replace an object.
The computer according to the above (33), comprising a code means.
Program products. (55) The content of (54), wherein the content comprises a video and includes program code means for instructing one or more frames or segments of the video to be replaced by one or more alternative frames or segments. Computer program product. (56) The program code means for instructing to change dynamically includes program code means for instructing to generate a second stream including the control specification for the content, wherein the control specification is a video stream. The computer program product of claim 33, wherein the computer program product is generated at either the header, a group of frames of the video, or at an individual frame level. (57) The computer program according to (54), wherein the content includes video, and includes program code means for instructing to skip a video frame or a video segment based on the control specification and the content specification. Product. (58) The program code means for instructing the content to include video and masking or blocking a particular portion of a video frame or video stream at either a server, proxy, set-top box, or client. Including (54)
Computer program product as described. (59) The computer program product according to (33), further comprising program code means for instructing transmission of the control designation and the content as one stream. (60) the program code means for instructing the content to include video and transmitting the program code for transmitting the control designation during a vertical blanking interrupt of the multimedia stream; The computer program product of (59), including means. (61) The computer program of (59), wherein the program code means for instructing to convey includes program code means for instructing to associate a frame label with one or more frames of the video. Product. (62) program code means for instructing to multicast one multimedia stream to a plurality of requesters; and program code for instructing each requester to render the video using at least two different content specifications. Means,
The computer program product according to (33). (63) The computer program product according to (38), further comprising program code means for overwriting a plurality of fuzz ball designations and instructing the content designation to be satisfied. (64) The computer program product of (33), wherein the object comprises an identifiable object in the multimedia stream comprising at least a portion of a frame of video and a sample of audio.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an Internet environment having features of the present invention.

FIG. 2 illustrates a more detailed example of a network environment having features of the present invention.

FIG. 3 shows the “fuzz ball” and “fuzz ball” of FIG.
It is a figure showing an example of "control designation".

FIG. 4 is a diagram showing an example of a user interface for storing a content designation according to the present invention.

FIG. 5 is a diagram showing an example of a user interface for storing a content designation according to the present invention.

FIG. 6 illustrates an example of the content server logic of FIG.

FIG. 7 is a diagram illustrating an example of a video check handler of a server.

8 illustrates an example of the video show handler of FIG.

FIG. 9 is a diagram showing an example of a frame masking / change routine of FIG. 8;

FIG. 10 is a diagram illustrating an example of the fuzz ball routine of FIG. 9;

FIG. 11 is a diagram illustrating an example of the client logic of FIG. 2;

FIG. 12 is a diagram illustrating an example of a client playback operation.

FIG. 13 illustrates an example of the mask provider logic of FIG.

[Description of Signs] 110, 111, 112, 113, 114, 115 Proxy layer 125, 209 Client 135, 203 Content server 155 Mask provider 165, 201 Network 205 Mask provider 227, 240, 260 CPU 235, 245, 263 Memory 239 Mask provider logic 227, 240, 260 CPU 230, 242, 265 Storage 247 Video playback operation logic 248 Multidimensional content specification 249 Client logic 267 Video check handler 268 Content server logic 269 Video show handler 280 Proxy Node 310 Content Advisor 316 Evaluation Control 318 Host / Media Type 337, 1003 Fuzz Ball Track 82 Fuzz ball size 386 Temporal relationship 390, 1002 Video stream 392 Video label (V-label) 394 Frame label (F-label) 396 Overlay label (O-label) 397, 735 Fuzz ball 430 Handler 1001 related audio stream

 ────────────────────────────────────────────────── ─── Continued on the front page (72) Inventor Peter Kenney Malkin United States 10502; Aarsley, NY; Bramble Brook Road 64 (72) Inventor Robert Jeffrey Scross United States 10510, Briarcliff Manor, NY Holbrook Line 155 (72) Inventor Edward Charles Sinible 10011 New York, New York, United States 10011 West 14th Street 232 (72) Inventor Marc Hubbert Wilby-Lumere United States 10598, Yorktown Heights, New York Pubist Church Road 1480 (72) Inventor Philip See-Lang You Amelie United States 10514, New York Chapakka, Stornoway 18

Claims (64)

[Claims] 1. A method for modifying an object associated with a content of a multimedia stream in a multimedia network including a multimedia stream, the method comprising: receiving a content request including a content designation; Dynamically changing one or more objects in one or more dimensions of the multimedia stream based on a designation and control designation.
Method. 2. The dynamically changing step includes: generating a first stream including the content; generating a second stream including the control specification for the content; Receiving the request for the content including: the first request according to the control designation and the content designation
Dynamically changing said content of said stream. 3. The method of claim 2, further comprising determining, in response to said receiving, a percentage of said content that is changed according to said content designation, and notifying a content requester. 4. The method of claim 2 including the step of communicating a blocking indicator to said requester without playing video if said percentage exceeds a threshold. 5. The method of claim 2, wherein said control specification comprises a multi-dimensional control specification. 6. The fuzz-ball designation corresponding to one or more content designations, wherein the content comprises a video, the control designation comprises a fuzz-ball designation, and wherein the dynamically changing comprises generating the fuzz-ball designation corresponding to one or more content designations. Receiving a request for the content that includes the content designation; dynamically overwriting at least a portion of the video frame based on the fuzz ball designation and the content designation in response to the receiving. Including
The method of claim 1. 7. The content designation and the control designation are P
7. The method of claim 6, including an ICS protocol, wherein the method includes generating separate fuzz ball designations corresponding to different content designations, and selecting a fuzz ball designation based on the PICS designation. . 8. The content designation is time-based.
The method of claim 6. 9. The method of claim 6, wherein the generating step comprises generating the fuzz ball designation as one or more fuzz balls having a size, location, and time relationship with the frames of the video. the method of. 10. The method of claim 1, wherein the step of dynamically changing comprises combining a plurality of content designations dealing with either a multi-dimensional or rating system. 11. The method of claim 10, wherein said content comprises video, and comprising the step of overwriting a plurality of fuzz ball filters in response to said combining step. 12. The content request includes a multi-dimensional content specification, and the step of dynamically changing includes a step of dynamically changing the content according to a plurality of control specifications and the multi-dimensional content specification. Item 7. The method according to Item 1. 13. The method of claim 1, comprising transmitting one of said content designation or said control designation according to one of a PICS protocol, an RSTP protocol, or an MPEG protocol. 14. The method according to claim 1, wherein the content includes a video,
The ICS protocol including a plurality of PICS labels, transmitting a V-label indicating a content rating of the video and an overlay label indicating an effect of the change of the content rating; Updating the category value of the label. 15. The method according to claim 15, wherein the content includes a video, and dynamically changing a frame of the video according to the plurality of control designations and the multi-dimensional content designation.
The method according to claim 12. 16. The method according to claim 16, wherein the content comprises a video, and the step of dynamically changing a frame of the video comprises masking a frame of the video according to the plurality of control specifications and the multidimensional content specification. Item 16. The method according to Item 15. 17. The dynamically changing step includes dynamically changing a frame of the video at one or more of a content server, a client, a set-top box, and a proxy node. Item 16. The method according to Item 15. 18. The method of claim 1, wherein the network comprises the World Wide Web including a hierarchy of servers, and wherein the intermediate proxy server comprises the step of modifying a content specification of an outgoing content request. 19. The method according to claim 19, wherein said hierarchy comprises a heterogeneous proxy hierarchy.
19. The method of claim 18, wherein said modifying is not performed by a client or all servers in said hierarchy. 20. Multicasting a multimedia stream to a plurality of requesters, and rendering video by the requesters, wherein at least two of the requesters render the video according to different content specifications. The method of claim 1, comprising: 21. One of the different content designations
21. The method of claim 20, comprising: generating one or more separate fuzz ball designations; and selecting one or more fuzz ball designations according to a PICS protocol. 22. The method of claim 1, wherein said dynamically altering comprises dynamically bypassing, masking, blocking, and replacing objects. 23. The method of claim 22, wherein said content comprises a video, and comprising the step of replacing one or more frames or segments of said video with one or more alternative frames or segments. 24. The dynamically changing step includes generating a second stream including the control specification for the content, wherein the control specification comprises a video header, a group of frames of the video, or an individual. The method of claim 1, wherein the method is generated at any of the following frame levels: 25. The method of claim 22, wherein said content comprises video, and comprising the step of skipping a video frame or video segment based on said control designation and said content designation. 26. The method according to claim 22, wherein the content includes video and includes the step of masking or blocking a particular portion of a video frame or stream at either a server, proxy, set-top box, or client. The described method. 27. The method according to claim 1, further comprising transmitting the control designation and the content as one stream.
The described method. 28. The method of claim 27, wherein said content comprises video and said communicating comprises communicating said control designation during a vertical blanking interrupt of said multimedia stream. 29. The method of claim 27, wherein said communicating comprises associating a frame label with one or more frames of said video. 30. The method of claim 1, comprising: multicasting a multimedia stream to a plurality of requesters; and rendering each of the requesters with at least two different content designations. 31. Overwriting a plurality of fuzz ball designations,
The method of claim 6, comprising satisfying the content specification. 32. The method of claim 1, wherein the objects include identifiable objects in the multimedia stream, including at least a portion of a video frame and audio samples. 33. A computer program product comprising a computer usable medium having computer readable program code means for modifying an object associated with the content of a multimedia stream, wherein said computer readable program code means. Program code means for instructing a computer to receive a content request including a content specification; and one or more objects in one or more dimensions of the multimedia stream based on the content specification and the control specification. Program code means for instructing to change dynamically. 34. The program code means for instructing a dynamic change, wherein the program code means instructs the computer to generate a first stream including the content, and the content Program code means for instructing to generate a second stream including the control designation for the program, program code means for instructing to receive a request for the content including the control designation, According to the content specification, the first
Program code means for instructing to dynamically change the content of the current stream.
Computer program product as described. 35. A program code means for instructing the computer to determine a ratio of the content changed in accordance with the content designation in response to the reception and to notify a content requester of the content.
A computer program product according to claim 34. 36. Program code means for instructing the computer to transmit a blocking indicator to the requester without playing a video if the percentage exceeds a threshold. Computer program product as described. 37. The control specification includes a multi-dimensional control specification.
A computer program product according to claim 34. 38. The content comprises a video, the control designation comprises a fuzz ball designation, and the dynamically changing program code means corresponds to the computer for one or more content designations. Program code means for instructing to generate the fuzz ball designation; program code means for instructing to receive a request for the content including the content designation; 34. The computer program product of claim 33, further comprising: program code means for instructing dynamically overwriting at least a portion of the video frame based on a ball designation and the content designation. 39. The content specification and the control specification include a PICS protocol, and wherein the computer readable program code means generates separate fuzz ball specifications for the computer corresponding to different content specifications. 39. The computer program product of claim 38, further comprising: program code means for directing the fuzz ball designation based on the PICS designation. 40. The computer program product according to claim 38, wherein said content designation is time-based. 41. The program code means for instructing to generate a fuzz ball designation includes a size,
1 having a position and a time relationship with the frame of the video
40. The computer program product of claim 39, comprising program code means for directing generation as one or more fuzz balls. 42. The program code means for instructing to change dynamically includes program code means for instructing to combine a plurality of content specifications dealing with either a multi-dimensional or rating system. Item 34. The computer program product according to Item 33. 43. The content comprises video, and in response to the combining, includes program code means for instructing to overwrite a plurality of fuzz ball filters.
43. The computer program product according to claim 42. 44. The program code means, wherein the content request includes a multi-dimensional content specification, and the program code means for instructing the content to be dynamically changed includes dynamically changing the content according to a plurality of control specifications and the multi-dimensional content specification. 34. The computer program product of claim 33, comprising program code means for directing a change. 45. Program code means for instructing to transmit one of the content designation and the control designation according to one of a PICS protocol, an RSTP protocol, and an MPEG protocol.
34. The computer program product according to claim 33. 46. The content comprising a video, wherein the P
The ICS protocol includes a plurality of PICS labels, and the program code means for instructing to convey a V-label indicating a video content rating and an overlay label indicating an effect of changing the content rating. 46. The computer program product of claim 45, further comprising: program code means for instructing to update the category value of the V-label in response to the dynamic change. 47. The method according to claim 45, wherein said content comprises a video and program code means for instructing to dynamically change frames of said video according to said plurality of control designations and said multi-dimensional content designation. Computer program products. 48. A program code means for instructing the content to include a video and dynamically changing frames of the video, wherein the program code means converts the frames of the video according to the plurality of control specifications and the multi-dimensional content specification. Including program code means for instructing to mask;
48. The computer program product according to claim 47. 49. The program code means for instructing to change dynamically comprises dynamically changing frames of the video at one or more of a content server, a client, a set-top box, and a proxy node. Including program code means for instructing to change
48. The computer program product according to claim 47. 50. The network comprising the World Wide Web including a hierarchy of servers and program code means for instructing an intermediate proxy server to change the content specification of an outgoing content request. Item 34. The computer program product according to Item 33. 51. The hierarchy comprising a heterogeneous proxy hierarchy,
The program code means for instructing to make a change, wherein the program code means for instructing that the change is not performed by a client or any server in the hierarchy
The computer program product of claim 50, comprising code means. 52. Program code means for instructing a multimedia stream to be multicast to a plurality of requesters; and program code means for instructing a video to be rendered by the requester, the program code means comprising: 34. The computer program product of claim 33, wherein at least two comprise program code means for rendering the video according to different content specifications. 53. The method according to claim 53, wherein:
Claims comprising: program code means for instructing to generate one or more separate fuzz ball designations; and program code means for instructing to select one or more fuzz ball designations according to the PICS protocol. Clause 52. The computer program product of clause 52. 54. The method of claim 33, wherein said program code means for instructing to change dynamically comprises program code means for instructing to dynamically bypass, mask, block and replace objects. Computer program product. 55. The method according to claim 54, wherein the content comprises a video and includes program code means for instructing one or more frames or segments of the video to be replaced by one or more alternative frames or segments.
Computer program product as described. 56. The program code means for instructing a dynamic change includes program code means for instructing to generate a second stream including the control specification for the content, wherein the control specification is video·
34. The computer program product of claim 33, wherein the computer program product is generated at either a header, a group of frames of the video, or an individual frame level. 57. The computer-readable medium of claim 54, wherein said content comprises video and program code means for instructing to skip a video frame or video segment based on said control designation and said content designation. Program products. 58. Program code wherein said content comprises video and instructions are provided to mask or block a particular portion of a video frame or stream at either a server, proxy, set-top box or client. 55. The computer program product of claim 54, comprising means. 59. A computer according to claim 33, further comprising program code means for instructing to transmit said control designation and said content as one stream.
Program products. 60. A program, wherein said program code means for indicating that said content includes video and transmitting said control designation during a vertical blanking interrupt of said multimedia stream. 60. The computer program product of claim 59, comprising code means. 61. The computer program product of claim 59, wherein the program code means for directing to communicate comprises program code means for directing a frame label to be associated with one or more frames of the video.
Program products. 62. Program code means for instructing a multimedia stream to be multicast to a plurality of requesters, and a program for instructing each requester to render the video using at least two different content designations. 34. The computer program product of claim 33, comprising: code means. 63. Overwriting a plurality of fuzz ball designations,
39. The computer program product of claim 38, comprising program code means for instructing the content specification to be satisfied. 64. The computer program product of claim 33, wherein the objects include identifiable objects in the multimedia stream, including at least a portion of a frame of video and a sample of audio.