US20040028257A1 - Method for watermarking a video display based on viewing mode - Google Patents

Method for watermarking a video display based on viewing mode Download PDF

Info

Publication number
US20040028257A1
US20040028257A1 US10636851 US63685103A US2004028257A1 US 20040028257 A1 US20040028257 A1 US 20040028257A1 US 10636851 US10636851 US 10636851 US 63685103 A US63685103 A US 63685103A US 2004028257 A1 US2004028257 A1 US 2004028257A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
data
format
viewing mode
screen
watermark
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10636851
Inventor
Andrew Proehl
Original Assignee
Proehl Andrew M.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84Generation or processing of descriptive data, e.g. content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television, VOD [Video On Demand]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318Processing of video elementary streams, e.g. splicing of content streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry
    • H04N5/445Receiver circuitry for displaying additional information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • H04N5/783Adaptations for reproducing at a rate different from the recording rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction

Abstract

A format to be used with the MPEG-4 standard alters the way video content is displayed on a screen based on whether the content is played in a normal playback mode or a fast playback mode by “watermarking” different or additional visual content onto the original video data stream. Metadata is included in the format to instruct a server to change the video display during fast playback by, for example, adding advertising information, closed captioning, scene summaries, help data, or station identification to the original image, either in a separate section of the screen or superimposed on the original image.

Description

    TECHNICAL FIELD
  • The present invention relates to a video display method and format, and more particularly to a video display method and format that changes a video display during a fast playback mode. [0001]
  • BACKGROUND ART
  • Current technology has provided television and video viewers with many viewing options, including the ability to fast-forward past commercials or program portions that are not of interest to the viewer. Fast-forwarding tends to cause some problems for both advertisers and viewers, however. With respect to advertisers, the visual content of commercials progresses too quickly in a fast-forward or rewind mode for viewers to see the name/logo of the product being advertised. With respect to viewers, fast-forwarding or rewinding (collectively referred to as “fast playback”) makes it more difficult for viewers to ascertain station/broadcaster information or scene information. Although the video data itself could be altered so that information appears during a fast playback mode, alteration of the video data is impractical and may adversely affect image quality when the video data is played during normal playback mode. [0002]
  • There is a need for a system that can provide viewer information when the visual content is being viewed in a fast playback mode without requiring extensive modification of the video's encoding format. [0003]
  • SUMMARY OF THE INVENTION
  • Accordingly, the present invention takes advantage of the additional flexibility provided by an MPEG-4 standard by including metadata that varies the visual content on a screen based on the playback mode. More particularly, the format according to the invention has a main video potion that includes primary content data to be displayed during a normal viewing mode and a metadata portion that includes watermark data corresponding to the primary content data and instructions for displaying the watermark data during a modified mode, such as a fast playback (e.g., fast forward or fast reverse) mode. [0004]
  • The watermark data itself can be any information that a program producer or advertiser wishes to be displayed when the program is played in the modified playback mode. The watermark can be displayed in any manner, such as by superimposing the watermark over the primary program content, removing the primary program and displaying the watermark by itself, or displaying the watermark in one portion of the screen and the primary program content in the remaining portion of the screen.[0005]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a diagram illustrating a relationship between object-oriented structures according to the MPEG-4 standard; [0006]
  • FIG. 2 shows a relationship between content data and hint tracks for a movie according to the MPEG-4 standard; and [0007]
  • FIGS. 3A through 3F are representative examples of ways in which the inventive format can be used to alter a screen display.[0008]
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • The Motion Pictures Expert Group-4 (“MPEG-4”) standard provides a way to store “metadata”, or information that describes other data or includes instructions on how to deliver media objects. This metadata capability provides video display flexibility that was previously unavailable with other standards. For clarity, the characteristics of the MPEG-4 standard that are relevant to implementation of the invention will be described below with reference to FIGS. 1 and 2. [0009]
  • Generally, MPEG-4 standardizes and organizes primitive media objects (e.g. still images, video objects, audio objects, etc.) so that the media objects can be represented and modified independently of its surroundings and background, allowing greater flexibility and functionality in both scene construction and playback. As shown in FIG. 1, the MPEG-4 standard includes object-oriented structures called “atoms” [0010] 100 and unique tags 102 identifying each atom. Many of the tags 102 describe a hierarchy of “metadata”, which provide information about the actual media objects/content data, such as index points, durations, and pointers. The media objects themselves can be located in the MPEG-4 file itself, in one or more media data atoms 100, or outside the MPEG-4 file for reference via URL's.
  • The MPEG-4 file format is a streamable, as opposed to streaming, format; the file format does not define an on-the-wire protocol and is never actually streamed over a transmission line. Instead, the metadata includes data that provides content delivery instructions by telling a server application how to deliver the content over a particular delivery protocol. The file can include multiple hint tracks for one presentation to provide instructions on how to deliver the content over different delivery protocols. [0011]
  • FIG. 2 shows one example of a relationship between the content data and RTP protocol hint tracks for streaming a simple movie that only has video data (i.e., no audio data). As can be seen in the Figure, an RTP hint track [0012] 200 and a video track 202 direct a server to specific locations of the media data 204 such that the media data 204 is delivered to an output in discrete sections. Of course, the use of metadata in the MPEG-4 standard is not limited to the examples shown above; metadata can include any data that corresponds to other data in the video stream and/or instructions for presenting the data. The metadata, combined with the flexible data storage options provided by the MPEG-4 standard, allows the format to support streaming, editing, local playback, and content interchange.
  • The present invention takes advantage of the flexibility provided by the MPEG-4 standard by including metadata that alters the way content is displayed on a video screen according to whether the content is displayed during a normal playback mode or a modified playback mode, such as a fast-forward playback mode. Generally, the invention encodes or “watermarks” different or additional video content separately from the original video stream and decodes the different or additional video content at an output, such as a television or set-top box, when selected criteria, such as information corresponding to a specific program or commercial played in a specific playback mode, are met. [0013]
  • FIGS. 3A through 3F illustrate possible ways in which the metadata can be used to watermark the primary video content in a fast playback mode (in these examples, a fast forward mode). These examples are not meant to be an exhaustive list; the inventive format can accommodate any combination of data, logos, and programming as long as the format includes instructions for changing the display when the playback mode changes. For example, watermark data can be added to selected key frames in the video stream to act as bookmarks for those selected frames so they can be easily located during fast playback (FIG. 3A). A watermark can also be superimposed onto a commercial when the commercial is played in a fast STET mode (FIG. 3B). Similarly, a watermark can be superimposed onto a television program to indicate the program's sponsorship when the program is played in a fast-forward mode (FIG. 3C). Intellectual property information, such as copyright ownership (FIG. 3D), or broadcaster identification (FIG. 3F) can also be superimposed onto a program or simply displayed on the screen alone. Alternatively, the watermark can be displayed in a letterbox area of the display so that the program is not obscured (FIG. 3E). Other possible watermarks can include credit information, closed-captioning, or any other information that may be considered useful for display during a modified playback mode. [0014]
  • The watermark data itself can be simple text data that is transmitted along with the primary content data in the video stream. Preferably, the text data is large enough and is displayed on the screen long enough so that it can be easily seen by the viewer; both of these variables can be controlled by metadata that includes the watermark data itself and instructions on how and when the watermark data is to be displayed. To enhance the appearance of the watermark data when it is displayed, the metadata may also instruct a set top box to display graphic data (e.g. graphic logos stored in the set top box) as the watermark data. Although graphic data and instructions for displaying the data can be sent via the video stream, accessing graphic data that is already stored in the set top box uses bandwidth more efficiently in many cases by limiting the amount of data transmitted in the stream. [0015]
  • The present invention therefore takes advantage of the display flexibility offered by the MPEG-4 standard by including metadata that instructs a playback apparatus to alter the video display during a modified playback viewing mode, such as a fast playback mode. The invention therefore provides a way to provide usable viewer content even during a fast playback mode, during which the regular video content may progress too quickly to provide any meaningful information. [0016]
  • It should be understood that various alternatives to the embodiments of the invention described herein may be employed in practicing the invention. It is intended that the following claims define the scope of the invention and that the method and apparatus within the scope of these claims and their equivalents be covered thereby. [0017]

Claims (18)

    What is claimed is:
  1. 1. A encoding format for displaying varying visual content on a screen based on a viewing mode, comprising:
    a main video portion having primary content data to be displayed during a normal viewing mode; and
    a metadata portion having watermark data corresponding to the primary content data and instructions for displaying the watermark data during a modified playback viewing mode.
  2. 2. The format of claim 1, wherein the format is an MPEG-4 format.
  3. 3. The format of claim 2, wherein during the modified playback viewing mode, the primary content data is removed from the screen and the watermark data is displayed on the screen.
  4. 4. The format of claim 2, wherein during the modified playback viewing mode, the primary content data is displayed on a first portion of the screen and the watermark data is displayed on a second portion of the screen.
  5. 5. The format of claim 2, wherein during the modified playback viewing mode, the primary content data is displayed on the screen and the watermark data is superimposed on the primary content data.
  6. 6. The format of claim 2, wherein the watermark data is at least one of text data and graphic data.
  7. 7. The format of claim 2, wherein the secondary data includes instructions for displaying at least one of text data and graphic data stored in a remote location.
  8. 8. The format of claim 7, wherein the remote location is a set-top box.
  9. 9. The format of claim 1, wherein the modified playback viewing mode is a fast playback mode.
  10. 10. A method for displaying varying visual content from a video stream on a screen based on a viewing mode, comprising the steps of:
    displaying a main video portion that includes primary content data during a normal viewing mode;
    detecting a modified playback viewing mode; and
    displaying a watermark corresponding to the primary content data during a modified playback viewing mode, wherein the watermark and instructions for displaying the watermark are stored in metadata in the video stream.
  11. 11. The method of claim 10, wherein the video stream complies with an MPEG-4 standard.
  12. 12. The method of claim 11, wherein during the modified playback viewing mode, the primary content data is removed from the screen and the watermark data is displayed on the screen.
  13. 13. The method of claim 11, wherein during the modified playback viewing mode, the primary content data is displayed on a first portion of the screen and the watermark data is displayed on a second portion of the screen.
  14. 14. The method of claim 11, wherein during the modified playback viewing mode, the primary content data is displayed on the screen and the watermark data is superimposed on the primary content data.
  15. 15. The method of claim 11, wherein the watermark data is at least one of text data and graphic data.
  16. 16. The method of claim 11, wherein the secondary data includes instructions for displaying at least one of text data and graphic data stored in a remote location.
  17. 17. The method of claim 16, wherein the remote location is a set-top box.
  18. 18. The method of claim 10, wherein the modified playback viewing mode is a fast playback mode.
US10636851 2000-11-14 2003-08-08 Method for watermarking a video display based on viewing mode Abandoned US20040028257A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US09712317 US6614844B1 (en) 2000-11-14 2000-11-14 Method for watermarking a video display based on viewing mode
US10636851 US20040028257A1 (en) 2000-11-14 2003-08-08 Method for watermarking a video display based on viewing mode

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US10636851 US20040028257A1 (en) 2000-11-14 2003-08-08 Method for watermarking a video display based on viewing mode

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09712317 Continuation US6614844B1 (en) 2000-11-14 2000-11-14 Method for watermarking a video display based on viewing mode

Publications (1)

Publication Number Publication Date
US20040028257A1 true true US20040028257A1 (en) 2004-02-12

Family

ID=27766489

Family Applications (2)

Application Number Title Priority Date Filing Date
US09712317 Active 2022-02-05 US6614844B1 (en) 2000-11-14 2000-11-14 Method for watermarking a video display based on viewing mode
US10636851 Abandoned US20040028257A1 (en) 2000-11-14 2003-08-08 Method for watermarking a video display based on viewing mode

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09712317 Active 2022-02-05 US6614844B1 (en) 2000-11-14 2000-11-14 Method for watermarking a video display based on viewing mode

Country Status (1)

Country Link
US (2) US6614844B1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080033814A1 (en) * 2006-06-07 2008-02-07 Seac02 S.R.L. Virtual advertising system
US20080074424A1 (en) * 2006-08-11 2008-03-27 Andrea Carignano Digitally-augmented reality video system
US7526650B1 (en) * 2003-10-22 2009-04-28 Microsoft Corporation Personal identifiers for protecting video content
US20090175490A1 (en) * 2008-01-09 2009-07-09 William Pat Price Watermark display controller and method
US20090256972A1 (en) * 2008-04-11 2009-10-15 Arun Ramaswamy Methods and apparatus to generate and use content-aware watermarks
US20110066437A1 (en) * 2009-01-26 2011-03-17 Robert Luff Methods and apparatus to monitor media exposure using content-aware watermarks
US20130124994A1 (en) * 2010-07-20 2013-05-16 Thomson Licensing Method for content presentation during trick mode operations
US20140119709A1 (en) * 2006-08-31 2014-05-01 Opentv, Inc. Systems and methods to modify playout or playback
US9552617B2 (en) 2008-12-31 2017-01-24 Digimarc Corporation Mobile media, devices, and signaling

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003075524A1 (en) * 2002-03-04 2003-09-12 Fujitsu Limited Hierarchical encoded data distributor and distributing method
JP4076067B2 (en) * 2002-07-02 2008-04-16 株式会社日立製作所 Video recording and playback system
JP2006503517A (en) * 2002-10-15 2006-01-26 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィKoninklijke Philips Electronics N.V. System and method for transmitting a scalable coded video with Ip Network
US20040210538A1 (en) * 2003-04-16 2004-10-21 Bruce Forest Method of generating or increasing product sales through the dissemination of on-line content for free over a distributed computer network
JP3833653B2 (en) * 2003-06-13 2006-10-18 シャープ株式会社 Information reproducing apparatus, a control method of the information reproducing apparatus, a content recording medium, a control program, computer-readable recording medium a control program
US7623673B2 (en) * 2005-03-30 2009-11-24 Dolby Laboratories Licensing Corporation Versatile watermark transport system
US20070169157A1 (en) * 2006-01-19 2007-07-19 Abernethy Michael N Computer controlled display implementation for displaying ancillary content during interruption of the primary display content
US8150097B2 (en) * 2007-01-24 2012-04-03 Sony Corporation Concealed metadata transmission system
US20080247543A1 (en) * 2007-02-22 2008-10-09 Colin Kennedy Mick Method and apparatus for protecting digital rights of copyright holders of publicly distributed multimedia files
US20100034514A1 (en) * 2008-08-05 2010-02-11 Mathieu Paul Luc Massart Display device and method with content recording and/or streaming
US20140181667A1 (en) * 2011-07-25 2014-06-26 Thomson Licensing Metadata Assisted Trick Mode Intervention Method And System

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5181114A (en) * 1990-03-14 1993-01-19 Sony Corporation Including break slots in broadcast video signals
US5315386A (en) * 1992-03-04 1994-05-24 Mitsubishi Denki Kabushiki Kaisha Television receiver and decoder for closed-caption broadcast providing simple character display showing existence of a closed-caption signal irrespective of user selection of closed caption demodulation
US5719786A (en) * 1993-02-03 1998-02-17 Novell, Inc. Digital media data stream network management system
US6256070B1 (en) * 1998-08-03 2001-07-03 Ati International Srl Concurrent discrete time oscillators (DTO) for video and closed caption encoding
US20030037068A1 (en) * 2000-03-31 2003-02-20 United Video Properties, Inc. Interactive media system and method for presenting pause-time content
US6611607B1 (en) * 1993-11-18 2003-08-26 Digimarc Corporation Integrating digital watermarks in multimedia content

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5181114A (en) * 1990-03-14 1993-01-19 Sony Corporation Including break slots in broadcast video signals
US5315386A (en) * 1992-03-04 1994-05-24 Mitsubishi Denki Kabushiki Kaisha Television receiver and decoder for closed-caption broadcast providing simple character display showing existence of a closed-caption signal irrespective of user selection of closed caption demodulation
US5719786A (en) * 1993-02-03 1998-02-17 Novell, Inc. Digital media data stream network management system
US6611607B1 (en) * 1993-11-18 2003-08-26 Digimarc Corporation Integrating digital watermarks in multimedia content
US20040037449A1 (en) * 1993-11-18 2004-02-26 Davis Bruce L. Integrating digital watermarks in multimedia content
US6256070B1 (en) * 1998-08-03 2001-07-03 Ati International Srl Concurrent discrete time oscillators (DTO) for video and closed caption encoding
US20030037068A1 (en) * 2000-03-31 2003-02-20 United Video Properties, Inc. Interactive media system and method for presenting pause-time content

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7526650B1 (en) * 2003-10-22 2009-04-28 Microsoft Corporation Personal identifiers for protecting video content
US20080033814A1 (en) * 2006-06-07 2008-02-07 Seac02 S.R.L. Virtual advertising system
US20080074424A1 (en) * 2006-08-11 2008-03-27 Andrea Carignano Digitally-augmented reality video system
US20140119709A1 (en) * 2006-08-31 2014-05-01 Opentv, Inc. Systems and methods to modify playout or playback
US20140199053A1 (en) * 2006-08-31 2014-07-17 Opentv, Inc. Systems and methods to modify playout or playback
US20090175490A1 (en) * 2008-01-09 2009-07-09 William Pat Price Watermark display controller and method
US20090256972A1 (en) * 2008-04-11 2009-10-15 Arun Ramaswamy Methods and apparatus to generate and use content-aware watermarks
US9514503B2 (en) 2008-04-11 2016-12-06 The Nielsen Company (Us), Llc Methods and apparatus to generate and use content-aware watermarks
US9042598B2 (en) 2008-04-11 2015-05-26 The Nielsen Company (Us), Llc Methods and apparatus to generate and use content-aware watermarks
US8805689B2 (en) 2008-04-11 2014-08-12 The Nielsen Company (Us), Llc Methods and apparatus to generate and use content-aware watermarks
US9552617B2 (en) 2008-12-31 2017-01-24 Digimarc Corporation Mobile media, devices, and signaling
US20110066437A1 (en) * 2009-01-26 2011-03-17 Robert Luff Methods and apparatus to monitor media exposure using content-aware watermarks
US20130124994A1 (en) * 2010-07-20 2013-05-16 Thomson Licensing Method for content presentation during trick mode operations

Also Published As

Publication number Publication date Type
US6614844B1 (en) 2003-09-02 grant

Similar Documents

Publication Publication Date Title
US6411725B1 (en) Watermark enabled video objects
US7634785B2 (en) DVR-based targeted advertising
US7779437B2 (en) Method for enhancing digital video recorder television advertising viewership
US20150172563A1 (en) Incorporating advertising content into a digital video
US20030149983A1 (en) Tracking moving objects on video with interactive access points
US20020016961A1 (en) Customized user interface generation in a video on demand environment
US20030188154A1 (en) System and method for pre-encryption of transmitted content
US20090150941A1 (en) Apparatus and method for video-on-demand playlist
US20100169906A1 (en) User-Annotated Video Markup
US20080007651A1 (en) Sub-frame metadata distribution server
US20090254823A1 (en) Bookmark Interpretation Service
US7440674B2 (en) Alternative advertising in prerecorded media
US6314569B1 (en) System for video, audio, and graphic presentation in tandem with video/audio play
US5818441A (en) System and method for simulating two-way connectivity for one way data streams
US20030037330A1 (en) Methods and apparatus for the display of advertising material during personal versatile recorder trick play modes
US20090119723A1 (en) Systems and methods to play out advertisements
US20080155585A1 (en) Systems and methods for viewing substitute media while fast forwarding past an advertisement
US6898799B1 (en) Multimedia content navigation and playback
US6889383B1 (en) Delivery of navigation data for playback of audio and video content
US20060222319A1 (en) Pre-recorded dvd ad insertion
US20040107437A1 (en) Systems and methods for coordinating interactive and passive advertisement and merchandising opportunities
US20020007493A1 (en) Providing enhanced content with broadcast video
US20100325660A1 (en) Re-addressable alternate content
US7069579B2 (en) On-demand interactive magazine
US20050220439A1 (en) Interactive multimedia system and method